Flash Gordon: A Data Intensive Computer

Flash Gordon：数据密集型计算机

• 批准号: 0910847
• 负责人: Michael Norman
• 金额: $ 2000万
• 依托单位: University of California-San Diego
• 依托单位国家: 美国
• 项目类别: Cooperative Agreement
• 财政年份: 2009
• 资助国家: 美国
• 起止时间: 2009-09-01 至 2017-03-31
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=0910847&HistoricalAwards=false
• 关键词: Flash; Gordon; Data; Intensive; Computer

ABSTRACT UCSD 0910847 Norman, Michael L.This project supports the acquisition, deployment and operation of a new supercomputing system suitable for data-intensive applications. The system, to be known as Flash Gordon, will be deployed by the University of California at San Diego at the San Diego Supercomputer Center and integrated into the TeraGrid. The system, which has been designed by Appro International Incorporated, with partners Intel and ScaleMP, seeks to bridge the widening latency gap between main memory and rotating disk storage in modern computing systems. It uses flash memory to provide a level of dense, affordable, low-latency storage that can be configured as either extended swap space or a very fast file system. The system will consist of very large shared virtual-memory, cache-coherent "super-nodes" to support a versatile set of programming paradigms. Peak performance will exceed 200 teraflops/s in double precision.Flash Gordon's large addressable virtual memory, low-latency flash memory, and user-friendly programming environment will provide a step-up in capability for data-intensive applications that scale poorly on current large-scale architectures, providing a resource that will enable transformative research in many research domains. Even sequential codes will be able to address up to terabytes of fast virtual memory. Examples of scientific challenges, as described in the proposal, that this resource will allow researchers to tackle, include the following. De Novo Genome Assembly: Gene sequencers produce information about many small fragments of a genome. Some recent assembly algorithms use a graph-based approach, much more readily executed on a shared-memory system. Using Flash Gordon, researchers will be able to rapidly assemble complex genomes such as mammalian genomes.Astronomy: Modern astronomy databases can be large; for example, the Sloan Digital Sky Survey is approximately six terabytes in size. Typically, the analysis algorithms that researchers use to perform complex searches for astronomical phenomena can be implemented more easily on shared-memory systems. Flash Gordon will enable researchers to load a copy of the Sloan Digital Sky Survey into the flash memory associated with a super-node, greatly extending the types of analyses astronomers can make.Astrophysics: Cosmological simulations produce many terabytes of output describing the simulated universe. Detailed analysis of the results of these simulations, to find features such as collapsed halos, galaxy mergers, dwarf galaxies, and galaxy clusters, often requires density-based cluster analysis that does not parallelize well. With Flash Gordon, these analyses can be accelerated by exploiting the large SMP partitions and fast flash memory.Interaction Networks: Interaction networks, graphs representing the relationships between objects, are used in research in areas such as epidemiology, phylogenetics, systems biology, and population biology. These interaction networks can represent relationships between types of data stored in different databases; for example, the combination of social network databases with medical records and genomic profiles to explore questions such as genetic resistance to disease. Flash Gordon will speed analysis of large interaction networks because the databases can be stored on the solid-state disks, greatly reducing access time and permitting more complex types of analysis.The project team will leverage a number of ongoing educational activities at UCSD to expand and diversify the community of users that can utilize this computational resource, including successful outreach programs for women and minorities from underrepresented groups in science and engineering. The project will also create a summer training program for undergraduates.

摘要 UCSD 0910847 Norman, Michael L. 该项目支持适用于数据密集型应用程序的新型超级计算系统的获取、部署和操作。 该系统被称为 Flash Gordon，将由加州大学圣地亚哥分校在圣地亚哥超级计算机中心部署，并集成到 TeraGrid 中。 该系统由 Appro International Incorporated 与合作伙伴英特尔和 ScaleMP 共同设计，旨在弥合现代计算系统中主内存和旋转磁盘存储之间不断扩大的延迟差距。 它使用闪存提供一定程度的密集、经济实惠、低延迟的存储，可以配置为扩展交换空间或非常快的文件系统。 该系统将由非常大的共享虚拟内存、高速缓存一致的“超级节点”组成，以支持一组通用的编程范例。 双精度峰值性能将超过 200 teraflops/s。Flash Gordon 的大型可寻址虚拟内存、低延迟闪存和用户友好的编程环境将为数据密集型应用程序提供能力提升，这些应用程序在当前大型应用程序上扩展性较差。规模架构，提供了能够在许多研究领域进行变革性研究的资源。 即使是顺序代码也能够寻址高达 TB 的快速虚拟内存。正如提案中所述，该资源将允许研究人员解决的科学挑战的例子包括以下内容。从头基因组组装：基因测序仪产生有关基因组许多小片段的信息。 最近的一些汇编算法使用基于图形的方法，更容易在共享内存系统上执行。 使用Flash Gordon，研究人员将能够快速组装复杂的基因组，例如哺乳动物基因组。天文学：现代天文学数据库可能很大；例如，斯隆数字巡天计划的大小约为 6 TB。 通常，研究人员用来执行复杂的天文现象搜索的分析算法可以在共享内存系统上更轻松地实现。 Flash Gordon 将使研究人员能够将斯隆数字巡天的副本加载到与超级节点相关的闪存中，从而极大地扩展了天文学家可以进行的分析类型。 天体物理学：宇宙学模拟产生了描述模拟宇宙的许多 TB 的输出。 对这些模拟结果的详细分析，以找到诸如塌缩光晕、星系合并、矮星系和星系团等特征，通常需要基于密度的聚类分析，而这种分析的并行性不佳。 借助 Flash Gordon，可以通过利用大型 SMP 分区和快速闪存来加速这些分析。 交互网络：交互网络，表示对象之间关系的图形，用于流行病学、系统发育学、系统生物学和人口等领域的研究生物学。 这些交互网络可以表示不同数据库中存储的数据类型之间的关系；例如，将社交网络数据库与医疗记录和基因组图谱相结合，以探索诸如疾病遗传抵抗力等问题。 Flash Gordon 将加速大型交互网络的分析，因为数据库可以存储在固态磁盘上，从而大大减少访问时间并允许进行更复杂类型的分析。项目团队将利用 UCSD 正在进行的许多教育活动来扩展和使可以利用这种计算资源的用户社区多样化，包括针对科学和工程领域代表性不足群体的妇女和少数族裔的成功外展计划。 该项目还将为本科生创建暑期培训计划。