Virtual Data Set Services Enabling New Science at NSF Facilities

虚拟数据集服务在 NSF 设施中实现新科学

• 批准号: 1841531
• 负责人: Ian Foster
• 金额: $ 150万
• 依托单位: University of Chicago
• 依托单位国家: 美国
• 项目类别: Standard Grant
• 财政年份: 2018
• 资助国家: 美国
• 起止时间: 2018-10-01 至 2021-09-30
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=1841531&HistoricalAwards=false
• 关键词: Virtual; Data; Set; Services; Enabling

Scientific facilities supported by the National Science Foundation such as the Daniel K. Inouye Solar Telescope (DKIST), National Center for Atmospheric Research (NCAR), and National Ecological Observatory Network (NEON) collect enormous quantities of valuable data about the world in which we live. These data can be used for scientific and societal benefit: to make breakthrough discoveries about sun's behavior and magnetic field, and our changing environment; to improve the speed and accuracy of forecasting of severe storms and destructive wildfires; to predict disruptions to electrical systems from solar flares; and many other purposes. Before such vital scientific data can be used effectively, they must be delivered rapidly, efficiently, and reliably to the people who need them. Researchers need interactive community access to hard-to-obtain data located in large data archives. Because the NCAR, DKIST, and NEON data archives cannot feasibly provide the computing resources needed for all analyses, end-user scientists need to be able to define, navigate, download, and analyze data subsets. Current web-based tools are not up to these tasks. The Virtual Data Set Services Enabling New Science at NSF Facilities project will tackle this challenge by developing new methods for organizing, packaging, and rapidly transporting data. A key innovation will be the development of methods for defining, sharing, and manipulating "virtual data sets," data collections extracted "on the fly" from the vast holdings of scientific facilities for a specific purpose. A researcher may define a virtual data set much as a shopper assembles products in an online "shopping cart." Once defined, a virtual data set can then be transferred to a remote computer for analysis, shared with colleagues, or extended for future projects. We will develop new services to (a) enable definition of, navigation over, and selective access to virtual data sets from petascale data archives of the scientific facilities, and (b) ensure reliable, automated, efficient, and secure replication and access of entire data sets or data subsets between a petascale data archive and other locations, to include both end user computers and remote mirrors intended to accelerate data access by community members. These new services will be constructed on top of the Globus platform, already heavily used within NCAR's Research Data Archive (RDA) and many other research data centers. The ultimate aim is to integrate the new services into operational systems in collaboration with DKIST, NEON, and NCAR/RDA. The results will be evaluated in the context of demanding science applications in partnership with solar physics, atmospheric science, and ecology researchers.This project is supported by the Office of Advanced Cyberinfrastructure in the Directorate for Computer and Information Science and Engineering.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.

由美国国家科学基金会支持的科学设施，例如丹尼尔·K·井上太阳望远镜 (DKIST)、国家大气研究中心 (NCAR) 和国家生态观测网络 (NEON)，收集了大量有关我们所在世界的宝贵数据。居住。这些数据可用于科学和社会效益：对太阳的行为和磁场以及我们不断变化的环境做出突破性发现；提高强风暴和破坏性野火预报的速度和准确性；预测太阳耀斑对电力系统的干扰；和许多其他目的。在有效使用这些重要的科学数据之前，必须将它们快速、高效、可靠地传递给需要它们的人。研究人员需要交互式社区访问大型数据档案中难以获取的数据。由于 NCAR、DKIST 和 NEON 数据档案无法切实提供所有分析所需的计算资源，因此最终用户科学家需要能够定义、导航、下载和分析数据子集。当前基于网络的工具无法胜任这些任务。 NSF 设施虚拟数据集服务支持新科学项目将通过开发组织、打包和快速传输数据的新方法来应对这一挑战。一项关键的创新将是开发定义、共享和操作“虚拟数据集”的方法，即为特定目的从大量科学设施中“动态”提取的数据集合。研究人员可以定义虚拟数据集，就像购物者在在线“购物车”中组装产品一样。一旦定义完毕，虚拟数据集就可以传输到远程计算机进行分析、与同事共享或扩展以用于未来的项目。我们将开发新的服务，以（a）实现对来自科学设施千万亿级数据档案的虚拟数据集的定义、导航和选择性访问，以及（b）确保整个数据集的可靠、自动化、高效和安全的复制和访问。千万级数据存档和其他位置之间的数据集或数据子集，包括最终用户计算机和远程镜像，旨在加速社区成员的数据访问。这些新服务将构建在 Globus 平台之上，该平台已在 NCAR 的研究数据档案 (RDA) 和许多其他研究数据中心内大量使用。最终目标是与 DKIST、NEON 和 NCAR/RDA 合作将新服务集成到操作系统中。研究结果将在要求严格的科学应用背景下与太阳物理学、大气科学和生态学研究人员合作进行评估。该项目得到了计算机和信息科学与工程理事会高级网络基础设施办公室的支持。该奖项反映了 NSF 的法定使命，并通过使用基金会的智力优点和更广泛的影响审查标准进行评估，被认为值得支持。