Framework: Software: Collaborative Research: CyberWater--An open and sustainable framework for diverse data and model integration with provenance and access to HPC

框架：软件：协作研究：Cyber​​Water——一个开放且可持续的框架，用于将多种数据和模型集成，并提供 HPC 的来源和访问权限

• 批准号: 1835817
• 负责人: Yao Liang
• 金额: $ 51.42万
• 依托单位: Indiana University
• 依托单位国家: 美国
• 项目类别: Standard Grant
• 财政年份: 2019
• 资助国家: 美国
• 起止时间: 2019-01-01 至 2023-12-31
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=1835817&HistoricalAwards=false
• 关键词: Framework; Software; Collaborative; Research; CyberWater

This project addresses a high priority need for water research communities: interoperability among a wide variety of data sources and models, and integration of different computational models into water research communities. The project will develop an open and sustainable software framework enabling integration of hydrologic data and models for interdisciplinary teamwork and discovery. The models and datasets cover fields such as hydrology, biology, environmental engineering and climate. The project also addresses one of the key issues for extreme-scale computing: scalable file systems. The collaboration draws upon computing, modeling, and hydrology expertise at six institutions: University of Pittsburgh, University of Iowa, Ball State University, North Carolina State University, Indiana University, and the Consortium of Universities for the Advancement of Hydrologic Science, Inc. (CUAHSI). The project develops CyberWater, a community-driven software framework that integrates a wide range of models and datasets across disparate temporal and spatial scales. The CyberWater framework allows scientists to bypass challenges associated with model and dataset complexity. The project designs a model agent tool enabling users to generate model agents for common model types without coding, and integrates multiple existing software codes/elements that provide for broad-scale use. To develop such a diverse modeling framework, the project brings together hydrologists, climate experts, meteorologists, computer scientists and cyberinfrastructure experts. The project builds upon an existing prototype developed by the lead investigator; basic elements for the system were developed, consisting of plugged-in models and data sources with corresponding agents and a workflow engine allowing user workflow control. The prototype was successfully demonstrated for two models, making use of datasets plugged in from NASA, USGS and CUAHSI. For the current project, new models and datasets are added to the framework; the ability to use high performance computing resources is also incorporated. The team will use the CUAHSI HydroShare System to distribute CyberWater software and its associate model agents, including instructions on how to establish a local CyberWater environment, models and model agents. The project will enable substantial scientific advances for water related issues, and the solution can be applied to other research disciplines. This award by the Office of Advanced Cyberinfrastructure is jointly supported by the NSF Directorate for Geosciences.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.

该项目解决了水研究界的一个高度优先的需求：各种数据源和模型之间的互操作性，以及将不同计算模型集成到水研究界中。 该项目将开发一个开放且可持续的软件框架，能够集成水文数据和模型，以实现跨学科团队合作和发现。 模型和数据集涵盖水文学、生物学、环境工程和气候等领域。 该项目还解决了超大规模计算的关键问题之一：可扩展的文件系统。 此次合作利用了六家机构的计算、建模和水文专业知识：匹兹堡大学、爱荷华大学、鲍尔州立大学、北卡罗来纳州立大学、印第安纳大学和水文科学促进大学联盟。 CUAHSI）。 该项目开发了 Cyber​​Water，这是一个社区驱动的软件框架，集成了跨不同时间和空间尺度的各种模型和数据集。 Cyber​​Water 框架使科学家能够绕过与模型和数据集复杂性相关的挑战。 该项目设计了一个模型代理工具，使用户无需编码即可生成常见模型类型的模型代理，并集成了多个现有的软件代码/元素以供广泛使用。 为了开发这样一个多样化的建模框架，该项目汇集了水文学家、气候专家、气象学家、计算机科学家和网络基础设施专家。 该项目以首席研究员开发的现有原型为基础； 开发了该系统的基本元素，包括插入模型和具有相应代理的数据源以及允许用户进行工作流控制的工作流引擎。 利用 NASA、USGS 和 CUAHSI 插入的数据集，该原型已成功演示了两个模型。 对于当前项目，新的模型和数据集被添加到框架中；还包含使用高性能计算资源的能力。 该团队将使用 CUAHSI HydroShare 系统来分发 Cyber​​Water 软件及其相关模型代理，包括有关如何建立本地 Cyber​​Water 环境、模型和模型代理的说明。该项目将为水相关问题带来重大科学进展，并且该解决方案可应用于其他研究学科。该奖项由高级网络基础设施办公室颁发，并得到 NSF 地球科学理事会的共同支持。该奖项反映了 NSF 的法定使命，并通过使用基金会的智力价值和更广泛的影响审查标准进行评估，认为值得支持。

项目成果

An open-data open-model framework for hydrological models’ integration, evaluation and application

用于水文模型集成、评估和应用的开放数据开放模型框架

• DOI: 10.1016/j.envsoft.2020.104622
• 发表时间: 2020-04
• 期刊: Environmental Modelling & Software
• 影响因子: 4.9
• 作者: Salas, Daniel;Liang, Xu;Navarro, Miguel;Liang, Yao;Luna, Daniel
• 通讯作者: Luna, Daniel

X-composer: enabling cross-environments in-situ workflows between HPC and cloud

X-composer：支持 HPC 和云之间的跨环境现场工作流程

• DOI: 10.1145/3468267.3470621
• 发表时间: 2021-07
• 期刊: Proceedings of the Platform for Advanced Scientific Computing Conference
• 作者: Li, Feng;Wang, Dali;Yan, Feng;Song, Fengguang
• 通讯作者: Song, Fengguang

CyberWater: An Open Framework for Data and Model Integration in Water Science and Engineering

Cyber​​Water：水科学与工程中数据和模型集成的开放框架

• DOI: 10.1145/3511808.3557186
• 发表时间: 2022-01
• 期刊: Proceedings of the 31st ACM Int’l Conference on Information and Knowledge Management (CIKM’22
• 作者: Chen, Ranran;Luna, Daniel;Li, Feng;Young, Ryan;Bieger, Drew;Song, Fengguang;Pamidighantam, Sudhakar;Liang, Yao;Liang, Xu
• 通讯作者: Liang, Xu

Open data and model integration through generic model agent toolkit in CyberWater framework

通过 Cyber​​Water 框架中的通用模型代理工具包开放数据和模型集成

• DOI: 10.1016/j.envsoft.2022.105384
• 发表时间: 2022-06
• 期刊: Environmental Modelling & Software
• 影响因子: 4.9
• 作者: Chen, Ranran;Luna, Daniel;Cao, Yuan;Liang, Yao;Liang, Xu
• 通讯作者: Liang, Xu

Accelerating complex modeling workflows in CyberWater using on-demand HPC/Cloud resources

使用按需 HPC/云资源加速 Cyber​​Water 中的复杂建模工作流程

• DOI: 10.1109/escience51609.2021.00030
• 发表时间: 2021-09
• 期刊: The 17th IEEE International Conference on eScience
• 作者: Li, Feng;Chen, Ranran;Fu, Yuankun;Song, Fengguang;Liang, Yao;Ranawaka, Isuru;Pamidighantam, Sudhakar;Luna, Daniel;Liang, Xu
• 通讯作者: Liang, Xu