POSE: Phase I: Tuitus - A sustainable, inclusive, open ecosystem for Natural Hazards Engineering

POSE：第一阶段：Tuitus - 一个可持续、包容、开放的自然灾害工程生态系统

基本信息

批准号：
2229702
负责人：
Krishna Kumar
金额：
$ 28.76万
依托单位：
University of Texas at Austin
依托单位国家：
美国
项目类别：
Standard Grant
财政年份：
2022
资助国家：
美国
起止时间：
2022-09-15 至 2024-08-31
项目状态：
已结题

来源：
https://www.nsf.gov/awardsearch/showAward?AWD_ID=2229702&HistoricalAwards=false
关键词：
POSE Phase Tuitus sustainable inclusive

项目摘要

This project is funded by Pathways to Enable Open-Source Ecosystems (POSE) which seeks to harness the power of open-source development for the creation of new technology solutions to problems of national and societal importance. Natural hazards, such as floods, landslides, earthquakes, tornadoes, and wildfires, threaten more than 57% of the US national infrastructure. Modeling these complex natural hazards pushes the frontiers of high-performance computing, multi-scale modeling, in-situ visualization, big-data analysis, and machine learning. Scientific software codes are often developed in an ad hoc manner by university researchers and graduate students with very little exposure to software development principles and practices. The robustness and open-source nature of these scientific codes are essential for the safety and security of the nation, its people, and the environment. The project establishes the Tuitus Foundation (Latin for “to protect or care for”), a sustainable, inclusive, open ecosystem of scientific codes for Natural Hazard Engineering (NHE). The project’s novelties are creating a unified interface that supports integration testing, research reproducibility, and workflow provenance in distributed computing environments. The project supports building scalable, automated testing and workflow management for high-performance computing (HPC) environments. The project tackles the social issues around building and sustaining a community by establishing a Governing Board of Directors and supporting community-driven software development in NHE. The project creates an inclusive community by offering guidelines and training for onboarding and supporting new developers through hackathons and Google Summer of Code. By auto-deploying thoroughly tested HPC software to the NSF-funded DesignSafe Cyberinfrastructure, the project impacts the broader community of 6,000 NHE researchers by making robust NHE codes immediately accessible. Open-source codes in NHE will significantly impact the decision-making process and regional-scale risk assessment. The integration of Tuitus Foundation’s HPC Continuous Integration/Continuous Delivery (CI/CD) service with DesignSafe creates a paradigm shift in open-source code delivery in NHE, improving real-world policy decisions during critical natural hazard events. The Tuitus Foundation adopts a holistic approach to address the critical technical challenges in the Open-Source Ecosystem (OSE) by offering a standard Application Programming Interface (API) for HPC and heterogenous hardware architectures and supporting a wide range of applications from HPC, machine learning, database schemas, Jupyter notebooks, and visualizations. This project is the first attempt to integrate HPC-scale CI testing with natural hazard engineering codes for multi-job pipelines. The Tapis framework provides programmable interfaces that enable developers to automate data management and job execution on HPC and cloud resources. Tapis OAuth2 provides a separate security layer for managing user credentials, allowing Tapis to access many different storage and computing resources on behalf of the user. HPC-scale CI/CD with theTapis API enables testing for extreme-scale problems on distributed computing environments and future exascale systems. The project offers workflow provenance in Jupyter notebooks by tracking workflows and packaging runtime environment, thus enhancing research reproducibility. The novel CI developments bring together literate programming and HPC testing to provide the much-needed robustness to improve trustworthiness in engineering decision-making.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.

该项目由开源生态系统之路 (POSE) 资助，旨在利用开源开发的力量，为国家和社会重要的自然灾害（如洪水、山体滑坡、自然灾害）创建新技术解决方案。地震、龙卷风和野火威胁着美国 57% 以上的国家基础设施，对这些复杂的自然灾害进行建模推动了高性能计算、多尺度建模、现场可视化和大数据的发展。科学软件代码通常由大学研究人员和研究生以临时方式开发，很少接触软件开发原理和实践，这些科学代码的稳健性和开源性质对于安全性至关重要。该项目建立了 Tuitus 基金会（拉丁语，意为“保护或照顾”），这是一个可持续、包容、开放的自然灾害工程 (NHE) 项目科学代码生态系统。新奇事物正在创建一个统一的界面支持分布式计算环境中的集成测试、研究可重复性和工作流来源该项目支持为高性能计算 (HPC) 环境构建可扩展的自动化测试和工作流管理该项目通过以下方式解决围绕构建和维持社区的社会问题。建立理事会并支持 NHE 中社区驱动的软件开发。该项目通过黑客马拉松和 Google Summer of Code 自动部署经过全面测试的 HPC，为新开发人员提供指导和培训并提供支持，从而创建一个包容性社区。该项目通过使强大的 NHE 代码可立即访问，影响更广泛的 6,000 名 NHE 研究人员社区。NHE 中的开源代码将极大地影响决策过程和区域规模的风险评估。 Tuitus 基金会的 HPC 持续集成/持续交付 (CI/CD) 服务与 DesignSafe 的合作，在 NHE 中实现了开源代码交付的范式转变，改善了重大自然灾害事件期间的实际政策决策。 Tuitus 基金会采用整体方法来解决开源生态系统 (OSE) 中的关键技术挑战，为 HPC 和异构硬件架构提供标准应用程序编程接口 (API)，并支持 HPC、机器学习等广泛应用、数据库模式、Jupyter 笔记本和可视化该项目是将 HPC 规模的 CI 测试与多作业管道的自然灾害工程代码集成的首次尝试。 Tapis 框架提供了可编程接口，使开发人员能够Tapis OAuth2 提供了一个单独的安全层来管理用户凭据，使 Tapis 能够通过 Tapis API 代表用户访问许多不同的存储和计算资源。该项目通过跟踪工作流程和打包运行时环境，在 Jupyter 笔记本中测试极端规模的问题，从而提高研究的可重复性。新颖的 CI 开发将文字编程结合在一起。该奖项反映了 NSF 的法定使命，并通过使用基金会的智力优势和更广泛的影响审查标准进行评估，被认为值得支持。