Collaborative Research: SI2-SSI: Swift/E: Integrating Parallel Scripted Workflow into the Scientific Software Ecosystem

协作研究：SI2-SSI：Swift/E：将并行脚本工作流程集成到科学软件生态系统中

• 批准号: 1550562
• 负责人: Gerrick Lindberg
• 金额: $ 5万
• 依托单位: Northern Arizona University
• 依托单位国家: 美国
• 项目类别: Standard Grant
• 财政年份: 2016
• 资助国家: 美国
• 起止时间: 2016-10-01 至 2020-09-30
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=1550562&HistoricalAwards=false
• 关键词: Collaborative; Research; SI2; SSI; Swift

Science and engineering research increasingly relies on repeated execution of a complex series of steps (i.e., workflows) to form hypotheses; conduct experiments; analyze results; and refine theory. Computation is often essential throughout the workflow and in this case, software can improve productivity by managing the computational and data workflow. Swift is one such open-source workflow system that has been developed and widely used in diverse areas ranging from materials simulations and climate modeling to neuroscience and genomics. This project extends the capabilities of Swift by integrating it with other software systems that enable collaboration, usability, maintainability, and productivity. The new ecosystem, Swift/E, will enable scientists and engineers to more productively create and run computational workflow campaigns of larger scale, and debug, execute, adapt, and disseminate them faster and easier than has been possible to date. These workflows embody and communicate the computational methods specific to each domain of scientific inquiry. Swift/E achieves community engagement and extensive productivity benefits for a large user community through an integrated program of research, education, and software dissemination. The project engages and serves science and engineering communities by creating patterns of practice for building and sharing reusable workflow libraries, and by training students, educators, and researchers in their use. To advance the education of the next generation of computationally trained scientists, Swift/E powers a network of NSF-supported "e-Labs" that teach the concepts of collaborative parallel computational science at high school and undergraduate levels, reaching over a thousand students annually.The open-source Swift/E "ecosystem" integrates Swift with several scientific software elements that play a major role in the national and global cyberinfrastructure of today. These elements are: Swift for the parallel scripting of scientific workflow; Globus for data cataloging, management, and high-speed wide-area transport; the Web-based Galaxy workflow portal for workflow composition, execution, and collaborative sharing; Jupyter for the interactive development, testing, debugging, and assembly of high level programming and workflow languages; Python and R for productively expressing high-level computational logic; and "git" and related tools and Web portals for revision control, code dissemination and sharing, and for the collaborative engagement of developers. Swift's implicitly parallel programming language is minimal and compact. Swift provides a facility for embedding other scripting languages (currently Python, R, Julia and Tcl) into its runtime environment. This project merges newer extreme-scale "Swift/T" capabilities with the flexible and portable original "Swift/K" version to make the core Swift/E software element more powerful and flexible while lowering it?s ongoing support cost. Swift/E enhances usability by extending Swift's troubleshooting and inter-language integration facilities. And with enhanced and innovative workflow sharing archives, new training materials, and a sustained program for user support and self-sustaining and expanding community engagement, the Swift/E project engages, supports, and sustains a large global science and engineering user base.

科学和工程研究越来越依赖于重复执行一系列复杂的步骤（即工作流程）来形成假设；进行实验；分析结果；并完善理论。 计算通常在整个工作流程中至关重要，在这种情况下，软件可以通过管理计算和数据工作流程来提高生产力。 Swift 就是这样一种开源工作流程系统，它已被开发并广泛应用于从材料模拟和气候建模到神经科学和基因组学等各个领域。该项目通过将 Swift 与其他软件系统集成来扩展 Swift 的功能，从而实现协作、可用性、可维护性和生产力。新的生态系统 Swift/E 将使科学家和工程师能够更高效地创建和运行更大规模的计算工作流程活动，并比迄今为止更快、更轻松地调试、执行、调整和传播它们。这些工作流程体现并传达了科学探究每个领域特有的计算方法。 Swift/E 通过研究、教育和软件传播的综合计划，为大型用户社区实现了社区参与和广泛的生产力优势。该项目通过创建构建和共享可重用工作流程库的实践模式，以及培训学生、教育工作者和研究人员使用这些库，吸引并服务于科学和工程社区。 为了促进下一代受过计算训练的科学家的教育，Swift/E 为 NSF 支持的“电子实验室”网络提供支持，该网络在高中和本科阶段教授协作并行计算科学的概念，每年覆盖一千多名学生开源 Swift/E“生态系统”将 Swift 与多种科学软件元素集成在一起，这些元素在当今的国家和全球网络基础设施中发挥着重要作用。这些元素是： Swift 用于科学工作流程的并行脚本编写； Globus 用于数据编目、管理和高速广域传输；基于 Web 的 Galaxy 工作流门户，用于工作流组合、执行和协作共享； Jupyter 用于高级编程和工作流语言的交互式开发、测试、调试和组装； Python 和 R 用于高效地表达高级计算逻辑； “git”以及相关工具和 Web 门户，用于修订控制、代码传播和共享以及开发人员的协作参与。 Swift 的隐式并行编程语言是最小且紧凑的。 Swift 提供了将其他脚本语言（当前为 Python、R、Julia 和 Tcl）嵌入到其运行时环境中的工具。 该项目将更新的超大规模“Swift/T”功能与灵活且可移植的原始“Swift/K”版本相结合，使核心 Swift/E 软件元素更加强大和灵活，同时降低其持续支持成本。 Swift/E 通过扩展 Swift 的故障排除和语言间集成设施来增强可用性。 通过增强和创新的工作流程共享档案、新的培训材料以及用户支持和自我维持和扩大社区参与的持续计划，Swift/E 项目吸引、支持和维持了庞大的全球科学和工程用户群。