Collaborative Research: SI2-SSI: Swift/E: Integrating Parallel Scripted Workflow into the Scientific Software Ecosystem

协作研究：SI2-SSI：Swift/E：将并行脚本工作流程集成到科学软件生态系统中

• 批准号: 1550562
• 负责人: Gerrick Lindberg
• 金额: $ 5万
• 依托单位: Northern Arizona University
• 依托单位国家: 美国
• 项目类别: Standard Grant
• 财政年份: 2016
• 资助国家: 美国
• 起止时间: 2016-10-01 至 2020-09-30
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=1550562&HistoricalAwards=false
• 关键词: Collaborative; Research; SI2; SSI; Swift

Science and engineering research increasingly relies on repeated execution of a complex series of steps (i.e., workflows) to form hypotheses; conduct experiments; analyze results; and refine theory. Computation is often essential throughout the workflow and in this case, software can improve productivity by managing the computational and data workflow. Swift is one such open-source workflow system that has been developed and widely used in diverse areas ranging from materials simulations and climate modeling to neuroscience and genomics. This project extends the capabilities of Swift by integrating it with other software systems that enable collaboration, usability, maintainability, and productivity. The new ecosystem, Swift/E, will enable scientists and engineers to more productively create and run computational workflow campaigns of larger scale, and debug, execute, adapt, and disseminate them faster and easier than has been possible to date. These workflows embody and communicate the computational methods specific to each domain of scientific inquiry. Swift/E achieves community engagement and extensive productivity benefits for a large user community through an integrated program of research, education, and software dissemination. The project engages and serves science and engineering communities by creating patterns of practice for building and sharing reusable workflow libraries, and by training students, educators, and researchers in their use. To advance the education of the next generation of computationally trained scientists, Swift/E powers a network of NSF-supported "e-Labs" that teach the concepts of collaborative parallel computational science at high school and undergraduate levels, reaching over a thousand students annually.The open-source Swift/E "ecosystem" integrates Swift with several scientific software elements that play a major role in the national and global cyberinfrastructure of today. These elements are: Swift for the parallel scripting of scientific workflow; Globus for data cataloging, management, and high-speed wide-area transport; the Web-based Galaxy workflow portal for workflow composition, execution, and collaborative sharing; Jupyter for the interactive development, testing, debugging, and assembly of high level programming and workflow languages; Python and R for productively expressing high-level computational logic; and "git" and related tools and Web portals for revision control, code dissemination and sharing, and for the collaborative engagement of developers. Swift's implicitly parallel programming language is minimal and compact. Swift provides a facility for embedding other scripting languages (currently Python, R, Julia and Tcl) into its runtime environment. This project merges newer extreme-scale "Swift/T" capabilities with the flexible and portable original "Swift/K" version to make the core Swift/E software element more powerful and flexible while lowering it?s ongoing support cost. Swift/E enhances usability by extending Swift's troubleshooting and inter-language integration facilities. And with enhanced and innovative workflow sharing archives, new training materials, and a sustained program for user support and self-sustaining and expanding community engagement, the Swift/E project engages, supports, and sustains a large global science and engineering user base.

科学与工程研究越来越依赖于重复执行一系列复杂的步骤（即工作流程）来形成假设。进行实验；分析结果；和完善理论。 在整个工作流程中，计算通常至关重要，在这种情况下，软件可以通过管理计算和数据工作流来提高生产率。 Swift是一种这样的开源工作流系统，已在从材料模拟和气候建模到神经科学和基因组学的不同领域开发和广泛使用。该项目通过将SWIFT与其他软件系统集成在一起，从而扩展了SWIFT的功能，从而可以协作，可用性，可维护性和生产力。新的生态系统Swift/E将使科学家和工程师能够更有生产力地创建和运行更大规模的计算工作流程，并比迄今为止更快，更容易地调试，执行，适应和更容易地进行它们。这些工作流程体现并传达了科学探究每个领域的计算方法。 Swift/E通过整合的研究，教育和软件传播计划，为大型用户社区带来了社区的参与和广泛的生产力。该项目通过创建用于建立和共享可重复使用的工作流库的实践模式，并通过培训学生，教育工作者和研究人员的使用方式来参与科学和工程社区。 To advance the education of the next generation of computationally trained scientists, Swift/E powers a network of NSF-supported "e-Labs" that teach the concepts of collaborative parallel computational science at high school and undergraduate levels, reaching over a thousand students annually.The open-source Swift/E "ecosystem" integrates Swift with several scientific software elements that play a major role in the national and global cyberinfrastructure of today.这些要素是：迅速的科学工作流程脚本； Globus用于数据编目，管理和高速宽面积运输；基于Web的Galaxy Workflow门户网站，用于工作流组成，执行和协作共享；互动开发，测试，调试和组装高级编程和工作流语言的jupyter； Python和R用于有效地表达高级计算逻辑；以及“ git”及相关工具和网站，用于修订控制，代码传播和共享以及开发人员的协作参与。 Swift隐式并行编程语言是最小而紧凑的。 Swift提供了将其他脚本语言（目前是Python，R，Julia和TCL）嵌入其运行时环境中的设施。 该项目将较新的极端“ Swift/T”功能与灵活和便携式的原始“ Swift/K”版本合并，以使Core Swift/E Software Element更加强大和灵活，同时降低其持续的支持成本。 Swift/E通过扩展Swift的故障排除和语言集成设施来增强可用性。 凭借增强和创新的工作流共享档案，新的培训材料以及持续的用户支持以及自我维持和扩大社区参与的计划，Swift/E项目的参与，支持并维持了大型的全球科学和工程用户群。