CCRI: Planning: Collaborative Research: Infrastructure for Enabling Systematic Development and Research of Scientific Workflow Management Systems

CCRI：规划：协作研究：支持科学工作流程管理系统系统开发和研究的基础设施

• 批准号: 2016610
• 负责人: Henri Casanova
• 金额: $ 1.5万
• 依托单位: University of Hawaii
• 依托单位国家: 美国
• 项目类别: Standard Grant
• 财政年份: 2020
• 资助国家: 美国
• 起止时间: 2020-10-01 至 2021-09-30
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=2016610&HistoricalAwards=false
• 关键词: CCRI; Planning; Collaborative; Research; Infrastructure

Scientific workflows are used almost universally across research and engineering disciplines and have underpinned some of the most significant discoveries of the past several decades (e.g., first detection of gravitational waves from colliding black holes, the discovery of the Higgs boson, and the detection of an exotic nuclear decay). Workflow management systems (WMSs) are software systems that provide abstraction and automation for facilitating access to and management of distributed and heterogeneous compute and storage resources. They enable a broad range of researchers to easily define sophisticated computational processes and to then execute them efficiently on parallel and distributed computing platforms. Unfortunately, in spite of widespread adoption of workflows, the technology landscape is segmented and presents significant barriers to entry due to the existence of dozens of seemingly comparable, yet incompatible, systems. The research landscape is also disjoint, making it difficult to compare and contrast approaches, verify and reproduce results, and build upon existing work.This project will engage with representatives from the workflows community – including researchers, developers, science and engineering users, and cyberinfrastructure experts. Through targeted community surveys and focused workshops, the project will gather a diverse set of perspectives, create a community-owned WMS inventory and common knowledge taxonomy, define an experimental methodology for measuring WMS capabilities, and develop a blueprint for a community research infrastructure. This proposed infrastructure has the potential to truly democratize workflows research, enabling researchers, postdocs, and students, irrespective of their institutions, to access cutting-edge infrastructure for comparison, evaluation, and verification of workflows research results.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.

科学工作流程几乎在研究和工程学科中普遍使用，并为过去几十年中一些最重要的发现提供了基础（例如，从碰撞的黑洞中首次检测引力波，发现希格斯玻色子的发现，以及对外来核衰变的检测）。工作流管理系统（WMS）是提供抽象和自动化的软件系统，可支持访问和管理分布式和异构计算和存储资源。它们使广泛的研究人员能够轻松地定义复杂的计算过程，然后在并行和分布式计算平台上有效地执行它们。不幸的是，尽管采用了工作流程，但由于存在数十个看似可比但不兼容的系统，因此对技术格局进行了细分，并构成了重大障碍。研究格局也是不相交的，使得很难比较和对比方法，验证和重现结果，并在现有工作的基础上进行。该项目将与工作流社区的代表互动，包括研究人员，开发人员，科学和工程用户以及Cyber​​infrastructure专家。通过有针对性的社区调查和专注的研讨会，该项目将收集一系列潜水员的观点，创建社区拥有的WMS库存和常见的知识分类法，定义了用于衡量WMS能力的实验方法，并为社区研究基础设施开发蓝图。这项拟议的基础设施有可能真正使工作流程的民主化研究，使研究人员，博士后和学生无关，无论其机构如何，都可以访问最先进的基础架构，以进行比较，评估和验证工作流程研究结果的研究结果，这是NSF的法定任务和审查范围的范围。

项目成果

Evaluating Energy-Aware Scheduling Algorithms for I/O-Intensive Scientific Workflows

• DOI: 10.1007/978-3-030-77961-0_16
• 发表时间: 2021
• 作者: T. Coleman;H. Casanova;Ty Gwartney;Rafael Ferreira da Silva

WfChef: Automated Generation of Accurate Scientific Workflow Generators

WfChef：自动生成准确的科学工作流程生成器

• 发表时间: 2021
• 期刊: 17th IEEE EScience Conference
• 作者: Coleman, Taina;Casanova, Henri;Ferreira da Silva, Rafael
• 通讯作者: Ferreira da Silva, Rafael

A Community Roadmap for Scientific Workflows Research and Development

• DOI: 10.1109/works54523.2021.00016
• 发表时间: 2021-01-01
• 期刊: PROCEEDINGS OF 16TH WORKSHOP ON WORKFLOWS IN SUPPORT OF LARGE-SCALE SCIENCE (WORKS21)
• 作者: da Silva, Rafael Ferreira;Casanova, Henri;Wolf, Matthew
• 通讯作者: Wolf, Matthew