OAC Core: Small: Collaborative Research: Scalable Run-Time for Highly Parallel, Heterogeneous Systems

OAC 核心：小型：协作研究：高度并行、异构系统的可扩展运行时

• 批准号: 1909015
• 负责人: George Bosilca
• 金额: $ 25万
• 依托单位: University of Tennessee Knoxville
• 依托单位国家: 美国
• 项目类别: Standard Grant
• 财政年份: 2019
• 资助国家: 美国
• 起止时间: 2019-07-01 至 2023-06-30
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=1909015&HistoricalAwards=false
• 关键词: OAC; Core; Small; Collaborative; Research

Supercomputing has become an essential tool in many scientific fields, including advances in engineering and medicine, and contributes to national security. Progress in many areas depends on continued improvements in the performance of supercomputers and their usability. Communication between processes is a critical component of this effort and is the target of this project. This project departs from the traditional communication protocols. Rather, the project focuses on providing middle ground solutions between hardware and software. This approach potentially reduces communication overheads and better matches the functionality of the communication library to the capabilities of modern communication adapters and also improves the match between the requirements of modern parallel computing frameworks and applications. By improving the communication capabilities of computational platforms, this project will promote faster and more flexible communication capabilities and will improve the time to completion of scientific applications. It, therefore, increases the scientific throughput of existing and future cyberinfrastructure platforms. The research and educational outcomes of this project are closely related, resulting in highly trained new generations of researchers and engineers leading to a more efficient and globally competent workforce. Therefore, this project aligns with the NSF's mission to promote the progress of science and to advance national prosperity and welfare through science, and serves the national interest. This project brings together a multidisciplinary team and aims at breaking away from the limitation of standards such as Message Passing Interface and pointing the way for handling the needs of future computational frameworks and high-end systems. To this end the project (1) designs and implements a communication library with new communication primitives to enable fast coordination with no serial bottleneck, to manage irregular, fine grain communication, and to provide new efficient synchronization mechanisms; (2) demonstrates the value of this library by using it to accelerate multiple task-based runtimes (Legion, PaRSEC) and communication libraries (MPI and GasNET); (3) demonstrates the value of hardware support by porting key components to a programmable NIC; and (4) delivers improvements and extensions to mainstream communication libraries to provide the new functionality. This work puts a special emphasis on emerging programming models, such as Legion or PaRSEC, and on emerging application domains, such as graph analytics. It aims at an orthogonal design where different mechanisms for associating producer buffer with consumer buffer can be composed with different mechanisms for synchronizing producer and consumer; and where mechanisms can be specialized so as to allow efficient hardware support.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.

超级计算已成为许多科学领域的重要工具，包括工程和医学领域的进步，并为国家安全做出了贡献。许多领域的进步取决于超级计算机性能及其可用性的持续改进。流程之间的通信是这项工作的关键组成部分，也是该项目的目标。该项目脱离了传统的通信协议。相反，该项目专注于提供硬件和软件之间的中间解决方案。这种方法潜在地减少了通信开销，并使通信库的功能与现代通信适配器的功能更好地匹配，并且还提高了现代并行计算框架和应用程序的要求之间的匹配。通过提高计算平台的通信能力，该项目将促进更快、更灵活的通信能力，并将缩短科学应用的完成时间。 因此，它提高了现有和未来网络基础设施平台的科学吞吐量。该项目的研究和教育成果密切相关，培养出训练有素的新一代研究人员和工程师，从而打造一支更加高效、具有全球竞争力的劳动力队伍。因此，该项目符合NSF推动科学进步、通过科学促进国家繁荣和福祉的使命，服务于国家利益。该项目汇集了多学科团队，旨在突破消息传递接口等标准的限制，为处理未来计算框架和高端系统的需求指明道路。为此，该项目 (1) 设计并实现了一个具有新通信原语的通信库，以实现无串行瓶颈的快速协调，管理不规则、细粒度的通信，并提供新的高效同步机制； (2) 通过使用该库来加速多个基于任务的运行时（Legion、PaRSEC）和通信库（MPI 和 GasNET），展示了该库的价值； (3) 通过将关键组件移植到可编程 NIC 来展示硬件支持的价值； (4) 对主流通信库进行改进和扩展以提供新功能。这项工作特别强调新兴编程模型（例如 Legion 或 PaRSEC）以及新兴应用领域（例如图形分析）。它的目标是正交设计，其中用于关联生产者缓冲区和消费者缓冲区的不同机制可以由用于同步生产者和消费者的不同机制组成；该奖项反映了 NSF 的法定使命，并通过使用基金会的智力优势和更广泛的影响审查标准进行评估，被认为值得支持。

项目成果

Callback-based completion notification using MPI Continuations

使用 MPI Continuations 的基于回调的完成通知

• DOI: 10.1016/j.parco.2021.102793
• 发表时间: 2021-09
• 期刊: Parallel Computing
• 影响因子: 1.4
• 作者: Schuchart, Joseph;Samfass, Philipp;Niethammer, Christoph;Gracia, José;Bosilca, George
• 通讯作者: Bosilca, George