OAC Core: Transpass: Transpiling Parallel Task Graph Programming Models for Scientific Software

OAC 核心：Transpass：为科学软件转译并行任务图编程模型

• 批准号: 2209957
• 负责人: Tsung-Wei Huang
• 金额: $ 48.87万
• 依托单位: University of Utah
• 依托单位国家: 美国
• 项目类别: Standard Grant
• 财政年份: 2022
• 资助国家: 美国
• 起止时间: 2022-07-01 至 2023-10-31
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=2209957&HistoricalAwards=false
• 关键词: OAC; Core; Transpass; Transpiling; Parallel

Task graph programming model (TGPM) is an essential component in many machine learning systems because it allows top-down optimization of parallelism that governs macroscale performance. Due to the distinct performance constraints exhibited by each TGPM when computing a specific machine learning workload, no single TGPM can guarantee optimal performance for all. Assisting researchers in transforming machine learning task graphs between different TGPMs is thus extremely beneficial for advancing the utilization of acceleration hardware for many of today’s machine learning-centric scientific software. Unfortunately, insufficient systems to streamline the transformation process has resulted in a significant turnaround time that prevents researchers from quickly optimizing the performance of machine learning algorithms on different computing platforms. This project creates a novel open-source system that 1) enables an automatic transformation of machine learning task graphs between different TGPMs and 2) establishes an open platform for a diverse group of researchers to contribute to program transformation research and education. This project establishes Transpass, a novel task graph-based programming environment to streamline the transformation of a program between different TGPMs with a specific focus on machine learning task graphs. Transpass introduces a new intermediate representation called control taskflow graph to represent end-to-end parallelism in a single task graph with in-graph control flow. Atop this intermediate representation, Transpass introduces a new source-to-source compiler (“transpiler”) to enable multidirectional transformations of programs between different TGPMs through transformed control taskflow graph. To support efficient execution of transformed graphs, Transpass introduces a new learning-based runtime that learns complex scheduling parameters in the given software and hardware environment. Technical contributions of this project span a multidisciplinary research community, including high-performance computing, program transformation, and machine learning. Transpass will be open-source to facilitate generalizability to many programming models and promote widespread contributions in the computing community.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.

任务图编程模型 (TGPM) 是许多机器学习系统中的重要组成部分，因为它允许对控制宏观性能的并行性进行自上而下的优化，由于每个 TGPM 在计算特定机器学习工作负载时表现出不同的性能限制，因此没有单一的并行性。 TGPM 可以保证所有人都能获得最佳性能，因此，帮助研究人员在不同 TGPM 之间转换机器学习任务图对于提高当今许多以机器学习为中心的科学软件的加速硬件的利用率非常有利，但不幸的是，没有足够的系统来简化转换过程。结果是该项目创建了一个新颖的开源系统，该系统 1) 能够在不同的 TGPM 之间自动转换机器学习任务图，2) 建立。该项目建立了 Transpass，这是一种新颖的基于任务图的编程环境，旨在简化不同 TGPM 之间的程序转换，特别关注机器学习任务图。 。 Transpass 引入了一种称为控制任务流图的新中间表示，用于在具有图内控制流的单个任务图中表示端到端并行性，在此中间表示之上，Transpass 引入了新的源到源编译器（“转译器”）。通过转换后的控制任务流图实现不同 TGPM 之间程序的多向转换 为了支持转换图的高效执行，Transpass 引入了一种新的基于学习的运行时，可以在给定的软件和硬件环境中学习复杂的调度参数。该项目跨越多学科研究社区，包括高性能计算、程序转换和机器学习。Transpass 将开源，以促进许多编程模型的推广，并促进计算社区的广泛贡献。该奖项反映了 NSF 的法定使命和目标。通过使用基金会的智力优点和更广泛的影响审查标准进行评估，该项目被认为值得支持。