Collaborative Research: PPoSS: Planning: Unifying Software and Hardware to Achieve Performant and Scalable Zero-cost Parallelism in the Heterogeneous Future

协作研究：PPoSS：规划：统一软件和硬件以在异构未来实现高性能和可扩展的零成本并行

• 批准号: 2028851
• 负责人: Peter Dinda
• 金额: $ 12.83万
• 依托单位: Northwestern University
• 依托单位国家: 美国
• 项目类别: Standard Grant
• 财政年份: 2020
• 资助国家: 美国
• 起止时间: 2020-10-01 至 2023-09-30
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=2028851&HistoricalAwards=false
• 关键词: Collaborative; Research; PPoSS; Planning; Unifying

Exploiting parallelism is essential to making full use of computer systems, and thus is intrinsic to most applications. Building parallel programs that can truly achieve the performance the hardware is capable of is extremely challenging even for experts. It requires a firm grasp of concepts that range from the very highest level to the very lowest, and that range is rapidly expanding. This project approaches this challenge along two lines, "theory down" and "architecture up". The first strives to simplify parallel programming through languages and algorithms. The second line strives to accelerate parallel programs through compilers, operating systems, and the hardware. The project's novelty is to bridge these two lines, which are usually treated quite distinctly by the research community. The unified team of researchers is addressing a specific subproblem, scheduling, and then determining how to expand out from it. The project's impact is in making it possible for ordinary programmers to program future parallel systems in a very high-level way, yet achieve the performance possible on the machine.The project studies an "intermediate representation out" approach to making high-level parallel abstractions implementable so that they can be used with zero cost. A core idea is to expand the compiler's intermediate representation such that it can capture both high-level parallel concepts and low-level machine and operating system structures, thus allowing full stack optimization. This planning project will flesh out this concept and set the stage for a larger scale effort in the future.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.

利用并行性对于充分利用计算机系统至关重要，因此对于大多数应用程序都是固有的。 建立可以真正实现硬件能够实现的性能的并行程序，即使对于专家来说，也极具挑战性。 它需要对概念的坚定掌握，从最高级别到最低水平，并且该范围正在迅速扩展。 该项目沿两条线“理论下降”和“架构上升”面对这一挑战。 第一个努力通过语言和算法简化并行编程。 第二行努力通过编译器，操作系统和硬件加速并行程序。 该项目的新颖性是桥接这两条线，研究界通常对此非常明显地对待。统一的研究人员团队正在解决特定的子问题，计划，然后确定如何从中扩展。 该项目的影响是使普通程序员有可能以非常高级的方式对未来的并行系统进行编程，但可以实现机器上的性能。可实施，以便可以以零成本使用。 一个核心想法是扩展编译器的中间表示形式，以便它可以捕获高级并行概念，低级机器和操作系统结构，从而允许完整的堆栈优化。 该计划项目将充实这一概念，并为未来的大规模努力奠定了基础。该奖项反映了NSF的法定任务，并被认为是值得通过基金会的知识分子优点和更广泛的影响评估标准来评估的。

项目成果

NOELLE Offers Empowering LLVM Extensions

NOELLE 提供强大的 LLVM 扩展

• DOI: 10.1109/cgo53902.2022.9741276
• 发表时间: 2022
• 期刊: 2022 IEEE/ACM International Symposium on Code Generation and Optimization (CGO
• 作者: Matni, Angelo;Deiana, Enrico Armenio;Su, Yian;Gross, Lukas;Ghosh, Souradip;Apostolakis, Sotiris;Xu, Ziyang;Tan, Zujun;Chaturvedi, Ishita;Homerding, Brian
• 通讯作者: Homerding, Brian

WARDen: Specializing Cache Coherence for High-Level Parallel Languages

WARDen：专门针对高级并行语言的缓存一致性

• DOI: 10.1145/3579990.3580013
• 发表时间: 2023
• 期刊: Proceedings of the 21st ACM/IEEE International Symposium on Code Generation and Optimization
• 作者: Wilkins, Michael;Westrick, Sam;Kandiah, Vijay;Bernat, Alex;Suchy, Brian;Deiana, Enrico Armenio;Campanoni, Simone;Acar, Umut A.;Dinda, Peter;Hardavellas, Nikos
• 通讯作者: Hardavellas, Nikos

Coalescent computing

• DOI: 10.1145/3476886.3477503
• 发表时间: 2021-04
• 期刊: Proceedings of the 12th ACM SIGOPS Asia-Pacific Workshop on Systems
• 作者: Kyle C. Hale

Parsimony: Enabling SIMD/Vector Programming in Standard Compiler Flows

简约：在标准编译器流程中启用 SIMD/向量编程

• DOI: 10.1145/3579990.3580019
• 发表时间: 2023
• 期刊: Proceedings of the 21st ACM/IEEE International Symposium on Code Generation and Optimization
• 作者: Kandiah, Vijay;Lustig, Daniel;Villa, Oreste;Nellans, David;Hardavellas, Nikos
• 通讯作者: Hardavellas, Nikos

Program State Element Characterization

程序状态元素表征

• DOI: 10.1145/3579990.3580011
• 发表时间: 2023
• 期刊: International Symposium on Code Generation and Optimization
• 作者: Deiana, Enrico Armenio;Suchy, Brian;Wilkins, Michael;Homerding, Brian;McMichen, Tommy;Dunajewski, Katarzyna;Dinda, Peter;Hardavellas, Nikos;Campanoni, Simone
• 通讯作者: Campanoni, Simone