CRII: SHF: A Compiler and Runtime Infrastructure for Flexible Scheduling and Scheduling-Enabled Optimizations on GPUs

CRII：SHF：用于 GPU 上灵活调度和启用调度优化的编译器和运行时基础架构

• 批准号: 1464216
• 负责人: Bo Wu
• 金额: $ 17.5万
• 依托单位: Colorado School of Mines
• 依托单位国家: 美国
• 项目类别: Standard Grant
• 财政年份: 2015
• 资助国家: 美国
• 起止时间: 2015-03-01 至 2018-02-28
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=1464216&HistoricalAwards=false
• 关键词: CRII; SHF; Compiler; Runtime; Infrastructure

Title: CRII:SHF: A Compiler and Runtime Infrastructure for Flexible Scheduling and Scheduling-Enabled Optimizations on GPUsThe computing power of a GPU (Graphics Processing Unit) lies in its abundant memory bandwidth and massive parallelism. However, its hardware thread schedulers, despite being able to quickly distribute computation to processors, often fail to capitalize on program characteristics effectively, achieving only a fraction of the GPUs' full potential. Moreover, current GPUs do not allow programmers or compilers to control thread scheduling, forfeiting important optimization opportunities at the program level. This research aims to develop a new software-level infrastructure for flexible scheduling and scheduling-enabled optimizations on GPUs. The intellectual merits of the research are two-fold: 1) It develops compiler techniques to circumvent the restrictions from the hardware thread scheduler, which enable programmers or the runtime to flexibly schedule tasks to the GPU processors; 2) It designs runtime optimizations to leverage the flexible scheduling. The project's broader significance and importance are that it provides essential support enhancing the computing efficiency of data-intensive applications in the era of GPU computing and, due to the importance of these applications, fosters sustained advances in science, engineering, humanity, and health.The project designs a code transformation component to enable flexible scheduling. The transformation, named SM (Streaming Multiprocessor)-centric transformation, consists of two techniques. The first technique is SM-centric task selection, which breaks the mapping between tasks and thread blocks and directly associates tasks with processors. The second technique is a filling and retreating scheme, which addresses some behaviors of the hardware scheduler and flexibly controls the number of active tasks for each processor. The project also designs three types of optimizations, namely parallelism control, affinity-based scheduling, and processor partitioning, which leverage the scheduling support to optimize for parallelism, locality, and resource allocation. The project develops both static and dynamic approaches to efficiently searching for the optimal scheduling strategies adapted to address various program and input features.

标题：CRII：SHF：用于灵活的调度和启用计划的GPUS的编译器和运行时基础架构，该GPU（图形处理单元）的计算能力在其丰富的内存带宽和巨大的并行性中。但是，尽管能够将计算快速分发给处理器，但其硬件线程调度程序通常无法有效地利用程序特征，仅实现了GPU的全部潜力的一小部分。此外，当前的GPU不允许程序员或编译器控制线程调度，从而在程序级别放弃了重要的优化机会。这项研究旨在开发一种新的软件级基础架构，以在GPU上进行灵活的计划和计划的优化。研究的智力优点是两个方面：1）它开发了编译器技术来规避硬件线程调度程序的限制，这使程序员或运行时可以灵活地将任务安排到GPU处理器； 2）它设计运行时优化以利用灵活的调度。该项目更广泛的意义和重要性是，它提供了基本的支持，从而提高了GPU计算时代数据密集型应用程序的计算效率，并且由于这些应用的重要性，促进了科学，工程，人性和健康方面的持续进展。项目代码转换组件以启用灵活的日程安排。转换为SM（流多处理器） - 中心转换，由两种技术组成。第一个技术是以SM为中心的任务选择，它打破了任务和线程块之间的映射，并将任务与处理器直接关联。第二种技术是一种填充和撤退方案，它解决了硬件调度程序的某些行为，并灵活地控制每个处理器的活动任务数量。该项目还设计了三种类型的优化，即并行性控制，基于亲和力的调度和处理器分区，它们利用计划支持来优化并行性，局部性和资源分配。该项目开发了静态和动态方法，以有效地搜索适合解决各种程序和输入功能的最佳调度策略。