CAREER: An Agile Compiler Framework for Spatial Dataflow Accelerators

职业：空间数据流加速器的敏捷编译器框架

• 批准号: 2338739
• 负责人: Thirimadura Mendis
• 金额: $ 52.5万
• 依托单位: University of Illinois at Urbana-Champaign
• 依托单位国家: 美国
• 项目类别: Continuing Grant
• 财政年份: 2024
• 资助国家: 美国
• 起止时间: 2024-02-01 至 2029-01-31
• 项目状态: 未结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=2338739&HistoricalAwards=false
• 关键词: CAREER; Agile; Compiler; Framework; Spatial

In the era of large machine learning models, hardware accelerators play a key role in achieving fast and scalable training and inference performance. Among them, spatial dataflow accelerators (SDA), such as tensor processing units, have been extremely successful at accelerating demanding neural network workloads. Subsequently, many diverse accelerator platforms have been introduced with heavily programmable interfaces. In spite of these advances in hardware, compilers have been lagging behind, having only limited support for these accelerators. The current approach of manually constructing compiler backends is not sustainable with diverse and rapidly evolving accelerators. The project’s novelty is a set of automated and parameterized compiler construction methodologies that can generate optimized code targeting a wide array of spatial dataflow accelerator designs. The project’s impact is enabling hardware designers to rapidly build optimizing compilers for novel emerging architectures, which in turn will democratize the usage of new hardware platforms for accelerating diverse machine learning workloads. The investigator’s integrated education plan creates a novel machine learning compilers course that integrates formalisms, compilation techniques, and machine learning for compilers topics explored in this project. This new course offering prepares students with the necessary knowledge to succeed in careers that involve designing and maintaining compilers for hardware-accelerated machine learning workloads. The investigator plans to open source both the code and the data with public competitions, publish academic papers, collaborate with key industry partners with the possibility of technology transfers, hold academic workshops, and increase undergraduate participation to broaden the impact of the proposed research activities.The project explores novel automated compiler construction methodologies that are suitable for emerging SDAs. Compared to established commodity hardware platforms, emerging SDAs are more diverse, have faster design iteration cycles, and have expensive execution modalities. The project investigates novel techniques tackling three different aspects of backend code generation by synergistically innovating in both formal methods and machine learning fronts that can cater to the aforementioned characteristics of SDAs. First, it develops parametric representations and formalisms of tensor compiler intermediate representations (IR) and SDA descriptions. It uses these to automatically generate code generators specialized to each SDA. Second, the project develops innovative solutions that require significantly less target data to transfer learned cost models from mature accelerators. Finally, the project explores novel multi-fidelity optimization techniques that leverage different execution modalities to find faster auto-tuning solutions amidst expensive simulations. Successful completion of the project produces an agile compiler framework that can rapidly generate retargetable compiler backends for emerging spatial dataflow accelerators.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.

在大型机器学习模型时代，硬件加速器在实现快速、可扩展的训练和推理性能方面发挥着关键作用，其中，张量处理单元等空间数据流加速器（SDA）在加速要求苛刻的神经网络方面非常成功。随后，许多具有高度可编程接口的加速器平台被引入，尽管硬件方面取得了这些进步，但编译器仍然落后，目前对这些加速器的支持有限。手动构建编译器后端的方法对于多样化且快速发展的加速器来说是不可持续的。该项目的新颖之处在于一套自动化和参数化的编译器构建方法，可以生成针对各种空间数据流加速器设计的优化代码。该项目的影响是支持硬件。设计人员能够快速构建针对新型新兴架构的优化编译器，这反过来将使新硬件平台的使用民主化，以加速不同的机器学习工作负载。研究人员的综合教育计划创造了一种新颖的方法。机器学习编译器课程集成了本项目中探讨的编译器主题的形式主义、编译技术和机器学习，这门新课程为学生提供了在涉及设计和维护硬件加速机器学习工作负载的编译器的职业生涯中取得成功所需的知识。研究人员计划通过公开竞赛开源代码和数据，发表学术论文，与主要行业合作伙伴进行技术转让的合作，举办学术研讨会，并增加本科生的参与，以扩大拟议研究活动的影响。项目探索适合新兴 SDA 的新型自动化编译器构建方法，与已建立的商品硬件平台相比，新兴 SDA 更加多样化，具有更快的设计迭代周期，并且具有昂贵的执行模式。该项目研究了解决后端代码的三个不同方面的新技术。首先，它开发了张量编译器中间表示（IR）和SDA的参数表示和形式体系。其次，该项目开发了创新的解决方案，需要显着减少从成熟加速器传输学习成本模型的能力。该项目的成功完成产生了一个敏捷的编译器框架，可以为新兴的空间数据流加速器快速生成可重定向的编译器后端。该奖项反映了 NSF 的成就。法定使命，并通过使用基金会的智力优点和更广泛的影响审查标准进行评估，被认为值得支持。