SHF: Small: Holistic Design of High-performance and Energy-efficient Accelerators for Graph Neural Networks

SHF：小型：图神经网络高性能、高能效加速器的整体设计

基本信息

批准号：
2131946
负责人：
Ahmed Louri
金额：
$ 50万
依托单位：
George Washington University
依托单位国家：
美国
项目类别：
Standard Grant
财政年份：
2021
资助国家：
美国
起止时间：
2021-10-01 至 2024-09-30
项目状态：
已结题

来源：
https://www.nsf.gov/awardsearch/showAward?AWD_ID=2131946&HistoricalAwards=false
关键词：
SHF Small Holistic Design performance

项目摘要

Graph Neural Networks (GNNs) have emerged as one of the most powerful techniques for next-generation learning systems, and are gaining attention in many high-impact domains such as graph mining (graph machine, graph clustering), biology (drug discovery, disease classification), traffic networks (traffic prediction), recommendation systems (user-item prediction, social recommendation), e-commerce analysis, stock market prediction, natural language processing (text classification, neural machine translation), image processing (image classification, object detection, semantic segmentation), and autonomous systems, among many others. The explosive growth of these applications has created an enormous demand for customized accelerator design to satisfy the computational requirements of GNNs, since many of these applications require high-throughput and energy-efficient GNN inference. Conventional deep neural network (DNN) accelerators cannot efficiently process GNNs due to the combination of irregular memory accesses, dynamic parallelism imposed by the graph structure, and the dense computation in learning algorithms. This project addresses these challenges with a holistic design framework spanning architecture study, Network-on-Chip (NoC) design, machine-learning algorithms development, and algorithm-architecture co-optimization with the aim of designing energy-efficient and high-performance accelerator architectures for GNNs. The cross-cutting nature of this project will offer valuable insights and solutions to many critical problems in GNN accelerator design. The research will also play a major role in education by integrating discovery with teaching and training. The outcomes of this project will be widely disseminated to researchers, engineers, and educators through technical publications and presentations. The goal of this project is to develop GNN accelerators with much-improved performance and energy efficiency for a wide variety of graph-based machine learning applications. To achieve this goal, this project proposes: (1) the design of a morphable GNN accelerator architecture and a reconfigurable NoC to satisfy the computational demands of various GNNs, (2) the development of a GNN accelerator/algorithm co-optimization exploration framework to maximize both inference accuracy and performance (latency, area, energy, etc.) for given graph-based machine learning tasks, (3) the development of an extensive modeling and simulation framework for GNN accelerators that will be used to validate the proposed design approach, and (4) the implementation of a small-scale prototype of the proposed accelerator using Field Programmable Gate Arrays (FPGAs) and its application to real-world problems. This timely research will greatly advance the state-of-the-art of GNN acceleration, benefit both the computing and machine-learning communities, and provide strong implications on advancements in society and the US computing industry-at-large.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.

图神经网络 (GNN) 已成为下一代学习系统最强大的技术之一，并在许多高影响力领域受到关注，例如图挖掘（图机器、图聚类）、生物学（药物发现、疾病）分类）、流量网络（流量预测）、推荐系统（用户项目预测、社交推荐）、电子商务分析、股市预测、自然语言处理（文本分类、神经机器翻译）、图像处理（图像分类、对象检测、语义分割），和自治系统等等。这些应用的爆炸式增长产生了对定制加速器设计的巨大需求，以满足 GNN 的计算要求，因为其中许多应用需要高吞吐量和节能的 GNN 推理。由于不规则的内存访问、图结构带来的动态并行性以及学习算法中的密集计算，传统的深度神经网络（DNN）加速器无法有效地处理 GNN。该项目通过涵盖架构研究、片上网络 (NoC) 设计、机器学习算法开发和算法架构协同优化的整体设计框架来应对这些挑战，旨在设计节能和高性能加速器GNN 的架构。该项目的跨领域性质将为 GNN 加速器设计中的许多关键问题提供有价值的见解和解决方案。该研究还将发现与教学和培训相结合，在教育中发挥重要作用。该项目的成果将通过技术出版物和演示文稿广泛传播给研究人员、工程师和教育工作者。该项目的目标是为各种基于图的机器学习应用开发性能和能效显着提高的 GNN 加速器。为了实现这一目标，该项目提出：（1）设计可变形的GNN加速器架构和可重构的片上网络（NoC），以满足各种GNN的计算需求，（2）开发GNN加速器/算法协同优化探索框架，以满足各种GNN的计算需求。最大限度地提高给定的基于图的机器学习任务的推理准确性和性能（延迟、面积、能量等），(3) 为 GNN 加速器开发广泛的建模和模拟框架，该框架将用于验证所提出的设计方法，以及（4）使用现场可编程门阵列（FPGA）实现所提出的加速器的小规模原型及其在实际问题中的应用。这项及时的研究将极大地推进 GNN 加速的最先进水平，使计算和机器学习社区受益，并对社会和整个美国计算行业的进步产生重大影响。该奖项反映了 NSF 的法定使命，并通过使用基金会的智力价值和更广泛的影响审查标准进行评估，被认为值得支持。