Collaborative Research: SHF: Medium: EPIC: Exploiting Photonic Interconnects for Resilient Data Communication and Acceleration in Energy-Efficient Chiplet-based Architectures

合作研究：SHF：中：EPIC：利用光子互连实现基于节能 Chiplet 的架构中的弹性数据通信和加速

• 批准号: 2311543
• 负责人: Ahmed Louri
• 金额: $ 60万
• 依托单位: George Washington University
• 依托单位国家: 美国
• 项目类别: Continuing Grant
• 财政年份: 2023
• 资助国家: 美国
• 起止时间: 2023-08-01 至 2027-07-31
• 项目状态: 未结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=2311543&HistoricalAwards=false
• 关键词: Collaborative; Research; SHF; Medium; EPIC

The on-chip communication fabric connecting the cores, accelerators and the memory in chiplet-based architectures consumes a significant amount of power today and must be designed to not only provide adequate connectivity and performance, but also be very energy efficient and scalable, to satisfy future computing demands. Silicon photonics has the potential to alleviate some of the on-chip communication problems thanks to better performance-per-watt and higher bandwidth density. A key issue in addressing this design challenge today is the under-utilization of the expensive silicon photonics technology due to temporal and spatial fluctuation of traffic patterns. To make silicon photonics practical and viable, re-purposing the under-utilized resources for computation can speed up application execution and provide much-needed energy-efficient data transfers. The proposed research is timely and vital for the continued growth of chiplet-based heterogeneous manycore architectures. It is an organized effort that combines recent advances in technology, architecture, application, and machine learning into a promising integrated approach that will tackle one of the most critical challenges of computing systems of the future, namely the design of next-generation communication fabrics for high-performance, energy-efficient and scalable heterogeneous architectures with much-increased functionality and flexibility. All the research findings and simulation toolkits will be disseminated to the community via conference and journal publications, and a dedicated website. The research will also play a major role in education by integrating discovery with teaching and training. This research will continue to expand on outreach activities and broadening participation in computing by making the necessary efforts to attract and train underrepresented and minority students in this field. This research will design a novel, dual-purpose photonic fabric that will not only enable power-efficient and scalable on-chip communications for heterogeneous multicores but will also function as a cost-efficient and high-performance neural network accelerator for diverse applications. The crux of the idea is to: (1) provide high-bandwidth and power-efficient data transfer between cores and accelerators during high network load, and (2) off-load key accelerator functions to the same network during low network load to maximize resource utilization and speedup computation, hence the dual-purpose nature of the photonic fabric. It is expected that the combined effects of meticulously orchestrating data communication (on-chip and off-chip), sharing hardware resources between communication and computation, and implementing optical neural computations will provide an extremely power-efficient and scalable platform for next-generation heterogeneous chiplet-based architectures. This research will result in (1) novel photonic architectures that can be leveraged for computing and communication simultaneously, (2) a fundamental understanding of photonic computation for implementing accelerator functions, (3) hardware techniques for photonic architectures to dynamically adapt to application demands to maximize the power-efficiency and improve resiliency, and (4) proof-of-concept and open-source tools that will expand and enhance the research capabilities of the computer architecture community in this critical area.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.

如今，在基于小芯片的架构中连接内核、加速器和存储器的片上通信结构消耗大量功率，其设计必须不仅提供足够的连接性和性能，而且还必须非常节能和可扩展，以满足未来的计算需求。由于更好的每瓦性能和更高的带宽密度，硅光子有可能缓解一些片上通信问题。当今解决这一设计挑战的一个关键问题是由于流量模式的时间和空间波动而导致昂贵的硅光子技术的利用不足。为了使硅光子学变得实用和可行，重新利用未充分利用的计算资源可以加快应用程序的执行速度并提供急需的节能数据传输。所提出的研究对于基于小芯片的异构众核架构的持续增长是及时且至关重要的。这是一项有组织的工作，将技术、架构、应用程序和机器学习方面的最新进展结合成一种有前途的集成方法，该方法将解决未来计算系统最关键的挑战之一，即下一代通信结构的设计高性能、节能和可扩展的异构架构，功能和灵活性大大增强。所有研究成果和模拟工具包将通过会议和期刊出版物以及专门网站向社区传播。该研究还将发现与教学和培训相结合，在教育中发挥重要作用。这项研究将继续扩大外展活动，并通过做出必要的努力吸引和培训该领域的代表性不足和少数族裔学生，扩大计算机领域的参与。这项研究将设计一种新颖的双用途光子结构，它不仅可以实现异构多核的高能效和可扩展的片上通信，而且还可以作为各种应用的经济高效和高性能的神经网络加速器。该想法的关键在于：(1) 在高网络负载期间在内核和加速器之间提供高带宽和高能效的数据传输，以及 (2) 在低网络负载期间将关键加速器功能卸载到同一网络，以最大化资源利用和加速计算，因此光子结构具有双重用途。预计精心编排数据通信（片内和片外）、在通信和计算之间共享硬件资源以及实施光神经计算的综合效果将为下一代异构网络提供极其节能和可扩展的平台。基于小芯片的架构。这项研究将产生（1）可同时用于计算和通信的新型光子架构，（2）对用于实现加速器功能的光子计算的基本理解，（3）用于动态适应应用需求的光子架构的硬件技术最大限度地提高能效并提高弹性，以及 (4) 概念验证和开源工具，将扩展和增强计算机体系结构社区在这一关键领域的研究能力。该奖项反映了 NSF 的法定使命，并已被视为值得通过使用基金会的智力优势和更广泛的影响审查标准进行评估来提供支持。