Collaborative Research: SHF: Small: Towards Robust Deep Learning Computing on GPUs

合作研究：SHF：小型：在 GPU 上实现稳健的深度学习计算

• 批准号: 2114519
• 负责人: Nima Karimian
• 金额: $ 16.02万
• 依托单位: San Jose State University Foundation
• 依托单位国家: 美国
• 项目类别: Standard Grant
• 财政年份: 2021
• 资助国家: 美国
• 起止时间: 2021-10-01 至 2022-12-31
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=2114519&HistoricalAwards=false
• 关键词: Collaborative; Research; SHF; Small; Towards

Graphics processing units (GPU) have become one of the most promising computing engines in many application domains such as scientific simulations and deep learning. With the massive parallel processing power provided by GPUs, most of the state-of-the-art server and edge systems employ GPUs as the core computing engines for deep-learning model training and inference. As the performance of deep learning models becomes one of the most important delimiters that determines market revenue of the model creators and the convenience of daily lives of model consumers, it is critical to enforce reliable and robust deep-learning computation. This project aims to explore the challenges and opportunities to address the reliability and privacy implications of GPU computing as a deep-learning accelerator and design lightweight protection schemes.The technical aims of this project are divided into three thrusts. The first thrust explores and evaluates possible vulnerabilities and their impact on GPU-based deep-learning computing. The second thrust tackles the vulnerabilities at the compute-unit level by redesigning GPU building blocks, such as new scheduling algorithms and activation acceleration logic. The third thrust explores selective integrity protection mechanisms in communication channels and memory subsystems to transfer data between the CPU and GPU without imposing significant performance overhead. The proposed solutions will mitigate architectural and system vulnerabilities in GPU-based deep learning computing, which will enable the deep learning algorithm developers to focus more on performance improvement and technological advancement, and the consumers to use deep learning-based cognitive products without privacy concerns. The findings of this research will be integrated into undergraduate and graduate courses as well as various outreach activities on K-12 education, and publicly shared through open-source repositories.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.

图形处理单元（GPU）已成为科学模拟和深度学习等许多应用领域最有前途的计算引擎之一。凭借 GPU 提供的大规模并行处理能力，大多数最先进的服务器和边缘系统都采用 GPU 作为深度学习模型训练和推理的核心计算引擎。随着深度学习模型的性能成为决定模型创建者的市场收入和模型消费者日常生活便利性的最重要的限制因素之一，执行可靠和鲁棒的深度学习计算至关重要。该项目旨在探索解决 GPU 计算作为深度学习加速器的可靠性和隐私影响的挑战和机遇，并设计轻量级保护方案。该项目的技术目标分为三个主旨。第一个重点是探索和评估可能的漏洞及其对基于 GPU 的深度学习计算的影响。第二个重点是通过重新设计 GPU 构建块（例如新的调度算法和激活加速逻辑）来解决计算单元级别的漏洞。第三个重点探索通信通道和内存子系统中的选择性完整性保护机制，以便在 CPU 和 GPU 之间传输数据，而不会造成显着的性能开销。所提出的解决方案将缓解基于GPU的深度学习计算的架构和系统漏洞，使深度学习算法开发人员能够更加关注性能改进和技术进步，并使消费者能够使用基于深度学习的认知产品而无需担心隐私问题。这项研究的结果将被纳入本科生和研究生课程以及 K-12 教育的各种推广活动中，并通过开源存储库公开共享。该奖项反映了 NSF 的法定使命，并通过使用评估结果被认为值得支持。基金会的智力价值和更广泛的影响审查标准。