SHF: Small: Automatic, adaptive and massive parallel data processing on GPU/RDMA clusters in both synchronous and asynchronous modes

SHF：小型：在同步和异步模式下在 GPU/RDMA 集群上自动、自适应和大规模并行数据处理

• 批准号: 2005884
• 负责人: Xiaodong Zhang
• 金额: $ 45万
• 依托单位: Ohio State University
• 依托单位国家: 美国
• 项目类别: Standard Grant
• 财政年份: 2020
• 资助国家: 美国
• 起止时间: 2020-07-01 至 2024-06-30
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=2005884&HistoricalAwards=false
• 关键词: SHF; Small; Automatic; adaptive; massive

The computing ecosystem in both hardware and software is in a critical transition time, coming from several technology crises and inevitable trends. First, the continued performance improvement in general-purpose processors is no longer realistic. Second, conventional processors are increasingly inefficient in both performance and power consumption for various data-intensive applications. Finally, the deep software stack that has been developed for several decades, from instruction-set architecture all the way to the programming layer in the existing ecosystem, has added cumbersome processing and even unnecessary overhead in computing. To address the above-mentioned issues, this project remedies the computing ecosystem in an accelerator-based way. GPU (Graphic Processing Unit) and RDMA (Remote Data Memory Access) are the two external hardware accelerators considered in the project. It aims to turn efficient asynchronous computing into a reality on clusters of hardware accelerators of GPU and RDMA adaptively and automatically by removing three technical barriers in the existing ecosystem: (1) the programming-model barrier, (2) the hardware abstraction barrier, and (3) the automation barrier. The project strives to make broad and transformational impact. It is expected to influence the data-processing research community with new algorithms and effective systems implementation, and influence industries to improve their production systems in their daily computing operations serving society. The developed algorithms, source code and measurements are available online for a public and wide usage, benefiting both industrial and academic researchers. The research training to both undergraduate and graduate students address the concerns of lacking hardware-acceleration and data-analytics professionals in information technology and computing industries. The curriculum development introduces related research results to classrooms and the outreach activities encourage high school students to be interested in computing related college education. The existing computing environment does not provide programming models for asynchronous execution. It is even harder for asynchronous programming on GPU/RDMA clusters. The execution-model difference between CPUs and GPUs makes the system lack a common hardware abstraction for GPU computing and for RDMA communication and management. Asynchronous programming is hard, and an automatic tool to ensure its correctness and efficiency is highly desirable. This research project bridges the gap between asynchronous computing and GPU/RDMA. It develops an autonomous memory pool (AMP) interfacing GPU/RDMA clusters, where an intermediate representation is proposed to abstract the GPU execution and AMP constructed by an RDMA. A set of intermediate representations are developed to support asynchronous programming, so that users can easily express asynchronous computing in programming. In addition, an intermediate representation is developed to allow conventional synchronous programming to become automated asynchronous execution code. The system is tested and evaluated using representative data-processing workloads on large GPU/RDMA clusters.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.

硬件和软件中的计算生态系统都来自几个技术危机和不可避免的趋势。首先，通用处理器的持续性能不再是现实的。其次，对于各种数据密集型应用程序，传统处理器的性能和功耗越来越低效率。最后，已经开发了几十年的深度软件堆栈，从教学集架构一直到现有生态系统中的编程层，都增加了繁琐的处理，甚至是计算中不必要的开销。为了解决上述问题，该项目以基于加速器的方式来补救计算生态系统。 GPU（图形处理单元）和RDMA（远程数据存储器访问）是项目中考虑的两个外部硬件加速器。它的目的是将有效的异步计算变成现实的GPU和RDMA硬件加速器簇，并通过删除现有生态系统中的三个技术障碍来自动自动自动：（1）编程模式屏障，（2）硬件抽象障碍物，以及（3）自动化障碍物。该项目致力于产生广泛而变革的影响。预计它将通过新算法和有效的系统实施影响数据处理研究社区，并影响行业以在为社会服务的日常计算运营中改善其生产系统。已开发的算法，源代码和测量可用于公共和广泛使用，从而使工业和学术研究人员受益。对本科和研究生的研究培训都解决了信息技术和计算行业缺乏硬件加速和数据分析专业人员的关注。课程开发将相关的研究结果引入教室，而外展活动鼓励高中生对计算相关的大学教育感兴趣。现有的计算环境不能为异步执行提供编程模型。在GPU/RDMA簇上的异步编程更加困难。 CPU和GPU之间的执行模式差异使该系统缺乏用于GPU计算以及RDMA通信和管理的常见硬件抽象。异步编程很难，并且是确保其正确性和效率的自动工具。该研究项目弥合了异步计算与GPU/RDMA之间的差距。它开发了一个自主内存池（AMP）接口GPU/RDMA群集，其中提出了一个中间表示来抽象GPU执行和由RDMA构建的AMP。开发了一组中间表示以支持异步编程，以便用户可以轻松地在编程中表达异步计算。此外，开发了一个中间表示，以允许常规同步编程成为自动化异步执行代码。该系统使用大型GPU/RDMA群集上的代表性数据处理工作负载进行了测试和评估。该奖项反映了NSF的法定任务，并且使用基金会的知识分子优点和更广泛的影响审查标准，被认为值得通过评估。

项目成果

Automating Incremental and Asynchronous Evaluation for Recursive Aggregate Data Processing

• DOI: 10.1145/3318464.3389712
• 发表时间: 2020-05
• 期刊: Proceedings of the 2020 ACM SIGMOD International Conference on Management of Data
• 作者: Qiange Wang;Yanfeng Zhang;Hao Wang;Liang Geng;Rubao Lee;Xiaodong Zhang;Ge Yu

DBSpinner: Making a Case for Iterative Processing in Databases

• DOI: 10.1109/icde51399.2021.00273
• 发表时间: 2021-04
• 期刊: 2021 IEEE 37th International Conference on Data Engineering (ICDE)
• 作者: Sofoklis Floratos;A. Ghazal;Jason Sun;Jianjun Chen;Xiaodong Zhang

Mixer: Efficiently Understanding and Retrieving Visual Content at Web-Scale

• DOI: 10.14778/3476311.3476371
• 发表时间: 2021-07
• 期刊: Proc. VLDB Endow.
• 作者: Mengbai Xiao;An Qin;Yongwei Wu;Xinjie Huang;Xiaodong Zhang

Maze: A Cost-Efficient Video Deduplication System at Web-scale

• DOI: 10.1145/3503161.3548145
• 发表时间: 2022-10
• 期刊: Proceedings of the 30th ACM International Conference on Multimedia
• 作者: An Qin;Mengbai Xiao;Ben Huang;Xiaodong Zhang

An RDMA-enabled In-memory Computing Platform for R-tree on Clusters

• DOI: 10.1145/3503513
• 发表时间: 2022-02
• 期刊: ACM Transactions on Spatial Algorithms and Systems (TSAS)
• 作者: Mengbai Xiao;Hao Wang-;Liang Geng;Rubao Lee;Xiaodong Zhang