SPX: Collaborative Research: Cross-stack Memory Optimizations for Boosting I/O Performance of Deep Learning HPC Applications

SPX：协作研究：用于提升深度学习 HPC 应用程序 I/O 性能的跨堆栈内存优化

• 批准号: 1919113
• 负责人: Ali Butt
• 金额: $ 95.29万
• 依托单位: Virginia Polytechnic Institute and State University
• 依托单位国家: 美国
• 项目类别: Standard Grant
• 财政年份: 2019
• 资助国家: 美国
• 起止时间: 2019-10-01 至 2024-09-30
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=1919113&HistoricalAwards=false
• 关键词: SPX; Collaborative; Research; Cross; stack

New computing applications are emerging in smart networks, scientific explorations, business management, security, and healthcare. These applications depend on very large amounts of data. This data must be used in a fast and efficient manner. The use of large supercomputers to analyze such data is on the rise. The techniques they use are referred to as deep learning (DL) high-performance computing (HPC). Researchers are using DL HPC to make sense of this flood of data and obtain useful information. To do this they must redesign HPC systems. A key challenge is how to use resources such as data storage and computer memory at a huge scale. This project will build Metis, a high-performance data storage system that uses new, end-to-end, hardware-supported memory and storage design to meet the needs of DL HPC applications. The goal is to satisfy the challenge posed by increasing data management performance for next-generation supercomputers. The project will connect several different computing communities and increase interactions among them. The project includes educational and engagement activities which will greatly increase the community's understanding of HPC systems. These activities include broadening participation activities to attract and retain new students. Special emphasis will be given to students from underrepresented groups. The project will encourage student interest in design and research in large-scale computing systems design.This project brings together researchers in micro-architecture, distributed computing systems, namely cloud and HPC systems, storage systems, and power/energy modeling to boost DL HPC data processing performance. The research will yield a fundamentally new software-hardware co-designed memory compression technique that transparently compresses DL application memories with negligible runtime performance overhead. Metis will leverage the novel compression substrate to enable a distributed, intelligent, operating-system-level data cache that effectively exploits the physical memory freed via program-memory compression. The developed techniques will open doors for innovative HPC and scientific applications in a broad range of disciplines, which have not been previously possible. Metis' focus on addressing the challenges of increasing performance in the Exascale era, along with engaging researchers from multiple areas, aligns it very well with the goals and objectives of the SPX program. Additionally, the research will also create new knowledge on design principles of memory compression, and yield insights to provide seamless integration of DL applications into the next-generation DL-aware supercomputer infrastructure.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.

项目成果

Towards a Serverless Bioinformatics Cyberinfrastructure Pipeline

• DOI: 10.1145/3452413.3464787
• 发表时间: 2020-06
• 期刊: Proceedings of the 1st Workshop on High Performance Serverless Computing
• 作者: S. Yao;Muhammad Ali Gulzar;Liqing Zhang;A. Butt

Application-Attuned Memory Management for Containerized HPC Workflows

• 作者: †. MoizArif;†. AvinashMaurya;†. M.MustafaRafique;Dimitrios S. Nikolopoulos;A. R. Butt

In Search of a Fast and Efficient Serverless DAG Engine

• DOI: 10.1109/pdsw49588.2019.00005
• 发表时间: 2019-10
• 期刊: 2019 IEEE/ACM Fourth International Parallel Data Systems Workshop (PDSW)
• 作者: Benjamin Carver;Jingyuan Zhang;Ao Wang;Yue Cheng

Heterogeneity-Aware Adaptive Federated Learning Scheduling

• DOI: 10.1109/bigdata55660.2022.10020721
• 发表时间: 2022-12
• 期刊: 2022 IEEE International Conference on Big Data (Big Data)
• 作者: Jingoo Han;Ahmad Faraz Khan;Syed Zawad;A. Anwar;Nathalie Baracaldo Angel;Yi Zhou;Feng Yan;A. Butt

Towards Efficient Python Interpreter for Tiered Memory Systems

面向分层内存系统的高效 Python 解释器

• 发表时间: 2024
• 期刊: Poster and Work-in-Progress in Proceedings of the 21st USENIX Conference on File and Storage Technologies (FAST
• 作者: Li, Yuze;Yao, Shunyu;Mobin, Jaiaid;Rafique, M. Mustafa;Nikolopoulos, Dimitrios;Sundararajah, Kirshanthan;Li, Huaicheng;Butt, Ali R.
• 通讯作者: Butt, Ali R.