CSR: Small: Data Parallel Frameworks for Large-scale Machine Learning through Sync-on-the-Fly

CSR：小型：通过即时同步实现大规模机器学习的数据并行框架

• 批准号: 1815412
• 负责人: Lixin Gao
• 金额: $ 49万
• 依托单位: University of Massachusetts Amherst
• 依托单位国家: 美国
• 项目类别: Standard Grant
• 财政年份: 2018
• 资助国家: 美国
• 起止时间: 2018-10-01 至 2023-09-30
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=1815412&HistoricalAwards=false
• 关键词: CSR; Small; Data; Parallel; Frameworks

The advances in sensing, storage, and networking technologies have led to the collections of high-volume, high-dimensional data. Making sense of these data is critical for companies and organizations to make better business decisions, to bring convenience to our daily life, and even enable better health through biological information and drug discovery. Recent advances in machine learning have led to a flurry of data analytic techniques that typically require an iterative refinement process. However, the massive amount of data involved and potentially numerous iterations required make performing data analytics in a timely manner challenging.This project aims to design and implement a data parallel programming framework called Sync-on-the-fly. The framework enables machine learning computations within cloud computing environments to establish synchronization barriers during the execution of the computations. Since synchronization barriers are established for building consistent model parameters, they do not need to be predefined. The barriers can be established during the computation based on the progress of the computation. This data parallel programming model preserves the semantics of machine learning algorithms. The goals are to build theoretical foundations and create efficient distributed frameworks for a series of well-known machine learning algorithms, and establish the programming models for these computations.The technologies developed from this project will have immediate important applications on road traffic prediction, biological information discovery, online marketing, and computer forensic analysis. This project will bring fast, accurate, and cost-effective processing of massive data to users. This project will also train new graduate engineers in distributed framework design, machine learning algorithms, and big data analytics. All of these skillsets are in broad demand in US industry.The data and software codes produced for the distributed framework and distributed machine learning algorithms will be made publicly available at the research website http://rio.ecs.umass.edu/html/research/index.html. The website will be retained for at least three years after the conclusion of the project.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.

传感、存储和网络技术的进步导致了海量、高维数据的收集。理解这些数据对于公司和组织做出更好的业务决策、为我们的日常生活带来便利，甚至通过生物信息和药物发现实现更好的健康至关重要。机器学习的最新进展催生了一系列通常需要迭代细化过程的数据分析技术。然而，所涉及的大量数据以及可能需要的大量迭代使得及时执行数据分析变得具有挑战性。该项目旨在设计和实现称为同步同步的数据并行编程框架。 该框架使云计算环境中的机器学习计算能够在计算执行期间建立同步屏障。由于同步障碍是为了构建一致的模型参数而建立的，因此不需要预定义它们。 可以在计算过程中根据计算的进度来建立障碍。这种数据并行编程模型保留了机器学习算法的语义。目标是为一系列著名的机器学习算法建立理论基础和创建高效的分布式框架，并建立这些计算的编程模型。该项目开发的技术将在道路交通预测、生物信息等方面产生直接的重要应用。发现、在线营销和计算机取证分析。该项目将为用户带来海量数据的快速、准确、经济高效的处理。该项目还将培训分布式框架设计、机器学习算法和大数据分析方面的新研究生工程师。所有这些技能在美国工业界都有广泛的需求。为分布式框架和分布式机器学习算法生成的数据和软件代码将在研究网站http://rio.ecs.umass.edu/html/上公开提供研究/index.html。该网站将在项目结束后保留​​至少三年。该奖项反映了 NSF 的法定使命，并通过使用基金会的智力价值和更广泛的影响审查标准进行评估，被认为值得支持。

项目成果

A Proactive Data-Parallel Framework for Machine Learning

• DOI: 10.1145/3492324.3494167
• 发表时间: 2021-12
• 期刊: Proceedings of the 2021 IEEE/ACM 8th International Conference on Big Data Computing, Applications and Technologies
• 作者: Guoyi Zhao;Tian Zhou;Lixin Gao

MOTrack: Real-time Configuration Adaptation for Video Analytics through Movement Tracking

MOTrack：通过运动跟踪进行视频分析的实时配置调整

• 发表时间: 2021
• 期刊: Spain.
• 作者: Fubao Wu, Lixin Gao

Guoyi Zhao, Tian Zhou, and Lixin Gao

赵国义、周田、高立新

• 发表时间: 2021
• 期刊: 2021 IEEE International Conference on Big Data
• 作者: Guoyi Zhao, Tian Zhou

Scalable Top-k Query on Information Networks with Hierarchical Inheritance Relations

• DOI: 10.1007/s10619-023-07432-2
• 发表时间: 2020-06
• 期刊: Distributed Parallel Databases
• 作者: Fubao Wu;Lixin Gao

A Fault-Tolerant Distributed Framework for Asynchronous Iterative Computations

• DOI: 10.1109/tpds.2021.3059420
• 发表时间: 2021-08
• 期刊: IEEE Transactions on Parallel and Distributed Systems
• 影响因子: 5.3
• 作者: Tian Zhou;Lixin Gao;X. Guan