CSR-PSCE, SM: MPI-PPA: Improving Efficiency of Large-Scale Clusters Through Statistical Performance Prediction

CSR-PSCE、SM：MPI-PPA：通过统计性能预测提高大规模集群的效率

• 批准号: 0834356
• 负责人: David Lowenthal
• 金额: $ 32万
• 依托单位: University of Georgia Research Foundation Inc
• 依托单位国家: 美国
• 项目类别: Continuing Grant
• 财政年份: 2008
• 资助国家: 美国
• 起止时间: 2008-09-01 至 2009-07-31
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=0834356&HistoricalAwards=false
• 关键词: CSR; PSCE; SM; MPI; PPA

This project develops a system that improves parallel efficiency on large numbers of processors - up to tens or hundreds of thousands - without running a program at scale. This system is called MPI-PPA: MPI Performance Prediction and Advisement. MPI-PPA takes as input a scientific computing application along with the input variables, including the desired number of processors, p. With executions on fewer than p processors only - so that these executions will occur quickly - MPI-PPA will produce a list of program phases that are predicted to achieve poor scalability, allowing the programmer to quickly address and possibly re-implement these phases - as well as a prediction for the entire program run.MPI-PPA makes these predictions using statistical regression to develop a prediction function that can be used with any number of processors. MPI-PPA will not require significant program comprehension, an important aspect when considering that computational scientists are typically experts in their scientific domain and not in computer science. The approach of MPI-PPA involves heavy reliance on statistical techniques, so the work in this project will be interdisciplinary between computer science (the PI) and statistics (the co-PI). MPI-PPA will be validated by using benchmark suites such as NAS and ASCI codes, along with large-scale applications - such as Paradis and Raptor - that are of interest to national labs.The broader impact of this work is multifold. First, MPI-PPA will be beneficial for computational scientists as well as cluster administrators. Among the benefits will be a simple and fast performance tuning system, an increase in overall cluster efficiency, and a reduction in response times for individual applications. The technology developed in this project will be transferred, in the form of performance tuning and prediction software, and made available to the public through cooperation with Lawrence Livermore National Laboratory. Second, more interdisciplinary interaction between statistics and computer science will be fostered through the supervised statistical consulting center at the University of Georgia. Third, efforts will continue recruiting students from strong historically black colleges and universities in the area, such as Morehouse University.

该项目开发了一个系统，可以提高大量处理器（多达数万或数十万）的并行效率，而无需大规模运行程序。该系统称为 MPI-PPA：MPI 性能预测和建议。 MPI-PPA 将科学计算应用程序以及输入变量（包括所需的处理器数量 p）作为输入。 仅在少于 p 个处理器上执行 - 因此这些执行将快速发生 - MPI-PPA 将生成预计将实现较差可扩展性的程序阶段列表，允许程序员快速解决并可能重新实现这些阶段 - 如以及对整个程序运行的预测。MPI-PPA 使用统计回归进行这些预测，以开发可与任意数量的处理器一起使用的预测函数。 MPI-PPA 不需要大量的程序理解，考虑到计算科学家通常是其科学领域而不是计算机科学领域的专家，这是一个重要的方面。 MPI-PPA 的方法严重依赖统计技术，因此该项目的工作将是计算机科学（PI）和统计学（co-PI）之间的跨学科工作。 MPI-PPA 将通过使用 NAS 和 ASCI 代码等基准套件以及国家实验室感兴趣的 Paradis 和 Raptor 等大型应用程序进行验证。这项工作的更广泛影响是多方面的。 首先，MPI-PPA 将有利于计算科学家和集群管理员。 其好处包括简单而快速的性能调整系统、整体集群效率的提高以及单个应用程序响应时间的减少。 该项目开发的技术将以性能调整和预测软件的形式进行转让，并通过与劳伦斯利弗莫尔国家实验室的合作向公众开放。 其次，将通过佐治亚大学的监督统计咨询中心促进统计学和计算机科学之间更多的跨学科互动。第三，将继续努力从该地区历史悠久的黑人学院和大学（例如莫尔豪斯大学）招收学生。