Collaborative Research: Performance Toolset for Dynamic Optimization of High-End Hybrid Applications

协作研究：用于高端混合应用动态优化的性能工具集

• 批准号: 0444468
• 负责人: Barbara Chapman
• 金额: --
• 依托单位: University of Houston
• 依托单位国家: 美国
• 项目类别: Standard Grant
• 财政年份: 2004
• 资助国家: 美国
• 起止时间: 2004-11-01 至 2008-06-30
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=0444468&HistoricalAwards=false
• 关键词: Collaborative; Research; Performance; Toolset; Dynamic

Current high-end applications usually exploit just a fraction of the theoretical performance of large platforms. Interactions among the hardware, system software, programming interface, and algorithm are extremely complex, and the implications for development of hybrid MPI+OpenMP Fortran/C/C++ applications are challenging. The emerging generation of machines will be even more complex, as will the applications that exploit them. Typical application development and tuning scenarios involve the manual and separate use of compilers and performance tools, and program modifications based upon insights laboriously gleaned from their output. In this proposal, we intend to raise the quality of the application development and tuning process by creating an integrated environment for program optimization that reduces the manual labor and guesswork of existing approaches. We will develop strategies and the corresponding interfaces that enable the application developer, compiler and performance tools to collaborate to generate optimized code based upon a variety of sources of feedback, including performance data from .offline. development runs as well as from .online. production runs. We will build and deploy a flexible, working system that combines robust, existing, open source software . a compiler, a program analysis tool and two performance tools with complementary features - into a single, coherent environment for collaborative static and dynamic application tuning. Application codes of varying complexity supplied by our application partner will motivate our development work as well as test and demonstrate our results. The result will be a powerful, integrated environment that can be used to obtain traditional performance data via program monitoring, event tracing and/or the extraction of hardware counter information, and to obtain support for the static or dynamic tuning of an application code. Intellectual Merit The proposed environment integrates several different existing technologies to provide a new level of support for optimizing hybrid MPI+OpenMP codes. Support for experimentation with the hybrid programming model is provided. The range of information that may be exploited by the compiler to optimize code is expanded to cover many system and application-level phenomena and a variety of optimization scenarios. Interactions between tools will facilitate the provision of an approach that is able to handle extreme-scale computations. Integration issues will be addressed with the goal of creating a deployable, extensible system. Broader Impacts The tools, ideas, and results of this project will be freely distributed and made available to the HPC community, nationally and internationally. Besides the general dissemination of results, the project has strong ties to performance engineering experts at NCSA. The tools will be installed on NCSA systems for testing and evaluation and will be made available to other users. The research brings together compiler, performance tool, and application developers, enriching the research experience of graduate students to create a well-rounded IT workforce. The PI is active in the OpenMP community and the project team has close working relationships with DOE and DOD. New knowledge generated will be integrated into advanced graduate coursework.

当前的高端应用通常仅利用大型平台理论性能的一小部分。硬件、系统软件、编程接口和算法之间的交互极其复杂，混合 MPI+OpenMP Fortran/C/C++ 应用程序的开发具有挑战性。新一代机器将更加复杂，利用它们的应用程序也将更加复杂。典型的应用程序开发和调优场景涉及手动和单独使用编译器和性能工具，以及根据从其输出中辛苦收集的见解进行程序修改。 在本提案中，我们打算通过创建一个用于程序优化的集成环境来提高应用程序开发和调整过程的质量，从而减少现有方法的体力劳动和猜测。我们将开发策略和相应的接口，使应用程序开发人员、编译器和性能工具能够协作，根据各种反馈源（包括来自 .offline 的性能数据）生成优化的代码。开发运行以及.online。生产运行。我们将构建和部署一个灵活的工作系统，该系统结合了强大的、现有的开源软件。一个编译器、一个程序分析工具和两个具有互补功能的性能工具 - 集成到一个单一的、连贯的环境中，用于协作静态和动态应用程序调整。我们的应用程序合作伙伴提供的不同复杂性的应用程序代码将激励我们的开发工作以及测试和演示我们的结果。 结果将是一个强大的集成环境，可用于通过程序监视、事件跟踪和/或提取硬件计数器信息来获取传统性能数据，并获得对应用程序代码的静态或动态调整的支持。 智力优点所提出的环境集成了多种不同的现有技术，为优化混合 MPI+OpenMP 代码提供新水平的支持。提供了对混合编程模型实验的支持。编译器可以利用来优化代码的信息范围已扩大到涵盖许多系统和应用程序级现象以及各种优化场景。工具之间的交互将有助于提供能够处理极端规模计算的方法。 解决集成问题的目的是创建一个可部署、可扩展的系统。 更广泛的影响 该项目的工具、想法和结果将免费分发给国内和国际的 HPC 社区。除了广泛传播成果外，该项目还与 NCSA 的性能工程专家有着密切的联系。这些工具将安装在 NCSA 系统上进行测试和评估，并将提供给其他用户。该研究汇集了编译器、性能工具和应用程序开发人员，丰富了研究生的研究经验，打造了一支全面发展的 IT 劳动力队伍。该 PI 活跃于 OpenMP 社区，项目团队与 DOE 和 DOD 有着密切的工作关系。产生的新知识将被整合到高级研究生课程中。