SI2-SSE: Fast Dynamic Load Balancing Tools for Extreme Scale Systems

SI2-SSE：适用于超大规模系统的快速动态负载平衡工具

• 批准号: 1533581
• 负责人: Mark Shephard
• 金额: $ 50万
• 依托单位: Rensselaer Polytechnic Institute
• 依托单位国家: 美国
• 项目类别: Standard Grant
• 财政年份: 2015
• 资助国家: 美国
• 起止时间: 2015-10-01 至 2020-09-30
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=1533581&HistoricalAwards=false
• 关键词: SI2; SSE; Fast; Dynamic; Load

Massively parallel computing combined with scalable simulation workflows that can reliably model systems of interest are central to the continued quest of scientists, engineers, and other practitioners to address advances in scientific discovery, engineering design, and medical treatment. However, to meet their potential, these methods must be able to operate efficiently and scale on massively parallel computers executing millions of processes. Reaching the goal of millions of parallel processes requires new methods in which the computational workload is extremely well balanced and interprocessor communications overheads are minimized. Attaining such parallel performance is greatly complicated in realistic simulation workflows where the models and their discrete computer representation must evolve to ensure simulation reliability, or to account for changing input streams. To address the need to obtain workload balance with controlled communications, various algorithms and associated software, referred to as load balancing procedures, have been, and continue to be, developed. To be effective in the execution of simulation workflows in which the workload evolves, the load balancing procedures must be applied dynamically at multiple points in the simulation. Current load balancing techniques demonstrate two deficiencies when applied as dynamic load balancing procedures at very large numbers of compute cores (e.g., greater than 100,000 cores): They become a major fraction of the total parallel computation (in some cases never finishing within an allocation) and they do not maintain good load balance for simulation steps that must balance based on multiple criteria. Building on initial efforts to improve dynamic load balancing methods for adaptive unstructured mesh applications, the goal of the proposed research is to develop fast multicriteria dynamic load balancing methods that are capable of quickly producing well balanced computations, with well controlled communications, for a wide variety of applications. An important characteristic of the dynamic load balancing procedures to be developed is generalizing the graph to account for multiple types of computational entities and interactions. The initial ideas for supporting multiple entity types came from consideration balancing finite element calculations that must consider multiple orders of mesh entities. These concepts will be refined and generalized to support multiple applications areas. An additional development will be fast hybrid dynamic load balancing methods that are combinations of "geometric", standard graph, and multicriteria graph methods in which the individual methods can be executed globally of at a more local level (such as at the node level). The dynamic load balancing method to be developed will be demonstrated on three applications in which the workload, and its distribution, is changing as the simulation proceeds. The applications will be adaptive mesh simulations, adaptive multiscale modeling, and massive scale free graphs. These applications will be carried out on available massively parallel computers where examples on 1 million cores will be demonstrated. A goal of the dynamic load balancing methods to be developed will be to attain scalability, and do so with controlled data movement such that the wall clock time and energy used is substantially less than that required for an equivalent accuracy non-adaptive calculation.The software produced by this project will be made available as open source components. These developments coupled with efforts to support users in applying them in the development of new simulation tools will impact many research communities. Based on past and present efforts, the PIs fully expect that technologies developed in this project will also be integrated into future industrial software systems.

大规模并行计算与可扩展的仿真工作流程相结合，可以可靠地对感兴趣的系统进行建模，这是科学家、工程师和其他从业者不断追求科学发现、工程设计和医疗进步的核心。然而，为了发挥其潜力，这些方法必须能够在执行数百万个进程的大规模并行计算机上高效运行并扩展。实现数百万个并行进程的目标需要新的方法，其中计算工作量能够得到极好的平衡，并且处理器间的通信开销被最小化。在现实的仿真工作流程中，获得这种并行性能非常复杂，其中模型及其离散计算机表示必须不断发展，以确保仿真可靠性，或考虑不断变化的输入流。为了满足通过受控通信获得工作负载平衡的需要，已经并将继续开发各种算法和相关软件（称为负载平衡过程）。为了有效执行工作负载变化的模拟工作流程，必须在模拟中的多个点动态应用负载平衡过程。当在大量计算核心（例如，超过 100,000 个核心）上用作动态负载平衡过程时，当前的负载平衡技术表现出两个缺陷： 它们成为总并行计算的主要部分（在某些情况下永远不会在分配内完成）并且它们不能为必须基于多个标准进行平衡的模拟步骤保持良好的负载平衡。 基于改进自适应非结构​​化网格应用的动态负载平衡方法的初步努力，本研究的目标是开发快速多标准动态负载平衡方法，该方法能够快速生成良好平衡的计算，并具有良好的受控通信，适用于各种应用。应用程序。要开发的动态负载平衡过程的一个重要特征是概括图形以考虑多种类型的计算实体和交互。支持多种实体类型的最初想法来自于平衡有限元计算的考虑，该计算必须考虑网格实体的多阶。这些概念将得到完善和推广，以支持多个应用领域。另一项发展将是快速混合动态负载平衡方法，该方法是“几何”、标准图和多标准图方法的组合，其中各个方法可以在更局部的级别（例如在节点级别）全局执行。将在三个应用程序中演示要开发的动态负载平衡方法，其中工作负载及其分布随着模拟的进行而变化。这些应用将是自适应网格模拟、自适应多尺度建模和大规模自由图。这些应用程序将在可用的大规模并行计算机上执行，其中将演示 100 万个内核的示例。待开发的动态负载平衡方法的目标是实现可扩展性，并通过受控数据移动来实现这一目标，从而使所使用的挂钟时间和能量大大少于同等精度非自适应计算所需的时间和能量。该软件该项目产生的产品将作为开源组件提供。这些发展加上支持用户将其应用于新模拟工具开发的努力将影响许多研究社区。基于过去和现在的努力，PI们充分期望该项目开发的技术也将被集成到未来的工业软件系统中。