Next Generation Software: Coordinated Allocation of Processor and I/O Resources in Parallel Systems

下一代软件：并行系统中处理器和 I/O 资源的协调分配

• 批准号: 9974992
• 负责人: Evgenia Smirni
• 金额: $ 35万
• 依托单位: College of William and Mary
• 依托单位国家: 美国
• 项目类别: Continuing Grant
• 财政年份: 1999
• 资助国家: 美国
• 起止时间: 1999-09-01 至 2004-02-29
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=9974992&HistoricalAwards=false
• 关键词: Next; Generation; Software; Coordinated; Allocation

EIA-9974992Smirni, EvgeniaCollege of William & MaryNext Generation Software: Coordinated Allocation of Processor and I/O Resources in Parallel SystemsA problem that plagues most parallel systems today is inefficient management of resources. Parallel systems are frequently over-utilized, yet they deliver relatively low performance to individual applications. In recent years, much research had been devoted to methods for allocating the processors of a parallel system to competing applications. However, an issue that has been traditionally overlooked is that many applications also contend for shared Input/Output (I/O) resources. Since I/O resources belong to the slowest level of memory hierarchy, their efficient management becomes critical for high performance.The proposed research focuses on the development of an allocation framework that integrates the management of computational and I/O resources in parallel systems. This research is facilitated, firstly, by previously obtained quantitative data on the processing and I/O requirements of parallel scientific applications. Additionally, recent studies on processor scheduling that explicitly consider the I/O demands of parallel scientific applications demonstrate performance trends that differ significantly from previously observed trends where only processor allocation is considered.The proposed plan considers a systematic exploration of coordinated allocation strategies of both processor and I/O resources and investigates issues that have not been addressed in traditional processor scheduling or I/O research in parallel systems. The primary objectives of this project are: 1) the development of an analytic model that effectively captures the scalability of I/O intensive applications under different data distributions on the disks and under different assignment of computational resources, 2) the analysis of the relative advantages and disadvantages of new dual resource allocation strategies through modeling and experimental measurements, and 3) the development of a unified framework that allows the processor scheduler and the parallel file system to operate jointly towards the common goal of sharing the parallel resources amoung the various executing applications in order to maximize overall system performance. The proposed work will be experimentally verified on a variety of parallel platforms and the dual resource allocation algorithms will be implemented so as to ensure their portability across these platforms.

EIA-9974992Smirni，Evgenia 威廉玛丽学院下一代软件：并行系统中处理器和 I/O 资源的协调分配当今困扰大多数并行系统的一个问题是资源管理效率低下。 并行系统经常被过度利用，但它们为单个应用程序提供的性能相对较低。 近年来，大量研究致力于将并行系统的处理器分配给竞争应用程序的方法。 然而，传统上被忽视的一个问题是许多应用程序还会争夺共享输入/输出 (I/O) 资源。 由于 I/O 资源属于内存层次结构的最慢级别，因此它们的有效管理对于高性能至关重要。本文提出的研究重点是开发一种分配框架，该框架集成了并行系统中计算和 I/O 资源的管理。 首先，先前获得的有关并行科学应用程序的处理和 I/O 要求的定量数据促进了这项研究。 此外，最近对处理器调度的研究明确考虑了并行科学应用的 I/O 需求，表明性能趋势与之前观察到的仅考虑处理器分配的趋势有很大不同。所提出的计划考虑了对两个处理器的协调分配策略的系统探索和 I/O 资源，并研究并行系统中传统处理器调度或 I/O 研究中尚未解决的问题。 该项目的主要目标是：1）开发一个分析模型，有效捕获 I/O 密集型应用程序在磁盘上不同数据分布和不同计算资源分配下的可扩展性，2）分析相对优势通过建模和实验测量来了解新的双资源分配策略的缺点和缺点，以及3）开发一个统一的框架，允许处理器调度程序和并行文件系统共同操作，以实现在各种执行应用程序之间共享并行资源的共同目标为了最大化整体系统性能。 所提出的工作将在各种并行平台上进行实验验证，并实现双资源分配算法，以确保其跨这些平台的可移植性。