CSR---PDOS: A Benchmarking Framework for High-Availability Distributed Storage Systems

CSR---PDOS：高可用分布式存储系统的基准框架

• 批准号: 1102629
• 负责人: Xubin He
• 金额: $ 0.8万
• 依托单位: Virginia Commonwealth University
• 依托单位国家: 美国
• 项目类别: Continuing Grant
• 财政年份: 2010
• 资助国家: 美国
• 起止时间: 2010-09-09 至 2011-08-31
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=1102629&HistoricalAwards=false
• 关键词: CSR; PDOS; Benchmarking; Framework; Availability

The availability and robustness of the I/O system is crucial to large-scale applications that generate and analyze terabytes of data. Storage systems are vulnerable to numerous hardware failures (I/O and metadata server crashes) and contribute to as much as 25% of all system failures. Actually, highly available data storage for high end computing is becoming increasingly more critical as high-end computing systems scale up in size. To achieve high availability storage systems, a challenging issue is to characterize the availability metric in addition to performance of these systems.This research investigates high-availability data and I/O services and benchmarking. The investigators take an organized approach to developing a benchmarking framework to measure the storage performance in consideration of availability under various faulty conditions. The research involves four tasks: 1) develop faults/errors model and design fault injection schemes for storage systems; 2) develop an innovative benchmarking framework for high availability distributed storage systems under different faulty conditions; 3) implement an Availability and Performance Evaluation Toolset (APET) to integrate the fault injection and stress testing libraries and capture raw performance of storage systems at block level under various faults; 4) validate the benchmarking framework using APET for block-level storage systems. This research has direct contributions to understanding highly available data and I/O services for HEC systems, establishing a general benchmarking framework for characterizing storage systems under faulty conditions, and thus benefiting the society by guiding develop high-availability oriented distributed storage systems which are crucial to many applications.

I/O系统的可用性和鲁棒性对于生成和分析数据的大规模应用至关重要。存储系统容易遭受众多硬件故障（I/O和元数据服务器崩溃），并占所有系统故障的25％。实际上，随着高端计算系统规模的扩大，高端计算的高端数据存储变得越来越关键。为了实现高可用性存储系统，一个具有挑战性的问题是除了这些系统的性能外，还要表征可用性指标。这项研究研究了高可用性数据，I/O服务和基准测试。研究人员采用有组织的方法来开发基准测量框架，以考虑到各种错误条件下的可用性，以衡量存储性能。该研究涉及四个任务：1）为存储系统开发故障/错误模型和设计故障注入方案； 2）在不同的故障条件下为高可用性分布式存储系统开发创新的基准测试框架； 3）实施可用性和性能评估工具集（APET），以整合故障注入和应力测试库，并在各种故障下捕获块级别存储系统的原始性能； 4）使用APET用于块级存储系统验证基准测试框架。这项研究对了解HEC系统的高度可用数据和I/O服务有直接的贡献，建立了在有缺陷条件下表征存储系统的一般基准测试框架，从而通过指导社会受益于开发高可用性的面向高可用性的分布式存储系统，这对许多应用至关重要。