CSR: Small: Software-defied HDDs: A System-centric Design Framework to Minimize Data Storage Cost for Data Centers

CSR：小型：软件定义的 HDD：以系统为中心的设计框架，可最大限度地降低数据中心的数据存储成本

• 批准号: 1814890
• 负责人: Tong Zhang
• 金额: $ 31.39万
• 依托单位: Rensselaer Polytechnic Institute
• 依托单位国家: 美国
• 项目类别: Standard Grant
• 财政年份: 2018
• 资助国家: 美国
• 起止时间: 2018-09-01 至 2021-08-31
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=1814890&HistoricalAwards=false
• 关键词: CSR; Small; Software; defied; HDDs

The project aims to develop storage system design techniques that can reduce the cost of hard disk drives (HDDs) for data centers. Based upon the observation that one could reduce the HDD cost by relaxing its storage reliability, the project will develop approaches that can accommodate low-cost but very unreliable HDDs in data centers without sacrificing the overall performance.The project will cohesively exploit the unique characteristics of data centers and HDDs to develop cross-layer design techniques that can most effectively embrace very unreliable HDDs in data centers. In particular, the project will develop cross-layer design techniques to achieve: (a) hybrid local/distributed sector repair, (b) iterative cross-layer decoding-based sector repair, and (c) configurable per-sector protection. The project will further investigate the integration of these design techniques and explore the involved design trade-offs. A data center HDD simulator will be implemented to support the evaluations and design space exploration, and will be made publicly available to the research community.The project could have significant impact on improving the cost effectiveness of mass data storage in data centers. The success of the project could lead to establishing a larger-scale inter-disciplinary research area covering data center storage systems, file system, coding theory, HDD firmware and read channel, and HDD manufacturing. The research training to both undergraduate and graduate students will address the concerns of lacking researchers and engineers with multi-disciplinary experience in computer industries. The main results will be research papers and a data center HDD simulator. The simulator source code and the corresponding documentation will be maintained on GitHub, where anyone can obtain and examine the most recent versions. Research papers will be available on the project web site at https://www.ecse.rpi.edu/homepages/tzhang/research.html. All the results will be kept publicly available for at least five years beyond the completion of the project.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.

该项目旨在开发可以降低数据中心硬盘驱动器（HDD）成本的存储系统设计技术。基于人们可以通过放宽存储可靠性来降低 HDD 成本的观察，该项目将开发能够在数据中心容纳低成本但非常不可靠的 HDD 而不牺牲整体性能的方法。该项目将集中利用 HDD 的独特特性数据中心和硬盘驱动器开发跨层设计技术，可以最有效地容纳数据中心中非常不可靠的硬盘驱动器。特别是，该项目将开发跨层设计技术，以实现：（a）混合本地/分布式扇区修复，（b）基于迭代跨层解码的扇区修复，以及（c）可配置的每扇区保护。该项目将进一步研究这些设计技术的整合，并探索所涉及的设计权衡。将实施数据中心 HDD 模拟器来支持评估和设计空间探索，并将向研究界公开提供。该项目可能会对提高数据中心海量数据存储的成本效益产生重大影响。该项目的成功可能会导致建立一个更大规模的跨学科研究领域，涵盖数据中心存储系统、文件系统、编码理论、硬盘固件和读取通道以及硬盘制造。对本科生和研究生的研究培训将解决计算机行业缺乏具有多学科经验的研究人员和工程师的问题。主要成果将是研究论文和数据中心硬盘模拟器。模拟器源代码和相应的文档将保存在 GitHub 上，任何人都可以在其中获取和检查最新版本。研究论文将在项目网站 https://www.ecse.rpi.edu/homepages/tzhang/research.html 上提供。所有结果将在项目完成后至少五年内公开。该奖项反映了 NSF 的法定使命，并通过使用基金会的智力价值和更广泛的影响审查标准进行评估，被认为值得支持。

项目成果

Implementing Flash-Cached Storage Systems Using Computational Storage Drive with Built-in Transparent Compression

使用具有内置透明压缩的计算存储驱动器实现闪存缓存存储系统

• 发表时间: 2021-01
• 期刊: and Storage (NAS
• 作者: J. Hao; X. Chen
• 通讯作者: X. Chen

Mitigate HDD Fail-Slow by Proactively Utilizing System-level Data Redundancy with Enhanced HDD Controllability and Observability

通过主动利用系统级数据冗余以及增强的 HDD 可控性和可观察性来缓解 HDD 故障缓慢

• 发表时间: 2019-05
• 期刊: International Conference on Massive Storage Systems and Technology (MSST
• 作者: J. Hao; Y. Li
• 通讯作者: Y. Li

On the Design of SMR HDD Block Device Driver

SMR硬盘块设备驱动程序的设计

• DOI: 10.1109/hpcc-smartcity-dss50907.2020.00166
• 发表时间: 2020-12-01
• 期刊: 2020 IEEE 22nd International Conference on High Performance Computing and Communications; IEEE 18th International Conference on Smart City; IEEE 6th International Conference on Data Science and Systems (HPCC/SmartCity/DSS)
• 作者: Jingpeng Hao;Xubin Chen;Yifan Qiao;Yuyang Zhang;Tong Zhang
• 通讯作者: Tong Zhang

An Exploratory Study on Software-Defined Data Center Hard Disk Drives

软件定义数据中心硬盘驱动器的探索性研究

• DOI: 10.1145/3319405
• 发表时间: 2019-05
• 期刊: ACM Transactions on Storage
• 影响因子: 1.7
• 作者: Li, Yin;Chen, Xubin;Zheng, Ning;Hao, Jingpeng;Zhang, Tong
• 通讯作者: Zhang, Tong