CSR: Medium: Collaborative Research: Data Center Scale Programmable Storage

CSR：媒介：协作研究：数据中心规模可编程存储

• 批准号: 1705095
• 负责人: Dirk Grunwald
• 金额: $ 50万
• 依托单位: University of Colorado at Boulder
• 依托单位国家: 美国
• 项目类别: Continuing Grant
• 财政年份: 2017
• 资助国家: 美国
• 起止时间: 2017-09-01 至 2021-08-31
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=1705095&HistoricalAwards=false
• 关键词: CSR; Medium; Collaborative; Research; Data

Historically, applications usually interface with persistent storage systems through protocols, abstractions and interfaces. Protocols define a series of actions that can be taken on the storage such as reading, or writing and have an implicit abstraction model such as blocks or objects. Interfaces such as general or dedicated storage networks transport protocol messages. While protocols and interfaces simplify storage system design, both impact performance by the use of abstraction models and limited operations. Emerging storage class memory has low latency and granular operations, greatly increasing the relative impact of the overhead of protocols, abstractions and interfaces. This project is re-imagining the storage interface as programmable storage, where the defined protocol involves sending encapsulated programs to the actual storage where their effect is applied. This will improve the performance of distributed systems as well as storage applications, both of which are central to Internet applications.The intellectual challenge in this project is the design of the new storage abstractions, insuring they are suitable for a variety of new storage media and that security is maintained while performance is improved. We are extending an existing storage system to include features of programmable storage while also supporting emerging consensus on low-level components used by distributed systems, such as persistent logs and transactional operations at the memory level. The project is using existing run-time code generation frameworks to insure that the programmable interface generates portable code that is also efficient. Part of the research effort is developing consensus among industry and academic researchers on the necessity and sufficiency of the storage abstractions we propose and developing educational materials to demonstrate how they should be used.

从历史上看，应用程序通常通过协议、抽象和接口与持久存储系统进行交互。协议定义了一系列可以在存储上执行的操作（例如读取或写入），并具有隐式抽象模型（例如块或对象）。通用或专用存储网络等接口传输协议消息。虽然协议和接口简化了存储系统设计，但两者都会通过使用抽象模型和有限的操作来影响性能。新兴存储类内存具有低延迟和粒度操作，大大增加了协议、抽象和接口开销的相对影响。该项目正在将存储接口重新想象为可编程存储，其中定义的协议涉及将封装的程序发送到应用其效果的实际存储。这将提高分布式系统以及存储应用程序的性能，这两者都是互联网应用程序的核心。该项目的智力挑战是新存储抽象的设计，确保它们适用于各种新的存储介质和在提高性能的同时保持安全性。我们正在扩展现有的存储系统，以包含可编程存储的功能，同时还支持分布式系统使用的低级组件的新兴共识，例如内存级别的持久日志和事务操作。该项目正在使用现有的运行时代码生成框架来确保可编程接口生成高效的可移植代码。研究工作的一部分是在行业和学术研究人员之间就我们提出的存储抽象的必要性和充分性达成共识，并开发教育材料来演示如何使用它们。