CAREER: In-Kernel Execution of Storage Functions

职业：存储函数的内核执行

• 批准号: 2143868
• 负责人: Asaf Cidon
• 金额: $ 50.84万
• 依托单位: Columbia University
• 依托单位国家: 美国
• 项目类别: Continuing Grant
• 财政年份: 2022
• 资助国家: 美国
• 起止时间: 2022-01-01 至 2026-12-31
• 项目状态: 未结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=2143868&HistoricalAwards=false
• 关键词: CAREER; Kernel; Execution; Storage; Functions

Emerging hardware storage devices can achieve millions of operations per second. They can also access data in as little as 2-3 microseconds, representing an order of magnitude improvement over legacy flash memory and hard disk technologies. However, at such low latencies, the overhead of the operating and file system becomes a significant bottleneck to end-to-end storage performance. Storage requests may slow down by 2x or more. The project designs XRP (eXpress Resubmission Path), a Linux-supported framework that allows applications to write storage functions that can be executed by the operating system. XRP allows applications to bypass almost entirely the overhead of the operating and file system. The main research challenge is that by bypassing the operating system’s storage layers, XRP lacks important context about the user’s request, such as who owns the block it is accessing, and how to traverse the application’s data structure safely and concurrently. The project organizes four primary research thrusts: (a) adding support for XRP in the Linux kernel and file system, (b) supporting a variety of storage operations and integrating with real-world storage systems, (c) enforcing quality of service, isolation and fairness of in-kernel storage functions, and (d) implementing in-kernel handling of over-the-network storage requests. Fast storage devices will fundamentally change the way software systems are built, and will require a redesign of the entire storage stack underpinning these systems. By eliminating the software overhead when accessing such devices, while maintaining operating system support, XRP will enable systems to achieve both high throughput and low and predictable tail latency, while leaving intact the existing isolation, security and safety guarantees of the Linux kernel. The immediate benefits will include high-performing datacenter data systems at a reduced cost, which will in turn translate to cost-effective cloud services for end users. Software artifacts will be released under open-source licenses to enable other researchers, and work with hardware and cloud providers to transition our research into practice. The project repository will be available via the principal investigator’s website: https://www.asafcidon.comThis award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.

新兴的硬件存储设备每秒可以实现数百万次操作，并且可以在短短 2-3 微秒内访问数据，这比传统闪存和硬盘技术有了一个数量级的改进，但是，在如此低的延迟下，开销也很大。操作系统和文件系统的故障成为端到端存储性能的重大瓶颈，存储请求可能会减慢 2 倍或更多。该项目设计了 XRP（eXpress 重新提交路径），这是一个 Linux 支持的框架，允许应用程序写入存储。功能可以由操作系统执行，XRP 允许应用程序几乎完全绕过操作系统和文件系统的开销，主要的研究挑战是，通过绕过操作系统的存储层，XRP 缺乏有关用户请求的重要上下文。谁拥有它正在访问的块，以及如何安全、并发地遍历应用程序的数据结构。该项目组织了四个主要研究重点：(a) 在 Linux 内核和文件系统中添加对 XRP 的支持，(b) 支持各种。存储操作并与现实世界的存储系统集成，(c) 加强内核存储功能的服务质量、隔离和公平性，以及 (d) 实现对网络存储请求的内核处理。将从根本上改变软件系统的构建方式，并且需要重新设计支撑这些系统的整个存储堆栈，通过消除访问此类设备时的软件开销，同时保持操作系统支持，XRP 将使系统能够实现高吞吐量和高吞吐量。尾部延迟低且可预测，同时保持完整Linux 内核现有的隔离、安全和安全保证将包括以更低的成本提供高性能的数据中心数据系统，这反过来又将为最终用户提供具有成本效益的云服务。开源许可证使其他研究人员能够与硬件和云提供商合作，将我们的研究转化为实践。该项目存储库将通过主要研究者的网站提供：https://www.asafcidon.com 该奖项反映了 NSF 的法定使命和使命。已被视为值得通过使用基金会的智力优点和更广泛的影响审查标准进行评估来支持。

项目成果

XRP: In-Kernel Storage Functions with eBPF

XRP：带有 eBPF 的内核存储功能

• 发表时间: 2022-07
• 期刊: 16th USENIX Symposium on Operating Systems Design and Implementation (OSDI 22
• 作者: Zhong, Yuhong;Li, Haoyu;Wu, Yu Jian;Zarkadas, Ioannis;Tao, Jeffrey;Mesterhazy, Evan;Makris, Michael;Yang, Junfeng;Tai, Amy;Stutsman, Ryan;et al
• 通讯作者: et al