Collaborative Research: CCF Core: Small: User-transparent Data Management for Persistence and Crash-consistency in Non-volatile Memories

协作研究：CCF 核心：小型：用户透明的数据管理，以实现非易失性存储器中的持久性和崩溃一致性

• 批准号: 2313146
• 负责人: Jia Rao
• 金额: $ 39.9万
• 依托单位: University of Texas at Arlington
• 依托单位国家: 美国
• 项目类别: Standard Grant
• 财政年份: 2023
• 资助国家: 美国
• 起止时间: 2023-10-01 至 2026-09-30
• 项目状态: 未结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=2313146&HistoricalAwards=false
• 关键词: Collaborative; Research; CCF; Core; Small

Non-volatile memory is a type of computer memory that can retain stored data upon a power loss or system crash. Due to its large capacity and low energy footprint compared to traditional volatile memory, non-volatile memory has long been envisioned as an ideal solution for building large-scale, cost-effective, energy-efficient, and recoverable applications in many critical domains, including high-performance computing, machine learning, and embedded systems. Although non-volatile memory is available as commercial memory chips and offers numerous promises, it has not yet been widely adopted in production systems. The major obstacle is the difficulty to ensure that data is timely and correctly written to non-volatile memory, allowing it to be restored to a consistent state after a crash. Currently, application developers carry the burden of porting legacy applications to non-volatile memory, which is tedious and error-prone. This project seeks to establish a generic framework for user-transparent persistence and crash consistency that allows unmodified legacy applications to run efficiently and correctly with non-volatile memory. The success of this project will help unleash the full potential of non-volatile memory and make it easier to adopt. The research will also provide valuable insights into data management in future hybrid, disaggregated memory systems. In addition, this project involves mentoring Ph.D. students, engaging minority students, course development, and K12 outreach activities. This project integrates non-volatile memory into the page/buffer cache in memory management – i.e., an abstraction that bridges the view of byte-addressable memory and a backing memory device -- to provide persistence and crash consistency to user-space programs with no or little user involvement. The challenges lie in 1) how to intercept program updates and redirect them to non-volatile memory for persistence; 2) how to properly order the updates and ensure update atomicity to guarantee crash consistency; 3) how to efficiently integrate non-volatile memory into page/buffer cache management without incurring noticeable overhead or performance degradation. This project addresses these challenges by focusing on persisting three types of program data – file-backed data, dynamically allocated application memory, and program metadata for virtual memory management, such as page tables, and exploring various software and hardware techniques, such as copy-on-write, undo logging, shadow paging, and extended page tables, for each data type to achieve efficient crash consistency. This project advances the understanding of hybrid memory management for volatile and non-volatile memories while simultaneously achieving high usability, good backward compatibility, and high efficiency.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.

非易失性存储器是一种可以在断电或系统崩溃时保留存储数据的计算机存储器，与传统易失性存储器相比，非易失性存储器具有大容量和低能耗的特点，长期以来一直被视为理想的解决方案。尽管非易失性存储器可作为商业存储器芯片并提供许多前景，但它可以在许多关键领域（包括高性能计算、机器学习和嵌入式系统）构建大规模、经济高效、节能和可恢复的应用程序。 ，目前还没有被广泛采用生产系统的主要障碍是难以确保数据及时、正确地写入非易失性内存，从而使其在崩溃后恢复到一致的状态。目前，应用程序开发人员承担着将遗留应用程序移植到非易失性内存的重担。 - 易失性内存，这是乏味且容易出错的，该项目旨在建立一个用户透明的持久性和崩溃一致性的通用框架，允许未经修改的遗留应用程序使用非易失性内存高效且正确地运行。帮助释放全部该研究还将为未来混合、分类存储系统中的数据管理提供有价值的见解。该项目将非易失性内存集成到内存管理中的页面/缓冲区缓存中，即桥接字节可寻址内存和后备内存设备视图的抽象，以提供持久性和崩溃。在没有或很少用户参与的情况下实现用户空间程序的一致性面临的挑战在于 1) 如何拦截程序更新并将其重定向到非易失性内存以实现持久性；2) 如何正确排序更新并确保更新原子性以保证崩溃。一致性；3）如何有效地将非易失性内存集成到页面/缓冲区缓存管理中，而不会产生明显的开销或性能下降。该项目通过关注持久化三种类型的程序数据（文件支持的数据、动态分配的应用程序内存）来解决这些挑战。 ， 和虚拟内存管理的程序元数据，例如页表，并针对每种数据类型探索各种软件和硬件技术，例如写入时复制、撤消日志记录、影子分页和扩展页表，以实现高效的崩溃一致性。该项目增进了对易失性和非易失性存储器混合存储器管理的理解，同时反映了实现高可用性、良好的向后兼容性和高效率。该奖项是 NSF 的法定使命，并通过使用基金会的智力优势和评估进行评估，被认为值得支持。更广泛的影响审查标准。