CAREER: Rethinking Replication in Highly Available and Reliable Data Stores

职业：重新思考高可用且可靠的数据存储中的复制

基本信息

批准号：
2238768
负责人：
Shuai Mu
金额：
$ 50.02万
依托单位：
SUNY at Stony Brook
依托单位国家：
美国
项目类别：
Continuing Grant
财政年份：
2023
资助国家：
美国
起止时间：
2023-05-01 至 2028-04-30
项目状态：
未结题

来源：
https://www.nsf.gov/awardsearch/showAward?AWD_ID=2238768&HistoricalAwards=false
关键词：
CAREER Rethinking Replication Highly Available

项目摘要

This project targets long-lasting and increasingly pervasive challenges in building highly reliable and available distributed storage systems, which are the key components in large-scale Internet services. The proposal aims to study and address insufficiencies in current distributed storage system designs from several important aspects including their abstraction, performance, communication, and failure models. These insufficiencies typically arise from the conventional designs in distributed systems that were not prepared for today’s Internet scale. This research may produce a major impact on industry and society because distributed systems are the cornerstones of modern computing infrastructures such as cloud computing, serverless computing, and high-performance computing. In particular, this work will be done in collaboration with widely used distributed storage systems built in Microsoft, Google, MongoDB, and Cockroach. The PI is working with their department to broaden the course offerings with multidisciplinary courses in the general area of cloud computing, distributed systems, reliable systems, and software engineering. The PI will incorporate the topics in this proposal into the courses he is teaching.Traditionally, systems often use a method called state machine replication (SMR) to achieve reliability. SMR is often treated as an independent module, with a clear boundary such as a key-value interface isolating it from the rest of the system. However, this creates problems in today’s systems. For example, using SMR as a blackbox in geo-replicated systems could incur a great performance penalty because each application request could translate into multiple SMR operations and each operation takes at least a wide-area round-trip to finish. This proposal summarizes four impediments of existing systems from different aspects in practice (abstraction, performance, communication model, and failure model), and proposes four research thrusts targeting these impediments: 1) use transactional data structures to enrich the abstraction layer between applications and the data store, 2) investigate leveraging multicore resources to improve performance for geo-replication, 3) study advanced SMR techniques under a more generalized communication model than the status quo, 4) study tolerating a new failure model, silent data corruption. The proposed work will develop a set of novel, transformative technologies, including a new replicated transactional data structure library that supports building general types of applications, other new system designs and implementations for providing fast and consistent replication that will be encapsulated in state-of-the-art research products and will dramatically improve the performance and fault-tolerance of modern distributed systems.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.

该项目针对建立高度可靠且可用的分布式存储系统的持久和越来越普遍的挑战，这是大规模互联网服务中的关键组成部分。该提案旨在研究和解决当前分布式存储系统设计中的不足，包括其抽象，性能，沟通和失败模型，包括它们的几个重要方面。这些不足通常是由于没有为当今互联网规模准备的分布式系统中的常规设计产生。这项研究可能会对工业和社会产生重大影响，因为分布式系统是现代计算基础架构（例如云计算，无服务器计算和高性能计算）的基石。特别是，这项工作将与在Microsoft，Google，MongoDB和蟑螂中建造的广泛使用的分布式存储系统合作完成。 PI正在与他们的部门合作，通过云计算，分布式系统，可靠系统和软件工程的多学科课程扩大课程产品。 PI将将本提案中的主题纳入他正在教学的课程中。在传统上，系统通常使用一种称为状态机器复制（SMR）的方法来实现可靠性。 SMR通常被视为一个独立的模块，具有清晰的边界，例如将其与系统其余部分隔离的钥匙值接口。但是，这在当今的系统中造成了问题。例如，将SMR用作地理复制系统中的黑框可能会造成巨大的性能罚款，因为每个应用程序请求都可以转化为多个SMR操作，并且每个操作至少需要一个宽区域的圆形旅行来完成。该提案总结了现有系统的四个障碍，从实践中的不同方面（抽象，性能，沟通模型和失败模型）总结了针对这些障碍的四个研究推力：1）使用交易数据结构丰富了应用程序层，以丰富应用程序和数据存储之间的抽象层，并在数据存储之间进行数据存储，2）调查多项式的效率，以提高性能，以提高性能，以提高综合性的范围。 quo，4）研究可容忍新的失败模型，无声数据腐败。拟议的工作将开发一系列新颖的变革性技术，包括一个新的重复的交易数据结构库，该库支持一般类型的应用程序，其他新的系统设计和实现，以提供快速，一致的复制，将封装在先进的研究产品中，并将通过对现代奖励的绩效和缺陷进行了良好的效果和缺陷。基金会的智力优点和更广泛的影响审查标准。