CRII: CSR: Efficient and Available Replication in Large-scale Datacenters

CRII：CSR：大型数据中心的高效可用复制

• 批准号: 1566403
• 负责人: Yang Wang
• 金额: $ 17.5万
• 依托单位: Ohio State University
• 依托单位国家: 美国
• 项目类别: Standard Grant
• 财政年份: 2016
• 资助国家: 美国
• 起止时间: 2016-04-01 至 2018-12-31
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=1566403&HistoricalAwards=false
• 关键词: CRII; CSR; Efficient; Available; Replication

Replication is widely used in the IT industry to protect users' data against various kinds of errors, such as power loss, disk corruption, and network partition. It is generally the case that we need to pay a higher cost for stronger replication protocols that can tolerate more kinds of errors. This presents a challenging trade-off to developers who will sometimes choose to use weaker forms of replication, willing to take the risk of occasional data loss in exchange for low cost. This project presents how to reduce the cost of Paxos, a popular strong replication protocol in today's data centers, while preserving its other properties.While this topic has already drawn a continuous effort in academia, existing approaches usually give up certain useful properties of Paxos, such as availability, presenting a different but equally hard question to the developers. This work presents ThriftyPaxos, a replication protocol that can achieve the same properties as Paxos with lower cost. To reduce cost, ThriftyPaxos incorporates the idea of on-demand instantiation, which activates the minimal number of replicas when there are no failures, and activates backup replicas when the active ones fail. To solve the key limitation of on-demand instantiation, that the system is unavailable when the backup is rebuilding its state, ThriftyPaxos incorporates the idea of delayed recovery, which allows the system to proceed while recovering a backup replica in the background. Such design is motivated by the observation that when acceptors and learners, the two key components of Paxos, are decoupled, it is possible to design separate mechanisms to delay their recovery without blocking the system.A cheaper Paxos protocol will be appealing to both existing Paxos users and to those who are still using weaker protocols, because they will not have the same type of difficult choice between data consistency and cost. To realize such impact, the PI will apply ThriftyPaxos to popular open-source software, as well as publishing the source code of ThriftyPaxos. This project has impact to education as well. The code will be converted for use in a course project so that graduate and undergraduate students can build a similar system with reasonable effort in a course project.

复制广泛应用于 IT 行业，以保护用户数据免受各种错误的影响，例如断电、磁盘损坏和网络分区。通常情况下，我们需要付出更高的成本来购买更强大的复制协议，以容忍更多类型的错误。这对开发人员来说是一个具有挑战性的权衡，他们有时会选择使用较弱的复制形式，愿意冒偶尔数据丢失的风险以换取低成本。该项目介绍了如何降低 Paxos（当今数据中心中流行的强复制协议）的成本，同时保留其其他属性。虽然该主题已经在学术界引起了持续的努力，但现有的方法通常会放弃 Paxos 的某些有用属性，例如可用性，向开发人员提出了一个不同但同样困难的问题。这项工作提出了 ThriftyPaxos，这是一种复制协议，可以以更低的成本实现与 Paxos 相同的属性。为了降低成本，ThriftyPaxos 融入了按需实例化的思想，即在没有故障时激活最少数量的副本，并在活动副本发生故障时激活备份副本。为了解决按需实例化的关键限制，即备份重建其状态时系统不可用，ThriftyPaxos 引入了延迟恢复的思想，允许系统在后台恢复备份副本的同时继续进行。这种设计的动机是这样的观察：当 Paxos 的两个关键组件接受者和学习者解耦时，可以设计单独的机制来延迟它们的恢复而不阻塞系统。更便宜的 Paxos 协议将对现有的 Paxos 都有吸引力用户以及那些仍在使用较弱协议的人，因为他们不会在数据一致性和成本之间进行同样类型的艰难选择。为了实现这样的影响，PI将把ThriftyPaxos应用到流行的开源软件中，并发布ThriftyPaxos的源代码。 该项目对教育也有影响。 该代码将被转换以用于课程项目，以便研究生和本科生可以在课程项目中通过合理的努力构建类似的系统。