CRII: CSR: Scaling Geo-Replicated Storage In and Across Many Datacenters

CRII：CSR：在多个数据中心内和跨多个数据中心扩展地理复制存储

• 批准号: 1464438
• 负责人: Wyatt Lloyd
• 金额: $ 17.5万
• 依托单位: University of Southern California
• 依托单位国家: 美国
• 项目类别: Standard Grant
• 财政年份: 2015
• 资助国家: 美国
• 起止时间: 2015-03-01 至 2017-02-28
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=1464438&HistoricalAwards=false
• 关键词: CRII; CSR; Scaling; Geo; Replicated

This project focuses on improving the state of the art in storage for large-scale websites like Amazon, Facebook, and Google that are an integral part of our modern lives. The research is important because it will make the websites more reliable, less expensive to build, and faster for everyone to access. The efforts of this project will guide and focus both industrial efforts and future researchers. This project has the following unique features: optimal speed for reading data from storage and scalability inside and across data centers when compared to the leading research system and the leading industrial system. A working prototype of new storage designs will be produced and released during the course of the work. To accomplish the goals, the project addresses two major deficiencies in the state of the art. First, current systems are likely non-optimal for reading data from storage as they all use multiple rounds of communication. This problem will be addressed by designing, implementing, and evaluating algorithms for reading data that use optimally few rounds of communication. Second, current systems do not scale across data centers, so that building more data centers does not increase the amount of storage or its throughput. This project will use partial replication to store only a subset of the data in each data center so that adding new data centers will result in proportional increases in storage capacity and throughput. An important component is the innovation educational experience in the design phase of the project and systems building experience in the implementation phase for graduate students.Large-scale websites are an important and enriching part of modern life. The algorithms and prototypes developed by this research will make the storage that powers them bigger and faster. These improvements to storage will in turn result in improvements to the websites themselves and perhaps even enable new types of services that were not previously possible.

该项目的重点是提高亚马逊、Facebook 和谷歌等大型网站的存储技术水平，这些网站是我们现代生活不可或缺的一部分。 这项研究很重要，因为它将使网站更可靠、构建成本更低，并且每个人都可以更快地访问。 该项目的努力将指导和集中工业界的努力和未来的研究人员。 与领先的研究系统和领先的工业系统相比，该项目具有以下独特功能：从存储读取数据的最佳速度以及数据中心内部和跨数据中心的可扩展性。 新存储设计的工作原型将在工作过程中制作和发布。 为了实现这些目标，该项目解决了现有技术的两个主要缺陷。 首先，当前的系统可能不是从存储读取数据的最佳选择，因为它们都使用多轮通信。 这个问题将通过设计、实现和评估用于读取数据的算法来解决，这些算法使用最佳的几轮通信。 其次，当前系统无法跨数据中心扩展，因此构建更多数据中心不会增加存储量或其吞吐量。 该项目将使用部分复制在每个数据中心中仅存储数据的子集，以便添加新的数据中心将导致存储容量和吞吐量成比例增加。 一个重要的组成部分是项目设计阶段的创新教育经验和研究生实施阶段的系统构建经验。大型网站是现代生活的重要组成部分。 这项研究开发的算法和原型将使为其提供动力的存储容量更大、速度更快。 这些对存储的改进反过来将导致网站本身的改进，甚至可能实现以前不可能的新型服务。