CAREER: Towards Scalable Datacenter Services with Strong Robustness Guarantees

职业生涯：实现具有强大稳健性保证的可扩展数据中心服务

• 批准号: 0953197
• 负责人: Michael Freedman
• 金额: $ 52.93万
• 依托单位: Princeton University
• 依托单位国家: 美国
• 项目类别: Continuing Grant
• 财政年份: 2010
• 资助国家: 美国
• 起止时间: 2010-07-01 至 2017-06-30
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=0953197&HistoricalAwards=false
• 关键词: CAREER; Towards; Scalable; Datacenter; Services

Modern datacenters have reached hundreds of thousands of servers, and modern distributed services can be spread over multiple or even dozens of datacenters worldwide. For scalability, availability, and performance, these services have increasingly embraced a weakened model of data consistency. This trade-off proved highly successful for applications such as web crawling, search, and content distribution. On the other hand, the recent trend to move ever-more dynamic applications to the "cloud" portends a shift in service requirements---in which losing data or applying operations out-of-order may not be acceptable---as does far-flung demand for concurrent access to data and services.To meet these changing needs, this research project reconsiders the challenge of building storage and replicated systems with strong robustness guarantees and at scale. Recognizing that large-scale, complex systems are typically built-up from smaller groups---which either provide different functionality or partition some larger state-space into smaller, more manageable parts---it leverages a group compositional approach to tackle the problem. First, the research develops novel protocols for smaller groups of nodes that offer strong properties at minimal overhead. Second, it proposes a coordination service and a suite of management algorithms that adaptively organizes these groups and composes them together. These algorithms explore problems of dynamic load balancing, topological control, and security. The research includes substantial systems building, including the incorporation of its core services into several other distributed systems (e.g., a scalable virtual world and a istributed name resolution service).The remarkably rich and varied Internet services run out of datacenters form the core of people's online experiences today. The algorithms and software systems developed by this research may lower the barrier to developing datacenter services that are scalable, reliable, secure, efficient, and easy to manage. And by reducing the technical difficulty of building robust, large-scale applications---by providing them with a firm foundation---this research may enable further innovation in Internet services.

现代数据中心已经到达了数十万个服务器，现代分布式服务可以分布在全球多个甚至数十个数据中心上。 对于可伸缩性，可用性和性能，这些服务越来越多地接受了弱化的数据一致性模型。 对于网络爬网，搜索和内容分布等应用程序，这种权衡被证明非常成功。 另一方面，将不断变化的动态应用程序移至“云”的最新趋势预示了服务要求的转变 - 在其中，丢失数据或施加运营的运营可能是不可接受的 - 为了满足这些不断变化的需求，该研究项目的挑战是，较大的需求，以稳健性保证并按比例扩大，这项研究项目的需求是为了满足这些不断变化的需求。 认识到大规模，复杂的系统通常是由较小的组构建的，这些组提供了不同的功能，或者将一些较大的状态空间分配为较小，更易于管理的部分 - 它利用了组成分方法来解决问题。 首先，该研究为较小的节点的较小群体开发了新的方案，这些方案在最小的开销时提供了强大的特性。 其次，它提出了一种协调服务和一套管理算法，可自适应地组织这些群体并将其组成。 这些算法探讨了动态负载平衡，拓扑控制和安全性的问题。 该研究包括大量的系统构建，包括将其核心服务纳入其他几种分布式系统（例如，可扩展的虚拟世界和iStribed name Solutive Services）。大量丰富且多样化的互联网服务构成了人们的核心，这是人们的核心。今天的在线体验。 这项研究开发的算法和软件系统可能会降低开发可扩展，可靠，安全，高效且易于管理的数据中心服务的障碍。通过减少构建强大，大规模应用程序的技术困难 - 通过为他们提供牢固的基础 - 这项研究可能会在互联网服务中进一步创新。