CSR: Medium: Limiting Manipulation in Data Centers and the Cloud

CSR：中：限制数据中心和云中的操纵

• 批准号: 1161813
• 负责人: Ion Stoica
• 金额: $ 29.95万
• 依托单位: International Computer Science Institute
• 依托单位国家: 美国
• 项目类别: Continuing Grant
• 财政年份: 2012
• 资助国家: 美国
• 起止时间: 2012-09-01 至 2016-08-31
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=1161813&HistoricalAwards=false
• 关键词: CSR; Medium; Limiting; Manipulation; Data

Datacenters and clouds have become the main compute platform for many large scale corporations. Petabyte-scale datasets are stored throughout the datacenter and hundreds to thousands of different users submit jobs to collect business intelligence, gather statistics, or to compute essential data, such as a large scale index or a list of top users or their message posts. However, a significant challenge to these centers arises from user manipulation by some or all of the many tenants (both intentional and unintentional) of the underlying resource allocation mechanisms through misreporting of true job characteristics.This project is designing and testing new algorithms combining ideas from computer science and economics which will make datacenters and clouds more robust to user manipulations. It is initially focusing on two important abstractions. The first allocates the total amount of resources and the second allocates individual machines (or virtual machines). The former is the standard abstraction for datacenters and the latter for many clouds, such as Facebook's internal cluster and Amazon's public EC2. For the former, where there are existing non-manipulable algorithms, the PIs are developing extensions to support new requirements, such as jobs with constraints. For the latter, the PIs are inventing new non-manipulable algorithms based on their preliminary studies. In addition, this project is applying recent results from algorithmic mechanism design and game theory to develop general procedures for converting existing manipulable protocols into non-manipulable ones.This project will lead to more robust mechanisms for datacenters and clouds, reducing costs and energy usage.

数据中心和云已成为许多大型公司的主要计算平台。 PETABYTE规模的数据集存储在整个数据中心，数百名不同的用户提交工作以收集商业智能，收集统计信息或计算基本数据，例如大型索引或顶级用户列表或其消息帖子。但是，这些中心的一个重大挑战是由于一些或全部租户（无论是故意和无意）中的某些或所有租户通过误报出的真实工作特征而对基本资源分配机制的用户操纵引起的。该项目正在设计和测试新的算法，从而使计算机科学和经济学的想法相结合，这些想法将使数据现场和云变得更加富有努力，以使其更加稳固。最初，它专注于两个重要的抽象。第一个分配资源总量，第二个分配了单个机器（或虚拟机）。前者是数据中心的标准抽象，而后者是许多云的标准抽象，例如Facebook的内部集群和亚马逊的公共EC2。对于前者，如果存在现有的不可操纵算法，则PI正在开发扩展以支持新需求的扩展，例如具有约束的工作。对于后者，PI是根据其初步研究发明新的不可操纵算法的。此外，该项目正在应用算法机理设计和游戏理论的最新结果，以开发将现有可操作协议转换为不可操作的程序的一般程序。此项目将为数据中心和云提供更多强大的机制，降低成本和能源使用。