CSR: Small: Towards Programming Datacenters

CSR：小型：迈向数据中心编程

• 批准号: 1817116
• 负责人: Scott Shenker
• 金额: $ 50万
• 依托单位: International Computer Science Institute
• 依托单位国家: 美国
• 项目类别: Standard Grant
• 财政年份: 2018
• 资助国家: 美国
• 起止时间: 2018-07-01 至 2022-06-30
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=1817116&HistoricalAwards=false
• 关键词: CSR; Small; Towards; Programming; Datacenters

This project seeks to redefine how developers can exploit the computational power of modern datacenters. Today, developers must specify how each compute job is split across the many machines in a datacenter. This project will allow programmers to merely write programs intended for a single machine; these programs are then transformed (by the technologies developed in this project) into a form that can take advantage of the abundant parallelism available in datacenters. Thus, in this approach, developers are not just programming a single computer, but the entire datacenter.This project leverages the recent advances in serverless computing, and extends its generality by addressing several fundamental questions, such as:- How can one provide fault tolerance and improved Input/Output performance for both existing and emerging serverless applications?- How can one efficiently ensure consistency when running serverless applications which might access the same data? - Can one automatically translate code written to be executed on a single server so it can run in a serverless environment where each execution is only allowed to run for bounded time (after which it is terminated)? Serverless computing is an increasingly popular paradigm, since it allows application developers to deploy applications without managing individual virtual machines. However, the current approach is incomplete which both impacts its generality (by limiting applications that can be executed) and correctness (since correctly implementing applications requires developers to reason about runtimes and resource access times). This project will eliminate these limitations of serverless computing, thus enabling a larger set of applications to be deployed as serverless applications. This will make it easier to harness the power of datacenters, thereby enabling progress in myriad areas of significant social and commercial importance. The work developed in this project will be placed on a public github repository, with the appropriate documentation so that the technologies are available to all interested parties.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.

该项目旨在重新定义开发人员如何利用现代数据中心的计算能力。如今，开发人员必须指定如何在数据中心的多台计算机上分配每个计算作业。该项目将允许程序员仅编写针对单台机器的程序；然后，这些程序（通过该项目中开发的技术）转换为可以利用数据中心中丰富的并行性的形式。因此，在这种方法中，开发人员不仅仅是对一台计算机进行编程，而是对整个数据中心进行编程。该项目利用了无服务器计算的最新进展，并通过解决几个基本问​​题来扩展其通用性，例如：如何提供容错能力并提高现有和新兴无服务器应用程序的输入/输出性能？ - 在运行可能访问相同数据的无服务器应用程序时，如何有效确保一致性？ - 是否可以自动翻译编写为在单个服务器上执行的代码，以便它可以在无服务器环境中运行，其中每次执行只允许运行有限的时间（之后终止）？无服务器计算是一种越来越流行的范例，因为它允许应用程序开发人员在不管理单个虚拟机的情况下部署应用程序。然而，当前的方法并不完整，这既影响了其通用性（通过限制可以执行的应用程序）又影响了正确性（因为正确实现应用程序需要开发人员推断运行时和资源访问时间）。该项目将消除无服务器计算的这些限制，从而使更多的应用程序能够部署为无服务器应用程序。这将使利用数据中心的力量变得更容易，从而在具有重要社会和商业重要性的无数领域取得进展。该项目开发的工作将放在公共 github 存储库上，并附有适当的文档，以便所有感兴趣的各方都可以使用该技术。该奖项反映了 NSF 的法定使命，并通过使用基金会的智力价值进行评估，被认为值得支持以及更广泛的影响审查标准。

项目成果

Kappa: a programming framework for serverless computing

Kappa：无服务器计算的编程框架

• DOI: 10.1145/3419111.3421277
• 发表时间: 2020-10-12
• 期刊: Proceedings of the 11th ACM Symposium on Cloud Computing
• 作者: Wen Zhang;Vivian Fang;Aurojit P;a;a;S. Shenker
• 通讯作者: S. Shenker

Persistent State Machines for Recoverable In-memory Storage Systems with NVRam}

使用 NVRam 的可恢复内存存储系统的持久状态机}

• 发表时间: 2020-01
• 期刊: 14th {USENIX} Symposium on Operating Systems Design and Implementation ({OSDI} 20
• 作者: Zhang, Wen;Shenker, Scott;Zhang, Irene
• 通讯作者: Zhang, Irene