CSR: Medium: Collaborative Research: GPL: General-Purpose Lambda Computing

CSR：媒介：协作研究：GPL：通用 Lambda 计算

• 批准号: 1763256
• 负责人: Keith Winstein
• 金额: $ 80万
• 依托单位: Stanford University
• 依托单位国家: 美国
• 项目类别: Continuing Grant
• 财政年份: 2018
• 资助国家: 美国
• 起止时间: 2018-09-01 至 2022-08-31
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=1763256&HistoricalAwards=false
• 关键词: CSR; Medium; Collaborative; Research; GPL

The project will design ways for computer programs to do things in a few seconds that would ordinarily take hours, by borrowing thousands of computers at once. Until recently, this was not possible or economical: the companies that rent computers required minutes of advance notice, with a minimum bill of at least ten minutes. Recently, new technology called "function-as-a-service computing" allows people to rent thousands of unreliable computers at the same time with no advance notice, for fractions of a second. This project will design software, storage systems, and programming languages to use this technology robustly for large calculations.This research aims to deliver a new model of "burst parallel" applications and systems. This model takes advantage of new function-as-a-service offerings by cloud-computing providers such as Amazon, Microsoft, and Google. In this model, fine-grained "ephemeral lambdas" enable large-scale parallel computations at low cost. With careful attention to algorithm parallelization, we argue that many both old and new data processing tasks can be adapted into a model of functions that operate on small pieces of data, executed in a burst-parallel manner to achieve interactive performance demands, in a way that can be debugged, traced, and understood.This project intends to provide the application blueprint and systems foundation to enable end-users and developers to access massive amounts of parallelism on demand, while only paying for those resources actually consumed by an application. The researchers will engage with the developer community to ensure that others are able to use and build upon the work. In addition to integrating this research into course curricula, the researchers have a formalized program for embedding under-represented minority undergraduate students into their research groups.Software will be released under open-source software licenses pursuant to the policies of the University of California and Stanford University, and distributed through the project website and through traditional means of distribution of open-source software (e.g., GNU/Linux distributions, ports collections, app stores, etc.). Data, code, and evaluation results will continue to be hosted for at least three years after project completion at https://gplambda.github.io.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.

该项目将设计方法，通过同时借用数千台计算机，让计算机程序在几秒钟内完成通常需要几个小时的事情。直到最近，这还是不可能或不经济的：租赁计算机的公司需要提前几分钟通知，最低费用至少为十分钟。最近，一种名为“功能即服务计算”的新技术允许人们在不提前通知的情况下，在几分之一秒的时间内同时租用数千台不可靠的计算机。该项目将设计软件、存储系统和编程语言，以稳健地使用该技术进行大型计算。这项研究旨在提供一种新的“突发并行”应用程序和系统模型。该模型利用了亚马逊、微软和谷歌等云计算提供商提供的新功能即服务产品。在此模型中，细粒度的“临时 lambda”能够以低成本实现大规模并行计算。 通过仔细关注算法并行化，我们认为许多新旧数据处理任务都可以适应对小块数据进行操作的函数模型，以突发并行方式执行，以在某种程度上实现交互式性能需求该项目旨在提供应用程序蓝图和系统基础，使最终用户和开发人员能够按需访问大量并行性，而只需为应用程序实际消耗的资源付费。研究人员将与开发者社区合作，以确保其他人能够使用该工作并在此基础上进行构建。除了将这项研究纳入课程之外，研究人员还制定了一项正式计划，将代表性不足的少数族裔本科生纳入他们的研究小组。软件将根据加州大学和斯坦福大学的政策，在开源软件许可下发布大学，并通过项目网站和传统的开源软件分发方式（例如 GNU/Linux 发行版、ports 集合、应用程序商店等）进行分发。数据、代码和评估结果将在项目完成后在 https://gplambda.github.io 上继续托管至少三年。该奖项反映了 NSF 的法定使命，并被认为值得通过使用基金会的智力评估进行支持优点和更广泛的影响审查标准。

项目成果

Sidecar: in-network performance enhancements in the age of paranoid transport protocols

Sidecar：偏执传输协议时代的网络内性能增强

• DOI: 10.1145/3563766.3564113
• 发表时间: 2022
• 期刊: The Twenty-first ACM Workshop on Hot Topics in Networks (HotNets 2022
• 作者: Yuan, Gina;Zhang, David K.;Sotoudeh, Matthew;Welzl, Michael;Winstein, Keith
• 通讯作者: Winstein, Keith

From Laptop to Lambda: Outsourcing Everyday Jobs to Thousands of Transient Functional Containers

• 发表时间: 2019-07
• 作者: Sadjad Fouladi;Francisco Romero;Dan Iter;Qian Li;Shuvo Chatterjee;Christos Kozyrakis;M. Zaharia;Keith Winstein

Computation-centric networking

以计算为中心的网络

• DOI: 10.1145/3563766.3564106
• 发表时间: 2022
• 期刊: HotNets
• 作者: Deng, Yuhan;Montemayor, Angela;Levy, Amit;Winstein, Keith
• 通讯作者: Winstein, Keith

TACK: Improving Wireless Transport Performance by Taming Acknowledgments

• DOI: 10.1145/3387514.3405850
• 发表时间: 2020-07
• 期刊: Proceedings of the Annual conference of the ACM Special Interest Group on Data Communication on the applications, technologies, architectures, and protocols for computer communication
• 作者: Tong Li;Kai Zheng;Ke Xu;R. Jadhav;Tao Xiong;Keith Winstein;Kun Tan

R2E2: low-latency path tracing of terabyte-scale scenes using thousands of cloud CPUs

R2E2：使用数千个云CPU对TB级场景进行低延迟路径追踪

• DOI: 10.1145/3528223.3530171
• 发表时间: 2022
• 期刊: ACM Transactions on Graphics
• 影响因子: 6.2
• 作者: Fouladi, Sadjad;Shacklett, Brennan;Poms, Fait;Arora, Arjun;Ozdemir, Alex;Raghavan, Deepti;Hanrahan, Pat;Fatahalian, Kayvon;Winstein, Keith
• 通讯作者: Winstein, Keith