Collaborative Research: SHF: Small: Exploiting Performance Correlations for Accurate and Low-cost Performance Testing for Serverless Computing

协作研究：SHF：小型：利用性能相关性对无服务器计算进行准确且低成本的性能测试

• 批准号: 2155096
• 负责人: Wei Wang
• 金额: $ 32.93万
• 依托单位: University of Texas at San Antonio
• 依托单位国家: 美国
• 项目类别: Standard Grant
• 财政年份: 2022
• 资助国家: 美国
• 起止时间: 2022-06-15 至 2025-05-31
• 项目状态: 未结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=2155096&HistoricalAwards=false
• 关键词: Collaborative; Research; SHF; Small; Exploiting

As organizations increasingly port their applications to cloud services instead of using local resources, they face the challenge of determining how to use cloud resources and maintain good interactive experiences for their application users while reducing their cloud usage costs. Serverless computing greatly simplifies the deployment of large-scale cloud applications by automatically provisioning and managing the servers and removing this burden from cloud developers. However, cloud developers still need to determine the most cost-effective cloud-resource allocations for their deployments and debug performance issues in their serverless applications. This research focuses on providing cloud-application developers with accurate performance knowledge by addressing the lack of performance testing tools to accurately determine the performance of serverless cloud applications. The success of this research can reduce the deployment costs and improve the performance satisfaction for organizations, such as education, research, and health institutions, that utilize serverless clouds. This research specifically addresses the scalability and workflow challenges that serverless computing sets forth to accurate performance testing through the design of novel performance-testing frameworks that will utilize correlation-aware, non-parametric statistical tools, including clustered-block bootstrap and regression-based bootstrap. It will provide three accurate, low-cost, and automated serverless performance-testing frameworks, specifically for: 1) unit testing for a single serverless application's performance by exploiting the correlation within the application's performance testing data from simultaneous invocations (i.e., intra-application correlation); 2) integration testing for the performance correlation between two serverless applications (i.e., inter-application correlation); and 3) integration testing for the overall performance of a workflow of serverless applications by exploiting both intra- and inter-application correlations. The insights and techniques developed in this project will also deepen the research community's understanding of the performance characteristics of serverless computing and on how to effectively analyze serverless performance using modern statistical tools.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.

随着组织越来越多地将其应用程序移植到云服务而不是使用本地资源，他们面临着确定如何使用云资源并为应用程序用户保持良好的交互体验，同时降低云使用成本的挑战。 无服务器计算通过自动配置和管理服务器并消除云开发人员的负担，极大地简化了大规模云应用程序的部署。 然而，云开发人员仍然需要为其部署确定最具成本效益的云资源分配，并调试无服务器应用程序中的性能问题。这项研究的重点是通过解决缺乏性能测试工具来准确确定无服务器云应用程序性能的问题，为云应用程序开发人员提供准确的性能知识。这项研究的成功可以降低部署成本并提高使用无服务器云的组织（例如教育、研究和医疗机构）的性能满意度。这项研究专门解决了无服务器计算通过设计新颖的性能测试框架来实现精确性能测试所面临的可扩展性和工作流程挑战，该框架将利用相关性感知、非参数统计工具，包括集群块引导程序和基于回归的引导程序。它将提供三种准确、低成本和自动化的无服务器性能测试框架，特别适用于： 1) 通过利用来自同时调用（即应用程序内）的应用程序性能测试数据之间的相关性，对单个无服务器应用程序的性能进行单元测试。相关性）; 2）对两个无服务器应用程序之间的性能相关性（即应用程序间相关性）进行集成测试； 3) 通过利用应用程序内和应用程序间的相关性，对无服务器应用程序工作流的整体性能进行集成测试。该项目中开发的见解和技术也将加深研究界对无服务器计算的性能特征以及如何使用现代统计工具有效分析无服务器性能的理解。该奖项反映了 NSF 的法定使命，并通过评估认为值得支持利用基金会的智力优势和更广泛的影响审查标准。

项目成果

Virtual Summer Camp for High School Students with Disabilities - An Experience Report

残疾高中生虚拟夏令营 - 经验报告

• DOI: 10.1145/3545945.3569818
• 发表时间: 2023
• 期刊: Proceedings of the 54th ACM Technical Symposium on Computer Science Education
• 作者: Wang, Wei;Ewoldt, Kathy B.;Xie, Mimi;Mestas-Nuñez, Alberto M.;Soderman, Sean;Wang, Jeffrey
• 通讯作者: Wang, Jeffrey

CloudBruno: A Low-Overhead Online Workload Prediction Framework for Cloud Computing

• DOI: 10.1109/ic2e55432.2022.00027
• 发表时间: 2022-09
• 期刊: 2022 IEEE International Conference on Cloud Engineering (IC2E)
• 作者: V. Jayakumar;Shivani Arbat;I. Kim;Wei Wang

A Study of Java Microbenchmark Tail Latencies

Java Microbenchmark 尾部延迟的研究

• DOI: 10.1145/3578245.3584690
• 发表时间: 2023
• 期刊: Companion of the 2023 ACM/SPEC International Conference on Performance Engineering
• 作者: He, Sen;Kim, In Kee;Wang, Wei
• 通讯作者: Wang, Wei