CNS Core: Small: Collaborative Research: HEECMA: A Hybrid Elastic Edge-Cloud Application Management Architecture

CNS 核心：小型：协作研究：HEECMA：混合弹性边缘云应用管理架构

• 批准号: 1908677
• 负责人: Abraham Matta
• 金额: $ 24.98万
• 依托单位: Trustees of Boston University
• 依托单位国家: 美国
• 项目类别: Standard Grant
• 财政年份: 2019
• 资助国家: 美国
• 起止时间: 2019-10-01 至 2023-09-30
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=1908677&HistoricalAwards=false
• 关键词: CNS; Core; Small; Collaborative; Research

Application software is becoming increasingly abundant in functionality and increasingly demanding of resources, e.g., memory and compute power. This project examines how application software, e.g., a Virtual Reality (VR) based drone control application, can be partitioned and deployed over different parts of a distributed computing infrastructure, i.e., resources are managed by a hybrid of service and cloud providers. Research questions that will be answered include: what is the best partitioning of the application that balances compute and memory demand for each application component (function) and the communication needs between these functions? Which provider should be used for each application function so that it runs quickly at the lowest cost? Moreover, how should the system adapt to changes in the availability of resources to maintain a high level of quality of experience for users?The project will develop the theoretical foundations of decomposing applications over a distributed complex cyberinfrastructure. We will study various decompositions and corresponding virtualization and resource allocation services offered by different providers with resources at the edge of the infrastructure, i.e., closer to users, and at the core, i.e., deeper into the infrastructure. The goal is to find the "best" decomposition to meet users' quality of experience while reducing the cost/price for the users. The decomposed (distributed) solution will be realized by employing corresponding feedback control algorithms and game-theoretic incentives. The project will then experiment with three classes of applications to validate these theoretical foundations: streaming Augmented/Virtual Reality (AR/VR), intrusion detection, and spatiotemporal ecological forecasting. Toward this end, a prototype will be developed and evaluated over existing open cloud infrastructures (e.g., GENI, CloudLab, Chameleon), commercial clouds, as well as private clouds (e.g., Massachusetts Open Cloud).This project will advance the state of the art in the area of application software decomposition and deployment over large-scale hybrid cloud infrastructures. The theoretical foundations and experimental validation of the work will inform the design and deployment of other foreseen and unforeseen applications. The performance and cost gains will translate to more efficient use of resources and consequently, a society that is better connected and greener. Outreach efforts will include several activities: (1) the development and delivery of hands-on tutorials that involve partitioning and running application software over a distributed cyberinfrastructure managed by multiple providers, (2) the organization of annual summer camps on cyberinfrastructure operations and management for high school students, and (3) the training and mentoring of minority and under-represented students working on research related to this project. The project will maintain a website at http://csr.bu.edu/heecma for the duration of this grant and beyond. The website will contain all the publications and results of this project in the form of code, prototype, and tutorials.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.

应用软件的功能越来越丰富，对内存和计算能力等资源的要求也越来越高。该项目研究了应用软件（例如基于虚拟现实（VR）的无人机控制应用程序）如何在分布式计算基础设施的不同部分上进行分区和部署，即资源由服务和云提供商的混合体进行管理。将回答的研究问题包括：平衡每个应用程序组件（功能）的计算和内存需求以及这些功能之间的通信需求的应用程序的最佳分区是什么？每个应用程序功能应该使用哪个提供商，以便以最低的成本快速运行？此外，系统应如何适应资源可用性的变化，以保持用户的高水平体验质量？该项目将开发在分布式复杂网络基础设施上分解应用程序的理论基础。我们将研究不同提供商提供的各种分解和相应的虚拟化和资源分配服务，资源位于基础设施边缘（即更靠近用户）和核心（即更深入基础设施）。目标是找到“最佳”分解以满足用户的体验质量，同时降低用户的成本/价格。分解（分布式）解决方案将通过采用相应的反馈控制算法和博弈论激励来实现。 然后，该项目将尝试三类应用程序来验证这些理论基础：流媒体增强/虚拟现实（AR/VR）、入侵检测和时空生态预测。为此，将在现有的开放云基础设施（例如 GENI、CloudLab、Chameleon）、商业云以及私有云（例如马萨诸塞州开放云）上开发和评估原型。该项目将推进应用软件分解和大规模混合云基础设施部署领域的艺术。 这项工作的理论基础和实验验证将为其他可预见和不可预见的应用程序的设计和部署提供信息。性能和成本收益将转化为更有效地利用资源，从而形成一个更加互联和更加绿色的社会。外展工作将包括几项活动：(1) 开发和提供实践教程，其中涉及在由多个提供商管理的分布式网络基础设施上分区和运行应用程序软件，(2) 组织关于网络基础设施运营和管理的年度夏令营高中生，以及 (3) 培训和指导从事与本项目相关研究的少数族裔和代表性不足的学生。在本次拨款期间及之后，该项目将维护一个网站：http://csr.bu.edu/heecma。该网站将以代码、原型和教程的形式包含该项目的所有出版物和结果。该奖项反映了 NSF 的法定使命，并通过使用基金会的智力价值和更广泛的影响审查标准进行评估，被认为值得支持。

项目成果

A Throughput Optimizing Scheduler for Multi-Cloud Serverless Computing

用于多云无服务器计算的吞吐量优化调度程序

• 发表时间: 2023-12
• 期刊: THE 14TH IEEE INTERNATIONAL CONFERENCE ON CLOUD COMPUTING TECHNOLOGY AND SCIENCE
• 作者: Mina Morcos and Ibrahim Matta

COSE: Configuring Serverless Functions using Statistical Learning

COSE：使用统计学习配置无服务器功能

• DOI: 10.1109/infocom41043.2020.9155363
• 发表时间: 2020-07
• 期刊: IEEE INFOCOM 2020 - IEEE Conference on Computer Communications
• 作者: Akhtar, Nabeel;Raza, Ali;Ishakian, Vatche;Matta, Ibrahim
• 通讯作者: Matta, Ibrahim

SoK: Function-As-A-Service: From An Application Developer’s Perspective

SoK：功能即服务：从应用程序开发人员的角度来看

• DOI: 10.5070/sr31154815
• 发表时间: 2021-09
• 期刊: Journal of Systems Research
• 作者: Raza, Ali;Matta, Ibrahim;Akhtar, Nabeel;Kalavri, Vasiliki;Isahagian, Vatche
• 通讯作者: Isahagian, Vatche

Combining split and federated architectures for efficiency and privacy in deep learning

结合分离和联合架构以提高深度学习的效率和隐私

• DOI: 10.1145/3386367.3431678
• 发表时间: 2020-11-23
• 期刊: Proceedings of the 16th International Conference on emerging Networking EXperiments and Technologies
• 作者: Valeria Turina;Zongshun Zhang;Flavio Esposito;I. Matta
• 通讯作者: I. Matta

Federated or Split? A Performance and Privacy Analysis of Hybrid Split and Federated Learning Architectures

联合还是分裂？

• DOI: 10.1109/cloud53861.2021.00038
• 发表时间: 2021-09-01
• 期刊: 2021 IEEE 14th International Conference on Cloud Computing (CLOUD)
• 作者: Valeria Turina;Zongshun Zhang;Flavio Esposito;I. Matta
• 通讯作者: I. Matta