SHF: Small: A Distributed Scalable End-to-End Tail Latency SLO Guaranteed Resource Management Framework for Microservices

SHF：Small：分布式可扩展端到端尾部延迟 SLO 保证的微服务资源管理框架

• 批准号: 2226117
• 负责人: Hong Jiang
• 金额: $ 60万
• 依托单位: University of Texas at Arlington
• 依托单位国家: 美国
• 项目类别: Standard Grant
• 财政年份: 2022
• 资助国家: 美国
• 起止时间: 2022-10-01 至 2025-09-30
• 项目状态: 未结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=2226117&HistoricalAwards=false
• 关键词: SHF; Small; Distributed; Scalable; End

Microsevice architecture typically yields highly scalable, maintainable, testable and loosely coupled systems. For this reason, cloud-computing services are shifting from traditional monolithic architectures to microservice architectures to enable fast development, easy debugging and frequent software updating. A primary design goal of cloud computing is to provide user-centric services that meet diverse end-to-end application query tail-latency Service Level Objective (SLO) requirements, while maximizing system-resource utilization. This proposal aims at developing such an approach, known as Distributed scalable End-to-end Tail lAtency SLO Guaranteed rEsource Management framework for microservices (DETAGEM). DETAGEM explores foundational principles to establish a solid theoretical foundation towards a comprehensive solution for resource allocation with guaranteed per-query tail-latency SLO. The algorithms and tools developed in DETAGEM will be made available to benefit a broad set of researchers, engineers and educators, and thereby advancing research across a range of other areas. Moreover, the obtained results from this project will be integrated into existing undergraduate and graduate curricula on a continuous basis. The involvement of underrepresented students in this proposed research at The University of Texas at Arlington will enhance their competitiveness in the future job market.DETAGEM is a comprehensive distributed scalable solution rooted in fundamental principles. The approach taken by DETAGEM is to (a) derive a mathematical foundation that maps the SLO for Directed Acyclic Graph (DAG) workflows for queries to the task queuing budgets for tasks in the queies at their respective microservices, based on the statistics of unloaded task response time measured at individual microservices at runtime; and (b) develop task-queuing-budget-aware queue-management schemes and resource-auto-scaling schemes based on measured task-queuing budget-violation ratios. The objective is to ensure that all the microservices meet their respective task-queuing budgets, which will then guarantee that the end-to-end query tail-latency SLO for the queries are satisfied. The successful completion of the proposed project is expected to greatly advance the state-of-the-art in terms of methodologies, theories, and practical solutions for the microservice architecture.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.

Microsevice架构通常会产生高度可扩展，可维护，可测试和松散的耦合系统。因此，云计算服务正在从传统的整体体系结构转变为微服务架构，以实现快速开发，简单的调试和频繁的软件更新。云计算的主要设计目标是提供以用户为中心的服务，以满足各种端到端应用程序查询尾部延迟服务水平目标（SLO）的要求，同时最大程度地提高系统资源资源利用率。该建议旨在开发这种方法，称为分布式可扩展的端到端尾部潜伏期SLO保证了微服务的资源管理框架（DESTAGEM）。 DEDAGEM探讨了基本原理，以建立扎实的理论基础，以提供保证的尾部延迟slo的综合解决方案。 将在DeTagem开发的算法和工具可供使用，以使广泛的研究人员，工程师和教育工作者受益，从而在许多其他领域进行研究。此外，该项目获得的结果将连续整合到现有的本科和研究生课程中。在德克萨斯大学阿灵顿分校的这项拟议的研究中，代表不足的学生的参与将提高他们在未来的就业市场中的竞争力。Detagem是一种综合分布式可扩展的解决方案，植根于基本原则。 DEDAGEM采用的方法是（a）得出数学基础，该数学基础映射了针对查询的定向无环形图（DAG）工作流程的工作流程，以根据在运行时在运行时在单个Microservices上测量的无载任务响应的统计数据，以在各自的微服务中对任务的任务排队预算排列预算； （b）基于测量的任务 - 筹备预算暴力比率，开发任务 - 筹备的预算 - 征收的队列管理计划和资源自动范围标准。 目的是确保所有微服务都符合各自的任务招募预算，然后确保满足查询的端到端查询尾部延迟SLO。预计拟议项目的成功完成将在微服务架构的方法，理论和实际解决方案方面大大提高最先进的方法。该奖项反映了NSF的法定任务，并被认为是值得通过基金会的知识分子优点和更广泛的审查标准来通过评估来通过评估来支持的。

项目成果

TailGuard: Tail Latency SLO Guaranteed Task Scheduling for Data-Intensive User-Facing Applications

• DOI: 10.1109/icdcs57875.2023.00042
• 发表时间: 2023-07
• 期刊: 2023 IEEE 43rd International Conference on Distributed Computing Systems (ICDCS)
• 作者: Zhijun Wang;Huiyang Li;Lin Sun;Todd Rosenkrantz;Hao Che;Hong Jiang

User Disengagement-Oriented Target Enforcement for Multi-Tenant Database Systems

• DOI: 10.1145/3620678.3624668
• 发表时间: 2023-10
• 期刊: Proceedings of the 2023 ACM Symposium on Cloud Computing
• 作者: Ning Li;Hong Jiang;Hao Che;Zhijun Wang;Minh Q. Nguyen;Todd Rosenkrantz