NeTS: Medium: SLATE: Service Layer Traffic Engineering

NeTS：媒介：SLATE：服务层流量工程

• 批准号: 2312714
• 负责人: Philip Godfrey
• 金额: $ 108.5万
• 依托单位: University of Illinois at Urbana-Champaign
• 依托单位国家: 美国
• 项目类别: Standard Grant
• 财政年份: 2023
• 资助国家: 美国
• 起止时间: 2023-10-01 至 2027-09-30
• 项目状态: 未结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=2312714&HistoricalAwards=false
• 关键词: NeTS; Medium; SLATE; Service; Layer

Most people use online applications -- web sites, maps, videoconferencing, shopping, messaging, and more -- on their phones and laptops every day. These applications are hosted in clouds, meaning that important parts of their application logic, databases, and storage run on servers in large data centers, typically in multiple sites across the country or world. Such applications usually involve many distinct components of software performing dozens or hundreds of small tasks behind the scenes to collectively produce the result the user wants, like a web page or a high-quality video stream. Because of the complexity of these cloud-hosted applications and the unpredictable workload they receive from users, it is difficult to optimize their performance and resource usage. The typical result today is that applications' resources are overprovisioned -- meaning, they are allocated much more computing resources than necessary; 70% waste, or even more, is common. Current methods to deal with this problem try to plan better long-term resource allocations, but do not help with short-term workload changes and do not help with network-related costs.This project will design and develop a system called Service Layer Traffic Engineering (SLATE). SLATE will help cloud-hosted applications to optimize the performance of tasks, deal gracefully with short-term workload fluctuations with less resource waste, and optimize cloud bandwidth and computing costs. At a technical level, SLATE will provide easily usable optimization for modern cloud-hosted applications with a new optimization layer beneath the application. SLATE focuses on applications which are microservice-based: such applications split each task into many small components which run on different servers. SLATE will extend existing open-source service meshes, which today provide networking functionality for microservice-based applications. However, this involves significant new challenges. First, the project will develop techniques to prioritize requests automatically across bottlenecks spanning multiple resource types (computing and network capacity). Second, the project will design methods to route requests in real time among possible servers, intelligently trading off latency, cost, bandwidth, and outlier considerations in multi-cluster environments. Third, the project will develop a theoretically grounded approach to decompose the service layer traffic engineering problem into a decentralized design, with local decisions enabling fast reaction, and just enough global coordination to achieve optimality.The project will seek to achieve substantial broader impact by benefiting cloud-hosted applications with significant performance, resource utilization, and cost improvements. The project will also support activities to broaden participation in computing, including mentoring Research Experiences for Undergraduates (REU) students, attracting applicants from underrepresented groups, and participating in the EECS Rising Stars workshops.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.

大多数人每天都在手机和笔记本电脑上使用在线应用程序 - 网站，地图，视频会议，购物，消息等。 这些应用程序托管在云中，这意味着其应用程序逻辑，数据库和存储的重要部分在大型数据中心的服务器上运行，通常在全国或世界各地的多个站点中。 此类应用程序通常涉及许多不同的软件组件，这些软件在幕后执行数十个或数百个小任务，以共同产生用户想要的结果，例如网页或高质量的视频流。由于这些云托管应用程序的复杂性以及从用户那里获得的不可预测的工作量，因此很难优化其性能和资源使用情况。 当今的典型结果是，应用程序的资源被过度提供了 - 意味着它们的计算资源比必要的要多得多； 70％的浪费，甚至更多是常见的。 解决此问题的当前方法试图计划更好的长期资源分配，但没有帮助短期工作量更改，并且无助于与网络相关的成本。该项目将设计和开发一个称为服务层的系统，称为服务层交通交通工程（石板）。 Slate将帮助云托管应用程序优化任务的性能，优雅地处理较少资源浪费的短期工作负载波动，并优化云带宽和计算成本。在技​​术层面上，Slate将为现代云托管应用程序提供易于使用的优化，并在应用程序下方具有新的优化层。 Slate专注于基于微服务的应用程序：此类应用程序将每个任务分为许多在不同服务器上运行的小组件。 Slate将扩展现有的开源服务网格，如今，该服务为基于微服务的应用程序提供网络功能。 但是，这涉及重大的新挑战。 首先，该项目将开发技术以跨越多种资源类型（计算和网络容量）的瓶颈自动确定请求的优先级。 其次，该项目将设计方法，以在可能的服务器之间实时路由请求，在多群集环境中智能地交易潜伏期，成本，带宽和离群值。 第三，该项目将开发一种理论上扎根的方法，将服务层交通工程问题分解为分散的设计，并具有在本地决策中实现快速反应，并且足够的全球协调以实现最佳性。该项目将寻求通过受益而获得更广泛的影响。具有大量性能，资源利用和成本提高的云托管应用程序。 该项目还将支持活动以扩大计算的活动，包括指导本科生（REU）学生的研究经验，吸引了代表性不足的团体的申请人，并参加了EEC的EEC崛起明星讲习班。这一奖项反映了NSF的法规任务，并被认为是值得的。通过基金会的智力优点和更广泛的影响评估标准通过评估来支持。