CC* Integration-Small: Enhancing Data Transfers by Enabling Programmability and Closed-loop Control in a Non-programmable Science DMZ

CC* Integration-Small：通过在不可编程科学 DMZ 中启用可编程性和闭环控制来增强数据传输

• 批准号: 2346726
• 负责人: Jorge Crichigno
• 金额: $ 50万
• 依托单位: University of South Carolina at Columbia
• 依托单位国家: 美国
• 项目类别: Standard Grant
• 财政年份: 2024
• 资助国家: 美国
• 起止时间: 2024-07-01 至 2026-06-30
• 项目状态: 未结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=2346726&HistoricalAwards=false
• 关键词: CC; Integration; Small; Enhancing; Data

Programmable data plane (PDP) switches have recently attracted significant attention from the communications industry. They are network devices that provide unprecedented visibility of events occurring in data networks and enable engineers to write software applications using the P4 programming language. The applications leverage the visibility and performance capacity of PDP switches, where applications can run orders of magnitude faster than those running on general-purpose computers. This project will deploy a "self-driving" network – referred to as Science DMZ – at the University of South Carolina (USC), using P4 applications running on PDP switches. The enhanced network will support science and engineering projects that foster the progress of science. Specifically, it will enable faculty members, researchers, and students to transfer big science data more efficiently within USC's campus and with external collaborators such as U.S. Department of Energy's laboratories (e.g., Savannah River, Argonne), national computing centers (e.g., San Diego Supercomputer Center, National Energy Research Scientific Computing Center), and international organizations (e.g., European Organization for Nuclear Research – CERN). The project has two objectives: 1) Develop a self-driving Science DMZ, capable of enhancing performance and fairness. Traffic will be monitored by PDP switches operating at terabits per second (Tbps) rate, and functions commonly executed on general-purpose CPUs will be offloaded to the PDP switches. The scheme will leverage the granular telemetry and the processing speed of the switches to automate the configuration of the Science DMZ and address challenges observed by USC and the community, such as traffic policing and optimal buffer sizing. Additionally, the project will extend perfSONAR to passively incorporate the telemetry generated by PDP switches, introduce real-time reporting on a per-flow basis, and add new metrics such as queue occupancy and packet interarrival time (i.e., per-packet visibility). 2) Disseminate the P4 technology by developing open-source P4 virtual lab libraries. The libraries will run on USC's cloud platform, referred to as the Academic Cloud, and on FABRIC. The Academic Cloud is used by several colleges and universities, researchers, and the cyberinfrastructure (CI) community for academic courses, workshops, and self-paced training. The libraries on FABRIC will use JupyterHub notebooks, incorporate the learner's customized topology, and embed P4 code alongside explanatory documentation, videos, and other visual aids. Finally, the project will support four PhD students and ten undergraduate students who will deploy the enhanced network under the guidance of the Principal Investigators and CI engineers.This project is jointly funded by the Office of Advanced Cyberinfrastructure, the Established Program to Stimulate Competitive Research (EPSCoR), and the Division of Computer and Network Systems.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.

可编程数据平面 (PDP) 交换机最近引起了通信行业的极大关注，它们是一种网络设备，可以提供数据网络中发生的事件的前所未有的可见性，并使工程师能够使用 P4 编程语言编写软件应用程序。 PDP 交换机的性能能力，其中应用程序的运行速度比通用计算机上运行的速度快几个数量级。该项目将在南卡罗来纳大学 (USC) 部署一个“自动驾驶”网络（称为 Science DMZ）。 ，使用运行在增强的网络将支持促进科学进步的科学和工程项目，具体来说，它将使教职员工、研究人员和学生能够在南加州大学校园内以及与美国科学系等外部合作者之间更有效地传输大科学数据。能源实验室（例如萨凡纳河、阿贡）、国家计算中心（例如圣地亚哥超级计算机中心、国家能源研究科学计算中心）和国际组织（例如欧洲组织）该项目有两个目标：1) 开发一个自动驾驶科学 DMZ，能够增强性能和公平性，并将由以每秒太比特 (Tbps) 速率运行的 PDP 交换机进行监控，并执行常用功能。通用 CPU 上的数据将被卸载到 PDP 交换机上，该方案将利用交换机的精细遥测和处理速度来自动配置 Science DMZ，并解决 USC 和实验室观察到的挑战。此外，该项目还将扩展 perfSONAR，以被动地合并 PDP 交换机生成的遥测数据，引入基于每个流的实时报告，并添加新的指标，例如队列占用率和数据包。到达间隔时间（即每个数据包的可见性）。 2) 传播由开源 P4 虚拟实验室库开发的 P4 技术。这些库将在 USC 的云平台上运行，称为学术库。 FABRIC 上的学术云被多所学院和大学、研究人员和网络基础设施 (CI) 社区用于学术课程、研讨会和自定进度培训。FABRIC 上的图书馆将使用 JupyterHub 笔记本，包含学习者的笔记本。最后，该项目将支持四名博士生和十名本科生在首席研究员的指导下部署增强的网络。该项目由高级网络基础设施办公室、刺激竞争性研究既定计划 (EPSCoR) 以及计算机和网络系统部门共同资助。该奖项反映了 NSF 的法定使命，并被认为值得通过以下方式支持：使用基金会的智力价值和更广泛的影响审查标准进行评估。