Collaborative Research: DOT -- Distributed Optical Testbed to Facilitate the Development of Techniques for Efficient Execution of Distributed Applications

合作研究：DOT——分布式光学测试台，促进分布式应用高效执行技术的开发

• 批准号: 0224427
• 负责人: Joel Mambretti
• 金额: $ 18.68万
• 依托单位: Northwestern University
• 依托单位国家: 美国
• 项目类别: Standard Grant
• 财政年份: 2002
• 资助国家: 美国
• 起止时间: 2002-09-15 至 2005-08-31
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=0224427&HistoricalAwards=false
• 关键词: Collaborative; Research; DOT; Distributed; Optical

EIA- 0224427Taylor, ValerieChoudhary, Alok; Dinda, Peter A.; Mambretti, Joel J.Northwestern University Title: CISE RR: (Collaborative) DOT--Distributed Optical Testbed to Facilitate the Development of Techniques for Efficient Execution of Distributed Applications This collaborative proposal with Illinois Institute of Technology (Sun, 02-24377) and the University of Chicago (Foster, 02-24187), acquiring data nodes and compute nodes at five sites, contributes to build a Distributed Optical Testbed (DOT). The DOT system, a product of the paradigm shift from large-scale applications running on large parallel systems at single sites to those running on distributed systems, has come about by the availability of high-speed optical networks (E.g., Starlight, TeraGrid 40 Gb/s network, the PacificRail 10 Gb/s network). This shift necessitates techniques that allow applications to efficiently utilize distributed systems. In contrast to parallel systems, these systems must exploit two characteristics:Heterogeneity of resources (processors and networks) and Dynamic changes in performance of shared resources, especially wide area networks. The system, consisting of Linux clusters at six geographically different sites interconnected via two existing research DWDM networks, I-WIRE and OMNInet, involves the following sites: Argonne National Laboratory (ANL), Illinois Institute of Technology (IIT), National Center for Supercomputer Applications (NCSA), Northwester University Chicago Campus (NU-C), Northwestern University Evanston Campus (NU-E), and the University of Chicago (UC). DOT will facilitate the following research activities in the area of distributed applications:Dynamic Load Balancing (Taylor)Performance Monitoring and Prediction (Dinda, Sun, Taylor)Data Management (Choudhary, Foster)The first activity develops techniques utilizing network performance predictions that take into consideration the heterogeneity of the processors and networks of distributed systems to dynamically balance the load during execution. The second extends performance monitoring, modeling and prediction techniques that have been focused on parallel systems and broadband network to distributed systems with optical networks and different topologies. The last develops techniques that manage the distributed data such that the actual data location is transparent and the data is accessed efficiently. These research activities are driven by three applications that have been parallelized using MPI, such that the applications can be easily ported to DOT:ENZO, an adaptive cosmological application,Cactus, an open framework used to solve Einstein's equations, andAudioVoice, a virtualized distributed audio application with physical simulations that have real-time deadlines and varying computational demands.Each application presents challenges, which include adaptivity, flexible framework, and simulations with real-time deadlines.

EIA-0224427泰勒、瓦莱丽·乔杜里、阿洛克；丁达，彼得·A.； Mambretti, Joel J. 西北大学 标题：CISE RR：（协作）DOT——分布式光学测试台，促进分布式应用程序高效执行技术的开发 这项与伊利诺伊理工学院（Sun，02-24377）和芝加哥大学（Foster，02-24187）在五个站点获取数据节点和计算节点，为构建分布式光学测试台（DOT）。 DOT 系统是从在单个站点的大型并行系统上运行的大规模应用程序到在分布式系统上运行的大规模应用程序范式转变的产物，它是由于高速光网络（例如 Starlight、TeraGrid 40 Gb）的可用性而产生的。 /s 网络，PacificRail 10 Gb/s 网络）。这种转变需要允许应用程序有效利用分布式系统的技术。与并行系统相比，这些系统必须利用两个特征：资源（处理器和网络）的异构性和共享资源（尤其是广域网）性能的动态变化。该系统由位于六个不同地理位置的 Linux 集群组成，通过两个现有的研究 DWDM 网络 I-WIRE 和 OMNInet 互连，涉及以下站点：阿贡国家实验室 (ANL)、伊利诺伊理工学院 (IIT)、国家超级计算机中心应用程序 (NCSA)、西北大学芝加哥校区 (NU-C)、西北大学埃文斯顿校区 (NU-E) 和芝加哥大学 (UC)。 DOT 将促进分布式应用领域的以下研究活动：动态负载平衡（Taylor）性能监控和预测（Dinda、Sun、Taylor）数据管理（Choudhary、Foster）第一项活动开发利用网络性能预测的技术，这些技术考虑到考虑分布式系统的处理器和网络的异构性，以动态平衡执行期间的负载。第二个将关注并行系统和宽带网络的性能监控、建模和预测技术扩展到具有光网络和不同拓扑的分布式系统。最后一个开发了管理分布式数据的技术，使得实际数据位置是透明的并且可以有效地访问数据。这些研究活动由三个使用 MPI 并行化的应用程序驱动，因此这些应用程序可以轻松移植到 DOT：ENZO（自适应宇宙学应用程序）、Cactus（用于求解爱因斯坦方程的开放框架）和 AudioVoice（虚拟化分布式音频）具有实时截止日期和不同计算需求的物理模拟应用程序。每个应用程序都面临着挑战，其中包括适应性、灵活的框架和具有实时截止日期的模拟。