Collaborative Research: CC-NIE Integration: Transforming Computational Science with ADAMANT (Adaptive Data-Aware Multi-Domain Application Network Topologies)

合作研究：CC-NIE 集成：利用 ADAMANT（自适应数据感知多域应用网络拓扑）转变计算科学

• 批准号: 1245926
• 负责人: Ilya Baldin
• 金额: $ 51.15万
• 依托单位: University of North Carolina at Chapel Hill
• 依托单位国家: 美国
• 项目类别: Standard Grant
• 财政年份: 2013
• 资助国家: 美国
• 起止时间: 2013-01-01 至 2015-12-31
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=1245926&HistoricalAwards=false
• 关键词: Collaborative; Research; CC; NIE; Integration

Workflows, especially data-driven workflows and workflow ensembles are becoming a centerpiece of modern computational science. However, scientists lack the tools that integrate the operation of workflow-driven science applications on top of dynamic infrastructures that link campus, institutional and national resources into connected arrangements targeted at solving a specific problem. These tools must (a) orchestrate the infrastructure in response to application demands, (b) manage application lifetime on top of the infrastructure by monitoring various workflow steps and modifying slices in response to application demands, and (c) integrate data movement with the workflows to optimize performance. Project ADAMANT (Adaptive Data-Aware Multi-domain Application Network Topologies) brings together researchers from RENCI/UNC Chapel Hill, Duke University and USC/ISI and two successful software tools to solve these problems: Pegasus workflow management system and ORCA resource control framework, developed for NSF GENI. The integration of Pegasus and ORCA enables powerful application- and data-driven virtual topology embedding into multiple institutional and national substrates (providers of cyber-resources, like computation, storage and networks). ADAMANT leverages ExoGENI - an NSF-funded GENI testbed, as well as national providers of on-demand bandwidth services (NLR, I2, ESnet) and existing OSG computational resources to create elastic, isolated environments to execute complex distributed tasks. This approach improves the performance of these applications and, by explicitly including data movement planning into the application workflow, enables new unique capabilities for distributed data-driven "Big Science" applications.

工作流程，尤其是数据驱动的工作流和工作流程集合正在成为现代计算科学的核心。但是，科学家缺乏将工作流程驱动的科学应用程序整合到动态基础设施上的工具，这些基础设施将校园，机构和国家资源连接到针对解决特定问题的连接安排。这些工具必须（a）根据应用程序需求来协调基础架构，（b）通过监视各种工作流程步骤并修改针对应用程序需求的切片来管理基础架构的应用程序寿命，以及（c）将数据移动与工作流程集成在一起以优化性能。 Project Apamant（自适应数据感知多域应用程序网络拓扑）将Renci/UNC Chapel Hill，Duke University和USC/ISI的研究人员汇集在一起​​，以及两个成功解决这些问题的软件工具：PEGASUS Workflow Management Management System和ORCA资源控制框架，为NSF Geni开发。 PEGASUS和ORCA的集成使强大的应用程序和数据驱动的虚拟拓扑嵌入到多个机构和国家基板（网络资源的提供商，例如计算，存储和网络）中。 Apamant Leverages Exogeni- NSF资助的GENI TESTBED，以及按需带宽服务（NLR，I2，ESNET）和现有OSG计算资源的国家提供者，以创建弹性，孤立的环境以执行复杂的分布式任务。这种方法改善了这些应用程序的性能，并明确将数据移动计划包括在应用程序工作流程中，从而为分布式数据驱动的“大科学”应用程序启用了新的独特功能。