CAREER: Data-aware Distributed Computing for Enabling Large-scale Collaborative Science

职业：数据感知分布式计算支持大规模协作科学

• 批准号: 0846052
• 负责人: Tevfik Kosar
• 金额: $ 40万
• 依托单位: Louisiana State University
• 依托单位国家: 美国
• 项目类别: Continuing Grant
• 财政年份: 2009
• 资助国家: 美国
• 起止时间: 2009-02-15 至 2011-05-31
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=0846052&HistoricalAwards=false
• 关键词: CAREER; Data; aware; Distributed; Computing

CAREER: Data-aware Distributed Computing for EnablingLarge-scale Collaborative SciencePI: Tevfik Kosar, Louisiana State UniversityAbstractApplications and experiments in all areas of science are becoming increasingly complex and more demanding in terms of their computational and data requirements. Some applications generate data volumes reaching petabytes. Sharing, disseminating, and analyzing these large data sets becomes a big challenge, especially when distributed resources are used. This Faculty Early Career Development (CAREER) project proposes a new distributed computing paradigm called ?data-aware distributed computing?, which will include a diverse set of algorithms, models, and tools for mitigating the data bottleneck in distributed computing systems; and will support a broad range of data-intensive as well as dynamic data-driven applications. As part of this project, research and development will be performed on three main components: i) a data-aware scheduler which will provide capabilities such as planning, scheduling, resource reservation, job execution, and error recovery for data movement tasks; ii) integration of these capabilities to the other layers in distributed computing such as workflow planning, resource brokering, and storage management; and iii) further optimization of data movement tasks via dynamically tuning of underlying protocol transfer parameters. Research will be integrated to literally all levels of education which will include science projects, seminars and summer camps on data-intensive computing with K-12 students (where 99% is minority); curriculum development, mentoring, and international student/intern exchange programs for undergraduate and graduate students; summer internships and workshops specifically for HBCU community including faculty members. The tools and software developed in this project will be available to public via open-source distribution.

职业：用于实现大规模协作科学的数据感知分布式计算 PI：Tevfik Kosar，路易斯安那州立大学摘要所有科学领域的应用和实验都变得越来越复杂，对计算和数据的要求也越来越高。一些应用程序生成的数据量达到 PB。共享、传播和分析这些大型数据集成为一个巨大的挑战，特别是在使用分布式资源时。该教师早期职业发展（CAREER）项目提出了一种新的分布式计算范式，称为“数据感知分布式计算”，其中包括用于缓解分布式计算系统中数据瓶颈的各种算法、模型和工具；并将支持广泛的数据密集型以及动态数据驱动的应用程序。作为该项目的一部分，研究和开发将在三个主要组件上进行：i）数据感知调度程序，它将为数据移动任务提供规划、调度、资源预留、作业执行和错误恢复等功能； ii) 将这些功能集成到分布式计算中的其他层，例如工作流程规划、资源代理和存储管理； iii) 通过动态调整底层协议传输参数进一步优化数据移动任务。研究将被整合到几乎所有级别的教育中，其中包括针对 K-12 学生（其中 99% 是少数族裔）的数据密集型计算的科学项目、研讨会和夏令营；本科生和研究生的课程开发、指导和国际学生/实习生交流计划；专门为 HBCU 社区（包括教职人员）提供的暑期实习和研讨会。该项目开发的工具和软件将通过开源分发向公众开放。