Collaborative Research:PPoSS:Planning: Streamware - A Scalable Framework for Accelerating Streaming Data Science

合作研究：PPoSS：规划：Streamware - 加速流数据科学的可扩展框架

• 批准号: 2118985
• 负责人: David Brooks
• 金额: $ 3.5万
• 依托单位: Harvard University
• 依托单位国家: 美国
• 项目类别: Standard Grant
• 财政年份: 2021
• 资助国家: 美国
• 起止时间: 2021-10-01 至 2023-09-30
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=2118985&HistoricalAwards=false
• 关键词: Collaborative; Research; PPoSS; Planning; Streamware

In grand-challenge scientific applications, the enormous amount of data produced by the sensing and instrumentation infrastructure often loses its value after a small window of time. Thus, to obtain actionable intelligence from the data, streaming analytics, i.e., the ability to analyze in-motion data, is increasingly becoming critical. Moreover, modern computing systems are highly heterogeneous, consisting of processors, accelerators, and large high-bandwidth external memories. To develop scalable streaming analytics applications, challenges across the full system stack -- from application to target platform -- need to be addressed. In this regard, this planning project is identifying a comprehensive set of research challenges, goals, key innovations and timelines in algorithms and applications, systems software, hardware-software co-design, and computer architecture. This project is bringing together a community of application developers and users, computer scientists, and data scientists, whose interests lie in building streaming data science applications targeting a wide variety of scalable systems. This project is demonstrating preliminary results on how it will achieve significant cross-stack performance improvements using Privacy Preserving Streaming Graph Learning for Secure Smart Grids as the driving application.Modern data-science applications are characterized as being highly decentralized, distributed and requiring composition and orchestration between localized analytics on thousands or millions of edge platforms and massive centralized analytics in cloud/data centers, as well as requiring real-time analytics on streaming data. To enable scalable performance of grand-challenge streaming data-science applications, a framework that allows developers to seamlessly build these applications targeting a wide variety of scalable systems is needed. This planning project is conducting preliminary research towards a large proposal for developing an opensource framework, StreamWare, that will enable users to develop streaming data-science applications. This project is establishing a community of application developers and users, computer scientists, and data scientists who would serve as early adopters and developers of the StreamWare framework. In consultation with domain experts, a list of key data-science kernels for StreamWare is being generated, and their existing state-of-the-art algorithms and hardware IPs are being evaluated to identify performance limitations and opportunities for improvement. This project is also articulating the requirements of novel abstractions that can represent and operate on streaming data on heterogeneous platforms. This project uses Privacy Preserving Streaming Graph Learning for Secure Smart Grids as a motivating application to show preliminary evidence of end-to-end scalability using a novel notion of symbiotic scalability that captures the impact of StreamWare's cross-layer optimizations. The expected outcomes of this planning project include a proposal for the research activities to be carried out in the large grant, publications on the results of the survey activities and future research directions for enabling streaming data science, and curricula for future graduate and undergraduate courses.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.

在具有挑战性的科学应用中，传感和仪器基础设施产生的大量数据通常会在一小段时间后失去其价值。因此，为了从数据中获取可操作的情报，流分析（即分析动态数据的能力）变得越来越重要。此外，现代计算系统是高度异构的，由处理器、加速器和大型高带宽外部存储器组成。为了开发可扩展的流分析应用程序，需要解决整个系统堆栈（从应用程序到目标平台）的挑战。在这方面，该规划项目正在确定算法和应用、系统软件、软硬件协同设计和计算机体系结构方面的一系列全面的研究挑战、目标、关键创新和时间表。该项目汇集了应用程序开发人员和用户、计算机科学家和数据科学家的社区，他们的兴趣在于构建针对各种可扩展系统的流数据科学应用程序。该项目正在展示如何使用安全智能电网的隐私保护流图学习作为驱动应用程序来实现显着的跨堆栈性能改进的初步结果。现代数据科学应用程序的特点是高度分散、分布式，并且需要组合和编排数以千计或数百万个边缘平台上的本地化分析与云/数据中心中的大规模集中式分析之间的关系，以及需要对流数据进行实时分析。为了实现具有挑战性的流数据科学应用程序的可扩展性能，需要一个允许开发人员无缝构建针对各种可扩展系统的应用程序的框架。该规划项目正在针对开发开源框架 StreamWare 的大型提案进行初步研究，该框架将使用户能够开发流数据科学应用程序。该项目正在建立一个由应用程序开发人员和用户、计算机科学家和数据科学家组成的社区，他们将成为 StreamWare 框架的早期采用者和开发人员。与领域专家协商，正在生成 StreamWare 的关键数据科学内核列表，并且正在评估其现有的最先进算法和硬件 IP，以确定性能限制和改进机会。该项目还阐明了可以表示和操作异构平台上的流数据的新颖抽象的要求。该项目使用安全智能电网的隐私保护流图学习作为激励应用程序，使用共生可扩展性的新概念来展示端到端可扩展性的初步证据，该概念捕获了 StreamWare 跨层优化的影响。该规划项目的预期成果包括关于在大笔赠款中开展的研究活动的提案、调查活动结果的出版物和实现流数据科学的未来研究方向，以及未来研究生和本科生课程的课程。该奖项反映了 NSF 的法定使命，并通过使用基金会的智力价值和更广泛的影响审查标准进行评估，被认为值得支持。