BIGDATA: Collaborative Research: F: Holistic Optimization of Data-Driven Applications

BIGDATA：协作研究：F：数据驱动应用程序的整体优化

• 批准号: 2027516
• 负责人: Alvin Cheung
• 金额: $ 20.04万
• 依托单位: University of California-Berkeley
• 依托单位国家: 美国
• 项目类别: Standard Grant
• 财政年份: 2020
• 资助国家: 美国
• 起止时间: 2020-04-01 至 2021-09-30
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=2027516&HistoricalAwards=false
• 关键词: BIGDATA; Collaborative; Research; Holistic; Optimization

We interact with online shopping and banking websites on a daily basis. Many of these websites are powered by data-driven applications. Such application often consists of two parts: an application hosted on an application server, and a database management system (DBMS) hosted on a separate server from the application server that maintains persistent data. Unfortunately, many data-driven applications suffer from performance problems, such as taking a long time to load a page or inability to scale up to serve large number of clients simultaneously. The state of the art in discovering and fixing performance problems in data-driven applications is to examine the two parts of the application separately, and doing so misses many opportunities in discovering and fixing such problems. Unlike prior approaches, in this project we will treat the DBMS and the application in tandem. In particular, we will devise new techniques and tools to help identify performance problems, understand the cause of such problems, and fix them automatically. This project will open up new opportunities in cross-layer program compilation and optimization, with the practical goal of improving the performance of data-driven applications that will have a significant impact in many aspects of our daily lives. The findings from this project will be incorporated into undergraduate and graduate software engineering, introduction to data management, and compiler classes to be offered at the University of Chicago and the University of Washington. The outreach activities of this project will include engaging and advising students through special programs geared toward under-represented groups such as the Distributed Research Experiences for Undergraduates (DREU) organized by CRA-W (Computing Research Association -- Women) and Diversity Workshops organized by CRA-W. Specifically, the proposed research consists of three thrusts: (1) a new cross-layer program analysis framework that produces an end-to-end profile of data-driven applications by understanding the application code, the queries that the application sends to the DBMS, and how the DBMS processes such queries; (2) a program analysis and testing framework that identify performance problems in data-driven applications by leveraging the end-to-end profile created from (1); and (3) new means to optimize data-driven applications by transforming both the application code and the queries that are issued. These three thrusts will work together to improve the performance of data-driven applications and help programmers detect performance problems during development. Software developed by this project, benchmarks used for evaluation, and performance comparison with existing techniques will be released to public domain through the project website. Further information will be available at the project website (https://people.eecs.berkeley.edu/~akcheung/coopt.html).

我们每天与在线购物和银行网站进行互动。这些网站中有许多由数据驱动的应用程序提供动力。该应用程序通常由两个部分组成：托管在应用程序服务器上的应用程序，以及与维护持久数据的应用程序服务器上托管的数据库管理系统（DBMS）。不幸的是，许多数据驱动的应用程序都遇到了性能问题，例如花很长时间来加载页面或无法扩展以同时为大量客户提供服务。在数据驱动的应用程序中发现和解决性能问题的最新状态是分别检查应用程序的两个部分，并因此而错过了发现和解决此类问题的许多机会。与先前的方法不同，在此项目中，我们将同时处理DBMS和应用程序。特别是，我们将设计新技术和工具，以帮助识别绩效问题，了解此类问题的原因并自动解决这些问题。该项目将在跨层计划汇编和优化方面开放新的机会，其实用目标是提高数据驱动应用程序的性能，这些应用程序将对我们日常生活的许多方面产生重大影响。该项目的发现将纳入本科和研究生软件工程，数据管理简介以及芝加哥大学和华盛顿大学将提供的编译器课程。该项目的外展活动将包括通过针对代表性不足的团体（例如由CRA-W（计算研究协会） - 妇女）和CRA-W组织的多样性讲习班的特殊计划（DREU）参与和建议学生。 具体而言，拟议的研究由三个推力组成：（1）一个新的跨层程序分析框架，该框架通过了解应用程序代码，应用程序发送给DBMS的查询以及DBMS如何处理此类疑问来产生数据驱动的应用程序的端到端概况； （2）通过利用（1）创建的端到端配置文件来识别数据驱动应用程序中的性能问题的程序分析和测试框架； （3）通过转换发行的应用程序代码和查询来优化数据驱动的应用程序的新方法。这三个推力将共同提高数据驱动的应用程序的性能，并帮助程序员在开发过程中发现性能问题。该项目开发的软件，用于评估的基准以及与现有技术的性能比较将通过项目网站发布到公共领域。更多信息将在项目网站（https://people.eecs.berkeley.edu/~akcheung/coopt.html）上获得。

项目成果

Generating Application-specific Data Layouts for In-memory Databases

• DOI: 10.14778/3342263.3342630
• 发表时间: 2019-07
• 期刊: Proc. VLDB Endow.
• 作者: Cong Yan;Alvin Cheung

Managing data constraints in database-backed web applications

管理数据库支持的 Web 应用程序中的数据约束

• DOI: 10.1145/3377811.3380375
• 发表时间: 2020
• 期刊: ICSE
• 作者: Junwen Yang, Utsav Sethi