Elements: Software: Towards Efficient Embedded Data Processing

要素：软件：实现高效的嵌入式数据处理

• 批准号: 1835446
• 负责人: Jignesh Patel
• 金额: $ 59.98万
• 依托单位: University of Wisconsin-Madison
• 依托单位国家: 美国
• 项目类别: Standard Grant
• 财政年份: 2019
• 资助国家: 美国
• 起止时间: 2019-01-01 至 2023-12-31
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=1835446&HistoricalAwards=false
• 关键词: Elements; Software; Towards; Efficient; Embedded

Embedded databases are ubiquitous, though that fact may not be widely-recognized. Every smart phone has many embedded databases, which implies that billions of people worldwide carry dozens of databases in their phones/pockets every day. Many of these databases are powered by data processing technology that has not kept up with the pace with which the underling hardware in phones have evolved. As a result, data processing is slow, and consumes more energy than needed. The focus of this proposal is on developing new data processing technology for mobile devices that targets a 10X efficiency and performance improvements. The aims of the project go beyond more efficient data processing on phones to also include more efficient processing in embedded environments, which also includes databases running on laptops. Thus, the project aims for a broad impact on database across a spectrum of mobile devices.The technical contributions of this project are in recognizing that modern hardware, even at the ?low-end? which includes mobile phones and laptops, now have multiple processing cores, relatively large amounts of memory, and flash storage. There is a critical need for a new class of embedded data processing systems that can work efficiently, and effectively on such modern mobile platforms. This project aims to build a system, called Hustle, to address this need. The project will design, develop and implement a range of data processing methods, which include predicate-based concurrency control mechanisms, query processing methods that inherently expose and exploit opportunities for intra and inter-operator parallelism, and query optimization methods that target embedded settings.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.

嵌入式数据库无处不在，尽管这一事实可能并未得到广泛认可。每部智能手机都有许多嵌入式数据库，这意味着全球有数十亿人每天在手机/口袋中携带数十个数据库。其中许多数据库由数据处理技术提供支持，但这些技术并没有跟上手机底层硬件发展的步伐。因此，数据处理速度很慢，并且消耗的能量超出了需要。该提案的重点是为移动设备开发新的数据处理技术，目标是将效率和性能提高 10 倍。该项目的目标不仅仅是在手机上进行更高效的数据处理，还包括在嵌入式环境中进行更高效的处理，其中还包括在笔记本电脑上运行的数据库。因此，该项目的目标是对跨一系列移动设备的数据库产生广泛的影响。该项目的技术贡献在于认识到现代硬件，即使是“低端”硬件。其中包括手机和笔记本电脑，现在拥有多个处理核心、相对大量的内存和闪存。迫切需要能够在此类现代移动平台上高效工作的新型嵌入式数据处理系统。该项目旨在构建一个名为 Hustle 的系统来满足这一需求。该项目将设计、开发和实现一系列数据处理方法，其中包括基于谓词的并发控制机制、本质上公开和利用运算符内和运算符间并行性机会的查询处理方法，以及针对嵌入式设置的查询优化方法。该奖项反映了 NSF 的法定使命，并通过使用基金会的智力价值和更广泛的影响审查标准进行评估，被认为值得支持。

项目成果

Simple Adaptive Query Processing vs. Learned Query Optimizers: Observations and Analysis

简单自适应查询处理与学习查询优化器：观察和分析

• DOI: 10.14778/3611479.3611501
• 发表时间: 2023
• 期刊: Proceedings of the VLDB Endowment
• 影响因子: 2.5
• 作者: Zhang, Yunjia;Chronis, Yannis;Patel, Jignesh M.;Rekatsinas, Theodoros
• 通讯作者: Rekatsinas, Theodoros

VIP hashing: adapting to skew in popularity of data on the fly

VIP 哈希：适应动态数据流行度的偏差

• DOI: 10.14778/3547305.3547306
• 发表时间: 2022
• 期刊: Proceedings of the VLDB Endowment
• 影响因子: 2.5
• 作者: Kakaraparthy, Aarati;Patel, Jignesh M.;Kroth, Brian P.;Park, Kwanghyun
• 通讯作者: Park, Kwanghyun

On inter-operator data transfers in query processing

• DOI: 10.1109/icde53745.2022.00066
• 发表时间: 2022-05
• 期刊: 2022 IEEE 38th International Conference on Data Engineering (ICDE)
• 作者: Harshad Deshmukh;Bruhathi Sundarmurthy;Jignesh M. Patel

How Good is My HTAP System?

我的 HTAP 系统有多好？

• DOI: 10.1145/3514221.3526148
• 发表时间: 2022
• 期刊: SIGMOD
• 作者: Milkai, Elena;Chronis, Yannis;Gaffney, Kevin P.;Guo, Zhihan;Patel, Jignesh M.;Yu, Xiangyao
• 通讯作者: Yu, Xiangyao

Database Isolation By Scheduling

• DOI: 10.14778/3461535.3461537
• 发表时间: 2021-05
• 期刊: Proc. VLDB Endow.
• 作者: Kevin P. Gaffney;R. Claus;J. Patel