Information Theoretic Research on Big Data Compression and Analytics: Theory, Algorithms, and Applications

大数据压缩与分析的信息论研究：理论、算法与应用

• 批准号: RGPIN-2016-03871
• 负责人: Yang, Enhui
• 金额: $ 3.28万
• 依托单位: University of Waterloo
• 依托单位国家: 加拿大
• 项目类别: Discovery Grants Program - Individual
• 财政年份: 2020
• 资助国家: 加拿大
• 起止时间: 2020-01-01 至 2021-12-31
• 项目状态: 已结题
• 来源: https://www.nserc-crsng.gc.ca/ase-oro/Details-Detailles_eng.asp?id=708571
• 关键词: Information; Theoretic; Research; Big; Data

With an explosion in data sets in our society, we are at the beginning of a big data revolution. Big data has a potential to accelerate the pace of discovery in science, engineering, and medicine, improve healthcare, finance, business, and our lives, and ultimately transform our society. To tap the opportunities afforded by the big data revolution, however, many challenges of big data have to be carefully addressed. For example, to fast access remotely, and reduce the on-going cost of maintaining, huge volumes of digital data, it is desirable to compress data as much as possible. Likewise, to glean knowledge and discoveries from huge volumes of digital data, tools and techniques based on context analytics have to be developed to organize, visualize, and manage huge volumes of digital data. Efficient data compression and accurate context analytics are of vital importance to turning big data to knowledge and discoveries to actions while achieving resource (bandwidth and power) efficiency. In the past, data compression and data analytics have been largely investigated separately in different disciplines. Although data compression has been around for many years, its existing theories and techniques, especially source coding theory from information theory, have been largely developed for stationary and/or well-structured data (such as text, web pages, etc.). In the context of big data, however, most data types are nonstationary and unstructured/semi-structured; applying existing compression techniques directly to these data types often leads to unsatisfied compression performance. Therefore, it is imperative to develop novel compression theories and techniques by incorporating data analytics into data compression to handle the lack of structure and stationarity in an elegant way. In the opposite direction, it is also beneficial to investigate how to apply information theoretic ideas, particularly source coding theory and techniques, to data analytics to develop better solutions for data analytics such as cognitive distance, clustering, and organization. Building on our early success, in this research, we will investigate and explore the interactions of data compression and analytics to advance knowledge in both fields. Our approach will be information theoretic. Three theme areas will be focused on: (1) interactions of data compression and analytics to improve lossy compression performance for nonstationary and unstructured data; (2) interactions of data compression and analytics to develop better cognitive distances and hence provide better tools for data clustering and organization; and (3) compression of and pattern discovery in large bipartite graphs. In the process of achieving our scientific objectives, we will maintain and enhance our leadership in the related areas, and train highly qualified personnel in information and communications technology for Canada.

随着社会数据集的爆炸式增长，我们正处于大数据革命的开端。大数据有潜力加快科学、工程和医学领域的发现步伐，改善医疗保健、金融、商业和我们的生活，并最终改变我们的社会。 然而，要抓住大数据革命带来的机遇，必须认真应对大数据的许多挑战。例如，为了快速远程访问并降低维护大量数字数据的持续成本，需要尽可能地压缩数据。同样，为了从大量数字数据中收集知识和发现，必须开发基于上下文分析的工具和技术来组织、可视化和管理大量数字数据。高效的数据压缩和准确的上下文分析对于将大数据转化为知识、将发现转化为行动、同时实现资源（带宽和功率）效率至关重要。 过去，数据压缩和数据分析主要在不同学科中分别进行研究。尽管数据压缩已经存在多年，但其现有的理论和技术，特别是来自信息论的源编码理论，主要是针对静态和/或结构良好的数据（例如文本、网页等）而开发的。然而，在大数据背景下，大多数数据类型都是非平稳的、非结构化/半结构化的；将现有压缩技术直接应用于这些数据类型通常会导致压缩性能不满意。因此，迫切需要开发新颖的压缩理论和技术，将数据分析融入数据压缩中，以优雅的方式解决结构性和平稳性的缺乏。相反，研究如何将信息论思想，特别是源编码理论和技术应用到数据分析中，为认知距离、聚类和组织等数据分析开发更好的解决方案也是有益的。 在我们早期成功的基础上，在这项研究中，我们将调查和探索数据压缩和分析的相互作用，以推进这两个领域的知识。我们的方法将是信息论的。将重点关注三个主题领域：（1）数据压缩和分析的交互，以提高非平稳和非结构化数据的有损压缩性能； （2）数据压缩和分析的相互作用，以形成更好的认知距离，从而为数据聚类和组织提供更好的工具； (3)大型二分图中的压缩和模式发现。在实现科学目标的过程中，我们将保持并加强在相关领域的领先地位，为加拿大培养信息和通信技术方面的高素质人才。