III: Medium: Collaborative Research: Principled Uncertainty Quantification in Deep Learning Models for Time Series Analysis

III：媒介：协作研究：用于时间序列分析的深度学习模型中的原则性不确定性量化

• 批准号: 2107200
• 负责人: Shuochao Yao
• 金额: $ 32.59万
• 依托单位: George Mason University
• 依托单位国家: 美国
• 项目类别: Continuing Grant
• 财政年份: 2021
• 资助国家: 美国
• 起止时间: 2021-10-01 至 2024-09-30
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=2107200&HistoricalAwards=false
• 关键词: III; Medium; Collaborative; Research; Principled

Time series data are ubiquitous in modern science and engineering. An unprecedented amount is being collected in diverse applications such as healthcare systems, the Web, cyber network monitoring, self-driving cars, and Internet-of-Things services. While deep learning has achieved enormous success in time series predictive analysis, a key bottleneck of such models is that they are ignorant about the uncertainties in their predictions. A consequence is that they can produce wildly wrong predictions without noticing---this will lead to misguided decisions, which can be catastrophic in life-critical applications. This project aims to remedy this issue and advance deep learning towards more trustworthy time series analysis. The project will enable principled deep learning models for uncertainty-aware and reliable time series regression and classification without sacrificing their predictive power. Research findings from the project will be incorporated into graduate-level classes, tutorials, and workshops to bring multiple stakeholders and domain scientists together.The technical aims of this project are divided into three thrusts. First, the project will develop novel techniques bridging deep sequential models (e.g., recurrent networks, transformers) with Gaussian processes to quantify uncertainty in the functional space. Second, the project will explore how to learn calibrated deep sequential models and how to further decouple different sources of uncertainties to understand where a model's predictive uncertainty comes from. Third, the project will harness uncertainty to improve the reliability and efficiency of time series predictive systems. These techniques will enjoy the representation power of deep neural networks for modeling complex temporal dependencies in time-series data, while providing principled methodologies for quantifying and leveraging uncertainty for robustness and performance. The developed new models, algorithms, and techniques will be deployed in two important applications for times series analysis: 1) public health monitoring and forecasting, and 2) real-time analysis for mobile sensing time series data. The developed tools will also be open-sourced for trustworthy time series analysis that can benefit many other applications.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.

时间序列数据在现代科学和工程中无处不在。医疗保健系统、网络、网络监控、自动驾驶汽车和物联网服务等各种应用程序正在收集前所未有的数量。虽然深度学习在时间序列预测分析方面取得了巨大成功，但此类模型的一个关键瓶颈是它们对预测中的不确定性一无所知。其结果是，它们可能会在没有注意到的情况下做出极其错误的预测——这将导致错误的决策，这在生命攸关的应用中可能是灾难性的。该项目旨在解决这个问题，并推动深度学习走向更值得信赖的时间序列分析。该项目将实现有原则的深度学习模型，用于不确定性感知和可靠的时间序列回归和分类，而不会牺牲其预测能力。该项目的研究成果将纳入研究生课程、教程和研讨会，将多个利益相关者和领域科学家聚集在一起。该项目的技术目标分为三个主旨。首先，该项目将开发将深度序列模型（例如循环网络、变压器）与高斯过程连接起来的新技术，以量化功能空间中的不确定性。其次，该项目将探索如何学习校准的深度序列模型，以及如何进一步解耦不同的不确定性来源，以了解模型的预测不确定性来自何处。第三，该项目将利用不确定性来提高时间序列预测系统的可靠性和效率。这些技术将享受深度神经网络的表示能力，用于对时间序列数据中复杂的时间依赖性进行建模，同时提供用于量化和利用不确定性以实现鲁棒性和性能的原则性方法。开发的新模型、算法和技术将部署在时间序列分析的两个重要应用中：1）公共卫生监测和预测，2）移动传感时间序列数据的实时分析。开发的工具还将开源，用于值得信赖的时间序列分析，这可以使许多其他应用受益。该奖项反映了 NSF 的法定使命，并通过使用基金会的智力价值和更广泛的影响审查标准进行评估，被认为值得支持。

项目成果

Semi-supervised Hypergraph Node Classification on Hypergraph Line Expansion

超图线展开的半监督超图节点分类

• DOI: 10.1145/3511808.3557447
• 发表时间: 2020-05-11
• 期刊: Proceedings of the 31st ACM International Conference on Information & Knowledge Management
• 作者: Chaoqi Yang;Ruijie Wang;Shuochao Yao;T. Abdelzaher
• 通讯作者: T. Abdelzaher

Exploring Spherical Autoencoder for Spherical Video Content Processing

探索用于球形视频内容处理的球形自动编码器

• DOI: 10.1145/3503161.3548364
• 发表时间: 2022-10
• 期刊: MM '22: Proceedings of the 30th ACM International Conference on Multimedia
• 作者: Zhou, Jin;Li, Na;Liu, Yao;Yao, Shuochao;Chen, Songqing
• 通讯作者: Chen, Songqing