Collaborative Research: ATD: Robust, Accurate and Efficient Graph-Structured RNN for Spatio-Temporal Forecasting and Anomaly Detection

合作研究：ATD：用于时空预测和异常检测的鲁棒、准确和高效的图结构 RNN

• 批准号: 2110145
• 负责人: Bao Wang
• 金额: $ 12万
• 依托单位: University of Utah
• 依托单位国家: 美国
• 项目类别: Standard Grant
• 财政年份: 2021
• 资助国家: 美国
• 起止时间: 2021-01-15 至 2022-12-31
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=2110145&HistoricalAwards=false
• 关键词: Collaborative; Research; ATD; Robust; Accurate

The project aims to develop robust, efficient, and transferrable deep learning algorithms for prediction and anomaly detection in human spatio-temporal dynamics. This will be a fundamental step in providing reliable and speedy decision support for mitigating infectious diseases and countering threats in a time varying and spatially complex environment. The project shall advance recent computational tools (deep neural networks) in adversarial conditions and on resource limited (low cost, low energy) platform, thereby contribute to information technology in adversarial learning, mobile computing and effective decision making. A broad range of applications include threat detection and prediction for traffic and public transportation networks, security and privacy critical data analysis and prediction, threat detection and error correction for hydraulic, electrical and nuclear power systems. The approaches to be used involve novel techniques in high dimensional non-smooth non-convex optimization and graph representation. Specifically, the project shall study (1) multi-scale graph-structured recurrent neural networks for spatio-temporal data modeling, prediction and anomaly detection; (2) adversarially robust, accurate, and transferable deep learning algorithms based on advection-diffusion equations; (3) efficient quantization algorithms under adversarial conditions to reduce the latency of deep networks. The projects shall train a diverse body of graduate and undergraduate students at the Irvine and Los Angeles campuses of University of California through collaborative education and research activities in applied mathematics, computer science, data science and social science.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.

该项目旨在开发稳健、高效且可迁移的深度学习算法，用于人类时空动力学的预测和异常检测。这将是为在时变和空间复杂的环境中减轻传染病和应对威胁提供可靠和快速的决策支持的一个基本步骤。 该项目将在对抗性条件下和资源有限（低成本、低能耗）平台上推进最新的计算工具（深度神经网络），从而为对抗性学习、移动计算和有效决策中的信息技术做出贡献。广泛的应用包括交通和公共交通网络的威胁检测和预测、安全和隐私关键数据分析和预测、水力、电力和核电系统的威胁检测和纠错。 使用的方法涉及高维非光滑非凸优化和图形表示中的新技术。具体来说，该项目将研究（1）用于时空数据建模、预测和异常检测的多尺度图结构循环神经网络； (2) 基于平流扩散方程的对抗性鲁棒、准确和可迁移的深度学习算法； （3）对抗条件下的高效量化算法，以减少深度网络的延迟。这些项目将通过应用数学、计算机科学、数据科学和社会科学领域的合作教育和研究活动，在加州大学欧文分校和洛杉矶分校培养多元化的研究生和本科生。该奖项反映了 NSF 的法定使命，并具有通过使用基金会的智力优点和更广泛的影响审查标准进行评估，被认为值得支持。

项目成果

How does momentum benefit deep neural networks architecture design? A few case studies

动量如何有利于深度神经网络架构设计？

• DOI: 10.1007/s40687-022-00352-0
• 发表时间: 2022-09
• 期刊: Research in the Mathematical Sciences
• 影响因子: 1.2
• 作者: Wang, Bao;Xia, Hedi;Nguyen, Tan;Osher, Stanley
• 通讯作者: Osher, Stanley

Implicit Graph Neural Networks: A Monotone Operator Viewpoint

隐式图神经网络：单调算子观点

• 发表时间: 2023-07
• 期刊: International Conference on Machine Learning
• 作者: Justin Baker; Qingsong Wang
• 通讯作者: Qingsong Wang

A deterministic gradient-based approach to avoid saddle points

一种避免鞍点的基于确定性梯度的方法

• DOI: 10.1017/s0956792522000316
• 发表时间: 2022-12
• 期刊: European Journal of Applied Mathematics
• 影响因子: 1.9
• 作者: Kreusser, L. M.;Osher, S. J.;Wang, B.
• 通讯作者: Wang, B.

Efficient and Reliable Overlay Networks for Decentralized Federated Learning

用于去中心化联邦学习的高效可靠的覆盖网络

• DOI: 10.1137/21m1465081
• 发表时间: 2022-08
• 期刊: SIAM Journal on Applied Mathematics
• 影响因子: 1.9
• 作者: Hua, Yifan;Miller, Kevin;Bertozzi, Andrea L.;Qian, Chen;Wang, Bao
• 通讯作者: Wang, Bao