BIGDATA:F: Statistical Learning with Large Dynamic Tensor Data

BIGDATA:F：利用大型动态张量数据进行统计学习

• 批准号: 1741390
• 负责人: Rong Chen
• 金额: $ 100万
• 依托单位: Rutgers University New Brunswick
• 依托单位国家: 美国
• 项目类别: Standard Grant
• 财政年份: 2017
• 资助国家: 美国
• 起止时间: 2017-09-01 至 2023-08-31
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=1741390&HistoricalAwards=false
• 关键词: BIGDATA; Statistical; Learning; Large; Dynamic

Time series analysis is mainly applied in the discovery of dependent and dynamic structure of observations over time, and in accurate prediction of potential outcomes of such data in the future. In the big-data era, modern data collection capabilities have led to massive amounts of time series data. Large tensor (or multi-dimensional array) data are now routinely collected in a wide range of applications. For example, a group of countries will report a set of economic indicators each quarter, forming a matrix (2-dimensional array) time series, with each column representing a country and each row representing an economic indicator. The import and export volume of different types of goods for a group of countries over time form a 3-dimensional array time series. The aim of the project is to lay a foundation and develop a general framework to systematically study the dynamics of such tensor systems, decipher the joint behavior of each individual time series in the tensor array, and provide methods for accurate prediction. The framework will include general and specific statistical models, practical applications, statistical methods and their theoretical and empirical properties, computational algorithms and software, and implementation in several data sets. The research can be applied to application areas ranging from finance and economics, environmental sciences, and human behavior (e.g. social networks) to neuroscience and engineering. The project also addresses the training and education of future data scientists. In the big-data era, large tensor time series are routinely observed in a wide range of applications. This project aims to develop state-of-the-art statistical tools to effectively and efficiently extract useful information from such big complex data. The work concerns a general framework of statistical learning with large dynamic tensor data. Specifically, the project will develop a general class of tensor factor models, with modifications for specific applications, for modeling matrix- and tensor-valued time series, dynamic networks, and spatial temporal data. The results are expected to be directly applicable to economic tensor data, import-export volume time series, dynamic social networks, pollution monitoring, problems in fluid dynamics, and dynamic brain connectivity networks. Model estimation procedures, along with their theoretical foundations will be developed. The research will enrich the toolkit of statistical learning for a highly important and widely encountered class of big-data problems. The project also involves research training of graduate and undergraduate students in the field of statistical learning and its applications. The project will develop and disseminate free software, including an array of cleaned data sets for research, and a permanently maintained website as a hub for dissemination of future dynamic tensor research. An international conference on large dynamic tensor analysis will be organized. Evaluation of the computational algorithms and implementation of the methods for large scale applications will leverage cloud computing resources provided through an agreement between commercial cloud service providers and NSF for the BIGDATA solicitation.

时间序列分析主要应用于发现观测值随时间变化的相关动态结构，并准确预测此类数据未来的潜在结果。大数据时代，现代数据采集能力产生了海量的时间序列数据。 现在，大型张量（或多维数组）数据通常在广泛的应用中收集。 例如，一组国家每个季度都会报告一组经济指标，形成一个矩阵（二维数组）时间序列，每一列代表一个国家，每一行代表一个经济指标。一组国家不同类型商品随时间的进出口量形成一个3维数组时间序列。该项目的目的是奠定基础并开发一个通用框架来系统地研究此类张量系统的动力学，破译张量阵列中每个单独时间序列的联合行为，并提供准确预测的方法。该框架将包括一般和具体的统计模型、实际应用、统计方法及其理论和经验特性、计算算法和软件以及在多个数据集中的实现。该研究可应用于从金融和经济、环境科学、人类行为（例如社交网络）到神经科学和工程学等应用领域。 该项目还致力于未来数据科学家的培训和教育。在大数据时代，大张量时间序列在广泛的应用中经常被观察到。该项目旨在开发最先进的统计工具，以有效且高效地从如此大的复杂数据中提取有用的信息。这项工作涉及大型动态张量数据统计学习的通用框架。 具体来说，该项目将开发一类通用的张量因子模型，并针对特定应用进行修改，用于对矩阵和张量值时间序列、动态网络和时空数据进行建模。研究结果预计将直接适用于经济张量数据、进出口量时间序列、动态社交网络、污染监测、流体动力学问题和动态大脑连接网络。将开发模型估计程序及其理论基础。这项研究将丰富统计学习的工具包，以解决一类非常重要且广泛遇到的大数据问题。该项目还涉及统计学习及其应用领域的研究生和本科生的研究培训。该项目将开发和传播免费软件，包括一系列用于研究的清理数据集，以及一个永久维护的网站，作为传播未来动态张量研究的中心。将组织一次大动态张量分析国际会议。 对大规模应用程序的计算算法的评估和方法的实施将利用商业云服务提供商与 NSF 之间就 BIGDATA 征集达成的协议提供的云计算资源。

项目成果

A Nonparametric Bayesian Framework for Short-Term Wind Power Probabilistic Forecast

• DOI: 10.1109/tpwrs.2018.2858265
• 发表时间: 2019-01
• 期刊: IEEE Transactions on Power Systems
• 影响因子: 6.6
• 作者: Wei Xie;Pu Zhang;Rong Chen;Zhi Zhou

KoPA: Automated Kronecker Product Approximation

• 发表时间: 2019-12
• 期刊: J. Mach. Learn. Res.
• 作者: Chencheng Cai;Rong Chen;Han Xiao

Factor models for matrix-valued high-dimensional time series

• DOI: 10.1016/j.jeconom.2018.09.013
• 发表时间: 2019-01-01
• 期刊: JOURNAL OF ECONOMETRICS
• 影响因子: 6.3
• 作者: Wang, Dong;Liu, Xialu;Chen, Rong
• 通讯作者: Chen, Rong

Extreme eigenvalues of nonlinear correlation matrices with applications to additive models

非线性相关矩阵的极值特征值及其在加性模型中的应用

• DOI: 10.1016/j.spa.2021.04.006
• 发表时间: 2021
• 期刊: Stochastic Processes and their Applications
• 影响因子: 1.4
• 作者: Guo, Zijian;Zhang, Cun-Hui
• 通讯作者: Zhang, Cun-Hui

Second-order Stein: SURE for SURE and other applications in high-dimensional inference

• DOI: 10.1214/20-aos2005
• 发表时间: 2018-11
• 期刊: The Annals of Statistics
• 作者: P. Bellec;Cun-Hui Zhang