BIGDATA:F: Statistical Learning with Large Dynamic Tensor Data

BIGDATA:F：利用大型动态张量数据进行统计学习

• 批准号: 1741390
• 负责人: Rong Chen
• 金额: $ 100万
• 依托单位: Rutgers University New Brunswick
• 依托单位国家: 美国
• 项目类别: Standard Grant
• 财政年份: 2017
• 资助国家: 美国
• 起止时间: 2017-09-01 至 2023-08-31
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=1741390&HistoricalAwards=false
• 关键词: BIGDATA; Statistical; Learning; Large; Dynamic

Time series analysis is mainly applied in the discovery of dependent and dynamic structure of observations over time, and in accurate prediction of potential outcomes of such data in the future. In the big-data era, modern data collection capabilities have led to massive amounts of time series data. Large tensor (or multi-dimensional array) data are now routinely collected in a wide range of applications. For example, a group of countries will report a set of economic indicators each quarter, forming a matrix (2-dimensional array) time series, with each column representing a country and each row representing an economic indicator. The import and export volume of different types of goods for a group of countries over time form a 3-dimensional array time series. The aim of the project is to lay a foundation and develop a general framework to systematically study the dynamics of such tensor systems, decipher the joint behavior of each individual time series in the tensor array, and provide methods for accurate prediction. The framework will include general and specific statistical models, practical applications, statistical methods and their theoretical and empirical properties, computational algorithms and software, and implementation in several data sets. The research can be applied to application areas ranging from finance and economics, environmental sciences, and human behavior (e.g. social networks) to neuroscience and engineering. The project also addresses the training and education of future data scientists. In the big-data era, large tensor time series are routinely observed in a wide range of applications. This project aims to develop state-of-the-art statistical tools to effectively and efficiently extract useful information from such big complex data. The work concerns a general framework of statistical learning with large dynamic tensor data. Specifically, the project will develop a general class of tensor factor models, with modifications for specific applications, for modeling matrix- and tensor-valued time series, dynamic networks, and spatial temporal data. The results are expected to be directly applicable to economic tensor data, import-export volume time series, dynamic social networks, pollution monitoring, problems in fluid dynamics, and dynamic brain connectivity networks. Model estimation procedures, along with their theoretical foundations will be developed. The research will enrich the toolkit of statistical learning for a highly important and widely encountered class of big-data problems. The project also involves research training of graduate and undergraduate students in the field of statistical learning and its applications. The project will develop and disseminate free software, including an array of cleaned data sets for research, and a permanently maintained website as a hub for dissemination of future dynamic tensor research. An international conference on large dynamic tensor analysis will be organized. Evaluation of the computational algorithms and implementation of the methods for large scale applications will leverage cloud computing resources provided through an agreement between commercial cloud service providers and NSF for the BIGDATA solicitation.

时间序列分析主要用于发现观察结果的依赖和动态结构，并准确预测未来此类数据的潜在结果。在大数据时代，现代数据收集功能导致了大量时间序列数据。 现在，通常会在广泛的应用中收集大型张量（或多维数组）数据。 例如，一组国家将在每个季度报告一组经济指标，形成一个矩阵（二维阵列）时间序列，每列代表一个国家，每行代表经济指标。随着时间的推移，一组国家的不同类型商品的进出口量形成了3维数组时间序列。该项目的目的是奠定基础并开发一个通用框架，以系统地研究此类张量系统的动态，破译张量阵列中每个单个时间序列的联合行为，并提供准确预测的方法。该框架将包括一般和特定的统计模型，实际应用，统计方法及其理论和经验属性，计算算法和软件以及在几个数据集中实现。该研究可应用于从金融和经济学，环境科学和人类行为（例如社交网络）到神经科学和工程的应用领域。 该项目还涉及对未来数据科学家的培训和教育。在大数据时代，通常在广泛的应用中观察到大张量时间序列。该项目旨在开发最先进的统计工具，以有效，有效地从如此大的复杂数据中提取有用的信息。这项工作涉及使用大量动态张量数据的统计学习的一般框架。 具体而言，该项目将开发一类张量因子模型的一般类别，并针对特定应用程序进行了修改，用于建模矩阵和张量值时间序列，动态网络和空间时间数据。预计该结果将直接适用于经济张量数据，进出口批量时间序列，动态社交网络，污染监测，流体动态问题和动态大脑连接网络。将开发模型估计程序以及其理论基础。这项研究将使统计学习的工具包丰富，以实现非常重要且广泛遇到的大数据问题。该项目还涉及对统计学习及其应用领域的研究生和本科生的研究培训。该项目将开发和传播免费软件，包括一系列用于研究的清洁数据集，以及一个永久维护的网站作为传播未来动态张量研究的枢纽。将组织一次国际大型动态张量分析会议。 对大规模应用程序的计算算法的评估和实施方法将利用通过商业云服务提供商与NSF之间的一致性提供的云计算资源，以进行BigData招标。

项目成果

A Nonparametric Bayesian Framework for Short-Term Wind Power Probabilistic Forecast

• DOI: 10.1109/tpwrs.2018.2858265
• 发表时间: 2019-01
• 期刊: IEEE Transactions on Power Systems
• 影响因子: 6.6
• 作者: Wei Xie;Pu Zhang;Rong Chen;Zhi Zhou

KoPA: Automated Kronecker Product Approximation

• 发表时间: 2019-12
• 期刊: J. Mach. Learn. Res.
• 作者: Chencheng Cai;Rong Chen;Han Xiao

Factor models for matrix-valued high-dimensional time series

• DOI: 10.1016/j.jeconom.2018.09.013
• 发表时间: 2019-01-01
• 期刊: JOURNAL OF ECONOMETRICS
• 影响因子: 6.3
• 作者: Wang, Dong;Liu, Xialu;Chen, Rong
• 通讯作者: Chen, Rong

Extreme eigenvalues of nonlinear correlation matrices with applications to additive models

非线性相关矩阵的极值特征值及其在加性模型中的应用

• DOI: 10.1016/j.spa.2021.04.006
• 发表时间: 2021
• 期刊: Stochastic Processes and their Applications
• 影响因子: 1.4
• 作者: Guo, Zijian;Zhang, Cun-Hui
• 通讯作者: Zhang, Cun-Hui

Second-order Stein: SURE for SURE and other applications in high-dimensional inference

• DOI: 10.1214/20-aos2005
• 发表时间: 2018-11
• 期刊: The Annals of Statistics
• 作者: P. Bellec;Cun-Hui Zhang