Collaborative Research: Fine-Grained Statistical Inference in High Dimension: Actionable Information, Bias Reduction, and Optimality

协作研究：高维细粒度统计推断：可操作信息、减少偏差和最优性

• 批准号: 2014279
• 负责人: Yuxin Chen
• 金额: $ 10万
• 依托单位: Princeton University
• 依托单位国家: 美国
• 项目类别: Standard Grant
• 财政年份: 2020
• 资助国家: 美国
• 起止时间: 2020-07-01 至 2025-06-30
• 项目状态: 未结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=2014279&HistoricalAwards=false
• 关键词: Collaborative; Research; Fine; Grained; Statistical

Emerging data science applications require efficient extraction of actionable insights from large and messy datasets. The number of relevant features often overwhelms the volume of data that is available, which dramatically complicates the statistical inference tasks and subsequent decision making. In the existing statistical literature, most of theory aims at understanding the average or global behavior of a statistical estimator in high dimensions. In many applications, however, it is often the case that the goal is not to explore the global behavior of a parameter estimator, but rather to perform inference and reasoning on its local, yet important, operational properties. The techniques and methods developed in the project will further advance the interplay between a broad range of areas including high-dimensional statistics, harmonic analysis, statistical physics, optimization, complex analysis, and statistical machine learning. The project provides research training opportunities for graduate students.This project pursues fine-grained inferential procedures and theory, aimed at enlarging the uncertainty assessment toolbox for various low-complexity models in high dimensions. Focusing on a few stylized problems, this research program consists of four major thrusts: (1) construct optimal confidence intervals for linear functionals of eigenvectors in low-rank matrix estimation; (2) design fine-grained hypothesis testing procedures for sparse regression under general designs; (3) develop entry-wise inference schemes for principal component analysis with missing data; and (4) conduct reliable and adaptive statistical eigen-analysis under minimal eigen-gaps. Emphasis is placed on algorithms that are model-agnostic and fully adaptive to data heteroscedasticity. Addressing these issues calls for the development of new statistical theory that enables reliable inference for a broad class of local properties underlying the unknown parameters.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.

新兴的数据科学应用需要从庞大而混乱的数据集中有效提取可操作的见解。相关特征的数量通常会超过可用数据量，这使得统计推断任务和后续决策变得非常复杂。在现有的统计文献中，大多数理论旨在理解高维统计估计量的平均或全局行为。然而，在许多应用中，通常的情况是，目标不是探索参数估计器的全局行为，而是对其局部但重要的操作属性进行推理和推理。 该项目开发的技术和方法将进一步促进高维统计、调和分析、统计物理、优化、复杂分析和统计机器学习等广泛领域之间的相互作用。该项目为研究生提供研究培训机会。该项目追求细粒度的推理程序和理论，旨在扩大高维各种低复杂度模型的不确定性评估工具箱。该研究项目重点关注一些典型问题，包括四个主要方向：（1）构建低秩矩阵估计中特征向量线性函数的最佳置信区间； (2) 为一般设计下的稀疏回归设计细粒度的假设检验程序； (3) 开发用于缺失数据的主成分分析的逐项推理方案； (4) 在最小特征间隙下进行可靠且自适应的统计特征分析。重点放在与模型无关且完全适应数据异方差性的算法上。解决这些问题需要开发新的统计理论，从而能够对未知参数下的广泛局部属性进行可靠的推断。该奖项反映了 NSF 的法定使命，并通过使用基金会的智力价值和更广泛的影响进行评估，被认为值得支持审查标准。

项目成果

Uncertainty quantification for nonconvex tensor completion: Confidence intervals, heteroscedasticity and optimality

非凸张量完成的不确定性量化：置信区间、异方差和最优性

• 发表时间: 2020-01
• 期刊: International Conference on Machine Learning
• 作者: Cai, Changxiao;Poor, H. Vincent;Chen, Yuxin
• 通讯作者: Chen, Yuxin

Noisy Matrix Completion: Understanding Statistical Guarantees for Convex Relaxation via Nonconvex Optimization

噪声矩阵完成：了解通过非凸优化实现凸松弛的统计保证

• DOI: 10.1137/19m1290000
• 发表时间: 2020-01
• 期刊: SIAM Journal on Optimization
• 影响因子: 3.1
• 作者: Chen, Yuxin;Chi, Yuejie;Fan, Jianqing;Ma, Cong;Yan, Yuling
• 通讯作者: Yan, Yuling

Uncertainty Quantification for Nonconvex Tensor Completion: Confidence Intervals, Heteroscedasticity and Optimality

非凸张量完成的不确定性量化：置信区间、异方差性和最优性

• DOI: 10.1109/tit.2022.3205781
• 发表时间: 2023-01
• 期刊: IEEE Transactions on Information Theory
• 影响因子: 2.5
• 作者: Cai, Changxiao;Poor, H. Vincent;Chen, Yuxin
• 通讯作者: Chen, Yuxin

Tackling Small Eigen-Gaps: Fine-Grained Eigenvector Estimation and Inference Under Heteroscedastic Noise

解决小特征间隙：异方差噪声下的细粒度特征向量估计和推理

• DOI: 10.1109/tit.2021.3111828
• 发表时间: 2021-11
• 期刊: IEEE Transactions on Information Theory
• 影响因子: 2.5
• 作者: Cheng, Chen;Wei, Yuting;Chen, Yuxin
• 通讯作者: Chen, Yuxin

Asymmetry helps: Eigenvalue and eigenvector analyses of asymmetrically perturbed low-rank matrices

不对称有助于：非对称扰动低秩矩阵的特征值和特征向量分析

• DOI: 10.1214/20-aos1963
• 发表时间: 2021-02
• 期刊: The Annals of Statistics
• 作者: Chen, Yuxin;Cheng, Chen;Fan, Jianqing
• 通讯作者: Fan, Jianqing