Statistical Analysis of Complex Featured Data: High Dimensionality, Measurement Error and Missing Values

复杂特征数据的统计分析：高维、测量误差和缺失值

• 批准号: RGPIN-2018-03819
• 负责人: Yi, Grace
• 金额: $ 3.28万
• 依托单位: University of Western Ontario
• 依托单位国家: 加拿大
• 项目类别: Discovery Grants Program - Individual
• 财政年份: 2022
• 资助国家: 加拿大
• 起止时间: 2022-01-01 至 2023-12-31
• 项目状态: 已结题
• 来源: https://www.nserc-crsng.gc.ca/ase-oro/Details-Detailles_eng.asp?id=765799
• 关键词: Statistical; Analysis; Complex; Featured; Data

As the advancement of modern technology in acquiring data, data with diverse features are becoming more accessible than ever before. The increasing complexity of structures and the large dimension of data have posed an urgent need for the development of novel and flexible modeling and analysis tools. While many complex features may be present in different applications, this research focuses on two prevailing issues commonly present in modern data : the quality and dimensionality of data. I plan to explore important problems in the following areas.(1) High dimensional data with measurement error and missing valuesIn the era of Big Data, large scale data are often available where the dimension of the variables is much larger than the number of subjects in the study. This presents a great challenge to traditional statistical methods which normally require the sample size to be bigger than the dimension of the variables. In addition, we face challenges related to data quality - measurement imprecision and missing observations. This research aims to investigate problems concerning high dimensionality, measurement error, and missing observations. The plan is to examine how measurement error and missing values may interplay in the analysis of high dimensional data. The objectives are to develop valid inference methods to handle data with all these features involved. Applications of the developed methods to survival data, image data and longitudinal data are planned.(2) Causal inference with complex featured dataAs opposed to association studies, causal inference is often the focus of empirical research. While many research methods are available for various settings, they are vulnerable to poor quality data. Most existing methods require that the data are “perfect” in the sense that no missing observations nor measurement error are present, but these assumptions are often violated in practice. Measurement error and missing observations have been a long standing concern in many studies including epidemiological, nutrition and environmental studies. However, research on causal inference with these features is rather limited and remains unexplored. I plan to explore this exciting area and develop new methods to address complex effects caused by measurement error and/or missing observation on causal inference. Furthermore, I intend to investigate the problems in the presence of large scale data where the dimension of potential confounders is high.My primary goals are to develop original and innovative methodology in advancing foundational work and to facilitate applications. This research is anticipated to provide valuable insights into making the best use of available large scale data and to broaden the scope of existing strategies and research. It is expected to have significant impact on the statistical community as well as other fields including public health, medical studies and data science.

随着现代技术在获取数据方面的进步，具有多种功能的数据的效果更大。在不同的应用程序中出现，这项研究集中于两个规定的ISSUSE，通常是数据的质量和数据，我计划在以下领域探索重要的问题。比研究中的s构成了对贸易统计方法的挑战。数据Quallity旨在调查有关高尺寸数据的分析的尿液误差和缺失的问题。图，图像数据和纵向数据是与关联研究组成的因果关系，而因果关系的重点是各种环境的重点。当前的R和缺失的观察结果包括流行病学，营养和环境研究的许多研究。或者缺少因果关系，我打算在潜在混杂因素的大规模上调查问题。大规模数据，以扩大外观和研究的范围。