Partial recovery of missing responses - a toolbox for efficient design and analysis when data may be missing not at random

部分恢复丢失的响应 - 当数据可能非随机丢失时进行有效设计和分析的工具箱

• 批准号: EP/V00641X/1
• 负责人: Robin Mitra
• 金额: $ 35.84万
• 依托单位: CARDIFF UNIVERSITY
• 依托单位国家: 英国
• 项目类别: Research Grant
• 财政年份: 2021
• 资助国家: 英国
• 起止时间: 2021 至 无数据
• 项目状态: 已结题
• 来源: https://gtr.ukri.org/projects?ref=EP%2FV00641X%2F1
• 关键词: Partial; recovery; missing; responses; toolbox

Missing data are a common problem in many application areas. The presence of missing values complicates analyses, and if not dealt with properly can result in incorrect conclusions being drawn from the data. It is often helpful to assume there is a process that produces the missing values, typically called a missing data mechanism. A particularly problematic scenario is when this mechanism is in part determined by some other unknown variables, such as the missing values themselves. This is known as a missing not at random (MNAR) mechanism.If missing values arise due to a MNAR mechanism then conclusions drawn from the data will typically be biased. Also, importantly, it is not possible to know whether this problem occurs or not in the data. This is the challenging problem area that this proposal seeks to address, namely developing procedures that can best test whether or MNAR occurs in the data.The proposal will consider scenarios where it is possible to estimate some of the missing values through a follow up sample. The main purpose of this is to learn about the missing data mechanism and specifically test whether the MNAR assumption is valid or not. Further, the recovered data will also help to correct for the effect the missing data have on conclusions. The proposal makes use of optimal design techniques to decide which missing values to follow up. Essentially certain missing values might yield more information about the type of missing data mechanism than others; in addition some values might be more likely than others to be recovered. In this way we would ensure maximum information from the recovered data is obtained. This will allow data analysts to determine whether the presence of MNAR is likely and take appropriate action.We will collaborate with our project partners, the Office for National Statistics and NHS Blood and Transplant in the development of these methods. Our project partners will provide relevant data for us to consider realistic scenarios and we will discuss interim results with them to ensure our methods are most useful for practitioners. We will also present the work as part of a missing data course at the African Institute of Mathematical Sciences (AIMS) to maximise the global benefit of the work.The methods developed in this proposal will be disseminated through papers and presentations. In addition, we will create a free to use R package that will implement the methods to allow easy uptake by users. We will provide training in using this R package as part of a two-day workshop where we will describe our methods to users. A dedicated website will be updated throughout the project to describe developments and facilitate engagement with interested parties.

数据缺失是许多应用领域的常见问题。缺失值的存在会使分析变得复杂，如果处理不当，可能会导致从数据中得出错误的结论。假设存在一个产生缺失值的过程（通常称为缺失数据机制）通常会很有帮助。一个特别有问题的情况是，当该机制部分由其他一些未知变量（例如缺失值本身）决定时。这称为非随机缺失 (MNAR) 机制。如果由于 MNAR 机制而出现缺失值，则从数据中得出的结论通常会有偏差。另外，重要的是，无法知道数据中是否存在此问题。这是本提案寻求解决的具有挑战性的问题领域，即开发能够最好地测试数据中是否出现 MNAR 的程序。该提案将考虑可以通过后续样本估计某些缺失值的场景。这样做的主要目的是了解缺失数据的机制，并具体测试MNAR假设是否有效。此外，恢复的数据还将有助于纠正丢失数据对结论的影响。该提案利用优化设计技术来决定跟踪哪些缺失值。本质上，某些缺失值可能比其他值产生更多有关缺失数据机制类型的信息；此外，某些值可能比其他值更有可能被恢复。通过这种方式，我们将确保从恢复的数据中获得最大的信息。这将使数据分析师能够确定是否可能存在 MNAR 并采取适当的行动。我们将与我们的项目合作伙伴、国家统计办公室和 NHS 血液和移植部门合作开发这些方法。我们的项目合作伙伴将为我们提供相关数据来考虑现实场景，我们将与他们讨论中期结果，以确保我们的方法对从业者最有用。我们还将把这项工作作为非洲数学科学研究所 (AIMS) 缺失数据课程的一部分进行展示，以最大限度地提高这项工作的全球效益。本提案中开发的方法将通过论文和演示文稿进行传播。此外，我们将创建一个免费使用的 R 包，该包将实现这些方法，以便用户轻松掌握。作为为期两天的研讨会的一部分，我们将提供有关使用此 R 包的培训，并向用户描述我们的方法。整个项目将更新一个专门的网站，以描述进展情况并促进与感兴趣的各方的互动。

项目成果

Comparing recovery sample designs to test for the presence of MNAR

比较回收样品设计以测试 MNAR 的存在

• 发表时间: 2022
• 作者: Adediran A

An integrated approach to test for missing not at random

一种非随机测试缺失的综合方法

• DOI: http://dx.10.48550/arxiv.2208.07813
• 发表时间: 2022
• 作者: Noonan J

An integrated approach to test for missing not at random

一种非随机测试缺失的综合方法

• 发表时间: 2022-08-15
• 作者: J. Noonan;A. A. Adediran;R. Mitra;Stefanie Biedermann
• 通讯作者: Stefanie Biedermann