Comparing Measures of Survey Data Quality

比较调查数据质量的衡量标准

基本信息

批准号：
8321406
负责人：
James R Wagner
金额：
$ 7.78万
依托单位：
UNIVERSITY OF MICHIGAN AT ANN ARBOR
依托单位国家：
美国
项目类别：
财政年份：
2011
资助国家：
美国
起止时间：
2011-08-16 至 2013-07-31
项目状态：
已结题

项目摘要

DESCRIPTION (provided by applicant): The risk of non response bias is a major threat to the validity of health surveys. Many special studies have found that this bias can impact the results of important health measures. Unfortunately, there is very little guidance about how to evaluate the risk of nonresponse bias. Many surveys rely on the response rate as a key statistic. However, a recent meta-analysis indicates that the response rate is a poor indicator for non response bias. In the studies examined, there was little or no correlation between the response rate and the non response bias. The lack of a good indicator for the risk of bias is harmful to health surveys in two ways. First, surveys with high response rates and relatively high non response bias may be accepted as valid and published. Second, surveys with low response rates and relatively low non response bias may be questioned and rejected for publication. Both of these situations may lead to incorrect conclusions about health policies and practices. The present proposal attempts to fill this void by evaluating a set of indicators for the risk of non response bias. Each of these measures (including the response rate) makes assumptions that are untestable in most practical situations. The goal of this research is to understand the strengths and weaknesses of each of several alternative measures and the implications of incorrect assumptions. These indicators are compared and contrasted through derivation of their key properties. These properties can include a description of how each measure can be used to place bounds on the potential non response bias and the assumptions required to do so. In addition, a simulation study will be conducted to demonstrate how each measure performs under a varied set of conditions. Finally, all the measures will be applied to existing survey data collections. The goal of the proposed project is to aid in the development of a common understanding of a set of measures that can be used to evaluate the risk of non response bias. This should greatly facilitate efforts to evaluate the quality of health-related survey data.

描述（由申请人提供）：非反应偏见的风险是对健康调查有效性的主要威胁。许多特殊研究发现，这种偏见会影响重要的健康措施的结果。不幸的是，如何评估无响应偏见的风险几乎没有指导。许多调查依靠响应率是关键统计数据。然而，最近的荟萃分析表明，反应率是非反应偏置的较差的指标。在检查的研究中，反应率与非反应偏差之间几乎没有相关性。缺乏偏见风险的良好指标对健康调查有害。首先，响应率较高的调查和相对较高的非反应偏见可能被接受为有效和发表。其次，可能会质疑和拒绝发表较低的响应率和相对较低的非反应偏见的调查。这两种情况都可能导致关于健康政策和实践的不正确结论。本提案试图通过评估一组非反应偏见的风险来填补这一空白。这些措施（包括响应率）中的每一个都使假设在大多数实际情况下无法测试。这项研究的目的是了解几种替代措施中每一种的优势和缺点以及错误假设的含义。将这些指标通过推导其关键特性进行比较和对比。这些属性可以包括有关如何使用每个度量来对潜在的非响应偏差和这样做所需的假设施加界限的描述。此外，将进行仿真研究，以证明每种度量在各种条件下的性能。最后，所有措施将应用于现有的调查数据收集。拟议项目的目的是帮助发展对一套可用于评估非反应偏见风险的措施的共同理解。这将极大地促进评估与健康相关的调查数据质量的努力。