Observer Studies Involving Search: Modeling and Analysis

涉及搜索的观察者研究：建模和分析

• 批准号: 6956859
• 负责人: DEV P CHAKRABORTY
• 金额: $ 33.41万
• 依托单位: UNIVERSITY OF PITTSBURGH AT PITTSBURGH
• 依托单位国家: 美国
• 财政年份: 2005
• 资助国家: 美国
• 起止时间: 2005-08-01 至 2009-05-31
• 项目状态: 已结题
• 来源: https://reporter.nih.gov/project-details/6956859
• 关键词: bioimaging /biomedical imaging; computer assisted diagnosis; computer program /software; computer system design /evaluation; diagnosis quality /standard; health care personnel performance; image processing; lung neoplasms; mathematical model; model design /development; radiography

DESCRIPTION (provided by applicant): Since the inception of the paradigm in 1961 the analysis of FROC (free-response receiver operating characteristic) data (i.e., mark-rating pairs) has remained an unsolved problem in imaging science. Since the radiologist must search patient images for localized lesions, intrinsically FROC data is generated in virtually all imaging studies in radiology. Currently there is great interest in evaluating different computer aided detection (CAD) algorithms for lung cancer screening with helical CT scans. This task also involves search and depending on the CAD in use there are approximately 4 to 20 suspicious areas reported per patient While in the past the receiver operating characteristic (ROC) paradigm has been the standard method for the evaluation of diagnostic imaging systems, its limitation to one report per patient is now being increasingly felt. This is a proposal to develop the science and perform the requisite testing of the FROC paradigm by accomplishing the following aims. (1) Develop a statistical model for FROC data that includes the effect of search and other relevant perceptual factors and which reduces to the standard ROC model in non-search tasks. (2) Use the model to validate and evaluate currently proposed methods for analyzing location and ratings data, and in particular determine their statistical power. (3) Develop an algorithm to determine the parameters of the model from clinical FROC data and to make statistical inferences regarding the modalities being tested; verify that the estimated search parameters correlate with values inferred from eye-movement recordings. (4) Provide practical and validated software to the user community that will offer more statistical power and therefore require fewer resources of cases and readers. The significance of the proposed work is that on the scale of previous developments, the potential gain in statistical power by the FROC method is very large. Also, the explicit modeling of search and the ability to estimate search related parameters from observer data should open up new areas of vision research that all researchers can exploit.

描述（由申请人提供）： 自1961年范式成立以来，对Froc（自由响应接收器操作特征）数据（即标记评分对）的分析在成像科学中仍然是一个尚未解决的问题。由于放射科医生必须搜索患者图像以获取局部病变，因此在放射学的所有成像研究中都会生成本质上的FROC数据。当前，人们对评估不同计算机辅助检测（CAD）算法进行肺癌筛查的算法非常感兴趣。这项任务还涉及搜索，根据使用的CAD，每名患者报告的可疑区域大约有4至20个可疑区域，而过去的接收器操作特征（ROC）范式一直是评估诊断成像系统的标准方法，现在越来越感受到其对每名患者一份报告的限制。这是开发科学并通过实现以下目标对FROC范式进行必要测试的建议。 （1）为FROC数据开发一个统计模型，其中包括搜索和其他相关感知因素的效果，并在非搜索任务中降低了标准ROC模型。 （2）使用该模型来验证和评估当前提出的方法，以分析位置和评级数据，特别是确定其统计能力。 （3）开发一种算法来从临床FROC数据中确定模型的参数，并就所测试方式做出统计推断；验证估计的搜索参数是否与眼动记录推论的值相关。 （4）向用户社区提供实用且经过验证的软件，这些软件将提供更多的统计能力，因此需要更少的案例和读者资源。拟议的工作的重要性是，根据先前发展的规模，FROC方法的统计能力潜在增益非常大。同样，搜索的明确建模以及从观察者数据估算搜索相关参数的能力，应打开所有研究人员都可以利用的新的视力研究领域。