Observer Studies Involving Search: Modeling and Analysis

涉及搜索的观察者研究：建模和分析

• 批准号: 7780213
• 负责人: DEV P CHAKRABORTY
• 金额: $ 45.89万
• 依托单位: UNIVERSITY OF PITTSBURGH AT PITTSBURGH
• 依托单位国家: 美国
• 财政年份: 2005
• 资助国家: 美国
• 起止时间: 2005-08-01 至 2013-12-31
• 项目状态: 已结题
• 来源: https://reporter.nih.gov/project-details/7780213
• 关键词: Address; Algorithms; Anatomy; Arts; Award; Biopsy; Breast; Chest; Clinical; Clinical Data; Clinical Trials; Complex; Computer Assisted; Computer software; Data; Data Analyses; Data Correlations; Data Set; Detection; Diagnostic; Digital Mammography; Early Diagnosis; Equipment; Funding; Goals; Gold; Healthcare; Human; Image; International; Journals; Left; Lesion; Location; Malignant Neoplasms; Mammography; Measurement; Measures; Methodology; Methods; Modality; Modeling; Outcome; Paper; Patients; Peer Review; Performance; Planning Techniques; Prospective Studies; Publishing; Receiver Operating Characteristics; Reporting; Research; Research Personnel; Rewards; Running; Sample Size; Screening procedure; Simulate; Specific qualifier value; System; Techniques; Testing; Validation; Woman; Work; base; cancer therapy; case-based; clinically relevant; cost; data acquisition; data modeling; design; image processing; malignant breast neoplasm; novel; prospective; public health relevance; radiologist; response; symposium; tool; virtual

DESCRIPTION (provided by applicant): The research involves measuring imaging system performance in tasks such as detecting breast cancer. Receiver operating characteristic (ROC) methodology, the current gold-standard, uses patient-level information that a woman has suspected breast cancer. The location-specific free-response ROC (FROC) method uses additional location-level information in the radiologist's report, e.g., the cancer is in the left breast and is present at a particular location. Progress during the funded period has resulted in a novel perceptually-based FROC model and data simulator and several validated methods for analyzing data which are applicable to human observers and computer aided detection (CAD) algorithms. Papers using the PI's ideas and software are being presented in increasing numbers at conferences and in journals, and his work has generated healthy debate. The overall goal of the competing renewal project is to continue advancing the state-of-the-art in this field by addressing a number of limitations of current methods. Specific Aim 1: The figure-of-merit (FOM) is a critical determinant of statistical power and clinical relevance but all current FOMs are lesion-based and cases with more lesions contribute more to the FOM than cases with fewer lesions, and clinically less important lesions contribute equally as more important ones; we will develop novel case-based FOMs that overcome these limitations. Specific Aim 2: A realistic simulator yields confidence in methodology validation using that simulator. We will extend the current simulator by incorporating more realistic correlation effects and we will develop methodology to calibrate the simulator to real datasets thereby allowing the methodology developer to tune the simulator to specific applications. The simulator will be used to validate the different methods of analysis developed in Aim 1. Specific Aim 3: We will address several practical issues with current FROC methodology: arbitrariness of the proximity criterion, i.e., how close a mark must be to a lesion in order to credit the observer for a true detection; lack of sample-size estimation methodology for planning prospective studies; and lack of methods for analyzing clinically realistic data acquisition scenarios such as multiple views and breasts and multiple lesion types per case. Specific Aim 4: We will validate the methodology using independently acquired ROC, FROC and outcome-data in mammography. Outcome is defined as GOOD for normal cases returned to screening or abnormal cases sent to biopsy and BAD otherwise. We will test the hypothesis that FROC better correlates with outcome and yields greater statistical power than ROC. The significance is that the field is increasingly moving towards location-specific analyses, because of its intrinsic appeal and clinical realism, therefore methodology capable of analyzing the complex data, well outside the scope of the current gold-standard, is urgently needed. Patients benefit from better designed and optimized equipment leading to early diagnosis and treatment of cancers. Health care benefits because more efficient and cost-effective studies become possible which could serve as surrogates for expensive clinical trials. PUBLIC HEALTH RELEVANCE: The research involves measuring imaging system performance in tasks such as detecting breast cancer where the current gold-standard uses information that a woman is suspected to have breast cancer, but the proposed new method uses additional information, e.g., the suspected cancer is in the left breast at a particular location, thereby yielding a more precise and clinically relevant measurement of performance. Patients benefit from better designed and optimized equipment leading to early diagnosis and treatment of cancers. Health care benefits because more efficient and cost-effective studies become possible which could serve as surrogates for expensive clinical trials.

描述（由申请人提供）：研究涉及测量诸如检测乳腺癌之类的任务中的成像系统性能。接收器操作特征（ROC）方法（当前的金标准）使用了女性怀疑乳腺癌的患者级信息。特定于位置的自由响应ROC（FROC）方法在放射科医生报告中使用其他位置级信息，例如，癌症位于左乳房中，并且存在于特定位置。在资助期间的进展导致了一种新颖的基于感知的FROC模型和数据模拟器，以及几种经过验证的方法，用于分析适用于人类观察者和计算机辅助检测（CAD）算法的数据。使用PI的想法和软件的论文在会议和期刊上的数量越来越多，他的工作引起了健康的辩论。竞争性更新项目的总体目标是通过解决当前方法的许多局限性，继续推进该领域的最先进。特定目的1：统计能力和临床相关性的关键决定因素（FOM）是基于病变的所有关键决定因素，并且病例比病变较少的病例更大的病例对FOM的贡献更大，并且临床上重要的病变在临床上较少重要的病变在同等的贡献中均与更重要的病变相同；我们将开发基于案例的新型FOM，以克服这些局限性。特定目的2：使用该模拟器对方法验证产生信心。我们将通过结合更现实的相关效应来扩展当前的模拟器，并将开发方法来校准模拟器到实际数据集中，从而允许方法论开发人员将模拟器调整为特定的应用程序。该模拟器将用于验证目标1中开发的不同分析方法。特定目的3：我们将通过当前的Froc方法论解决几个实际问题：接近性标准的任意性，即，必须有多么近的病变，以使观察者对观察者进行真实检测；缺乏用于计划前瞻性研究的样本大小估计方法；缺乏分析临床现实的数据获取方案（例如多种视图和乳房以及每例病变类型）的方法。特定目标4：我们将在乳房X线摄影中使用独立获取的ROC，FROC和结果数据验证方法。结果被定义为返回筛查的正常病例或送往活检的异常病例，否则不良。我们将检验以下假设：FOR与结果更好，并产生比ROC更大的统计能力。意义在于，由于其内在的吸引力和临床现实主义，该领域越来越朝着特定于位置的分析方向发展，因此能够迫切需要能够分析复杂数据的方法学，这是迫切需要的。患者从设计和优化的设备中受益，从而可以早期诊断和治疗癌症。医疗保健益处是因为可以进行更有效和成本效益的研究，这可能是昂贵的临床试验的替代物。 公共卫生相关性：该研究涉及测量诸如检测乳腺癌等任务的成像系统性能，其中当前的金标准使用了怀疑女性患有乳腺癌的信息，但是拟议的新方法使用了其他信息，例如，可疑的癌症位于特定位置的左乳腺，从而产生了更精确的和临床相关的表现测量。患者从设计和优化的设备中受益，从而可以早期诊断和治疗癌症。医疗保健益处是因为可以进行更有效和成本效益的研究，这可能是昂贵的临床试验的替代物。