Creating simulation-based performance assessment tools for practicing physicians

为执业医师创建基于模拟的绩效评估工具

• 批准号: 8248049
• 负责人: MATTHEW BRET WEINGER
• 金额: $ 34.99万
• 依托单位: VANDERBILT UNIVERSITY
• 依托单位国家: 美国
• 财政年份: 2011
• 资助国家: 美国
• 起止时间: 2011-04-01 至 2014-03-31
• 项目状态: 已结题
• 来源: https://reporter.nih.gov/project-details/8248049
• 关键词: Creating; simulation; based; performance; assessment

DESCRIPTION (provided by applicant): Creating simulation-based performance assessment tools for practicing physicians A team of leading simulation researchers and educators propose a 10-center study of the applicability of mannequin-based simulation to high-stakes assessment of practicing clinicians who are seeking board recertification. This unique study will address important issues for performance evaluation of practicing clinicians, which include the development of standardized scenarios with associated reliable scoring instruments, distributed delivery and assessment of clinicians' performance using those scenarios across multiple testing sites, and a description of the distribution of medical/technical and behavioral performance of 200 practicing board- certified anesthesiologists (BCA). The results will inform competency assessment of physicians in other specialties as well as physicians-in-training. Using a network of experienced simulation instructors and programs already offering all-day simulation courses that are mandatory for BCA desiring Maintenance of Certification in Anesthesia (MOCA) provides a singular opportunity to address some of the challenges of measuring clinical competency using high-fidelity simulation. The Specific Aims are to: 1) Develop standardized, generalizable simulation scenarios with associated valid, reliable performance assessment tools to conduct simulation-based assessment of BCA; 2) Demonstrate that simulation-based clinical assessment can be reliably delivered across multiple national sites for the purpose of evaluating board-certified physicians seeking recertification; 3) Describe quantitatively and qualitatively the distribution of clinical performance during simulation from a large and diverse cross-section of board-certified physicians; and 4) Begin to address the remaining challenges and questions related to reliable and valid simulation-based assessment of practicing physicians' clinical competency. The products of Aim 1 will be 4 standardized scenarios, associated reliable performance rating instruments, and detailed methods for conducting clinical performance ratings. In Aim 2, we will conduct more than 100 MOCA(R) courses over a two-year period in 10 ASA-Endorsed centers; the clinical performance of 200 BCA will be assessed. We hypothesize that there will be a broad distribution of medical/technical and (especially) behavioral performance ratings from poor to excellent, reflecting a diverse cross-section of participants. Finally, we will hold a national stakeholders consensus conference to discuss the remaining challenges and questions related to reliable and valid simulation-based assessment of clinical competency. The results will delineate the requirements of future validation studies of clinical performance assessment and provide important guidance for simulation-based competency assessment across multiple specialties. PUBLIC HEALTH RELEVANCE: Assurance of physicians' ability to detect and manage uncommon but potentially lethal events is an area of particular societal concern and may be amenable to simulation-based performance assessment. This multicenter study will develop rigorous methods and measures for assessing the acute care competency of practicing physicians using mannequin-based high-fidelity simulation.

描述（由申请人提供）：为执业医师创建基于模拟的绩效评估工具由领先的模拟研究人员和教育工作者组成的团队提出了一项 10 中心研究，研究基于人体模型的模拟对正在寻求的执业临床医生的高风险评估的适用性董事会重新认证。这项独特的研究将解决执业临床医生绩效评估的重要问题，其中包括开发具有相关可靠评分工具的标准化场景、使用跨多个测试站点的这些场景分布式交付和评估临床医生的绩效，以及描述200 名执业委员会认证麻醉师 (BCA) 的医疗/技术和行为表现。结果将为其他专业医生以及实习医生的能力评估提供信息。使用由经验丰富的模拟讲师和项目组成的网络，该网络已经提供全天模拟课程，这些课程是希望维持麻醉认证 (MOCA) 的 BCA 所必需的，这为解决使用高保真模拟衡量临床能力的一些挑战提供了独特的机会。具体目标是： 1) 开发标准化、可推广的模拟场景以及相关的有效、可靠的性能评估工具，以对 BCA 进行基于模拟的评估； 2) 证明基于模拟的临床评估可以在多个国家站点可靠地进行，以评估寻求重新认证的委员会认证医生； 3) 定量和定性地描述模拟过程中来自大量不同领域的委员会认证医生的临床表现分布； 4) 开始解决与可靠且有效的基于模拟的执业医师临床能力评估相关的剩余挑战和问题。目标1的产品将是4个标准化场景、相关的可靠性能评级工具以及进行临床性能评级的详细方法。在目标 2 中，我们将在两年内在 10 个 ASA 认可的中心举办 100 多个 MOCA(R) 课程；将评估 200 个 BCA 的临床表现。我们假设医疗/技术和（特别是）行为表现评级将有从差到优秀的广泛分布，反映了参与者的不同横截面。最后，我们将召开全国利益相关者共识会议，讨论与可靠且有效的基于模拟的临床能力评估相关的剩余挑战和问题。结果将描述未来临床表现评估验证研究的要求，并为跨多个专业基于模拟的能力评估提供重要指导。 公共卫生相关性：确保医生检测和处理不常见但可能致命的事件的能力是社会特别关注的一个领域，并且可能适合基于模拟的绩效评估。这项多中心研究将开发严格的方法和措施，使用基于人体模型的高保真模拟来评估执业医生的急症护理能力。