FW-HTF-RM: Collaborative Research: Augmenting Remote Medical Procedure Training and Assistance with Spatial Computing and Volumetric Capture

FW-HTF-RM：合作研究：通过空间计算和体积捕获增强远程医疗程序培训和援助

• 批准号: 2026505
• 负责人: Krzysztof Pietroszek
• 金额: $ 60.27万
• 依托单位: American University
• 依托单位国家: 美国
• 项目类别: Standard Grant
• 财政年份: 2020
• 资助国家: 美国
• 起止时间: 2020-09-01 至 2023-08-31
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=2026505&HistoricalAwards=false
• 关键词: FW; HTF; RM; Collaborative; Research

Healthcare expenditure accounts for 17% of the US Gross Domestic Product and 12% of the workforce, but access to highly skilled health professionals is not evenly distributed across geographic and socioeconomic strata. Videoconferencing-based telehealth systems partly address this inequality by enabling experts to assist and train remote or rural medical personnel. However, videoconferencing alone cannot adequately convey three-dimensional information that is essential in performing many medical procedures. For example, it is very difficult for an expert to precisely guide an operator's hand remotely in performing a medical procedure using only videoconferencing. This project will transform the way medical personnel communicates and collaborates across the distance by allowing for real-time exchange of three-dimensional information that is missing in current videoconferencing telehealth. The project will lead to more equitable access to healthcare; improved success for medical procedures that require the assistance of a remote expert; more cost-effective distribution of healthcare skills and training; and higher quality expert medical advice from a distance. It will also engage students in interdisciplinary research using emerging technology.The goals of this research include: i) developing an understanding of the communication needs for medical staff in distant training, mentoring and procedural assistance, ii) insights into the application of mixed-reality volumetric representation and transmission in remote healthcare settings; iii) design guidelines for a mixed-reality volumetric communication system that simulates the physical presence of the patient at the location of the remote expert; iv) clinical evaluation of the utility of 3D spatial information in remote medical procedures assistance; and v) user studies examining the efficacy of spatially-enhanced communication in remote medical training and guidance. The project aims to enroll 144 trainees consisting of medical and allied health students, physicians, physician assistants, and nurse practitioners to participate in randomized training experiments in three conditions: current standard training, 2D and voice guidance, and 3D mixed-reality. To achieve the above goals, researchers will also advance spatial computation and volumetric capture technologies. The project deliverables include a prototype of a spatial communication telehealth system that will create a real-time three-dimensional representation of the patient. This shared representation will be annotated with information exchanged between the medical procedure operator and the remotely guiding expert. The project is a collaboration between the Department of Emergency Medicine and the Clinical Learning and Simulation Skills Center at George Washington University, and American University. The multidisciplinary research team includes researchers from computer science, human-computer interaction, communication, telehealth, emergency medicine, medical simulation, and medical education.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.

医疗保健支出占美国国内生产总值的17％，占劳动力的12％，但是在地理和社会经济阶层中均未均匀分配高技能的卫生专业人员。 基于视频会议的远程医疗系统可以通过使专家能够协助和培训远程或农村医务人员来解决这种不平等问题。但是，仅视频会议不能充分传达三维信息，这对于执行许多医疗程序至关重要。例如，专家很难精确地指导操作员的手仅使用视频会议执行医疗程序。该项目将通过实时交换三维信息的实时交流，这些信息将改变医疗人员在远处进行交流和合作的方式，这些信息在当前的视频会议中远程医疗中缺少。该项目将导致更公平地获得医疗保健；改善了需要远程专家协助的医疗程序的成功；更具成本效益的医疗技能和培训分配；以及远距离的更高质量的专家建议。它还将使用新兴技术吸引学生进行跨学科研究。这项研究的目标包括：i）对医务人员在远处培训，指导和程序援助中的沟通需求的了解，ii）洞悉混合现实的应用。远程医疗设置中的体积表示和传输； iii）混合现实体积通信系统的设计指南，该指南模拟了远程专家位置的患者的身体存在； iv）在远程医疗程序援助中对3D空间信息的效用的临床评估； v）用户研究检查在远程医学培训和指导中空间增强沟通的功效。 该项目旨在招募由医学和盟友健康学生，医师，医师助理和护士从业人员组成的144名学员，以在三种条件下参加随机培训实验：当前的标准培训，2D和语音指导以及3D混合现实。为了实现上述目标，研究人员还将推进空间计算和体积捕获技术。项目可交付成果包括空间通信远程医疗系统的原型，该系统将创建患者的实时三维表示。该共享表示形式将注释，医疗程序操作员与远程指导专家之间交换的信息。该项目是急诊医学系与乔治华盛顿大学和美国大学的临床学习与模拟技能中心之间的合作。多学科研究团队包括计算机科学，人力计算机互动，沟通，远程医学，急诊医学，医学模拟和医学教育的研究人员。该奖项反映了NSF的法定任务，并被认为是值得通过基金会的知识分子优点和智力优点和评估的支持。更广泛的影响审查标准。

项目成果

Volumetric Communication in Medical Training - CPR Emergencies

医疗培训中的体积通信 - 心肺复苏紧急情况

• DOI: 10.21125/edulearn.2023.2014
• 发表时间: 2023
• 期刊: 15th International Conference on Education and New Learning Technologies
• 作者: Pietroszek, Krzysztof;Rebol, Manuel;Steinmaurer, Alexander;Gamillscheg, Florian;Gütl, Christian;Ranniger, Claudia;Hood, Colton;Rutenberg, Adam;Sikka, Neal
• 通讯作者: Sikka, Neal

Mixed Reality Communication System for Procedural Tasks

用于程序任务的混合现实通信系统

• DOI: 10.1145/3531073.3534497
• 发表时间: 2022
• 期刊: AVI 2022: Proceedings of the 2022 International Conference on Advanced Visual Interfaces
• 作者: Rebol, Manuel;Ranniger, Claudia;Hood, Colton;Horan, Erin;Rutenberg, Adam;Sikka, Neal;Ajabnoor, Yasser;Alshikah, Safinaz;Pietroszek, Krzysztof
• 通讯作者: Pietroszek, Krzysztof

Collaborative System Design of Mixed Reality Communication for Medical Training

医疗培训混合现实通信协同系统设计

• 发表时间: 2023
• 期刊: Proceedings of the Annual Hawaii International Conference on System Sciences
• 作者: Rebol, Manuel Pietroszek

Work-in-Progress-Volumetric Communication for Remote Assistance Giving Cardiopulmonary Resuscitation

用于心肺复苏远程协助的正在进行的容量通信

• 发表时间: 2022
• 期刊: 2022 8th International Conference of the Immersive Learning Research Network (iLRN
• 作者: Rebol, Manuel;Pietroszek, Krzysztof;Ranniger, Claudia;Hood, Colton;Rutenberg, Adam;Sikka, Neal;Steinmaurer, Alexander;Gutl, Christian
• 通讯作者: Gutl, Christian

Mixed Reality Communication for Medical Procedures: Teaching the Placement of a Central Venous Catheter

• DOI: 10.1109/ismar55827.2022.00050
• 发表时间: 2022-10
• 期刊: 2022 IEEE International Symposium on Mixed and Augmented Reality (ISMAR)
• 作者: M. Rebol;Krzysztof Pietroszek;C. Ranniger;C. Hood;A. Rutenberg;N. Sikka;David Li;Christian Gütl