CAREER: Leveraging the Virtualness of Virtual Reality for More-Effective Training

职业：利用虚拟现实的虚拟性进行更有效的培训

• 批准号: 2021607
• 负责人: Ryan McMahan
• 金额: $ 27.32万
• 依托单位: The University of Central Florida Board of Trustees
• 依托单位国家: 美国
• 项目类别: Continuing Grant
• 财政年份: 2019
• 资助国家: 美国
• 起止时间: 2019-08-08 至 2023-08-31
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=2021607&HistoricalAwards=false
• 关键词: CAREER; Leveraging; Virtualness; Virtual; Reality; CAREER; Leveraging; Virtualness; Virtual; Reality

This research takes a new approach to computer-based virtual reality (VR) training by leveraging the virtualness of VR to provide training solutions not possible in the real world. The aim is to develop VR techniques that are more effective and more time-efficient for training than real-world exercises and VR systems that emulate them. To demonstrate the general effectiveness of these new VR training techniques, the research focuses on two training domains: (1) Robotic operating room tasks for non-surgeon team members, including preoperative setup, intraoperative tasks, and postoperative cleanup. (2) Pre-shift inspections of off-highway trucks, which include walk-around inspections, mounting the vehicle, and in-cab inspections. Formative expert reviews, studies comparing the new techniques to traditional VR training versions, and real-world validation studies will be used to determine the effectiveness and efficiency of the techniques. Educational activities include a graduate VR course, research experiences for undergraduates, a summer research program for underrepresented high school students, an annual VR summer camp for high and middle school students, and the creation of online video tutorials for VR development to support formal and informal learning.A new framework for designing and analyzing VR training techniques has been developed to facilitate this research, the Framework for Altering Fidelity to Influence Memory. It connects two concepts, system fidelity and working memory. System fidelity is the objective degree of exactness with which real world experiences are reproduced by a VR system. Working memory is the temporal activation of short-term or long-term perceptual, cognitive, and motor memory networks in the mind of the human user. The premise of the framework is to manipulate an aspect of system fidelity to help a stage of working memory, which in turn should improve the effectiveness of training. Six novel VR techniques, based on approaches identified with this framework, will be developed and investigated: (1) causation signaling, (2) sensory accents, (3) situational dramatization, (4) error instigation, (5) object conjuration, and (6) regulated biomechanics. For example, the causation signaling method is to purposefully alter time and physics to convey the cause-and-effect relationship between an event and its consequence. Time warping is a causation signaling technique in which the training scenario can be fast-forwarded after an error to the resulting consequence and then rewound back to the decision point just before the error. This technique will convey to the user the cause-and-effect relationship between the error and resulting consequence, in addition to allowing the user to correct the mistake.

这项研究通过利用VR的虚拟性来提供现实世界中不可能提供培训解决方案的虚拟性来对基于计算机的虚拟现实（VR）培训进行新的方法。目的是开发与模仿它们的现实世界练习和VR系统更有效且更有效率的VR技术。为了证明这些新的VR培训技术的总体有效性，该研究重点介绍了两个培训领域：（1）针对非外科手术团队成员的机器人手术室任务，包括术前设置，术中任务和术后清理。 （2）对高速公路卡车的档前检查，其中包括步行检查，安装车辆和驾驶室内检查。形成性专家评论，将新技术与传统VR培训版本进行比较的研究以及现实世界验证研究将用于确定技术的有效性和效率。 教育活动包括一项研究生VR课程，本科生的研究经验，针对代表性不足的高中生的夏季研究计划，每年的VR夏令营和中学生的VR夏令营以及为VR开发的在线视频教程，以支持正式和非正式的学习。用于设计和分析VR培训技术的新框架，以实现这一范围，以实现这一范围，以实现这项研究，以实现这一研究。 它连接了两个概念：系统保真度和工作记忆。系统保真度是现实世界经验由VR系统复制的客观程度。工作记忆是人用户心中的短期或长期感知，认知和运动记忆网络的时间激活。该框架的前提是操纵系统保真度的一个方面，以帮助工作记忆的阶段，进而将提高训练的有效性。将开发和研究六种基于此框架确定的方法，基于该框架确定的方法：（1）因果信号传导，（2）感觉口音，（3）情境戏剧化，（4）误差煽动，（5）对象融合和（6）受调节的生物力学。 例如，因果信号传导方法是有目的地改变时间和物理，以传达事件及其后果之间的因果关系。 时间扭曲是一种因果信号技术，其中训练方案在错误后可以在错误后的后果后快速前进，然后在错误之前重新回到决策点。此技术除了允许用户纠正错误外，还将向用户传达错误与结果之间的因果关系。