Distortions in virtual and augmented environments: impact on performance and well-being

虚拟和增强环境中的扭曲：对性能和健康的影响

• 批准号: 523632-2018
• 负责人: Wilcox, Laurie
• 金额: $ 9.47万
• 依托单位: York University
• 依托单位国家: 加拿大
• 项目类别: Collaborative Research and Development Grants
• 财政年份: 2020
• 资助国家: 加拿大
• 起止时间: 2020-01-01 至 2021-12-31
• 项目状态: 已结题
• 来源: https://www.nserc-crsng.gc.ca/ase-oro/Details-Detailles_eng.asp?id=697767
• 关键词: Distortions; virtual; augmented; environments; impact

The human brain has evolved an impressive ability to integrate visual information with input from multiple sensory systems (e.g. vestibular, auditory). As a result, we seemingly effortlessly interact with, and navigate within, our environment. We naturally adapt to some changes in the relation between these inputs, for instance as the body grows, and also to more temporary changes in the correspondence between sensory information. The study of sensory integration has long been a focus of scientific study, using carefully controlled stimuli. However, it is difficult to extrapolate these results to vision in more natural environments. The rapid expansion of virtual reality (VR) and augmented reality (AR) content and displays provides opportunities to assess sensory integration in a controlled manner, but with more complex naturalistic stimuli. In addition, behavioural experiments have the potential to provide important insights into the impact of sensory distortions on user well-being and for task performance in virtual environments. In collaboration with Qualcomm Canada Inc., we will systematically evaluate the effects of sensory discord in virtual environments using rigorous behavioural assessment methods when users a) passively integrate conflicting visual spatial and geometric information, b) actively integrate conflicting visual depth/location cues and c) actively interpret self-motion information based on visual, auditory and vestibular cues. In all cases, we will use a combination of psychophysical methods, validated questionnaires and human factors protocols to evaluate the impact of the sensory distortions. Thus, the results of the proposed experiments will inform both our understanding of human visual processing under naturalistic viewing scenarios, and the user experience in advanced head-mounted displays (HMD).

人类大脑已经进化出一种令人印象深刻的能力，可以将视觉信息与多个感觉系统（例如前庭、听觉）的输入相结合。结果，我们似乎毫不费力地与我们的环境互动并在其中导航。我们自然地适应这些输入之间关系的一些变化，例如随着身体的成长，以及感觉信息之间对应关系的暂时变化。长期以来，使用精心控制的刺激来进行感觉统合研究一直是科学研究的焦点。然而，很难将这些结果推断为更自然环境中的视觉。 虚拟现实 (VR) 和增强现实 (AR) 内容和显示的快速扩展提供了以受控方式评估感觉统合的机会，但具有更复杂的自然刺激。此外，行为实验有可能为虚拟环境中感觉扭曲对用户福祉和任务绩效的影响提供重要见解。 与高通加拿大公司合作，当用户a）被动整合冲突的视觉空间和几何信息，b）主动整合冲突的视觉深度/位置线索和c时，我们将使用严格的行为评估方法系统地评估虚拟环境中感官不和谐的影响。 ）根据视觉、听觉和前庭线索积极解释自我运动信息。 在所有情况下，我们将结合使用心理物理学方法、经过验证的问卷和人为因素协议来评估感觉扭曲的影响。因此，所提出的实验结果将有助于我们理解自然观看场景下的人类视觉处理，以及先进头戴式显示器（HMD）中的用户体验。