Transcended Reality: Modeling, Fabrication, Interaction, Navigation and Perception in Immersive (AR/VR) Environments

超越现实：沉浸式 (AR/VR) 环境中的建模、制造、交互、导航和感知

• 批准号: RGPIN-2016-06183
• 负责人: Singh, Karan
• 金额: $ 2.77万
• 依托单位: University of Toronto
• 依托单位国家: 加拿大
• 项目类别: Discovery Grants Program - Individual
• 财政年份: 2020
• 资助国家: 加拿大
• 起止时间: 2020-01-01 至 2021-12-31
• 项目状态: 已结题
• 来源: https://www.nserc-crsng.gc.ca/ase-oro/Details-Detailles_eng.asp?id=710208
• 关键词: Transcended; Reality; Modeling; Fabrication; Interaction

Augmented and Virtual Reality (AR/VR) are experiencing an unprecedented resurgence, with the onset of consumer-grade AR/VR devices and real-time computer graphics, to deliver an immersive experience where the virtual and real blend indistinguishably together. This proposal ambitiously aims to take the promise of AR/VR further, to one of TR or Transcended Reality, where our real physical environment is not only added to as in AR but subtracted from, replicated, abstracted and transformed, or more generally transcended. The dream of VR thinkers since early science fiction writings, has not been to merely recreate our physical reality, but to go beyond, indeed to transcend it. We will accomplish this by coupling a suite of devices that allow 3D shape and motion to co-exist in the digital and physical realm: combining AR/VR immersive displays (like the Oculus Rift, HTC/Valve Vive, Meta-AR or Microsoft HoloLens) and real-time 3D shape and motion acquisition devices (like the Microsoft Kinect or VICON motion capture), with robotic actuators, laser cutters and 3D printing. Specifically, the proposed research will focus on three areas within immersive environments: modeling form and function of objects, character interaction and navigation; all grounded by the perceptual capabilities of the immersive setting. Modeling and Fabrication: We expect 3D models in immersive environments to go beyond shape or form, to imbibe the functionality of physical objects, so that we may actively interact with them. In this proposal, we will thus focus on the simultaneous modeling of both 3D form and function. Digital designs using our research would thus instantly usable, both as digital models in an immersive setting, as 3D printed physical artifacts, or more interestingly as combinations of both. Interaction: As more devices in our environment become "internet aware", TR will be a space where humans communicate with their physical environments via the "internet of things". Interactive communication between man and machine in an immersive setting will be another thread of this proposal.This proposal will further explore modeling and animation techniques that produce emotionally engaging avatars, on either side of the uncanny valley. Navigation and Perception: Understanding the affordances and limitations of shape and motion perceived using stereoscopic and holographic projections continues to evolve with new AR/VR displays, and increased human exposure to these devices. Evaluating the perceptual impact of various immersive interaction and navigation techniques, is an important thread that will pervade our proposed research.

增强和虚拟现实（AR/VR）正在经历前所未有的复兴，随着消费级AR/VR设备和实时计算机图形技术的发作，可以提供一种沉浸式的体验，在其中虚拟和真正的真正混合在一起。该提议雄心勃勃地旨在将AR/VR的承诺进一步诺言，即TR或超越现实之一，在这种情况下，我们的实际物理环境不仅添加到AR中，而且从AR中添加，而是从中减去，复制，抽象和转换，或更普遍地超越。自早期科幻小说著作以来，VR思想家的梦想并不只是重现我们的身体现实，而是要超越它，而是超越了它。 我们将通过耦合一套设备来实现这一目标，这些设备可以允许3D形状和运动在数字和物理领域共存：结合AR/VR浸入式显示器（例如Oculus Rift，HTC/VALVE VIVE，Meta-Ar或Microsoft Hololens）以及与Microsoft kicoft kicoft kicoft kicoft kicoft kicoft kituer captue caption（Meta-ar或Microsoft Hololens）以及Microsoft KICOFT ORTER，LASECONT ORLES LASECONT或VICONT ACTURES，LASECONT或VICONT ORLECTER，LASER，或切割机和3D打印。 具体而言，拟议的研究将集中在沉浸式环境中的三个领域：对象的建模形式和功能，角色相互作用和导航；所有这些都基于身临其境环境的感知能力。 建模和制造：我们期望沉浸式环境中的3D模型超出形状或形式，吸收物理对象的功能，以便我们可以主动与它们相互作用。在此提案中，我们将重点关注3D形式和功能的同时建模。因此，使用我们的研究的数字设计将立即可用，无论是在身临其境的环境中作为数字模型，即3D打印的物理工件，还是更有趣的是两者的组合。 互动：随着我们环境中越来越多的设备成为“ Internet Aware”，TR将成为人类通过“物联网”与物理环境进行沟通的空间。在沉浸式环境中，人与机器之间的互动沟通将是该提案的另一个线程。该提案将进一步探索建模和动画技术，这些技术在不可思议的山谷的两侧产生情感吸引人的化身。 导航和感知：了解使用立体和全息投影感知的形状和运动的提供和局限性继续随着新的AR/VR显示，并增加了人类对这些设备的暴露。评估各种沉浸式互动和导航技术的感知影响是一个重要的线程，它将遍及我们建议的研究。