APlausE-MR - Audiovisual Plausibility and Experience in Multi-Party Mixed Reality

APlausE-MR - 多方混合现实中的视听合理性和体验

• 批准号: 444831328
• 负责人: Professor Dr.-Ing. Karlheinz Brandenburg
• 金额: --
• 依托单位: Institut für Medientechnik
• 依托单位国家: 德国
• 项目类别: Priority Programmes
• 资助国家: 德国
• 项目状态: 未结题
• 来源: https://gepris.dfg.de/gepris/projekt/444831328?language=en
• 关键词: APlausE; MR; Audiovisual; Plausibility; Experience

APlausE-MR focuses on distributed multi-party mixed reality (MR) scenarios that involve groups of collocated and remote users. It is our hypothesis that realistic audiovisual virtual environments contribute mainly to the place illusion, the sense of being there, but that creating and maintaining the illusion of plausibility, the sensation of what is happening is real, also requires avatar representations that look, behave and sound credible. Here, the usage of participant representations based on 3D-video-capture will be compared to classic avatar-type representations. Furthermore, supporting the users’ natural interaction with the virtual environment and with each other promotes the credibility of the experience through joint perception. These factors mutually reinforce plausibility and can even compensate each other in case of imperfections. To validate this hypothesis our proposed research addresses three main challenges: (1) The development and integration of the audiovisual technologies that enable plausible communication within a group and between groups in virtual worlds, (2) the identification and qualification of factors influencing the plausibility of audiovisual experiences in multi-party IVEs and (3) the development of suitable evaluation methods and technologies for the analysis of user and group behavior in collocated and distributed audiovisual IVEs. The PhD students of this project will be supported by three research groups with significant expertise in multi-user virtual reality, immersive telepresence, highly realistic spatial audio experiences, and the assessment of the quality of experience in audiovisual environments and for multi-party communication.

APlausE-MR 专注于涉及多组远程用户的分布式多方混合现实 (MR) 场景，我们的假设是，真实的视听虚拟环境主要有助于营造场所幻觉、身临其境的感觉，但也有助于创造和呈现现场感。为了保持似是而非的幻觉，所发生的事情的感觉是真实的，还需要外观、行为和声音可信的化身表示。这里，基于 3D 视频捕获的表示的使用参与者将与经典化身类型进行比较。此外，支持用户与虚拟环境以及彼此之间的自然交互可以通过联合感知来提高体验的可信度，甚至可以在出现缺陷时相互补偿。研究解决了三个主要挑战：(1) 视听技术的开发和集成，使虚拟世界中的群体内部和群体之间能够进行合理的沟通，(2) 影响多方视听体验合理性的因素的识别和限定IVE 和(3) 开发合适的评估方法和技术，用于分析并置和分布式视听 IVE 中的用户和群体行为。该项目的博士生将得到在多用户虚拟现实、沉浸式体验方面拥有丰富专业知识的三个研究小组的支持。远程呈现、高度逼真的空间音频体验以及视听环境和多方通信体验质量的评估。