APlausE-MR - Audiovisual Plausibility and Experience in Multi-Party Mixed Reality

APlausE-MR - 多方混合现实中的视听合理性和体验

• 批准号: 444831328
• 负责人: Professor Dr.-Ing. Karlheinz Brandenburg
• 金额: --
• 依托单位: Institut für Medientechnik
• 依托单位国家: 德国
• 项目类别: Priority Programmes
• 资助国家: 德国
• 项目状态: 未结题
• 来源: https://gepris.dfg.de/gepris/projekt/444831328?language=en
• 关键词: APlausE; MR; Audiovisual; Plausibility; Experience

APlausE-MR focuses on distributed multi-party mixed reality (MR) scenarios that involve groups of collocated and remote users. It is our hypothesis that realistic audiovisual virtual environments contribute mainly to the place illusion, the sense of being there, but that creating and maintaining the illusion of plausibility, the sensation of what is happening is real, also requires avatar representations that look, behave and sound credible. Here, the usage of participant representations based on 3D-video-capture will be compared to classic avatar-type representations. Furthermore, supporting the users’ natural interaction with the virtual environment and with each other promotes the credibility of the experience through joint perception. These factors mutually reinforce plausibility and can even compensate each other in case of imperfections. To validate this hypothesis our proposed research addresses three main challenges: (1) The development and integration of the audiovisual technologies that enable plausible communication within a group and between groups in virtual worlds, (2) the identification and qualification of factors influencing the plausibility of audiovisual experiences in multi-party IVEs and (3) the development of suitable evaluation methods and technologies for the analysis of user and group behavior in collocated and distributed audiovisual IVEs. The PhD students of this project will be supported by three research groups with significant expertise in multi-user virtual reality, immersive telepresence, highly realistic spatial audio experiences, and the assessment of the quality of experience in audiovisual environments and for multi-party communication.

Aplause-MR专注于分布式多方混合现实（MR）方案，涉及一组相处和远程用户。我们的假设是，现实的视听虚拟环境主要贡献了幻想，在那里的感觉，但是创造和维持了合理性的幻想，所发生的事情的感觉是真实的，也需要外观，表现和可信的头像表示。在这里，将将基于3D-Video捕获的参与者表示形式与经典的头像型表示。此外，支持用户与虚拟环境的自然互动以及彼此之间的自然互动，可以通过共同的感知来促进体验的信誉。这些因素相互加强可增强合理性，甚至可以在不完美的情况下相互补偿。为了验证这一假设，我们提出的研究解决了三个主要挑战：（1）视听技术的发展和整合，能够在小组内以及虚拟世界中的群体之间以及在虚拟世界中的群体之间进行合理的沟通，（22）识别和资格的识别和资格，影响了对多方派系和（3）在适当范围内的Audiovisal Experience的合理性和（3）的行为和（3）的行为（3）的行为（3）的行为（3）并列和分布的视听ives。该项目的博士学位学生将得到三个在多用户虚拟现实，沉浸式远程敏感，高度现实的空间音频体验以及评估视听环境中经验质量和多方交流的评估方面具有重要专业知识的研究小组的支持。