Real-time volumetric video recording of large capture areas

大捕捉区域的实时体积视频录制

• 批准号: 107443
• 金额: $ 22.21万
• 依托单位: CONDENSE REALITY LTD
• 依托单位国家: 英国
• 项目类别: Collaborative R&D
• 财政年份: 2020
• 资助国家: 英国
• 起止时间: 2020 至 无数据
• 项目状态: 已结题
• 来源: https://gtr.ukri.org/projects?ref=107443
• 关键词: Real; time; volumetric; video; recording

The aim of this project is to build a system capable of recording photorealistic 3D models of fast moving content in real-time, with an initial focus on sports events. When paired with virtual reality (VR), augmented reality (AR) or mixed reality (MR) hardware, these recordings will provide viewers with immersive, hologram-style renderings of events from the comfort of their own homes. The technology (known as volumetric capture) will use multiple, non intrusive sensors positioned around an event to generate the 3D reconstruction. Although the focus of this project will be on sports, the technology will be applicable to a wide range of live events. Currently, recording volumetric video of large areas (as large as or greater than the size of a boxing ring) requires processing times which prohibit live broadcasting. To enable us to record and distribute sports events in real-time, we will develop highly optimised algorithms and data structures alongside deep learning powered systems to create volumetric video of fast moving events over large areas in real-time. Working with our partner company, we will also develop camera equipment which is portable, easy to set up, and non-intrusive so as not to restrict the view of audience members.

该项目的目的是构建一个能够实时录制快速移动内容的感性3D模型的系统，最初的重点是体育赛事。当与虚拟现实（VR），增强现实（AR）或混合现实（MR）硬件配对时，这些录音将为观众提供沉浸式的全息图式渲染，从自己家中舒适地进行事件。该技术（称为体积捕获）将使用围绕事件的多个非侵入性传感器来产生3D重建。尽管该项目的重点将放在体育上，但该技术将适用于广泛的现场活动。目前，录制大面积的体积视频（大约或大于拳击圈的大小）需要处理时间，以禁止实时广播。为了使我们能够实时记录和分发体育赛事，我们将与深度学习动力系统一起开发高度优化的算法和数据结构，以创建实时大型区域快速移动活动的体积视频。与我们的合作伙伴公司合作，我们还将开发可移植，易于设置且无侵入性的相机设备，以免限制受众的观点。