Coding of spatial sound fields

空间声场编码

基本信息

批准号：
286857504
负责人：
Professor Dr.-Ing. Karlheinz Brandenburg
金额：
--
依托单位：
Institut für Medientechnik
依托单位国家：
德国
项目类别：
Research Grants
财政年份：
2015
资助国家：
德国
起止时间：
2014-12-31 至 2020-12-31
项目状态：
已结题

来源：
https://gepris.dfg.de/gepris/projekt/286857504?language=en
关键词：
Coding spatial sound fields

项目摘要

The realization of virtual acoustic environments (VAEs) is a current trend in spatial audio research. VAEs are increasingly used in a wide range of applications, like in movie and music productions, computer games, as well as in medical science. With the processing power of up-to-date PC's and digital signal processing techniques it is possible to render complex virtual worlds in high grades of detail. Especially in three-dimensional applications, this leads to enormous amounts of data which are impractical for real-time signal processing, storage and transmission. In order to reduce the data, the main objective of this research proposal is a parametric coding approach for spherical sound fields. The focus of the experiments is on the binaural auralization of spherical microphone array data for room simulation applications. For coding, the data is evaluated perceptually in listening experiments and further related to the physical properties of the sound field. This way, various perceptual and room acoustical parameters are extracted, which are important for room acoustical quality description. They provide a basis for the parametric representation of the sound field. In the encoder, the multi-channel audio signals are down-mixed to a mono representation which is transmitted to the decoder, together with the parameters as side information. Here, the original scene is reconstructed. In the experiments, various array configurations, rooms, test signals, as well as realistic measurement conditions, like spatial aliasing or microphone noise, are taken into account.

虚拟声学环境（VAE）的实现是当前空间音频研究的趋势。 VAE 越来越多地用于广泛的应用，例如电影和音乐制作、计算机游戏以及医学科学。凭借最新 PC 的处理能力和数字信号处理技术，可以以高细节等级渲染复杂的虚拟世界。特别是在三维应用中，这会产生大量数据，这对于实时信号处理、存储和传输来说是不切实际的。为了减少数据，本研究提案的主要目标是球形声场的参数编码方法。实验的重点是用于房间模拟应用的球形麦克风阵列数据的双耳可听。对于编码，数据在听力实验中进行感知评估，并进一步与声场的物理特性相关。通过这种方式，可以提取各种感知和房间声学参数，这对于房间声学质量描述很重要。它们为声场的参数表示提供了基础。在编码器中，多通道音频信号被下混音为单声道表示，并将其与作为辅助信息的参数一起发送到解码器。在这里，原始场景被重建。在实验中，考虑了各种阵列配置、房间、测试信号以及实际测量条件，如空间混叠或麦克风噪声。