Multi-Speaker Separation in Reverberant Room Using Velocity-Based Microphone

使用基于力度的麦克风在混响室中进行多扬声器分离

• 批准号: 531229-2018
• 负责人: Zhu, WeiPing
• 金额: $ 1.82万
• 依托单位: Concordia University
• 依托单位国家: 加拿大
• 项目类别: Engage Grants Program
• 财政年份: 2018
• 资助国家: 加拿大
• 起止时间: 2018-01-01 至 2019-12-31
• 项目状态: 已结题
• 来源: https://www.nserc-crsng.gc.ca/ase-oro/Details-Detailles_eng.asp?id=669893
• 关键词: Multi; Speaker; Separation; Reverberant; Room

Audio signal separation has found many applications in electrical and computer engineering fields, such as**automatic speech recognition, voice communication, hearing aids etc. These applications have driven the need**of directional microphone solutions that can pick up only the sound from the desired speaker while suppressing**the voices from other speakers as well as the background noise. Conventional solutions using array of**pressure-based microphones combined with digital signal processing (DSP) techniques do not work well in**space-constrained applications where the captured sound contains mixed voices and ambient noises. Soundskrit**is developing a revolutionary fiber-based directional microphone technology that can directly measure the**particle velocity of an incoming sound wave. Currently, the Soundskrit R&D team lacks signal processing**expertise that is required to develop sound separation software based on the real data acquired by the new**fiber-based microphone in a multi-speaker and reverberant environment.**In this project, we intend to develop DSP algorithms for the Soundskrit's prototype to separate multiple moving**speakers in a reverberant room. The project has two main objectives: (1) localizing active sources in a**reverberant room using sound intensity, and (2) beamforming toward the desired speaker to attenuate unwanted**sounds and noise. The proposed work is divided into three phases. Phase 1 is to build a baseline system to**study the performance of the existing solutions via computer simulation. Phase 2 is to develop DSP algorithms**for the Soundskrit prototype to achieve the objectives in a simulated environment and compare it with the**solutions in Phase 1. In Phase 3, real data will be collected using Soundskrit's prototype in several reverberant**rooms, and the algorithm will be tested and evaluated in real-time. The research results achieved in this project**will be transferred to Soundskrit through a detailed technical report including all software codes and hardware**design.

音频信号分离在电气和计算机工程领域有许多应用，例如**自动语音识别、语音通信、助听器等。这些应用推动了对定向麦克风解决方案的需求**，该解决方案只能拾取来自音频的声音。所需的扬声器，同时抑制**其他扬声器的声音以及背景噪音。使用基于压力的麦克风阵列与数字信号处理 (DSP) 技术相结合的传统解决方案在空间受限的应用中效果不佳，在这些应用中捕获的声音包含混合语音和环境噪声。 Soundskrit** 正在开发一种革命性的基于光纤的定向麦克风技术，可以直接测量传入声波的**粒子速度。目前，Soundskrit 研发团队缺乏信号处理**专业知识，无法根据新型**光纤麦克风在多扬声器和混响环境中获取的真实数据开发声音分离软件。**在该项目中，我们打算为 Soundskrit 原型开发 DSP 算法，以分离混响室中的多个移动**扬声器。该项目有两个主要目标：(1) 使用声音强度在混响房间中定位有源源，以及 (2) 向所需扬声器进行波束成形，以减弱不需要的声音和噪音。拟议的工作分为三个阶段。第一阶段是建立一个基线系统，通过计算机模拟研究现有解决方案的性能。第 2 阶段是为 Soundskrit 原型开发 DSP 算法**，以在模拟环境中实现目标，并将其与**第 1 阶段的解决方案进行比较。在第 3 阶段，将使用 Soundskrit 原型在多个混响中收集真实数据**房间，算法将被实时测试和评估。该项目**取得的研究成果将通过详细的技术报告（包括所有软件代码和硬件**设计）转移给Soundskrit。