Multimicrophone Adaptive Array Augmented with Visual Cueing

通过视觉提示增强的多麦克风自适应阵列

• 批准号: 8508239
• 负责人: Kevin M. Kramer
• 金额: $ 55.2万
• 依托单位: ADVANCED MEDICAL ELECTRONICS CORPORATION
• 依托单位国家: 美国
• 财政年份: 2010
• 资助国家: 美国
• 起止时间: 2010-09-23 至 2015-08-31
• 项目状态: 已结题
• 来源: https://reporter.nih.gov/project-details/8508239
• 关键词: Algorithms; Attention; Automobiles; Back; Communications aid for the blind; Computer software; Consult; Cues; Detection; Development; Devices; Digital Signal Processing; Electronics; Elements; Engineering; Ensure; Environment; Face; Friends; Hearing; Hearing Aids; Human; Hybrids; Image; Industry; Language; Lead; Location; Manufacturer Name; Marketing; Medical Device; Medical Electronics; Minnesota; Noise; Persons; Phase; Plastics; Positioning Attribute; Principal Investigator; Production; Psychology; Radio; Recording of previous events; Reporting; Research Personnel; Resources; Restaurants; Science; Scientist; Signal Transduction; Source; Speech; Speech Intelligibility; System; Techniques; Technology; Testing; Time; United States National Institutes of Health; Universities; Validation; Visual; Work; base; commercialization; cost; design; digital; experience; improved; professor; programs; prototype; sound

DESCRIPTION (provided by applicant): Advanced Medical Electronics Corporation (AME) proposes to develop a smartphone-based audiovisual array that enables hearing aid users to converse with multiple speakers in reverberant environments with significant speech babble noise where their hearing aids do not function well. The array will consist of a smartphone, a smartphone accessory, and a smartphone software application. The smartphone multi-microphone audiovisual array accessory will be in a form factor that allows attachment to the back of the smartphone. The accessory will also contain a lower power radio by which it can transmit audio signals to compatible hearing aids. The smartphone software application will use the smartphone's built in camera to acquire images and perform real-time face detection using the built-in face detection support of the smartphone. The location of talking targets will be used to implement an audiovisual beamforming algorithm to improve the signal to noise ratio and consequently improve the user's speech intelligibility. Since the proposed array system leverages a handheld consumer electronic device, it will be portable and low cost. AME will design a production prototype in phase II and perform validation.

描述（由申请人提供）：高级医学电子公司（AME）建议开发一个基于智能手机的视听阵列，使助听器用户能够在带有大量语音babble噪声的响声环境中与多个扬声器进行交谈，而其助听器的助听器无法正常运行。该阵列将由智能手机，智能手机配件和智能手机软件应用程序组成。智能手机多微型电视阵列阵列附件将具有符合智能手机背面附件的外形。该配件还将包含较低的电源收音机，通过该收音机可以将音频信号传输到兼容的助听器。智能手机软件应用程序将使用智能手机内置的相机来获取图像，并使用智能手机的内置面部检测支持进行实时面部检测。会说话目标的位置将使用 实现视听束形成算法以提高信号与噪声比，从而提高用户的语音清晰度。由于拟议的阵列系统利用了手持式消费电子设备，因此它将是便携式和低成本。 AME将在第II阶段设计生产原型并进行验证。