Cross-frequency integration for speech recognition in bimodal hearing

双模态听力中语音识别的跨频集成

• 批准号: 7638421
• 负责人: YING-YEE KONG
• 金额: $ 15.6万
• 依托单位: NORTHEASTERN UNIVERSITY
• 依托单位国家: 美国
• 财政年份: 2008
• 资助国家: 美国
• 起止时间: 2008-06-13 至 2011-05-31
• 项目状态: 已结题
• 来源: https://reporter.nih.gov/project-details/7638421
• 关键词: Accounting; Acoustic Stimulation; Acoustics; Algorithms; Auditory; Characteristics; Cochlear Implants; Contralateral; Cueing for speech; Cues; Development; Ear; Electric Stimulation; Exhibits; Frequencies; Fuzzy Logic; Goals; Hearing; Hearing Aids; Implant; Individual; Individual Differences; Investigation; Knowledge; Label; Life; Lipreading; Materials Testing; Measures; Modeling; Outcome; Patients; Pattern; Perception; Performance; Pitch Perception; Process; Protocols documentation; Rehabilitation therapy; Reporting; Research Personnel; Residual state; Signal Transduction; Simulate; Source; Speech; Statistical Models; Stimulus; Stress; System; Testing; Variant; Visual; Work; base; clinically relevant; computerized data processing; design; hearing impairment; improved; rehabilitation strategy; simulation; speech processing; speech recognition; transmission process

DESCRIPTION (provided by applicant): The benefit of combined electric and acoustic stimulation in speech and pitch perception has been demonstrated in a number of studies. A close examination of the amount of combined benefit reported varies across studies and across test materials and conditions. Some patients did not demonstrate any combined benefit and in rare occasions, some even exhibited a potential incompatibility between the two types of stimulation. Several attempts have been made to relate combined acoustic and electric hearing benefits to some measure of auditory function in the residual hearing, but significant correlations were not found. This study focuses on bimodal hearing in which listeners receive electric stimulation in one ear and acoustic stimulation in the contralateral ear. The long-term goals of this project are (1) to understand the processing of speech in CI listeners who receive combined acoustic and electric stimulation, and (2) to provide a basis for the development of rehabilitation strategies for improving speech recognition in CI listeners. The specific aims are (1) to identify the speech information extracted in electric hearing in the high-frequency regions and residual acoustic hearing in the low-frequency regions; (2) to investigate how the extracted information from each ear is integrated in normal-hearing and cochlear-implant listeners; and (3) to relate phoneme recognition performance to sentence recognition performance. We will apply several well-developed speech integration models, including a simple probabilistic model, Fuzzy Logic Model of Perception, and Pre-Labeling and Post- Labeling models to predict intelligibility scores for combined hearing performance. This model-based approach provides the means to systematically study the differences in the abilities of cochlear-implant listeners to simultaneously extract speech information from acoustic and electric stimulation and integrate this information across ears. The proposed work is of high clinical relevance because it may help identify deficits in information extraction and/or integration, encountered by implant users on an individual basis and aid in developing rehabilitative strategies tailored to individual needs. Relevance: The purpose of this study is to investigate how speech information is integrated across ears in individuals who wear a cochlear implant in one ear and a hearing aid in the opposite ear. The proposed work is of high clinical relevance because it may help identify the problems encountered by implant users and aid in developing rehabilitative strategies tailored to individual needs.

描述（由申请人提供）：许多研究已经证明了电刺激和声刺激相结合对语音和音调感知的好处。对报告的综合效益的仔细检查因研究以及测试材料和条件而异。一些患者没有表现出任何综合益处，在极少数情况下，有些患者甚至表现出两种刺激之间潜在的不相容性。已经进行了多次尝试将声学和电学听力联合益处与残余听力中听觉功能的某些测量联系起来，但没有发现显着的相关性。这项研究的重点是双模态听力，即听者在一只耳朵中接受电刺激，在对侧耳朵中接受声刺激。该项目的长期目标是（1）了解接受声电刺激相结合的 CI 听者的语音处理过程，以及（2）为制定康复策略提供基础，以提高 CI 听者的语音识别能力。具体目的是：（1）识别高频区电听觉提取的语音信息和低频区残余声听觉提取的语音信息； (2) 研究从每只耳朵提取的信息如何在正常听力和人工耳蜗收听者中整合； (3)将音素识别性能与句子识别性能联系起来。我们将应用几种成熟的语音集成模型，包括简单的概率模型、感知的模糊逻辑模型以及预标记和后标记模型来预测组合听力表现的清晰度分数。这种基于模型的方法提供了系统研究人工耳蜗听者从声学和电刺激中同时提取语音信息并将这些信息跨耳整合的能力差异的方法。拟议的工作具有很高的临床相关性，因为它可能有助于识别植入物使用者在个人基础上遇到的信息提取和/或整合方面的缺陷，并有助于制定适合个人需求的康复策略。 相关性：本研究的目的是调查在一只耳朵佩戴人工耳蜗、另一只耳朵佩戴助听器的个体中，语音信息如何跨耳朵整合。拟议的工作具有很高的临床相关性，因为它可能有助于识别植入物使用者遇到的问题，并有助于制定适合个人需求的康复策略。