ENHANCED COMMUNICATIONS FOR SPEECHREADERS

增强语音朗读者的沟通能力

• 批准号: 2127121
• 负责人: LOUIS D BRAIDA
• 金额: $ 25.39万
• 依托单位: MASSACHUSETTS INSTITUTE OF TECHNOLOGY
• 依托单位国家: 美国
• 财政年份: 1994
• 资助国家: 美国
• 起止时间: 1994-07-01 至 1998-06-30
• 项目状态: 已结题
• 来源: https://reporter.nih.gov/project-details/2127121
• 关键词: auditory stimulus; cues; deafness; hearing; hearing aids; human subject; mathematical model; psychoacoustics; psychomotor reaction time; sensorineural hearing loss; speech viewer; speechreading; stimulus /response; visual perception; visual stimulus

This research is directed toward improving speech reception for the severely hearing impaired who rely on speechreading for communication. Attempts to advance basic understanding involve study of speechreading and the effects of auditory and visual supplements on audiovisual speech reception. Attempts to develop supplements for speechreaders involve extracting effective cues from acoustic speech and displaying them to individuals with severe hearing impairments. Attempts to develop mathematical models of audiovisual integration focus on quantifying low well supplementary signals are integrated with speechreading in the reception of speech segments, suprasegmental characteristics, and sentences. Model predictions are compared to measured speech reception for a variety of listeners and presentation conditions, including degraded auditory and visual reception, to measure the efficiency of audiovisual integration. Attempts to develop signal processing techniques to derive speechreading supplements from acoustic speech will be concerned with simplified signals that can be readily matched to residual hearing. The signals must be accurately derived from speech degraded by interference and reverberation. Attempts to determine the factors that limit the effectiveness of such signals will provide foundation for realistic evaluations of promising simplified signals as speechreading supplements. Attempts to apply automatic speech recognition to the development of speechreading supplements involve the study of Manual Cued Speech, determination of the extent to which modern speech recognition algorithms can produce speechreading cues automatically, and study of visual displays for presenting speechreading supplements based on the output of automatic recognition systems to impaired listeners.

这项研究是针对改善语音接收的 依靠语音阅读进行交流的严重听力受损。 试图提高基本理解的尝试涉及对语音阅读的研究和 听觉和视觉补品对视听语音的影响 接待。试图为语音阅读器开发补充剂涉及 从声音演讲中提取有效的提示，并将其显示为 严重听力障碍的人。 尝试开发视听集成重点的数学模型 在量化低井的补充信号中 语音阅读在言语段，上段 特征和句子。将模型预测与测量 各种听众和演示条件的语音接收， 包括降级的听觉和视觉接收，以测量 视听整合的效率。 尝试开发信号处理技术来得出语音阅读 声音中的补充将与简化的信号有关 这很容易与残留的听力相匹配。信号必须是 准确地源自干扰和混响而降解的语音。 试图确定限制此类有效性的因素 信号将为有希望的现实评估提供基础 简化信号作为语音阅读补充。 试图将自动语音识别应用于开发 语音阅读补品涉及手动提示语音的研究， 确定现代语音识别算法的程度 可以自动产生语音阅读线索，并研究视觉显示 用于根据自动输出来呈现语音阅读补品 识别系统损害听众。