LIP READING AID VIA THE TONGUE

通过舌头辅助唇读

• 批准号: 6741812
• 负责人: PAUL BACH-Y-RITA
• 金额: $ 10万
• 依托单位: WICAB, INC.
• 依托单位国家: 美国
• 财政年份: 2004
• 资助国家: 美国
• 起止时间: 2004-09-15 至 2007-03-15
• 项目状态: 已结题
• 来源: https://reporter.nih.gov/project-details/6741812
• 关键词: auditory stimulus; clinical research; cues; electrotactile communication; functional ability; hearing disorders; human subject; medical rehabilitation related tag; questionnaires; speech recognition; speechreading; technology /technique development; tongue; training

DESCRIPTION (provided by applicant): Lip-reading is the primary mode of linguistic communication for thousands of hard of hearing individuals. There are ambiguities in lip reading that make it problematic. Currently available tactile aids to lip reading have the following problems: 1. They do not provide enough information to resolve ambiguities and 2. They are not flexible or convenient to use. In phase 1 we propose to develop an information-rich and flexible lip reading assistive technology and a training program for improving the speed and accuracy of lip reading well beyond 15%. It will be based on tongue-interface technology that has been successfully applied to prototype systems for blind persons and for persons with loss of vestibular function. It will present simple but sophisticated timing and amplitude lip reading cues. The performance of five subjects will be evaluated. Since the presented information will not be word recognition, it will be independent of the speaker and easy for the subjects to learn, and will significantly reduce the ambiguity in lip reading. The phase two proposal will develop a miniature version of the present back-pack size system and will optimize the presentation of speech via a tongue display. Successful completion of the lip reading system may lead to the development of a hearing substitution system for deaf persons.

描述（由申请人提供）：唇读是成千上万听力障碍人士的主要语言交流方式。唇读中存在含糊之处，导致出现问题。目前可用的触觉唇读辅助工具存在以下问题：1.它们没有提供足够的信息来解决歧义；2.它们使用起来不灵活或不方便。在第一阶段，我们建议开发一种信息丰富且灵活的唇读辅助技术和一个培训计划，以将唇读的速度和准确性提高超过 15%。它将基于舌界面技术，该技术已成功应用于盲人和前庭功能丧失者的原型系统。它将呈现简单但复杂的时序和幅度唇读提示。将评估五个科目的表现。由于所呈现的信息不是文字识别，因此它独立于说话者，易于受试者学习，并且将显着减少唇读中的歧义。第二阶段提案将开发现有背包大小系统的微型版本，并将通过舌头显示器优化语音呈现。唇读系统的成功完成可能会导致聋人听力替代系统的开发。