Speech Perception Training: Advanced Scoring and Feedback Methods

言语感知训练：高级评分和反馈方法

• 批准号: 9908339
• 负责人: Silvio P Eberhardt
• 金额: $ 54.95万
• 依托单位: SEEHEAR, LLC
• 依托单位国家: 美国
• 财政年份: 2017
• 资助国家: 美国
• 起止时间: 2017-06-01 至 2021-08-31
• 项目状态: 已结题
• 来源: https://reporter.nih.gov/project-details/9908339
• 关键词: Acoustics; Address; Adult; Age; Association Learning; Auditory; Client; Comprehension; Computer software; Computers; Control Groups; Data; Data Analyses; Data Security; Databases; E-learning; Effectiveness; Elderly; Feedback; Funding; Individual; Instruction; Label; Laboratories; Learning; Lipreading; Memory; Methods; Modality; Noise; Online Systems; Outcome; Paired-Associate Learning; Participant; Perceptual learning; Persons; Phase; Play; Publications; Randomized Controlled Clinical Trials; Randomized Controlled Trials; Recovery; Reporting; Research; Research Training; Security; Sequence Alignment; Side; Signal Transduction; Small Business Innovation Research Grant; Speech; Speech Perception; Stimulus; Sum; System; Systems Development; Testing; Text; TimeLine; Training; Verbal Learning; Visual; Vocabulary; Waiting Lists; audiovisual speech; commercialization; comparison group; design; experience; functional gain; hearing impairment; hearing threshold; improved; normal hearing; novel; operation; preservation; recruit; repository; response; social; speech in noise; speech recognition; tool; visual learning; web page; web services; word learning

Older adults commonly experience hearing difficulties in noisy settings, whether or not their hearing thresholds have increased. Being able to see the person who is talking can significantly ameliorate their hearing difficulties, but the magnitude of the benefit depends greatly on each person’s lipreading ability. Unfortunately, the vast majority of older adults who have had normal hearing during most of their lives are poor lipreaders. With Phase- I SBIR funding, SeeHear LLC realized a web-based speech recognition training system to improve lipreading. The training system implements unique high-contingency feedback following open set recognition responses during training with isolated sentences. High-contingency feedback informs the trainee about the relationship between their perceptual errors and the stimulus at the level of words or phonemes, a key to perceptual learning. Typical software for training with connected speech stimuli provides low-contingency feedback: The feedback does not establish a relationship between the stimulus and the trainee’s perceptual response errors. High- contingency feedback increases lipreading accuracy and speech recognition with audiovisual stimuli in noise in younger normal-hearing (NH) adults. This training approach will be evaluated with older hearing-impaired participants, and it will be extended beyond lipreading training to audiovisual speech recognition training in a noisy background. A second, highly novel, but potentially effective and efficient training paradigm will also be evaluated. This second approach uses a paired associates learning task, in which trainees learn to associate spoken nonsense words with nonsense pictures. The task is designed to encourage trainees to attend closely to the spoken nonsense words while trying to learn the word-to-picture associations. Laboratory testing with younger NH adults shows that lipreading training with this paradigm can deliver significant generalization to lipreading with new stimuli and a new talker. This paradigm will be tested with older adults and will be extended to offer audiovisual training in noise. The proposed project comprises randomized controlled-trial clinical tests and additional training system development. There will be a wait-list control group for comparison to groups assigned to train with sentence stimuli and high- or low-contingency feedback for open set sentence lipreading or audiovisual recognition. Two additional groups will train in the paired associates paradigm: One group will carry out training by lipreading the stimuli, and the other group will carry out training with audiovisual stimuli in speech-shaped noise. All of the participants in the research will undergo laboratory pre- and post-training tests that are designed to determine whether learning during the training sessions generalizes to different speech perception tasks, different stimuli, and different talkers across different modalities (lipreading, auditory-only, and audiovisual speech with acoustic signals in noise). In order to carry out all of the proposed training research and data recovery, the web-based system will be expanded. Successful completion of this Phase-II project will directly support commercialization of the training system.

老年人通常会在噪音设置上遇到听力困难，无论他们的听力门槛是否 增加了。能够看到正在说话的人可以大大改善他们的听力困难， 但是收益的幅度在很大程度上取决于每个人的血脂能力。不幸的是，疫苗 大多数一生都有正常听力的老年人都是脂肪差。与相位 我的资助，SeeHear LLC实现了一种基于网络的语音识别培训系统，以改善唇读。 训练系统在开放式识别响应后实现独特的高态反馈 在用孤立句子的培训中。高态反馈向受训者通报了关系 在他们的感知错误和单词或音素级别的刺激之间，这是感知学习的关键。 通过连接的语音刺激进行培训的典型软件可提供低音反馈：反馈 没有在刺激与受训者的感知反应错误之间建立关系。高的- 应急反馈通过噪声中的视听刺激提高了脂质的准确性和语音识别 年轻的正常听觉（NH）成年人。这种培训方法将通过较旧的听力受损进行评估 参与者，它将扩展到口头培训以外 嘈杂的背景。第二个，高度新颖但潜在有效，有效的训练范式也将是 评估。第二种方法使用配对的同事学习任务，在其中学员学习合并 用胡说八道的图片说胡说八道。该任务旨在鼓励学员密切参加 在试图学习单词到图片的关联时，对口语的单词。实验室测试 年轻的NH成年人表明，通过这种范式进行的Lipaded培训可以对 用新的刺激和一个新的谈话者的唇读。该范式将与老年人进行测试，并将延长 提供噪音的视听培训。 拟议的项目包括随机对照临床测试和其他培训系统 发展。将有一个等待名单对照组与分配训练的小组进行比较 开放式句子Lipading或视听识别的刺激和高态反馈。二 其他小组将在配对的同事范式中进行训练：一个组将通过唇读来进行培训 刺激和另一组将在语音形噪声中对视听刺激进行训练。全部 研究的参与者将经过旨在确定的实验室训练前和培训后测试 在培训期间学习是否会概括到不同的语音感知任务，不同的刺激， 以及跨不同方式的不同说话者（唇读，仅听觉和视听语音 噪音中的信号）。为了进行所有拟议的培训研究和数据恢复，基于Web 系统将扩展。成功完成此期II项目将直接支持商业化 培训系统。