AUDIOVISUAL INTEGRATION, AGE, AND HEARING LOSS

视听整合、年龄和听力损失

基本信息

批准号：
10197095
负责人：
Nancy Ann Tye-Murray
金额：
$ 60.92万
依托单位：
WASHINGTON UNIVERSITY
依托单位国家：
美国
项目类别：
财政年份：
2018
资助国家：
美国
起止时间：
2018-07-01 至 2023-06-30
项目状态：
已结题

来源：
https://reporter.nih.gov/project-details/10197095
关键词：
Address Age Area Auditory Auditory area Behavior Code Cognitive Cognitive Science Contrast Sensitivity Counseling Coupling Detection Elderly Foundations Functional Magnetic Resonance Imaging Gestures Goals Grant Hearing Individual Individual Differences Lipreading Measures Methods Modeling Modification Motor Neighborhoods Neurocognitive Noise Participant Pattern Perception Performance Peripheral Play Process Production Research Research Personnel Role Seminal Signal Transduction Speech Speech Perception Stimulus Structure of superior temporal sulcus Techniques Temporal Lobe Testing Time Training Vision Visual Visual Cortex Visual Perception Visuospatial age related audiovisual speech auditory stimulus aural rehabilitation base behavior measurement cognitive ability cognitive skill density evidence base experience gaze hearing impairment interest lexical lexical processing multisensory neural correlate processing speed programs relating to nervous system skills sound speech processing theories visual speech visual stimulus young adult

项目摘要

ABSTRACT People with hearing loss might benefit greatly if they could use the visual signal to recognize speech. Sadly, as people age, they often experience a decline in both their hearing ability and their lipreading ability, so that at the very time their audiovisual speech perception could maximally benefit from visual speech information, they are least able to utilize it. Understanding the linkage between these phenomena has been a longstanding challenge for both cognitive science and aural rehabilitation, yet we believe this linkage provides a major clue to understanding both individual and age-related differences in everyday speech perception. Most researchers assume that there is a distinct integration stage and that integrative ability diminishes with age. Our most recent findings, however, suggest that differences in unimodal performance, and not differences in integrative abilities, underlie both individual and age-related differences in audiovisual speech perception. Accordingly, the proposed research takes the unique approach of focusing on both the causes of individual differences in lipreading skill and on lipreading as a cause of differences in audiovisual speech perception. For Specific Aim 1, we will use our new feature analysis methods to predict audiovisual speech perception based on participants' unimodal (i.e., auditory-only and vision-only) performance. We will evaluate the relative contributions of cognitive, perceptual, and speech production abilities as well as gaze behavior to both individual and age-related differences in vision-only and audiovisual speech perception. For Specific Aim 2, we will use a modification of our speech detection and lipread- yourself tasks, along with fMRI, to assess differences in the correspondence between the phonetic representations that support speech production and perception. Finally, for Aim 3, we will identify neural correlates of vision-only and audiovisual speech perception using fMRI. The results from Aims 1 and 2 will help us identify the regions of interest. We will focus on premotor areas because we hypothesize that the linkage between speech production and visual speech perception is critical for understanding how people recognize visual speech signals, and we will directly compare the activation in premotor cortex during both speech production and perception using representational similarity analysis, an elegant multi-variate analytic technique. By the end of the grant cycle, our goal is to have developed a unified neurocognitive framework for understanding both individual and age-related differences in lipreading and audiovisual speech perception. This framework and our experimental results will also provide evidence-based guidance for both speech perception training and aural rehabilitation counselling.

抽象的如果听力损失的人能够利用视觉信号进行识别，他们可能会受益匪浅演讲。可悲的是，随着人们年龄的增长，他们的听力和听力能力往往都会下降。他们的唇读能力，因此他们的视听言语感知可以他们从视觉语音信息中获益最多，但利用它的能力却最少。理解这些现象之间的联系一直是认知和认知领域的长期挑战。科学和听力康复，但我们相信这种联系提供了重要线索了解日常言语感知中的个体和年龄相关差异。最多研究人员假设存在一个明显的整合阶段并且整合能力随着年龄的增长而减少。然而，我们最近的研究结果表明，单峰的差异个人和年龄相关的基础是表现，而不是综合能力的差异视听言语感知的差异。因此，拟议的研究采取独特的方法既关注唇读技巧个体差异的原因，又关注唇读技巧的个体差异的原因唇读是视听言语感知差异的一个原因。对于具体目标 1，我们将使用我们的新特征分析方法来预测视听语音感知参与者的单峰（即仅听觉和仅视觉）表现。我们将评估认知、知觉、言语能力以及凝视的相对贡献仅视觉和视听言语中的个体和年龄相关差异的行为洞察力。对于特定目标 2，我们将使用语音检测和唇读的修改版你自己的任务，连同功能磁共振成像，来评估之间的对应关系的差异支持语音产生和感知的语音表示。最后，对于目标 3，我们将使用功能磁共振成像识别仅视觉和视听语音感知的神经相关性。这目标 1 和 2 的结果将帮助我们确定感兴趣的区域。我们将重点关注前电机因为我们假设语音产生和视觉语音之间的联系感知对于理解人们如何识别视觉语音信号至关重要，我们将直接比较言语产生和感知过程中前运动皮层的激活使用代表性相似性分析，一种优雅的多变量分析技术。到最后在资助周期中，我们的目标是开发一个统一的神经认知框架了解唇读和视听语音的个体差异和年龄相关差异洞察力。这个框架和我们的实验结果也将提供基于证据的言语感知训练和听力康复咨询的指导。