The interaction of auditory and visual detection, discrimination, and recognition in infants’ real-world listening environments

婴儿现实世界聆听环境中听觉和视觉检测、辨别和识别的相互作用

• 批准号: 9392321
• 负责人: Kaylah L Lalonde
• 金额: $ 0.06万
• 依托单位: UNIVERSITY OF WASHINGTON
• 依托单位国家: 美国
• 财政年份: 2016
• 资助国家: 美国
• 起止时间: 2016-12-02 至 2017-06-30
• 项目状态: 已结题
• 来源: https://reporter.nih.gov/project-details/9392321
• 关键词: Acoustics; Adult; Auditory; Auditory Perception; Categories; Cereals; Child; Child Language; Clinical; Complex; Cueing for speech; Cues; Detection; Development; Discrimination; Environment; Hearing; Hearing Impaired Persons; Human; Infant; Knowledge; Language; Language Development; Lead; Learning; Literature; Longevity; Measures; Methods; Noise; Parents; Participant; Perception; Performance; Positioning Attribute; Procedures; Production; Property; Psychoacoustics; Psychometrics; Research; Research Personnel; Sensory; Signal Transduction; Specific qualifier value; Speech; Speech Perception; Speech Sound; Stimulus; Television; Testing; Uncertainty; Vision; Visual; Work; age group; audiovisual speech; auditory stimulus; base; behavior test; evidence base; evidence based guidelines; experience; hearing impairment; improved; infancy; insight; multimodality; research and development; skills; sound; visual information; visual speech

ABSTRACT Infants are more susceptible to noise than adults, and learn speech and language in noisy environments. Visual speech could be one of the most important cues available to infants to compensate for noisy listening environments, but a coherent picture of audiovisual (AV) speech perception development has yet to emerge. Multiple mechanisms underlie AV benefit to speech perception in adults: common AV onsets and offsets provide information about when to listen, correlations between the amplitude envelopes of auditory and visual signals help to distinguish between different consonants, and experienced listeners can use visual/multimodal phonetic representations. Differences in the mechanisms underlying AV speech perception benefit across tasks and age groups have lead to inconsistencies in the developmental literature. In order to form a unified account of AV speech perception development, this research focuses on the development of the mechanisms underlying AV speech benefits. The proposed research will use a hierarchical framework to investigate AV speech perception. Specifically, the proposed research will compare performance across a hierarchy of perceptual tasks and use stimulus manipulations to limit the AV benefit mechanisms available to participants. The aims are to determine whether typically developing, 7-month-old infants use visual speech cues to improve detection, discrimination, and identification of auditory speech in noise and to investigate the mechanisms by which infants and adults benefit from visual speech. To that end adults and infants will complete auditory-only, visual-only, and AV speech detection, discrimination, and identification tasks, matched on procedural details, but varying in the level of perceptual processing required to perform them. An additional condition uses a visual speech signal that only provides information about the onset/offset of the auditory stimulus. The research uses an established, developmentally appropriate, and psychometrically rigorous behavioral testing method, the observer-based psychoacoustics procedure (Werner, 1995). We expect that (1) infants will detect, discriminate, and identify auditory speech in noise better when they can also see the talker compared to when they can only hear the talker, (2) infants' benefit will primarily result from the visual signal providing information about when to listen, and (3) infants will benefit less than adults on higher-level tasks because adults will use the crossmodal correlations and visual phonetic information to gain additional benefits on higher-level tasks. The proposed research will improve our understanding of how speech sound detection, discrimination, and identification interact with vision in infants and adults, and lead to a better understanding of the development of auditory perception in real-world listening environments. It will provide researchers with a context in which to study development in older children with normal hearing and infants and children with hearing loss. It will also provide the evidence-base for recommendations that parents promote and make use of AV skills in support of a hearing-impaired infant's or child's language acquisition.

抽象的 婴儿比成人更容易受到噪音的影响，并且在噪音环境中学习言语和语言。 视觉言语可能是婴儿可以用来补偿嘈杂听力的最重要线索之一 环境，但视听 (AV) 语音感知发展的连贯图景尚未出现。 AV 对成人言语感知有益的多种机制：常见的 AV 起始和偏移 提供有关何时聆听、听觉和视觉幅度包络之间的相关性的信息 信号有助于区分不同的辅音，有经验的听众可以使用视觉/多模态 语音表示。 AV 语音感知背后机制的差异有益于不同领域 任务和年龄组导致发展文献中的不一致。为了形成统一的 考虑到 AV 语音感知的发展，本研究重点关注机制的发展 AV 语音的潜在优势。拟议的研究将使用分层框架来研究 AV 言语感知。具体来说，拟议的研究将比较不同层次结构的性能 感知任务并使用刺激操纵来限制参与者可用的 AV 利益机制。 目的是确定正常发育的 7 个月大婴儿是否使用视觉言语提示来改善 噪声中听觉语音的检测、辨别和识别，并通过以下方式研究其机制： 婴儿和成人从视觉言语中受益。为此，成人和婴儿将仅完成听觉， 仅视觉和 AV 语音检测、辨别和识别任务，匹配程序细节， 但执行它们所需的感知处理水平有所不同。附加条件使用视觉 语音信号仅提供有关听觉刺激的开始/偏移的信息。该研究使用 一种既定的、适合发展的、心理测量上严格的行为测试方法， 基于观察者的心理声学程序（Werner，1995）。我们期望 (1) 婴儿能够发现， 与其他人相比，当他们还可以看到说话者时，能够更好地辨别和识别噪音中的听觉言语 他们只能听到说话者的声音，（2）婴儿的益处主要来自提供信息的视觉信号 关于何时倾听，以及（3）婴儿在执行更高级别的任务时比成人受益更少，因为成人会使用 跨模态关联和视觉语音信息，以获得更高级别任务的额外好处。 拟议的研究将提高我们对语音检测、辨别和识别如何进行的理解。 识别与婴儿和成人的视觉相互作用，并导致更好地了解 现实世界聆听环境中的听觉感知。它将为研究人员提供一个环境 研究听力正常的较大儿童以及听力损失的婴儿和儿童的发育情况。它还将 为家长提倡的建议提供证据基础，并利用 AV 技能来支持 听力障碍婴儿或儿童的语言习得。