The interaction of auditory and visual detection, discrimination, and recognition in infants’ real-world listening environments

婴儿现实世界聆听环境中听觉和视觉检测、辨别和识别的相互作用

• 批准号: 9392321
• 负责人: Kaylah L Lalonde
• 金额: $ 0.06万
• 依托单位: UNIVERSITY OF WASHINGTON
• 依托单位国家: 美国
• 财政年份: 2016
• 资助国家: 美国
• 起止时间: 2016-12-02 至 2017-06-30
• 项目状态: 已结题
• 来源: https://reporter.nih.gov/project-details/9392321
• 关键词: Acoustics; Adult; Auditory; Auditory Perception; Categories; Cereals; Child; Child Language; Clinical; Complex; Cueing for speech; Cues; Detection; Development; Discrimination; Environment; Hearing; Hearing Impaired Persons; Human; Infant; Knowledge; Language; Language Development; Lead; Learning; Literature; Longevity; Measures; Methods; Noise; Parents; Participant; Perception; Performance; Positioning Attribute; Procedures; Production; Property; Psychoacoustics; Psychometrics; Research; Research Personnel; Sensory; Signal Transduction; Specific qualifier value; Speech; Speech Perception; Speech Sound; Stimulus; Television; Testing; Uncertainty; Vision; Visual; Work; age group; audiovisual speech; auditory stimulus; base; behavior test; evidence base; evidence based guidelines; experience; hearing impairment; improved; infancy; insight; multimodality; research and development; skills; sound; visual information; visual speech

ABSTRACT Infants are more susceptible to noise than adults, and learn speech and language in noisy environments. Visual speech could be one of the most important cues available to infants to compensate for noisy listening environments, but a coherent picture of audiovisual (AV) speech perception development has yet to emerge. Multiple mechanisms underlie AV benefit to speech perception in adults: common AV onsets and offsets provide information about when to listen, correlations between the amplitude envelopes of auditory and visual signals help to distinguish between different consonants, and experienced listeners can use visual/multimodal phonetic representations. Differences in the mechanisms underlying AV speech perception benefit across tasks and age groups have lead to inconsistencies in the developmental literature. In order to form a unified account of AV speech perception development, this research focuses on the development of the mechanisms underlying AV speech benefits. The proposed research will use a hierarchical framework to investigate AV speech perception. Specifically, the proposed research will compare performance across a hierarchy of perceptual tasks and use stimulus manipulations to limit the AV benefit mechanisms available to participants. The aims are to determine whether typically developing, 7-month-old infants use visual speech cues to improve detection, discrimination, and identification of auditory speech in noise and to investigate the mechanisms by which infants and adults benefit from visual speech. To that end adults and infants will complete auditory-only, visual-only, and AV speech detection, discrimination, and identification tasks, matched on procedural details, but varying in the level of perceptual processing required to perform them. An additional condition uses a visual speech signal that only provides information about the onset/offset of the auditory stimulus. The research uses an established, developmentally appropriate, and psychometrically rigorous behavioral testing method, the observer-based psychoacoustics procedure (Werner, 1995). We expect that (1) infants will detect, discriminate, and identify auditory speech in noise better when they can also see the talker compared to when they can only hear the talker, (2) infants' benefit will primarily result from the visual signal providing information about when to listen, and (3) infants will benefit less than adults on higher-level tasks because adults will use the crossmodal correlations and visual phonetic information to gain additional benefits on higher-level tasks. The proposed research will improve our understanding of how speech sound detection, discrimination, and identification interact with vision in infants and adults, and lead to a better understanding of the development of auditory perception in real-world listening environments. It will provide researchers with a context in which to study development in older children with normal hearing and infants and children with hearing loss. It will also provide the evidence-base for recommendations that parents promote and make use of AV skills in support of a hearing-impaired infant's or child's language acquisition.

抽象的 婴儿比成人更容易受到噪音的影响，并且在嘈杂的环境中学习语音和语言。 视觉演讲可能是婴儿可用的最重要的提示之一，以弥补嘈杂的聆听 环境，但尚未出现视听（AV）语音感知发展的连贯图片。 多种机制是成人语音感知的AV构成的基础 提供有关聆听何时的信息，听觉和视觉幅度振幅信封之间 信号有助于区分不同的辅音，而经验丰富的听众可以使用视觉/多模式 语音表示。跨越AV语音感知益处的机制的差异 任务和年龄段导致发展文献中的不一致。为了形成统一 AV语音感知发展的描述，该研究重点是机制的发展 基本的AV语音好处。拟议的研究将使用分层框架来研究AV 语音感知。具体而言，拟议的研究将比较跨层次结构的表现 感知任务并使用刺激操纵来限制参与者可用的AV益处机制。 目的是确定是否通常发育，7个月大的婴儿使用视觉语音提示来改善 检测，歧视和识别噪声中听觉语音的检测，并通过 哪些婴儿和成人受益于视觉言语。为此，成年人和婴儿将完成仅听觉的工作， 仅视觉和AV语音检测，歧视和识别任务，与程序细节相匹配， 但是，执行它们所需的感知处理水平有所不同。另一个条件使用视觉 语音信号仅提供有关听觉刺激的发作/偏移的信息。研究使用 一种已建立的，发育适当且心理严格的行为测试方法， 基于观察者的心理声学程序（Werner，1995）。我们希望（1）婴儿会发现， 与何时相比，当他们也可以看到谈话者时，歧视和确定噪音中的听觉演讲 他们只能听到说话者，（2）婴儿的利益主要是由提供信息的视觉信号造成的 关于何时聆听，（3）婴儿在高级任务上的受益人比成年人少，因为成年人会使用 交叉模式的相关性和视觉语音信息，以在更高级别的任务上获得额外的好处。 拟议的研究将提高我们对语音检测，歧视和如何的理解 识别与婴儿和成人的视力相互作用，并更好地理解 在现实世界听力环境中的听觉感知。它将为研究人员提供一个环境 研究患有正常听力，婴儿和听力损失的儿童的年龄较大儿童的发展。它也会 为父母促进和利用AV技能的建议提供证据库 听力受损的婴儿或儿童的语言获取。