Multilevel Auditory Processing of Continuous Speech, from Acoustics to Language

连续语音的多级听觉处理，从声学到语言

• 批准号: 10490333
• 负责人: Jonathan Z. Simon
• 金额: $ 57.04万
• 依托单位: UNIV OF MARYLAND, COLLEGE PARK
• 依托单位国家: 美国
• 财政年份: 2021
• 资助国家: 美国
• 起止时间: 2021-09-17 至 2026-08-31
• 项目状态: 未结题
• 来源: https://reporter.nih.gov/project-details/10490333
• 关键词: Acoustics; Area; Attention; Auditory; Auditory area; Auditory system; Awareness; Behavior; Brain; Brain Stem; Development; Electroencephalography; Failure; Feedback; Financial compensation; Frequencies; Goals; Hearing Aids; Hearing problem; Individual; Knowledge; Language; Linguistics; Link; Magnetoencephalography; Measures; Methods; Midbrain structure; Modeling; Patient Self-Report; Periodicity; Physiological; Prefrontal Cortex; Process; Proxy; Research; Resolution; Role; Semantics; Series; Signal Transduction; Specific qualifier value; Speech; Speech Acoustics; Speech Intelligibility; Stimulus; Testing; Thalamic structure; Time; auditory pathway; auditory processing; base; innovation; lexical; normal hearing; programs; relating to nervous system; response; speech processing; temporal measurement; Acoustics; Area; Attention; Auditory; Auditory area; Auditory system; Awareness; Behavior; Brain; Brain Stem; Development; Electroencephalography; Failure; Feedback; Financial compensation; Frequencies; Goals; Hearing Aids; Hearing problem; Individual; Knowledge; Language; Linguistics; Link; Magnetoencephalography; Measures; Methods; Midbrain structure; Modeling; Patient Self-Report; Periodicity; Physiological; Prefrontal Cortex; Process; Proxy; Research; Resolution; Role; Semantics; Series; Signal Transduction; Specific qualifier value; Speech; Speech Acoustics; Speech Intelligibility; Stimulus; Testing; Thalamic structure; Time; auditory pathway; auditory processing; base; innovation; lexical; normal hearing; programs; relating to nervous system; response; speech processing; temporal measurement

PROJECT SUMMARY For continuous speech to be perceived as intelligible, the brain employs an extended series of representations along the auditory pathway, emphasizing different temporal features of speech at each stage. From brainstem to midbrain, thalamus, and through multiple cortical areas, these stages support representations of fast pitch- relevant periodicity, slower representations corresponding to vocal-tract/envelope modulations, and ultimately, linguistic and semantic representations. Furthermore, the strength of these representations is not determined solely in a feedforward way, but also by top-down processes, modulated by attention and listening effort. It is well known that degradation of a speech signal will interfere with these neural representations in different ways: some losses are irreparable, but others can be compensated for at a later stage. A gap in knowledge arises because the different neural stages, and the corresponding continuous speech representations, are rarely studied as a longitudinal chain. Partial failure at one processing level might be compensated for at a subsequent level, and the level of compensation might be associated with the level of listening effort. The specific objectives of this application are to determine how continuous speech is progressively represented along and beyond the auditory pathway, from midbrain to language areas, in young normal- hearing listeners. Both electroencephalography (EEG) and magnetoencephalography (MEG) will be employed for their high time resolution, simultaneously recording from subcortical and multiple cortical areas respectively, along with measures of behavior, and listening effort. The speech representations of different neural stages will be quantified by specified measures of time-locked neural processing and of neural connectivity. Pupillometry measures will be used as a physiological proxy for listening effort, in addition to self- reported effort measures. Our central hypothesis is that a grounded understanding of the progression of representations of continuous speech processing, viewed as a network with both feedforward and feedback connectivity (and including task-based and effort-linked connectivity changes), will elucidate the acoustic and neural conditions under which continuous speech is ultimately perceived as intelligible. Aim 1 investigates a broad set of neural measures of continuous speech processing, simultaneously obtained along and beyond the auditory pathway, and the extent to which they can predict intelligibility. Aim 2 investigates the extent to which also incorporating measures of sustained listening effort, in concert with the above neural measures of continuous speech processing, may allow better predictions of intelligibility than the neural measures alone. Aim 3 investigates the functional role of neural connectivity in supporting continuous speech processing along the auditory pathway and beyond.

项目摘要 为了将连续的语音视为可理解的，大脑采用了一系列扩展的表示 沿着听觉路径，强调每个阶段的语音的不同时间特征。来自脑干 到中脑，丘脑和通过多个皮质区域，这些阶段支持快速球的表示形式 相关的周期性，较慢的表示对应于声音诱饵/信封调制，最终 语言和语义表示。此外，这些表示的强度未确定 仅以喂食方式，也只能通过自上而下的过程，并受到关注和听力工作的调节。 众所周知，语音信号的降解会干扰不同的神经表示 方式：有些损失是无法弥补的，但有些损失可以在以后的阶段得到补偿。知识差距 之所以出现，是因为不同的神经阶段和相应的连续语音表示是 很少被研究为纵向链。在一个处理级别的部分故障可能会在 随后的水平，薪酬水平可能与听力工作水平有关。 本应用程序的具体目标是确定连续语音的逐步逐步逐步 从中脑到语言领域，在听觉途径上代表，在年轻的正常状态下 听听听众。脑电图（EEG）和磁脑摄影（MEG）都将使用 对于他们的高时间分辨率，同时从皮质下和多个皮质区域记录 分别是行为和听力努力的衡量标准。不同的语音表示 神经阶段将通过定期锁定神经加工和神经的指定度量来量化 连接性。除自我外 报告了努力措施。我们的核心假设是对 连续语音处理的表示，被视为具有前馈和反馈的网络 连接性（包括基于任务和努力链接的连接性变化）将阐明声学和 神经条件最终被认为是可理解的。 AIM 1同时研究了一系列连续语音处理的广泛神经测量 沿着听觉途径和超越听觉途径，以及他们可以预测可理解性的程度。目标2 调查了与持续听力措施的措施的程度，并与 超过连续语音处理的神经测量，可以比 仅神经措施。 AIM 3研究了神经连通性在支持连续的功能作用 沿着听觉路径及以后的语音处理。