Characterizing the temporal processing of speech in the human auditory cortex

表征人类听觉皮层中语音的时间处理

• 批准号: 10448483
• 负责人: Adeen Flinker
• 金额: $ 66.97万
• 依托单位: NEW YORK UNIVERSITY SCHOOL OF MEDICINE
• 依托单位国家: 美国
• 财政年份: 2021
• 资助国家: 美国
• 起止时间: 2021-09-01 至 2026-05-31
• 项目状态: 未结题
• 来源: https://reporter.nih.gov/project-details/10448483
• 关键词: Acoustic Nerve; Acoustics; Address; Anatomy; Area; Auditory; Auditory area; Behavioral; Behavioral Research; Brain; Categories; Communication; Communication impairment; Communities; Complex; Computer Models; Custom; Data; Dimensions; Discipline; Early identification; Focal Brain Injuries; Heterogeneity; Human; Impairment; Implanted Electrodes; Language Disorders; Light; Linguistics; Link; Measures; Methods; Modeling; Nature; Neural Network Simulation; Neurobiology; New York; Patients; Pattern; Process; Prosthesis; Research; Research Personnel; Resolution; Route; Scheme; Semantics; Signal Transduction; Speech; Speech Disorders; Speech Pathology; Speech Perception; Speech Sound; Stimulus; Structure; Surface; System; Techniques; Technology; Testing; Time; Universities; auditory pathway; behavior observation; cohort; deep neural network; density; design; experimental study; human model; interest; lexical; lexical processing; millisecond; neuroimaging; neurophysiology; novel; novel therapeutic intervention; pandemic disease; phonology; phrases; receptive field; relating to nervous system; response; sound; spatiotemporal; speech processing; speech recognition; syntax; temporal measurement

Project Summary Time is the fundamental dimension of sound, and temporal integration is thus fundamental to speech perception. To recognize a complex structure such as a word in fluent speech, the brain must integrate across many different timescales spanning tens to hundreds of milliseconds. These timescales are considerably longer than the duration of responses at the auditory nerve. Therefore, the auditory cortex must integrate acoustic information over long and varied timescales to encode linguistic units. On the other hand, the nature of the intermediate units of representation between sound and meaning remains debated. Focal brain injuries have shown selective impairment at all levels of linguistic processing (phonemic, phonotactic, and semantic) but current models of spoken word recognition disagree on the existence and type of these representational levels. The neural basis of temporal and linguistic processing remains speculative partly due to the limited spatiotemporal resolution of noninvasive human neuroimaging techniques which is needed to study the encoding of fluent speech. Our multi- PI proposal overcomes these challenges by assembling a team of researchers and clinicians with complementary expertise at NYU and Columbia University. We propose to record invasively from a large number of neurosurgical patients, which provides a rare and unique opportunity to collect direct cortical recordings across several auditory regions. We propose novel experimental paradigms and analysis methods to investigate where, when, and how acoustic features of speech are integrated over time to encode linguistic units. Our experimental paradigms will determine the functional and anatomical organization of stimulus integration periods in primary and nonprimary auditory cortical regions and relate the temporal processing in these regions to the emergence of phonemic-, phonotactic-, and semantic-level representations. Finally, we will determine the nonlinear computational mechanisms that enable the auditory cortex to integrate fast features over long durations, which is essential in speech recognition. Understanding of the temporal processing of speech in primary and nonprimary auditory cortex is critical for developing complete models of speech perception in the human brain, which is essential to understanding of how these processes break down in speech and communication disorders.

项目概要 时间是声音的基本维度，因此时间整合是语音感知的基础。 为了识别复杂的结构，例如流利语音中的单词，大脑必须整合许多不同的结构 时间尺度跨越数十到数百毫秒。这些时间尺度比 听觉神经反应的持续时间。因此，听觉皮层必须整合声音信息 在漫长且不同的时间尺度上对语言单元进行编码。另一方面，中间单位的性质 声音和意义之间的表征仍然存在争议。局灶性脑损伤表现出选择性 语言处理各个层面（音位、音位和语义）的损伤，但当前的模型 口语单词识别对于这些表征水平的存在和类型存在分歧。神经基础 时间和语言处理的过程仍然是推测性的，部分原因是时空分辨率有限 研究流利语音的编码所需的非侵入性人类神经成像技术。我们的多 PI 提案通过组建一个由研究人员和临床医生组成的团队来克服这些挑战 纽约大学和哥伦比亚大学的专业知识互补。我们建议从大量的侵入性记录 神经外科患者的数据，这提供了一个罕见且独特的机会来收集跨区域的直接皮质记录 几个听觉区域。我们提出了新颖的实验范式和分析方法来研究， 何时以及如何随着时间的推移整合语音的声学特征以编码语言单元。我们的实验 范式将决定初级阶段刺激整合期的功能和解剖组织 和非初级听觉皮层区域，并将这些区域的时间处理与出现联系起来 音位、音位和语义层面的表示。最后，我们将确定非线性 使听觉皮层能够长时间整合快速特征的计算机制，这 在语音识别中至关重要。了解初级和中级语言的时间处理 非初级听觉皮层对于开发人脑语音感知的完整模型至关重要， 这对于理解这些过程在言语和沟通障碍中如何崩溃至关重要。