Neural mechanisms: Learned audio-visuo-motor integration

神经机制：习得的视听运动整合

基本信息

批准号：
7547049
负责人：
JOHN W BELLIVEAU
金额：
$ 69.21万
依托单位：
MASSACHUSETTS GENERAL HOSPITAL
依托单位国家：
美国
项目类别：
财政年份：
2006
资助国家：
美国
起止时间：
2006-01-01 至 2010-09-30
项目状态：
已结题

来源：
https://reporter.nih.gov/project-details/7547049
关键词：
Adult Area Association Learning Auditory Automobile Driving Behavioral Binding Biological Neural Networks Brain Cell Nucleus Cerebellum Cognition Complement Computer Simulation Data Data Analyses Data Collection Databases Development Diffusion Distant Educational process of instructing Electroencephalography Equation Etiology Exhibits Experimental Designs Functional Magnetic Resonance Imaging Goals Human Image Individual Japanese Population Language Learning Letters Magnetoencephalography Measurement Medial Methods Modality Modeling Monitor Motor Motor Cortex Names Network-based Neurocognitive Neurosciences Output Perception Phase Process Production Property Psychophysiology Reading Relative (related person)Research Research Personnel Role Semantics Sensory Short-Term Memory Signal Transduction Stimulus Structure System Techniques Temporal Lobe Testing Time Visual Work Writing abstracting association cortex base classical conditioning long term memory memory encoding millimeter millisecond multisensory neuroinformatics neuromechanism neurophysiology novel relating to nervous system response spatiotemporal visual motor visual stimulus

项目摘要

This study answers fundamental questions of large-scale neural networks in the human brain supporting crossmodal cognition. To reveal how auditory and visual stimuli and motor acts are arbitrarily combined as a result of crossmodal learning and integrated to supramodal symbolic representations, we will study the neural representations of the letters of the Roman alphabet. These consist of four unimodal representations (visual, auditory, and motor representations for writing and speaking) and learned connections between these, that is, the processes that underlie their audiovisual recognition and motor production. Accurate experimental control is facilitated by the fact that letters exhibit all the necessary properties of symbolic crossmodal representations but in a physically simple and exact format carrying no semantic associations that could confound the neurophysiological interpretation of results. Combined 3-Tesla functional magnetic resonance imaging (fMRI) and 306-channel magnetoencephalographic / 128-channel electroencephalographic (MEG/EEG) techniques with simultaneous behavioral recordings will be applied to pinpoint the exact underlying neural mechanisms. This approach combines the advantages of spatially accurate fMRI with temporally specific MEG/EEG, enabling accurate spatiotemproal characterization of brain activity totally noninvasively. To directly observe how large-scale neurocognitive networks evolve during crossmodal associative learning, we will also conduct fMRI/MEG/EEG measurements before and after our subjects are taught (previously unfamiliar) Japanese kana-letters. The specific aims are to elucidate structure, function, and oscillatory mechanisms of fully established crossmodal neural networks based on previous extensive associative learning (Roman letters) and currently evolving networks representing novel crossmodal associations (Japanese letters). We will characterize the relative roles of deep brain nuclei, cerebellum, medial temporal lobe, and sensory-specific and multisensory association cortices in such networks. The multidimensional experimental design allows isolation of neural mechanisms utilized by perception, working memory, memory encoding, and recall.

这项研究回答了人脑支持大规模神经网络的基本问题跨模态认知。揭示听觉和视觉刺激以及运动行为如何任意组合为跨模态学习的结果并整合到超模态符号表示中，我们将研究罗马字母的神经表征。这些由四种单峰表示组成（写作和口语的视觉、听觉和运动表征）以及习得的联系这些，即构成视听识别和运动产生基础的过程。准确的字母表现出符号的所有必要属性，这一事实促进了实验控制跨模态表示，但采用物理上简单且精确的格式，不带有语义关联这可能会混淆结果的神经生理学解释。组合 3-Tesla 功能磁磁共振成像 (fMRI) 和 306 通道脑磁图 / 128 通道具有同步行为记录的脑电图（MEG/EEG）技术将应用于查明确切的潜在神经机制。该方法结合了空间方法的优点精确的功能磁共振成像（fMRI）与时间特定的脑电图（MEG）/脑电图（EEG），能够准确地描述大脑的时空特征完全非侵入性的活动。直接观察大规模神经认知网络在跨模式关联学习，我们还将在我们的学习前后进行功能磁共振成像/脑磁图/脑电图测量科目教授（以前不熟悉的）日语假名字母。具体目标是阐明基于完全建立的跨模态神经网络的结构、功能和振荡机制以前广泛的联想学习（罗马字母）和当前不断发展的代表小说的网络跨模式关联（日语字母）。我们将描述深部脑核团的相对作用，小脑、内侧颞叶以及感觉特异性和多感觉联合皮层网络。多维实验设计允许隔离所利用的神经机制感知、工作记忆、记忆编码和回忆。