Hippocampal-orbitofrontal interactions and reward learning

海马-眶额相互作用和奖励学习

基本信息

批准号：
10724154
负责人：
Joni D Wallis
金额：
$ 7.88万
依托单位：
UNIVERSITY OF CALIFORNIA BERKELEY
依托单位国家：
美国
项目类别：
财政年份：
2019
资助国家：
美国
起止时间：
2019-12-03 至 2024-10-31
项目状态：
已结题

来源：
https://reporter.nih.gov/project-details/10724154
关键词：
Affect Anterior Anxiety Area Brain Cognitive Communication Data Decision Making Dorsal Environment Evolution Frequencies Functional disorder Future Goals Grant Habits Hippocampus Learning Maps Measures Mediating Mental Depression Methodology Methods Modeling Mood Disorders Neurons Obsessive-Compulsive Disorder Pathway interactions Performance Post-Traumatic Stress Disorders Primates Process Property Psychiatry Psychological reinforcement Psychopathology Research Rewards Rodent Role Schizophrenia Signal Transduction Stimulus Structure Symptoms System Testing Therapeutic Therapeutic Intervention Theta Rhythm Time Work addiction electrical microstimulation environmental change flexibility high dimensionality improved learning strategy microstimulation neural neuromechanism neuropsychiatric disorder response skills

Affect Anterior Anxiety Area Brain Cognitive Communication Data Decision Making Dorsal Environment Evolution Frequencies Functional disorder Future Goals Grant Habits Hippocampus Learning Maps Measures Mediating Mental Depression Methodology Methods Modeling Mood Disorders Neurons Obsessive-Compulsive Disorder Pathway interactions Performance Post-Traumatic Stress Disorders Primates Process Property Psychiatry Psychological reinforcement Psychopathology Research Rewards Rodent Role Schizophrenia Signal Transduction Stimulus Structure Symptoms System Testing Therapeutic Therapeutic Intervention Theta Rhythm Time Work addiction electrical microstimulation environmental change flexibility high dimensionality improved learning strategy microstimulation neural neuromechanism neuropsychiatric disorder response skills

展开

项目摘要

Project summary (<30 lines) Dysfunction of both the hippocampus and the orbitofrontal cortex have been implicated in a wide variety of neuropsychiatric disorders, including obsessive-compulsive disorder, mood disorders and addiction. However, their exact contribution remains unclear. A major problem is that most research on hippocampal mechanisms is derived from rodent work. However, the structure of the hippocampus has undergone dramatic changes across the course of evolution, particularly in those parts associated with psychopathologies. This necessitates the use of primate models, but there have been few studies of hippocampus in the primate. The current grant will investigate the neuronal properties of hippocampus in the primate and determine how it interacts with orbitofrontal cortex. The theoretical framework that we will employ is derived from computational psychiatry, with a particular focus on how the computational processes underlying reinforcement learning might contribute to neuropsychiatric disease. Our hypothesis is that both hippocampus and orbitofrontal cortex make critical contributions to model-based reinforcement learning, whereby hippocampus is responsible for constructing the cognitive map that instantiates the neural representation of the task model, and orbitofrontal cortex is responsible for using the cognitive map to generate reward predictions that can be used to guide decision-making. To test this hypothesis, we will use a combination of high-channel count neuronal recordings and electrical microstimulation. We will record from single neurons in the hippocampus during performance of a reward-based learning task and examine whether hippocampal neurons show value place tuning. We will then examine how hippocampus might communicate this information to orbitofrontal cortex by recording from both structures simultaneously. Our prediction is that this communication will be mediated via synchronization of theta rhythms. However, such measures are correlative. Establishing a causal role for neural rhythms has proven challenging, since it is difficult to manipulate a specific neuronal rhythm without affecting other neuronal rhythms and/or neuronal firing rates. We have recently developed a closed-loop approach, which involves recording rhythms in real-time and using those signals to control the application of electrical microstimulation. This allows us to disrupt a neuronal rhythm of a specific frequency. We will use this method to examine whether there is a causal role for the theta oscillation in reward-based learning. Taken together, the results of this proposal will provide convergent correlative and causal evidence for the role of hippocampus and orbitofrontal cortex in reward-based learning and the mechanism by which they communicate. This will help lay the groundwork for future potential therapeutic approaches for frontolimbic dysfunction based on closed-loop microstimulation.

项目摘要（<30行）海马和眶额皮质的功能障碍都与多种多样神经精神疾病，包括强迫症，情绪障碍和成瘾。然而，他们的确切贡献尚不清楚。一个主要问题是，大多数关于海马机制的研究源自啮齿动物的工作。但是，海马的结构发生了巨大变化在整个进化过程中，特别是在与精神病理学相关的那些部分。这是必要的灵长类动物模型的使用，但是在灵长类动物中对海马的研究很少。当前的赠款将研究灵长类动物中海马的神经元特性，并确定其如何与眶额皮质。我们将采用的理论框架来自计算精神病学，特别重点关于强化学习的基础计算过程如何有助于神经精神病学疾病。我们的假设是海马和眶额皮质都为基于模型的强化学习，海马负责构建认知图实例化任务模型的神经表示，Orbitrontal Cortex负责使用认知图生成可用于指导决策的奖励预测。测试这个假设，我们将使用高通道计数神经元记录和电气的组合微刺激。在执行基于奖励的学习任务期间，我们将从海马的单个神经元中记录并检查海马神经元是否显示值位置调节。然后，我们将检查海马可以通过同时从两个结构录制来将此信息传达给Orbitrontal Cortex。我们的预测是，这种交流将通过theta节奏的同步来介导。但是，这样措施是相关的。确立神经节律的因果作用已被证明是具有挑战性的，因为它是难以操纵特定的神经元节奏，而不会影响其他神经元节奏和/或神经元发射率。我们最近开发了一种闭环方法，涉及实时记录节奏并使用这些信号来控制电微刺激的应用。这使我们可以破坏特定频率的神经元节奏。我们将使用此方法检查是否有因果关系基于奖励的学习中的theta振荡。综上所述，该提案的结果将为该角色提供收敛的相关和因果证据基于奖励的学习中的海马和眶额皮质的交流。这将有助于为未来的额叶骨化方法奠定基础基于闭环微刺激的功能障碍。