Goals vs. habits in the human brain: Cognitive and computational mechanisms

人脑中的目标与习惯：认知和计算机制

• 批准号: 8337832
• 负责人: Daphna Shohamy
• 金额: $ 37.12万
• 依托单位: COLUMBIA UNIV NEW YORK MORNINGSIDE
• 依托单位国家: 美国
• 财政年份: 2011
• 资助国家: 美国
• 起止时间: 2011-09-30 至 2015-08-31
• 项目状态: 已结题
• 来源: https://reporter.nih.gov/project-details/8337832
• 关键词: Address; Affect; Behavior; Behavioral; Behavioral Mechanisms; Brain; Brain region; Clinical; Cognitive; Communities; Complement; Corpus striatum structure; Development; Disease; Dopamine; Equilibrium; Exercise; Feedback; Foundations; Functional Imaging; Functional Magnetic Resonance Imaging; Functional disorder; Future; Goals; Habits; Health; Health Food; Human; Individual; Interdisciplinary Study; Intervention; Knowledge; Laboratories; Lead; Learning; Lesion; Life; Link; Measures; Medial; Memory; Neurobiology; Operant Conditioning; Organism; Parkinson Disease; Patients; Pharmaceutical Preparations; Plant Roots; Psychological reinforcement; Relative (related person); Research; Rewards; Rodent; Role; Series; Signal Transduction; Substance abuse problem; Support System; System; Targeted Research; Testing; Time; Training; Work; clinically relevant; cognitive neuroscience; computational neuroscience; experience; flexibility; forgetting; habit learning; insight; neurobiological mechanism; neuroimaging; neuromechanism; neuropsychological; nigrostriatal system; prevent; programs; relating to nervous system; systems research; theories

DESCRIPTION (provided by applicant): Habits can exert powerful control over behavior. Sometimes habits are maladaptive, such as in substance abuse. In many cases, however, habits can be adaptive, enabling organisms to engage in healthy choices rapidly and efficiently. In recent years there has been substantial progress in understanding the neural mechanisms that support the transition from effortful, goal-directed to more automatic, habitual behavior through research in rodents. This work has emphasized the role of dopamine and its striatal targets in habits and has begun to suggest the principles by which their strength is controlled. Surprisingly, however, the rodent research has led to only limited progress in understanding the balance between goal-directed vs. habitual behaviors in humans, preventing the scientific community from being able to apply this knowledge to clinical settings and everyday life. We hypothesize that the main reason for this gap is the lack of rich and precise behavioral markers for habitual behavior in laboratory settings in humans. The proposed research program aims to address this gap. We propose a series of functional imaging (fMRI) and neuropsychological studies that focus on computational characterization of distinct types of learning and the factors that impact their relative strength. Because both habits and goal-directed behaviors depend on past experience, we can leverage recent advances in characterizing brain systems for learning and memory in humans that have already led to a rich, quantitative characterization of multiple aspects of behavior and neural signaling. Using these graded and dynamic signatures of habit formation - specifically, by examining choices and choice-related fMRI signals during trial-and-error learning, and during subsequent probes of the memories formed - we propose to ask a series of questions collectively aimed at uncovering the mechanisms by which the brain balances goal-directed and habitual behaviors. Our specific aims are: (1) To determine how the capacity to form flexible memory representations modulates goal-directed and habitual systems (2) To understand how the timing of feedback modulates the balance between the systems; (3) To determine how the reliability of feedback modulates goal-directed and habitual systems. For each aim, we test healthy subjects with fMRI to determine the dynamic contribution of multiple brain regions to different aspects of behavior. Parallel studies with Parkinson's patients complement the fMRI studies and provide evidence about the causal role of dopaminergic inputs to the striatum in habit learning. Results from this research will advance understanding of the behavioral and neurobiological mechanisms that control the emergence of habits and the implications for decisions and actions. Determining how multiple brain systems for learning support the transition of behavior from goal-directed to habitual control will lay the foundation for future translational work on potential treatment interventions that can adaptively shift behavior towards the formation of healthy habits in both health and disease.

描述（由申请人提供）：习惯可以对行为产生强大的控制。有时习惯是适应不良的，例如药物滥用。但是，在许多情况下，习惯可以是适应性的，使生物可以快速有效地从事健康的选择。近年来，通过在啮齿动物的研究中，了解从努力，目标指导到更自动，习惯行为的过渡的神经机制方面取得了重大进展。这项工作强调了多巴胺及其纹状体靶标在习惯中的作用，并开始提出控制强度的原理。然而，令人惊讶的是，啮齿动物的研究在理解人类目标定向与惯常行为之间的平衡方面仅取得了有限的进步，从而阻止了科学界能够将这些知识应用于临床环境和日常生活。我们假设这种差距的主要原因是缺乏人类实验室环境中习惯行为的丰富而精确的行为标记。拟议的研究计划旨在解决这一差距。我们提出了一系列功能成像（fMRI）和神经心理学研究，该研究的重点是不同学习类型的计算表征以及影响其相对强度的因素。由于习惯和目标指导的行为都取决于过去的经验，因此我们可以利用最新的进步来表征人类的学习和记忆，这已经导致了对行为和神经信号的多个方面的丰富，定量的特征。使用这些习惯形成的分级和动态签名 - 具体来说，通过在试验和错误学习过程中检查选择和选择相关的fMRI信号，以及在随后对所形成的记忆的探测过程中 - 我们提议集体提出一系列问题，旨在探讨一系列问题，旨在揭示大脑目标定位的机制，并平衡目标方向的机制以及习惯性的行为。我们的具体目的是：（1）确定形成灵活内存表示的能力如何调节目标定向和习惯系统（2），以了解反馈时机如何调节系统之间的平衡； （3）确定反馈的可靠性如何调节目标定向和习惯系统。对于每个目标，我们都通过fMRI测试健康的受试者，以确定多个大脑区域对行为不同方面的动态贡献。与帕金森患者的平行研究补充了fMRI研究，并提供了关于多巴胺能输入对纹状体在习惯学习中的因果作用的证据。这项研究的结果将进一步了解控制习惯出现的行为和神经生物学机制及其对决策和行动的影响。确定多个学习的大脑系统如何支持从目标定向到习惯控制的行为的过渡将为未来的转化工作基础，以对潜在的治疗干预措施，这些干预措施可以适应行为向健康和疾病的健康习惯形成。