Single-trial reward learning and generalization

单次试验奖励学习和泛化

• 批准号: 8718412
• 负责人: Vishnu Pradeep Murty
• 金额: $ 5.15万
• 依托单位: NEW YORK UNIVERSITY
• 依托单位国家: 美国
• 财政年份: 2014
• 资助国家: 美国
• 起止时间: 2014-04-01 至 2017-03-31
• 项目状态: 已结题
• 来源: https://reporter.nih.gov/project-details/8718412
• 关键词: Address; Animal Model; Association Learning; Behavior; Behavioral; Computer Simulation; Corpus striatum structure; Data; Disease; Dissociation; Drug Addiction; Drug abuse; Environment; Episodic memory; Etiology; Feedback; Functional Magnetic Resonance Imaging; Hippocampus (Brain); Human; Individual; Knowledge; Lead; Learning; Life; Mediating; Memory; Methods; Modeling; Nature; Neurobiology; Outcome; Process; Psychological reinforcement; Relapse; Relative (related person); Research; Resolution; Restaurants; Rewards; Signal Transduction; Structure; System; Testing; Update; addiction; base; classical conditioning; design; experience; flexibility; human subject; neuroimaging; neuromechanism; novel; public health relevance; relating to nervous system

DESCRIPTION (provided by applicant): To behave adaptively, individuals must learn associations between reward outcomes and features of the environment, and use these associations to inform behavior in novel situations. Previous research in animal models has demonstrated that the neural systems engaged during associative learning can influence such generalization behaviors, such that adaptive generalization requires engagement of the hippocampus. However, the majority of research in human subjects has investigated striatal-guided reward learning and generalization, often during multi-trial, probabilistic feedback learning. In everyday life, reward values are often acquired after only a single experience or episode; the neural mechanisms guiding such single-trial reward feedback learning are undefined. The current proposal advances the claim that single-trial reward feedback learning and generalization may be characterized by the interactions between reinforcement learning and episodic memory systems. We will test this claim by combining behavioral methods, computational modeling, and high-resolution neuroimaging. We will characterize the neural systems engaged during the acquisition of single-trial reward feedback associations using hi-resolution fMRI (Aim 1). Further, we will characterize how associative learning via single-trial reward feedback contributes to generalization behavior using reinforcement-learning modeling (Aim 2) and model-based fMRI (Aim 3). We predict that (1) single-trial reward-feedback learning will engage interactions between the striatum and hippocampus during associative learning, and (2) the interaction between these systems will promote adaptive generalization of reward associations. The knowledge obtained from this proposal will advance our understanding of the neurobiology of reward learning and provide evidence for the mechanisms underlying healthy and impaired reward-related behaviors such as drug addiction.

描述（由申请人提供）：为了做出适应性行为，个人必须学习奖励结果与环境特征之间的关联，并利用这些关联来指导新情况下的行为。先前对动物模型的研究表明，联想学习过程中参与的神经系统可以影响这种泛化行为，因此适应性泛化需要海马体的参与。然而，大多数人类受试者研究通常是在多次试验、概率反馈学习过程中研究纹状体引导的奖励学习和泛化。在日常生活中，奖励值通常是在一次经历或事件后获得的；指导这种单次试验奖励反馈学习的神经机制尚未定义。当前的提案提出了这样的主张：单次试验奖励反馈学习和泛化的特征可能是强化学习和情景记忆系统之间的相互作用。我们将通过结合行为方法、计算模型和高分辨率神经影像来检验这一说法。我们将使用高分辨率功能磁共振成像（目标 1）来描述在获得单次试验奖励反馈关联过程中参与的神经系统的特征。此外，我们将使用强化学习模型（目标 2）和基于模型的 fMRI（目标 3）来描述通过单次试验奖励反馈进行联想学习如何有助于泛化行为。我们预测（1）单次奖励反馈学习将在联想学习过程中涉及纹状体和海马体之间的相互作用，（2）这些系统之间的相互作用将促进奖励关联的适应性泛化。从该提案中获得的知识将增进我们对奖励学习的神经生物学的理解，并为健康和受损的奖励相关行为（例如毒瘾）的潜在机制提供证据。