CRCNS:US-Fr Research: Neurobehavioral Assessment of a Reward Learning Model

CRCNS：US-Fr 研究：奖励学习模型的神经行为评估

基本信息

批准号：
9313241
负责人：
MATTHEW R ROESCH
金额：
$ 13.09万
依托单位：
UNIV OF MARYLAND, COLLEGE PARK
依托单位国家：
美国
项目类别：
财政年份：
2015
资助国家：
美国
起止时间：
2015-09-15 至 2019-07-31
项目状态：
已结题

来源：
https://reporter.nih.gov/project-details/9313241
关键词：
Animals Behavior Behavioral Biology Brain Communities Computer Simulation Conditioned Stimulus Development Drug Addiction Educational process of instructing Engineering Environment Faculty Foundations France Goals Heart High School Student Human Human Resources Individual Individual Differences Intervention Journals Learning Manuscripts Mathematics Medicine Methods Modeling Neurobiology Performance Pharmaceutical Preparations Pharmacogenetics Postdoctoral Fellow Preparation Process Protocols documentation Psychology Publications Research Rewards Robot Role Science Scientist Series Side Signal Transduction Students Techniques Testing Training Underrepresented Groups Universities Work base classical conditioning conditioning dissemination research drug craving evidence base experimental study flexibility graduate student high school individualized medicine insight meetings member neurobehavioral optogenetics outreach peer coaching programs research data dissemination response symposium theories trait undergraduate student

项目摘要

DESCRIPTION (provided by applicant): The objective of this proposal is to provide powerful insight into the computational and neurobiological processes underlying learning during Pavlovian conditioning, and to elucidate the origin of differences between individuals in their response to a conditioned stimulus (CS), namely sign-trackers (ST) attracted by the CS and goal-trackers (GT) directly attracted by the reward. One of the project's partners recently proposed a computational model which accounts for a large set of studies examining ST/GT behaviors. More importantly, this model has led to a series of new experimental predictions which, if tested experimentally, could help further validate or refute the computational mechanisms that underlie everyday learning. Here we propose a unique series of model-driven experiments to precisely test those predictions on both the computational and neurobiological levels using rigorous behavioral protocols and state-of-the art optogenetic and pharmacogenetic methods. This will enable us to assess and refine the proposed computational theory, and thus to provide a detailed description of the mechanisms underlying inter-individual differences during learning. Intellectual Merit (provided by applicant): Understanding how the brain integrates predictive information is a fundamental issue and has major implications at both theoretical and applied levels. In both ecological and artificial situations, these processes enable animals, humans and even robots to flexibly adapt their performances according to changes in the environment. Particularly poorly understood here are the mechanisms underlying inter-individual differences in learning, which may explain why some individuals fail in learning in particular situations while others succeed. Understanding these individual differences can help us better characterize why some individuals are more prone to drug addiction and craving in front of a CS associated to a drug-taking context, and has implications about individualized treatment. The research herein draws on complementary expertise from Biology, Psychology, Medicine, Applied Mathematics and Engineering in order to elucidate the combination of computational processes and behavioral traits that underlie these differences. To this end, we will systematically manipulate parameters that the model identifies as crucial and evaluate the dynamics and role of dopaminergic error signaling. Our work involves a unique combination of correlative and selective interventional approaches that directly test the fundamental assumptions of the model. Our results will thus provide definitive evidence regarding the competition of model-free and model-based processes in conditioning. The computational model that is at the heart of this proposal may thus represent a major step in the approach of individual differences. Broader Impact (provided by applicant): The broader impacts of this proposal will occur through the integration of the proposed research with teaching and training as follows. 1) Outreach. The PI will broaden the participation of underrepresented groups through research opportunities provided to high school students and underrepresented undergraduates through an ongoing partnership with Eleanor Roosevelt High School. The latter program will consist of a 3-week scientific boot camp during the summer for 1-2 students followed by a year of research in the PI's lab 2) Professional development. This project will train one postdoc, three graduate students, at least three undergraduates, and several high school students in collaborative research. Tiered peer mentoring will allow training of new personnel by more senior lab members, all carried out under the guidance of the PI. 3) Teaching. The boot camp, developed by the PI, will provide students with a foundation in scientific methods and will use evidence-based approaches to introduce them to how scientists investigate research questions using techniques performed in the PI's lab. The French co-PIs will on their side continue their development of introductions to science classes for high-school students and courses at various university levels. 4) Dissemination of research findings. All trainees will present their research t lab meetings, journal clubs, and conferences and will participate in manuscript preparation in order to share results with the scientific community. All publications generated by the project wil be made open-access (via PI's faculty pages and HAL in France).

描述（由申请人提供）：该提案的目的是提供对巴甫洛夫条件学习期间学习的计算和神经生物学过程的深入了解，并阐明个体之间对条件刺激（CS）反应差异的根源，即该项目的一个合作伙伴最近提出了一种计算模型，该模型解释了检查 ST/GT 行为的大量研究。重要的是，该模型引发了一系列新的实验预测，如果通过实验进行测试，可以帮助进一步验证或反驳日常学习背后的计算机制。在这里，我们提出了一系列独特的模型驱动实验来精确测试这些预测。使用严格的行为协议和最先进的光遗传学和药物遗传学方法在计算和神经生物学水平上进行研究，这将使我们能够评估和完善所提出的计算理论，从而提供个体间差异背后机制的详细描述。学习期间。智力优点（由申请人提供）：了解大脑如何整合预测信息是一个基本问题，在理论和应用层面都具有重大意义，在生态和人工环境中，这些过程使动物、人类甚至机器人能够灵活地适应它们。人们对个体间学习差异的机制了解甚少，这可以解释为什么有些人在特定情况下学习失败。了解这些个体差异可以帮助我们更好地描述为什么某些人更容易吸毒成瘾并渴望与吸毒环境相关的 CS，并且对个体化治疗具有影响。本文的研究借鉴了互补的专业知识。为了阐明这些差异背后的计算过程和行为特征的结合，我们将系统地操纵模型确定的关键参数，并评估其动态和作用。多巴胺能错误信号传导。这项工作涉及相关性和选择性干预方法的独特组合，这些方法直接测试模型的基本假设，因此我们的结果将为无模型和基于模型的过程在调节中的竞争提供明确的证据。因此，该提案的核心可能代表着解决个体差异问题的重要一步。更广泛的影响（由申请人提供）：该提案的更广泛影响将通过将拟议的研究与教学和培训相结合来实现，如下所示： 1) 外展活动将通过向高中提供研究机会来扩大代表性不足的群体的参与。通过与 Eleanor Roosevelt 高中的持续合作，为学生和代表性不足的本科生提供服务。后一个项目将包括在夏季为 1-2 名学生举办为期 3 周的科学训练营，然后在 PI 实验室进行一年的研究 2)。该项目将培训一名博士后、三名研究生、至少三名本科生和几名高中生进行合作研究，分层同伴指导将允许更多高级实验室成员培训新人员，所有这些都在实验室的指导下进行。 3) 教学。由 PI 开发的训练营将为学生提供科学方法的基础，并使用基于证据的方法向他们介绍科学家如何使用 PI 实验室中的技术来研究问题。 -PI 将在他们的双方继续为高中生开发科学入门课程和各个大学级别的课程。 4) 所有学员将在实验室会议、期刊俱乐部和会议上展示他们的研究成果，并按顺序参与手稿准备。与科学界分享该项目产生的所有出版物都将开放获取（通过 PI 的教师页面和法国的 HAL）。

项目成果

期刊论文数量（7）

专著数量（0）

科研奖励数量（0）

会议论文数量（0）

专利数量（0）

Impacts of inter-trial interval duration on a computational model of sign-tracking vs. goal-tracking behaviour.

试验间间隔持续时间对符号跟踪与目标跟踪行为的计算模型的影响。

DOI：
10.1007/s00213-019-05323-y
发表时间：
2019
期刊：
Psychopharmacology
影响因子：
3.4
作者：
Cinotti,François;Marchand,AlainR;Roesch,MatthewR;Girard,Benoît;Khamassi,Mehdi
通讯作者：
Khamassi,Mehdi

Development and function of the midbrain dopamine system: what we know and what we need to.

DOI：
10.1111/gbb.12257
发表时间：
2016-01
期刊：
Genes, brain, and behavior
影响因子：
0
作者：
Bissonette GB;Roesch MR
通讯作者：
Roesch MR

Editorial: Neural Circuitry of Behavioral Flexibility: Dopamine and Related Systems.

社论：行为灵活性的神经回路：多巴胺和相关系统。

DOI：
10.3389/fnbeh.2016.00006
发表时间：
2016
期刊：
Frontiers in behavioral neuroscience
影响因子：
3
作者：
Bissonette,GregoryB;Roesch,MatthewR
通讯作者：
Roesch,MatthewR

The impact of drugs of abuse on executive function: characterizing long-term changes in neural correlates following chronic drug exposure and withdrawal in rats.

DOI：
10.1101/lm.047001.117
发表时间：
2018-09
期刊：
Learning & memory (Cold Spring Harbor, N.Y.)
影响因子：
0
作者：
Brockett AT;Pribut HJ;Vázquez D;Roesch MR
通讯作者：
Roesch MR

Firing of Putative Dopamine Neurons in Ventral Tegmental Area Is Modulated by Probability of Success during Performance of a Stop-Change Task.

腹侧被盖区假定的多巴胺神经元的放电受到停止变化任务执行过程中成功概率的调节。

DOI：
10.1523/eneuro.0007-18.2018
发表时间：
2018
期刊：
eNeuro
影响因子：
3.4
作者：
Tennyson,StephenS;Brockett,AdamT;Hricz,NicholasW;Bryden,DanielW;Roesch,MatthewR
通讯作者：
Roesch,MatthewR