Individual differences through self-reinforcement of suboptimal strategies

通过次优策略的自我强化而产生的个体差异

基本信息

批准号：
10702117
负责人：
Ilana Witten
金额：
$ 113.52万
依托单位：
PRINCETON UNIVERSITY
依托单位国家：
美国
项目类别：
财政年份：
2023
资助国家：
美国
起止时间：
2023-08-21 至 2028-07-31
项目状态：
未结题

项目摘要

Project Summary/Abstract What produces individual differences in behavior? This fundamental question has classically been given two answers: nature and nurture. Here, we suggest that those two answers, while both critical and correct, are insufficient to fully explain individual variability. Instead, we propose that the vast differences in behavior between individuals arise in part from different individuals forming different reward associations within the same environment. This results from the fact that the world is complex and high-dimensional, in that there are almost always multiple possible actions or events that could be attributed to reward. Given the key role of dopamine neurons as the brain’s positive feedback system for behavioral control, the specific hypothesis is that small differences across individuals in initial conditions ultimately produce large differences in which features of the environment that the individual attributes to reward. This hypothesis is inspired in part by complex systems theory, which emphasizes the role of positive feedback in generating and amplifying small differences, creating outcomes that seem stochastic. To address this hypothesis, we will leverage our recent finding that different dopamine neurons calculate reward prediction error across different dimensions of the environment. Specifically, we will use dopamine neuron recordings to infer the time-varying features of the environment that each animal uses to predict reward, and then build reinforcement learning models of each individual based on these features. Ultimately, this testable framework aims to explain both normal variation across individuals, as well as the ubiquitous contribution of dopamine in mediating a disparate range of neuropsychiatric diseases.

项目摘要/摘要是什么在行为上产生个人差异？答案：自然和养育。不足以完全解释个人的变异性。个人之间的部分原因是不同的个体与Inins形成不同的奖励关联同样的环境。几乎总是可以归因于奖励的多个可能的行动或事件。多巴胺神经元是大脑对行为控制的积极反馈系统，具体假设是在初始条件下，个人之间的微小差异最终会产生差异，其中特征关闭个人归属于奖励的环境是由复杂系统启发的理论强调了积极反馈在产生和扩大微小差异中的作用，创造了似乎随机解决这一假设的结果，我们将利用我们最近的发现多巴胺神经元计算环境不同维度的奖励预测误差。具体而言，我们将使用多巴胺神经元录音到环境的时变特征每种动物都用来预测奖励，并根据每个人的线程加强学习模型这些功能最终。以及多巴胺在介导不同神经精神疾病范围的无处不在的贡献。