The neural and behavioral causes underlying differences between visual perception and memory

神经和行为导致视觉感知和记忆之间的潜在差异

• 批准号: 10556562
• 负责人: Wilma A. Bainbridge
• 金额: $ 36.9万
• 依托单位: UNIVERSITY OF CHICAGO
• 依托单位国家: 美国
• 财政年份: 2023
• 资助国家: 美国
• 起止时间: 2023-03-01 至 2028-02-29
• 项目状态: 未结题
• 来源: https://reporter.nih.gov/project-details/10556562
• 关键词: Address; Alzheimer' s Disease; Anterior; Behavioral; Big Data; Big Data Methods; Brain; Brain region; Computer Models; Development; Dissociation; Eye; Functional Magnetic Resonance Imaging; Goals; Human; Image; Imagery; Impairment; Individual; Knock-out; Knowledge; Laboratories; Memory; Memory Disorders; Memory impairment; Methods; Mind; Nature; Neurodegenerative Disorders; Neurons; Participant; Patients; Pattern; Perception; Population; Prevalence; Process; Psyche structure; Research; Risk; Role; Running; Semantic memory; Semantics; Sensory; Steel; Structure; Temporal Lobe; Testing; Vision; Vision Disorders; Visual; Visual Perception; Visualization; Work; blind; crowdsourcing; diagnostic tool; experience; innovation; member; memory process; mental representation; neural; neural patterning; neuroimaging; neuromechanism; regional difference; visual imagery; visual information; visual memory

PROJECT SUMMARY Until recently, it was thought that our memories occur as a reactivation of perception – reconjuring the same visual information and neural patterns (dubbed the sensory reinstatement hypothesis; e.g., Buckner & Wheeler, 2001). However, in recent work, we observed surprising differences between perception and memory, with separate brain voxels and patterns involved in each process (Bainbridge et al., 2021b). We observed that memory representations in the brain lose rich high-level visual information, and that the neurons sensitive to memory are anterior to those sensitive to perception. Here, we hypothesize that memories become more semanticized representations of perception, resulting in an anterior neural shift towards more semantic regions (Popham et al., 2021); we dub this the semantic transformation hypothesis. This hypothesis runs counter to a recent proposal that memory and perception are supported by two separate yet adjacent networks (the separate networks hypothesis, Steel et al., 2021). By testing these three hypotheses in conjunction, we will be able to identify the specific neural mechanisms that support visual memory and its relation to visual perception. Crucially, this project has critical importance for understanding memory disorders such as Alzheimer’s Disease, for which recent work has shown that visual and semantic information in an image can predict its eventual memory fate in a patient (Bainbridge et al., 2019a; Grande et al., 2021). Towards this question, we utilize innovative methods pioneered by our laboratory, including a direct read-out of a participant’s perception and memory through drawings that are quantified through online crowd- sourcing (Bainbridge et al., 2019a; Bainbridge, 2021). In Aim 1, we use drawings to identify the direct influences of visual and semantic information on visual memory representations. In Aim 2, we use representational similarity analyses (Bainbridge et al., 2021b) combined with functional magnetic resonance imaging to test the roles of visual and semantic information on memory patterns in the brain. Importantly, in addition to testing typical individuals, we also study the newly characterized phenomenon of congenital aphantasia (2-5% prevalence), which describes individuals with no visual memory yet intact visual perception and semantic memory (Zeman et al., 2015; Keogh & Pearson, 2018). Aphantasia serves as natural “knock- out” case to observe behavioral and neural differences between perception and memory, and our laboratory is the only laboratory in the U.S. to have studied the condition thus far (Bainbridge et al., 2021a). Armed with this unique population, in Aim 3, we will identify the neural substrates that underlie their dissociation of visual memory and vision, and test the role of semantic vs. visual content on memory. In sum, this study promises to resolve our understanding of how what we see becomes what we remember, by identifying the causes of these striking differences observed in the brain between perception and memory.

项目概要 直到最近，人们还认为我们的记忆是感知的重新激活——重新唤起相同的事物 视觉信息和神经模式（称为感觉恢复假说；例如，Buckner & Wheeler，2001）然而，在最近的工作中，我们观察到感知和认知之间存在令人惊讶的差异。 记忆，每个过程都涉及单独的大脑体素和模式（Bainbridge 等人，2021b）。 观察到大脑中的记忆表征失去了丰富的高级视觉信息，并且神经元 对记忆敏感的人先于对知觉敏感的人。 变得更加语义化的感知表征，导致前神经向 更多语义区域（Popham 等人，2021）；我们将其称为语义转换假设。 假设与最近的一项提议背道而驰，该提议认为记忆和感知是由两个独立的但尚未支持的部分支持的。 相邻网络（单独的假设网络，Steel et al., 2021）。 结合起来，我们将能够识别支持视觉记忆的特定神经机制 至关重要的是，这个项目对于理解记忆至关重要。 阿尔茨海默病等疾病，最近的研究表明，视觉和语义信息 图像中的信息可以预测患者的最终记忆命运（Bainbridge 等人，2019a；Grande 等人，2021）。 针对这个问题，我们利用了我们实验室首创的创新方法，包括直接读出 通过在线人群量化的绘画来了解参与者的感知和记忆 采购（Bainbridge 等人，2019a；Bainbridge，2021）。在目标 1 中，我们使用图纸来识别直接来源。 在目标 2 中，我们使用 代表性相似性分析（Bainbridge 等人，2021b）与功能磁共振相结合 重要的是，通过成像来测试视觉和语义信息对大脑记忆模式的作用。 除了测试典型个体外，我们还研究先天性新特征的现象 失语症（患病率 2-5%），描述没有视觉记忆但视觉感知完整的个体 和语义记忆（Zeman et al., 2015; Keogh & Pearson, 2018）。 out”案例来观察感知和记忆之间的行为和神经差异，以及我们的 实验室是迄今为止美国唯一研究过这种情况的实验室（Bainbridge 等人， 2021a）。在目标 3 中，有了这个独特的群体，我们将确定其背后的神经基础。 视觉记忆和视觉的分离，并测试语义与视觉内容对记忆的作用。 总而言之，这项研究有望解决我们对所见如何变成所记忆的理解， 通过确定大脑中感知和记忆之间观察到的这些显着差异的原因。