Hierarchies of spatiotemporal anticipation in the human brain

人脑中时空预期的层次结构

• 批准号: 10558919
• 负责人: Mariam Aly
• 金额: $ 40.61万
• 依托单位: COLUMBIA UNIV NEW YORK MORNINGSIDE
• 依托单位国家: 美国
• 财政年份: 2023
• 资助国家: 美国
• 起止时间: 2023-03-01 至 2028-02-29
• 项目状态: 未结题
• 来源: https://reporter.nih.gov/project-details/10558919
• 关键词: Affect; Area; Behavior; Behavioral; Brain; Brain region; Cities; Computer Models; Creativeness; Data; Destinations; Development; Distant; Environment; Episodic memory; Event; Functional Magnetic Resonance Imaging; Future; Generations; Goals; Hour; Human; Impairment; Individual; Knowledge; Laboratory Study; Learning; Lesion; Link; Memory; Methods; Modeling; Movement; Natural Language Processing; Neuropsychology; Organ; Participant; Patients; Pattern; Play; Poetry; Role; Route; Semantic memory; Semantics; Signal Transduction; Stimulus; Structure; System; Testing; Update; Visual; Visual Cortex; Visual System; Walking; Work; expectation; experience; extrastriate visual cortex; flexibility; insight; movie; novel; predictive modeling; prospective; recurrent neural network; simulation; spatiotemporal; theories; tool; virtual reality environment; visual tracking

PROJECT SUMMARY Everyday experience requires humans to make plans in a hierarchical fashion, so they can anticipate visual events that might occur seconds, minutes, hours, or longer in the future. For example, when walking through a city, individuals must track their immediate surroundings (e.g., the movement of pedestrians around them), intermediate sub-goals (e.g., landmarks along their route), and long-timescale goals (e.g., their final destination). Despite the ubiquity of such hierarchical anticipation in behavior, it is unclear how the brain can simultaneously anticipate events at multiple timescales. Our aim is to uncover the mechanisms underlying hierarchical anticipatory signals in the brain’s visual system, by determining how these signals form, what they represent, how they are updated, and how they guide future-oriented behavior. This will be accomplished with functional magnetic resonance imaging (fMRI), neuropsychological studies, naturalistic stimuli, computational models, and sophisticated analytic approaches for characterizing the dynamics of brain activity. These methods will determine the conditions under which the visual system generates hierarchical anticipatory signals, the content and flexibility of those signals, how they arise, and their consequences for behavior. Aim 1 will establish how hierarchical anticipatory signals form and what they represent. We hypothesize that such hierarchical anticipation depends on input from memory systems, is informed by pre-existing schema, and is flexible in the visual features and timescales represented. Aim 2 will determine how hierarchical anticipatory signals may be affected by top- down goals to simulate the future, and how these signals relate to future-oriented visual behavior at a range of timescales. We hypothesize that the visual hierarchy differentially updates its anticipatory signals when the environment or goals change, and generates predictive signals in novel situations by linking separate episodic memories. Finally, Aim 3 will test competing theories of the structure of anticipatory representations. We hypothesize that anticipatory representations are influenced by both temporal and semantic relationships within an event sequence, and propose a computational model for predicting anticipatory event representations learned from a temporally-structured stimulus. Together, the findings will elucidate the mechanisms by which the visual system forms and flexibly updates anticipatory representations at multiple timescales, and how these representations relate to anticipatory behavior in naturalistic conditions. Such insights are important because expectations are instrumental in allowing individuals to behave adaptively, and disruption of visual anticipation might broadly impair goal-directed behavior. This work will therefore shed light on how the capacity to anticipate upcoming events to adaptively guide behavior might be impaired following damage to different parts of the visual system, including higher-order areas whose damage is not associated with primary visual deficits. Together, the results will provide empirical tests of the structure and development of anticipatory signals across the visual hierarchy, informing theories that consider the brain to be a fundamentally predictive organ.

项目摘要 每天的经验要求人类以层次结构制定计划，以便他们可以预料到视觉 将来可能发生几秒钟，分钟，小时或更长的事件。例如，走过 城市，个人必须跟踪周围的周围环境（例如，周围的行人的运动）， 中级子目标（例如，沿途的地标）和长时间的目标（例如，最终目的地）。 尽管行为中这种层次结构的预期无处不在，但尚不清楚大脑如何轻松 预测多个时间尺度的事件。我们的目的是发现层次结构的基础机制 通过确定这些信号如何形成，它们代表的内容， 它们的更新方式以及它们如何指导未来的行为。这将通过功能实现 磁共振成像（fMRI），神经心理学研究，自然主义刺激，计算模型和 软化的分析方法，用于表征大脑活性的动力学。这些方法将确定 视觉系统生成层次结构的预期信号，内容和 这些信号的灵活性，它们的出现方式以及对行为的后果。 AIM 1将确定如何 等级预期信号形式及其代表。我们假设这样的层次结构期望 取决于内存系统的输入，通过预先存在的架构告知，并且在视觉功能中具有灵活性 和时间尺度代表。 AIM 2将决定如何影响层次结构的预期信号。 降低目标以模拟未来，以及这些信号如何与以未来为导向的视觉行为相关 时间尺度。我们假设视觉层次结构对当 环境或目标改变，并通过链接单独的情节在新颖情况下产生预测信号 回忆。最后，AIM 3将测试预期表示结构的竞争理论。我们 假设预期表示受到临时关系和语义关系的影响 事件序列，并提出一个计算模型，用于预测预期事件表示 来自暂时结构的刺激。共同的发现将阐明视觉的机制 系统表格并灵活地更新多个时间尺度的预期表示形式，以及如何 表示与自然主义条件下的预期行为有关。这样的见解很重要，因为 期望有助于允许个人的行为行为和视觉预期的破坏 可能会广泛损害目标指导的行为。因此，这项工作将阐明如何预期的能力 在视觉的不同部分损坏后，即将发生的自适应指导行为的事件可能会受到损害 系统，包括损害与主要视觉缺陷无关的高阶区域。在一起， 结果将为视觉上的预期信号的结构和开发提供经验测试 层次结构，告知将大脑视为根本性预测器官的理论。