CONVERGENT PROCESSING ACROSS VISUAL AND HAPTIC CIRCUITS FOR 3D SHAPE PERCEPTION

跨视觉和触觉电路的融合处理，实现 3D 形状感知

• 批准号: 10720137
• 负责人: CHARLES E CONNOR
• 金额: $ 72.73万
• 依托单位: JOHNS HOPKINS UNIVERSITY
• 依托单位国家: 美国
• 财政年份: 2023
• 资助国家: 美国
• 起止时间: 2023-09-01 至 2025-08-31
• 项目状态: 未结题
• 来源: https://reporter.nih.gov/project-details/10720137
• 关键词: 3-Dimensional; Action Potentials; Acute; Animal Model; Anterior; Area; Behavioral; Brain; Calibration; Code; Cognitive; Complex; Cues; Darkness; Development; Dimensions; Discrimination; Elements; Force of Gravity; Functional Magnetic Resonance Imaging; Future; Goals; Human; Individual; Insula of Reil; Lateral; Learning; Mechanics; Medial; Mediating; Methods; Modality; Monitor; Monkeys; Neurons; Parietal; Pathway interactions; Pattern; Perception; Population; Positioning Attribute; Prosthesis; Resolution; Rest; Shapes; Signal Transduction; Stereognosis; Stimulus; Supervision; Surface; System; Tactile; Testing; Time; Touch sensation; Training; Vision; Visual; area V1; combinatorial; experience; experimental study; extrastriate visual cortex; grasp; haptics; high dimensionality; human imaging; inferotemporal cortex; neural; neural network; novel; object perception; object shape; response; sensory input; somatosensory; spatiotemporal; success; tool; virtual; visual coding

THEORETICAL FRAMEWORK: Vision and touch share a critical function—perception of 3D object shape. We use vision and touch both alternatively and simultaneously to recognize, understand, and interact physically with real world objects, based on detailed apprehension of their 3D shapes and mechanical functionality. METHODS, INNOVATION, SPECIES: We propose a novel exploration of visual/haptic circuit interactions underlying 3D object perception: (i) at the spatiotemporal resolution of individual neurons and action potentials, (ii) across the scope of local neural networks studied with linear array recording in monkey IT, and (iii) in the behavioral context of active grasp to discriminate unseen objects. AIM 1 TEST OF HYPOTHESIS: Haptic 3D object discrimination evokes distinct, shape-specific neural population response patterns in anterior monkey IT. This predicted result would provide strong evidence that the final stage in the visual object pathway also carries haptic-origin information sufficient to discriminate 3D shapes through touch, as suggested by human fMRI. AIM 2 TEST OF HYPOTHESIS: Haptic shape-dependent responses in monkey IT embody a compositional geometric code for 3D shape, analogous to the IT code for visual 3D shape. We have previously shown that IT neurons responding to 3D object stimuli encode volumetric shape fragments in a high-dimensional geometric space. These signals provide the essential elements for ensembles of IT neurons to represent objects as 3D spatial compositions. We predict analogous compositional coding for haptic 3D shape, showing that vision and touch converge on the same powerful coding solution. AIM 3 TEST OF HYPOTHESIS: Individual IT neurons carry identical 3D shape information about haptic and visual objects. This predicted result of congruent visual and haptic coding by the same neurons would demonstrate that anterior IT carries a unified, supramodal 3D object representation. ENABLING A FUTURE BCP R01, LONG-TERM GOAL: Success on any of these aims would justify a subsequent TargetedBCP R01 application to characterize HOW haptic and visual circuits interact to: (i) exchange information across circuits connecting multiple processing stages (visual areas V1, V2, V4, posterior IT, anterior IT; somatosensory areas SI, SII, superior parietal, insula). (ii) dynamically combine and refine 3D shape information across visual and haptic circuits as congruent, redundant, or conflicting information accumulates from the two modalities. (iii) interact in new object learning, since the two modalities almost certainly provide mutual supervision, especially during development, when vision must calibrate so many indirect cues for 3D shape information directly available to touch. The LONGTERM GOAL is to understand how visual and haptic cortical circuits refine, reconcile, and synthesize two very different sensory inputs to produce a unified cognitive appreciation of 3D shape.

理论框架：视觉和触摸共享关键功能 - 对3D对象的感知 形状。我们使用视觉和触摸既可以触摸，仅仅是为了识别，理解和 基于对其3D形状的详细恐惧，与现实世界对象进行物理互动 机械功能。方法，创新，物种：我们提出了对 3D对象感知的视觉/触觉电路相互作用：（i）在时空分辨率下 单个神经元和动作电位，（ii）遍布局部神经元的范围 猴子中的线性阵列记录，（iii）在主动抓地的行为上下文中以区分 看不见的对象。 AIM 1的假设检验：触觉3D对象歧视引起了不同 前猴子的形状特异性中性种群反应模式。这个预测的结果将 提供有力的证据表明，视觉对象途径的最后阶段也带有触觉 - 源性 如人fMRI所建议的那样，足以通过触摸区分3D形状的信息。 AIM 2假设检验：猴子中的触觉依赖性响应体现了 3D形状的组成几何代码，类似于视觉3D形状的IT代码。我们有 先前表明的神经元响应3D对象刺激编码体积形状片段 高维几何空间。这些信号为合奏提供了基本要素 神经元表示对象为3D空间组成。我们预测类似的组成编码 对于触觉3D形状，显示视力和触摸在相同强大的编码解决方案上收敛。 AIM 3的假设检验：单个IT神经元具有相同的3D形状信息 触觉和视觉对象。这一预测的结果是相同的视觉和触觉编码的结果 神经元将证明它带有统一的，超大型3D对象表示。 实现未来的BCP R01，长期目标：这些目标的成功都将证明 随后的针对性BCP R01应用以表征触觉和视觉电路的相互作用： （i）跨电路交换信息，这些电路连接多个处理阶段（视觉区域v1，v2， v4，后部，前方；体感觉区SI，SII，上顶，岛）。 （ii）动态 将视觉和杂色电路的3D形状信息组合在一起，作为一致，多余的或 相互矛盾的信息从两种方式中积累了。 （iii）在新对象学习中进行互动，因为 几乎可以肯定，这两种方式可以提供相互监督，尤其是在开发过程中 视觉必须校准如此多的间接提示，以直接可触摸3D形状信息。 长期目标是了解视觉和触觉皮质电路如何完善，调和和调和 合成两个非常不同的感觉输入，以产生3D形状的统一认知欣赏。