CONVERGENT PROCESSING ACROSS VISUAL AND HAPTIC CIRCUITS FOR 3D SHAPE PERCEPTION

跨视觉和触觉电路的融合处理，实现 3D 形状感知

基本信息

批准号：
10720137
负责人：
CHARLES E CONNOR
金额：
$ 72.73万
依托单位：
JOHNS HOPKINS UNIVERSITY
依托单位国家：
美国
项目类别：
财政年份：
2023
资助国家：
美国
起止时间：
2023-09-01 至 2025-08-31
项目状态：
未结题

来源：
https://reporter.nih.gov/project-details/10720137
关键词：
3-Dimensional Action Potentials Acute Animal Model Anterior Area Behavioral Brain Calibration Code Cognitive Complex Cues Darkness Development Dimensions Discrimination Elements Force of Gravity Functional Magnetic Resonance Imaging Future Goals Human Individual Insula of Reil Lateral Learning Mechanics Medial Mediating Methods Modality Monitor Monkeys Neurons Parietal Pathway interactions Pattern Perception Population Positioning Attribute Prosthesis Resolution Rest Shapes Signal Transduction Stereognosis Stimulus Supervision Surface System Tactile Testing Time Touch sensation Training Vision Visual area V1 combinatorial experience experimental study extrastriate visual cortex grasp haptics high dimensionality human imaging inferotemporal cortex neural neural network novel object perception object shape response sensory input somatosensory spatiotemporal success tool virtual visual coding

项目摘要

THEORETICAL FRAMEWORK: Vision and touch share a critical function—perception of 3D object shape. We use vision and touch both alternatively and simultaneously to recognize, understand, and interact physically with real world objects, based on detailed apprehension of their 3D shapes and mechanical functionality. METHODS, INNOVATION, SPECIES: We propose a novel exploration of visual/haptic circuit interactions underlying 3D object perception: (i) at the spatiotemporal resolution of individual neurons and action potentials, (ii) across the scope of local neural networks studied with linear array recording in monkey IT, and (iii) in the behavioral context of active grasp to discriminate unseen objects. AIM 1 TEST OF HYPOTHESIS: Haptic 3D object discrimination evokes distinct, shape-specific neural population response patterns in anterior monkey IT. This predicted result would provide strong evidence that the final stage in the visual object pathway also carries haptic-origin information sufficient to discriminate 3D shapes through touch, as suggested by human fMRI. AIM 2 TEST OF HYPOTHESIS: Haptic shape-dependent responses in monkey IT embody a compositional geometric code for 3D shape, analogous to the IT code for visual 3D shape. We have previously shown that IT neurons responding to 3D object stimuli encode volumetric shape fragments in a high-dimensional geometric space. These signals provide the essential elements for ensembles of IT neurons to represent objects as 3D spatial compositions. We predict analogous compositional coding for haptic 3D shape, showing that vision and touch converge on the same powerful coding solution. AIM 3 TEST OF HYPOTHESIS: Individual IT neurons carry identical 3D shape information about haptic and visual objects. This predicted result of congruent visual and haptic coding by the same neurons would demonstrate that anterior IT carries a unified, supramodal 3D object representation. ENABLING A FUTURE BCP R01, LONG-TERM GOAL: Success on any of these aims would justify a subsequent TargetedBCP R01 application to characterize HOW haptic and visual circuits interact to: (i) exchange information across circuits connecting multiple processing stages (visual areas V1, V2, V4, posterior IT, anterior IT; somatosensory areas SI, SII, superior parietal, insula). (ii) dynamically combine and refine 3D shape information across visual and haptic circuits as congruent, redundant, or conflicting information accumulates from the two modalities. (iii) interact in new object learning, since the two modalities almost certainly provide mutual supervision, especially during development, when vision must calibrate so many indirect cues for 3D shape information directly available to touch. The LONGTERM GOAL is to understand how visual and haptic cortical circuits refine, reconcile, and synthesize two very different sensory inputs to produce a unified cognitive appreciation of 3D shape.

理论框架：视觉和触觉共享一个关键功能——感知 3D 物体我们交替并同时使用视觉和触觉来识别、理解和塑造形状。基于对 3D 形状的详细理解，与现实世界的物体进行物理交互机械功能、创新、物种：我们提出了一种新颖的探索。 3D 物体感知的视觉/触觉回路交互：(i) 时空分辨率为单个神经元和动作电位，（ii）在局部神经网络的范围内进行研究猴子 IT 中的线性阵列记录，以及（iii）在主动抓取的行为背景下进行区分目标 1 假设检验：触觉 3D 物体辨别唤起不同的、猴子前部IT的形状特异性神经群体反应模式。提供强有力的证据表明视觉对象通路的最后阶段也带有触觉起源正如人类功能磁共振成像所建议的那样，这些信息足以通过触摸来区分 3D 形状。目标 2 假设检验：猴子 IT 的触觉形状依赖性反应体现了 3D 形状的组合几何代码，类似于视觉 3D 形状的 IT 代码。先前表明，IT 神经元响应 3D 物体刺激，编码体积形状片段这些信号为 IT 集成提供了基本元素。神经元将物体表示为 3D 空间组合，我们预测类似的组合编码。对于触觉 3D 形状，表明视觉和触觉汇聚在同一个强大的编码解决方案上。目标 3 假设检验：单个 IT 神经元携带相同的 3D 形状信息这通过相同的视觉和触觉编码来预测一致的结果。神经元将证明前 IT 具有统一的超模态 3D 对象表示。实现未来的 BCP R01 长期目标：任何这些目标的成功都将证明随后的 TargetedBCP R01 应用程序可描述触觉和视觉电路如何相互作用： (i) 在连接多个处理阶段的电路之间交换信息（视觉区域 V1、V2、 V4，后IT，前IT体感区域SI，SII，上顶叶，岛叶）。将视觉和触觉电路中的 3D 形状信息组合并细化为一致、冗余或 (iii) 在新对象学习中相互作用，因为两种模式会积累相互冲突的信息。这两种模式几乎肯定会提供相互监督，特别是在开发过程中，当视觉必须校准如此多的间接线索，以获得可直接触摸的 3D 形状信息。长期目标是了解视觉和触觉皮层回路如何完善、协调和综合两种截然不同的感官输入，产生对 3D 形状的统一认知欣赏。