Scene Analysis and Cross-Modal Interactions

场景分析和跨模式交互

• 批准号: 6725879
• 负责人: CHRISTOPHER B BRAUN
• 金额: $ 5.86万
• 依托单位: HUNTER COLLEGE
• 依托单位国家: 美国
• 财政年份: 2004
• 资助国家: 美国
• 起止时间: 2004-01-01 至 2005-12-31
• 项目状态: 已结题
• 来源: https://reporter.nih.gov/project-details/6725879
• 关键词: auditory discrimination; auditory stimulus; behavioral /social science research tag; biological models; goldfish; labyrinth; lateral line; model design /development; psychophysiology; sensory mechanism; sensory signal detection; sound perception; stimulus /response

DESCRIPTION (provided by applicant): Scene analysis, or the mental parcellation of complex sensory input into representations of external objects, is the central task of any sensory system. Sensory stimuli can only inform behavior if the nervous system can distinguish between irrelevant background noise and important stimulus sources, and each source must be distinguished both from noise and from other possibly relevant sources. The goal of research in sensory science is to explain how this task is accomplished and to identify stimuli that allow an animal to direct appropriate behaviors. The present study addresses this problem for two important detectors of vibratory stimuli -- the inner ear and the closely related lateral line system of fishes. Unlike the majority of existing studies of these systems, which have been performed against a quiet background, this proposal measures the ability to detect spatially discrete signals and discriminate source location in both quiet and noisy settings. The mammalian sense of hearing (in air) relies only on the detection of pressure fluctuations, but for most aquatic animals, the sensory systems that detect vibratory sources provide information not only about the propagating pressure wave, but also two other aspects of the sound field surrounding a vibratory source: The acceleration detected by inertial sensors of the inner ear; and the pattern of water motions detected by the lateral line. Thus each of these sensors responds to the same stimuli, but detects different physical aspects of the stimulus. This study will test the importance of multisensory interaction in the perception of the natural environment, focusing on how each sensory channel contributes to a perception of source location. This proposal will also develop the octavolateralis system (hearing and lateral line senses) as a model of multisensory complementation, much like human touch relies on complementation between texture, pressure, and vibration sensory channels. Multisensory processing is ubiquitous and one important feature of our experimental approach is the use of natural stimuli (vibratory dipoles) that are more effective than loudspeakers for stimulating multiple hearing-related submodalities. An improved understanding of how multiple sensory systems combine to create unitary percepts will lead to better rehabilitation strategies following partial sensory loss.

描述（由申请人提供）：场景分析或复杂感觉输入到外部对象表示形式中的心理分析是任何感觉系统的核心任务。感觉刺激只有在神经系统可以区分不相关的背景噪声和重要刺激来源时才能告知行为，并且必须将每个源与噪声和其他可能相关的来源区分开。感官科学研究的目的是解释如何完成这项任务并识别允许动物指导适当行为的刺激。本研究解决了两个重要的振动刺激检测器的问题 - 内耳和紧密相关的鱼类侧线系统。与已针对安静的背景进行的大多数现有系统的现有研究不同，该提案可以衡量检测空间离散信号并在安静和嘈杂设置中区分源位置的能力。哺乳动物的听力感（空气中）仅依赖于压力波动的检测，但是对于大多数水生动物而言，检测振动源的感觉系统不仅提供有关传播压力波的信息，而且还提供了声场的其他两个方面围绕振动来源：通过内耳的惯性传感器检测到的加速度；以及横向线检测到的水运动模式。因此，这些传感器中的每一个都响应相同的刺激，但检测到刺激的不同物理方面。这项研究将测试多感官相互作用在自然环境感知中的重要性，重点是每个感觉渠道如何促进对源位置的感知。该提案还将发展为多感觉互补的模型，将开发八度八度系统（听力和侧线感官），就像人的触摸一样，依赖于质地，压力和振动感官通道之间的互补。多感官处理无处不在，我们实验方法的一个重要特征是使用自然刺激（振动偶极子），这些刺激比扬声器更有效，用于刺激多个听力相关的多种间距。对多种感觉系统如何结合以创造统一感知将导致更好的康复策略，对部分感觉丧失后，对多种感觉系统进行了改进的了解。