Multisensory perception: Audiovisual interactions under dynamic conditions

多感官知觉：动态条件下的视听交互

• 批准号: 8575462
• 负责人: CATHLEEN M MOORE
• 金额: $ 22.24万
• 依托单位: UNIVERSITY OF IOWA
• 依托单位国家: 美国
• 财政年份: 2013
• 资助国家: 美国
• 起止时间: 2013-09-30 至 2015-09-29
• 项目状态: 已结题
• 来源: https://reporter.nih.gov/project-details/8575462
• 关键词: Accounting; Age; Aging; Alcohols; Area; Auditory; Automobile Driving; Behavioral; Brain; Cells; Conscious; Development; Disease; Encapsulated; Event; Explosion; Eye Movements; Failure; Feedback; Functional Magnetic Resonance Imaging; Image; Individual; Lead; Literature; Location; Modality; Motion; Neurons; Perception; Pharmaceutical Preparations; Process; Reporting; Research; Retina; Saccades; Sampling; Sensory; Signal Detection Analysis; Source; Stimulus; Stream; Testing; Time; Vision; Visual; Visual Perception; association cortex; auditory stimulus; distraction; feeding; multisensory; neurophysiology; novel; public health relevance; sensory mechanism; sensory system; tool; visual information; visual stimulus

PROJECT SUMMARY This research investigates intersensory mechanisms that underlie the influence of auditory stimuli on visual perception. Findings from single-cell neurophysiology, event-related brain potentials, and functional MRI indicate that neurons in cortical areas that were once thought to be unisensory can be driven by stimuli from multiple modalities. Moreover, the timing of multisensory-driven activity is such that it is unlikely to be due to just to feedback from anatomically later cortical areas. A set of recently reported behavioral effects showing the enhancement of visual perception from informationally unrelated but concomitantly presented auditory stimuli seem to be manifestations of these multisensory mechanisms. To date, however, these effects have not been understood in terms of any common intersensory mechanism. This research tests the audiovisual temporal-encapsulation hypothesis which states that an abrupt transient auditory stimulus defines a temporal window within which the representation of visual stimuli that appear in that time window are isolated from interaction with temporally surrounding visual information. This hypothesis can account for all of the effects reviewed above and it makes novel predictions beyond these, which are the focus of the present proposal. Significantly, the intersensory effects that have been reported in the literature are primarily examples of visual facilitation by concomitant auditory stimuli. The new predictions that we have derived from the audiovisual temporal encapsulation hypothesis are examples of impaired visual perception by concomitant auditory stimuli, which make them especially powerful for testing the hypothesis. The general idea is that if visual information is encapsulated by concomitant auditory stimuli, then it follows that tasks that require integration of that encapsulated visual information with information sampled at a different time will be impaired. This idea will be tested in three specific aims. Specific Aim 1 tests the effects of auditory stimuli in a visual integration task. Specific Aim 2 tests the effects of auditory stimuli on the processes by which visible persistence for moving stimuli is actively suppressed known, as motion deblurring. Specific Aim 3 tests the effects of auditory stimuli on the processes by which visual information is suppressed during eye movements, known as saccadic suppression. If confirmed, the audiovisual temporal-encapsulation hypothesis could explain why people are susceptible to auditory distraction when engaged in what are primarily visual tasks (e.g., driving). Moreover, the encapsulation process might be a mechanism that is subject to failure in impaired states due to drugs, alcohol or disease. It may also be a mechanism that is subject to decline with age.

项目概要 这项研究调查了听觉刺激影响的感觉间机制。 视觉感知。单细胞神经生理学、事件相关脑电位和功能的发现 MRI 表明，曾经被认为是单感觉的皮质区域的神经元可以由刺激驱动 来自多种方式。此外，多感官驱动活动的时间安排不太可能是 由于只是来自解剖学上较晚的皮质区域的反馈。最近报道的一组行为影响 显示从不相关但同时呈现的信息中视觉感知的增强 听觉刺激似乎是这些多感觉机制的表现。然而迄今为止，这些 尚未通过任何常见的感觉机制来理解这种效应。 这项研究测试了视听时间封装假说，该假说指出突然的 瞬态听觉刺激定义了一个时间窗口，在该窗口内视觉刺激的表示 出现在该时间窗口中的内容与与时间周围视觉信息的交互隔离。这 假设可以解释上面审查的所有影响，并做出超越这些的新颖预测， 这是本提案的重点。值得注意的是，已报道的感觉间效应 文献主要是伴随听觉刺激来促进视觉的例子。新的预测 我们从视听时间封装假说中得出的结论是视觉受损的例子 通过伴随的听觉刺激来感知，这使得它们对于检验假设特别有效。 一般的想法是，如果视觉信息被伴随的听觉刺激所封装，那么它如下 需要将封装的视觉信息与在某个位置采样的信息集成的任务 不同的时间会受到损害。这个想法将在三个具体目标上进行测试。具体目标 1 测试效果 视觉整合任务中的听觉刺激。具体目标 2 测试听觉刺激对过程的影响 通过这种方式，运动刺激的可见持久性被主动抑制，称为运动去模糊。具体的 目标 3 测试听觉刺激对视觉信息被抑制的过程的影响 眼球运动，称为扫视抑制。 如果得到证实，视听时间封装假说可以解释为什么人们容易受到影响 当从事主要是视觉任务（例如驾驶）时，听觉会分散注意力。此外， 封装过程可能是一种因药物、酒精而在受损状态下失效的机制 或疾病。它也可能是一种随着年龄的增长而衰退的机制。