Multisensory perception: Audiovisual interactions under dynamic conditions

多感官知觉：动态条件下的视听交互

基本信息

批准号：
8732658
负责人：
CATHLEEN M MOORE
金额：
$ 18.08万
依托单位：
UNIVERSITY OF IOWA
依托单位国家：
美国
项目类别：
财政年份：
2013
资助国家：
美国
起止时间：
2013-09-30 至 2016-09-29
项目状态：
已结题

项目摘要

DESCRIPTION (provided by applicant): This research investigates intersensory mechanisms that underlie the influence of auditory stimuli on visual perception. Findings from single-cell neurophysiology, event-related brain potentials, and functional MRI indicate that neurons in cortical areas that were once thought to be unisensory can be driven by stimuli from multiple modalities. Moreover, the timing of multisensory-driven activity is such that it is unlikely to be due to just to feedback from anatomically later cortical areas. A set of recently reported behavioral effects showing the enhancement of visual perception from informationally unrelated but concomitantly presented auditory stimuli seem to be manifestations of these multisensory mechanisms. To date, however, these effects have not been understood in terms of any common intersensory mechanism. This research tests the audiovisual temporal-encapsulation hypothesis which states that an abrupt transient auditory stimulus defines a temporal window within which the representation of visual stimuli that appear in that time window are isolated from interaction with temporally surrounding visual information. This hypothesis can account for all of the effects reviewed above and it makes novel predictions beyond these, which are the focus of the present proposal. Significantly, the intersensory effects that have been reported in the literature are primarily examples of visual facilitation by concomitant auditory stimuli. The new predictions that we have derived from the audiovisual temporal encapsulation hypothesis are examples of impaired visual perception by concomitant auditory stimuli, which make them especially powerful for testing the hypothesis. The general idea is that if visual information is encapsulated by concomitant auditory stimuli, then it follows that tasks that require integration o that encapsulated visual information with information sampled at a different time will be impaired. This idea will be tested in three specific aims. Specific Aim 1 tests the effects of auditory stimuli in a visual integration task. Specific Aim 2 tests the effects of auditory stimulion the processes by which visible persistence for moving stimuli is actively suppressed known, as motion deblurring. Specific Aim 3 tests the effects of auditory stimuli on the processes by which visual information is suppressed during eye movements, known as saccadic suppression. If confirmed, the audiovisual temporal-encapsulation hypothesis could explain why people are susceptible to auditory distraction when engaged in what are primarily visual tasks (e.g., driving). Moreover, the encapsulation process might be a mechanism that is subject to failure in impaired states due to drugs, alcohol or disease. It may also be a mechanism that is subject to decline with age.

描述（由申请人提供）：本研究调查听觉刺激对视觉感知影响的感觉间机制。单细胞神经生理学、事件相关脑电位和功能性 MRI 的研究结果表明，曾经被认为是单感觉的皮质区域的神经元可以由多种方式的刺激驱动。此外，多感官驱动活动的时间安排不可能仅仅归因于解剖学上较晚的皮质区域的反馈。最近报道的一组行为效应显示，信息无关但同时呈现的听觉刺激增强了视觉感知，这似乎是这些多感觉机制的表现。然而，迄今为止，这些效应尚未通过任何常见的感觉机制得到理解。这项研究测试了视听时间封装假说，该假说指出，突然的瞬态听觉刺激定义了一个时间窗口，在该时间窗口内，出现在该时间窗口中的视觉刺激的表示与与时间上周围的视觉信息的交互隔离。该假设可以解释上面审查的所有影响，并做出除这些影响之外的新颖预测，这是本提案的重点。值得注意的是，文献中报道的感觉间效应主要是伴随听觉刺激的视觉促进的例子。我们从视听时间封装假说中得出的新预测是伴随听觉刺激导致视觉感知受损的例子，这使得它们对于检验该假设特别有效。一般的想法是，如果视觉信息被伴随的听觉刺激所封装，那么需要将封装的视觉信息与在不同时间采样的信息整合的任务将会受到损害。这个想法将在三个具体目标上进行测试。具体目标 1 测试视觉整合任务中听觉刺激的效果。具体目标 2 测试听觉刺激的效果，即主动抑制运动刺激的可见持久性的过程，称为运动去模糊。具体目标 3 测试听觉刺激对眼球运动期间视觉信息被抑制的过程（称为扫视抑制）的影响。如果得到证实，视听时间封装假说可以解释为什么人们在从事主要是视觉任务（例如驾驶）时容易受到听觉干扰。此外，封装过程可能是一种在药物、酒精或疾病导致的受损状态下容易失败的机制。它也可能是一种随着年龄的增长而衰退的机制。