Eye movements during real-world visual search

现实世界视觉搜索期间的眼球运动

• 批准号: 6655672
• 负责人: GREGORY J ZELINSKY
• 金额: $ 11.29万
• 依托单位: STATE UNIVERSITY NEW YORK STONY BROOK
• 依托单位国家: 美国
• 财政年份: 2002
• 资助国家: 美国
• 起止时间: 2002-09-05 至 2007-07-31
• 项目状态: 已结题
• 来源: https://reporter.nih.gov/project-details/6655672
• 关键词: behavioral /social science research tag; clinical research; eye movements; form /pattern perception; human subject; image processing; mathematical model; neural information processing; space perception; vision; visual fixation; visual perception; visual stimulus; visual tracking

DESCRIPTION (provided by applicant): Visual search has typically been studied using button-press dependent measures and fairly simple stimuli, methodological choices that have rendered current theories of search poorly equipped to predict the locations and durations of individual search movements to featurally complex real-world objects. In response to these limitations, the goals of the proposed project are to: (1) describe real-world visual search in terms of directly observable and spatio-temporally exact eye movement behavior, and (2) introduce a computational model capable of accommodating real-world oculomotor search. Work on this interdisciplinary project will be accomplished in three phases. Phase I will implement the computational model. Filter-based image processing techniques will be used to represent the real-world search stimuli, and visual routines acting on these representations will endow the model with simulated oculomotor behavior. The visual information available to each of these eye movements will be constrained by a simulated fovea that moves over the scene as the model's "eye" gradually converges on the search target. Phase 2 will apply this behavioral and computational approach to address basic questions regarding real-world oculomotor search (set size effects, target presence/absence, etc). Behavioral studies will determine how people direct their gaze as they search for simple and real-world targets. Computational studies will then input to the model the same search scenes viewed by the human observers and compare the simulated eye movement behavior to the sequence of saccades and fixations obtained from the behavioral studies. Phase 3 will build on the results of Phase 2 by using the gaze patterns predicted by the model to test several novel questions regarding search processes and representations (e.g., What is the role of complex backgrounds in a search task? Should search items be treated as objects or spatially extensive image patches?, What are the relationships between visual search and memory?). Finding spatio-temporal agreement between human and simulated gaze patterns in these studies will not only provide the literature with a validated computational model of oculomotor search, but also open to researchers a (real) world of stimuli to challenge our understanding of visual search behavior.

描述（由申请人提供）：通常使用按钮依赖的措施和相当简单的刺激研究了视觉搜索，方法论选择使当前的搜索理论不佳，以预测单个搜索运动的位置和持续时间，以使其具有特征复杂的现实世界对象。为了应对这些局限性，提议的项目的目标是：（1）用直接观察和时空精确的眼动行为描述现实世界的视觉搜索，（2）引入一个计算模型，能够适应现实世界中的动眼搜索。该跨学科项目的工作将分为三个阶段。第一阶段将实施计算模型。基于滤波器的图像处理技术将用于表示现实世界搜索刺激，而作用于这些表示形式的视觉例程将赋予模型以模拟的眼球运动行为。这些眼睛运动中可用的视觉信息将受到模拟中央凹的限制，该动脉植物在搜索目标上逐渐收敛时在场景上移动。第2阶段将采用这种行为和计算方法来解决有关现实世界动眼搜索（设定大小效果，目标存在/不存在等）的基本问题。行为研究将决定人们在寻找简单和现实世界的目标时如何指导他们的目光。然后，计算研究将向模型输入人类观察者观察的相同搜索场景，并将模拟的眼动行为与从行为研究获得的扫视和固定序列进行比较。第3阶段将通过使用模型预测的凝视模式来测试有关搜索过程和表示的几个新颖问题（例如，复杂背景在搜索任务中的作用是什么？应该将搜索项目视为对象还是空间广泛的图像补丁？，视觉搜索和内存之间的关系是什么？）。在这些研究中找到人类和模拟的凝视模式之间的时空一致性不仅会为文献提供了有效的眼球搜索计算模型，而且还向研究人员开放刺激的（真实）刺激世界，以挑战我们对视觉搜索行为的理解。