Eye movements during real-world visual search

现实世界视觉搜索期间的眼球运动

• 批准号: 6778395
• 负责人: GREGORY J ZELINSKY
• 金额: $ 11.29万
• 依托单位: STATE UNIVERSITY NEW YORK STONY BROOK
• 依托单位国家: 美国
• 财政年份: 2002
• 资助国家: 美国
• 起止时间: 2002-09-05 至 2007-07-31
• 项目状态: 已结题
• 来源: https://reporter.nih.gov/project-details/6778395
• 关键词: behavioral /social science research tag; clinical research; eye movements; form /pattern perception; human subject; image processing; mathematical model; neural information processing; space perception; vision; visual fixation; visual perception; visual stimulus; visual tracking

DESCRIPTION (provided by applicant): Visual search has typically been studied using button-press dependent measures and fairly simple stimuli, methodological choices that have rendered current theories of search poorly equipped to predict the locations and durations of individual search movements to featurally complex real-world objects. In response to these limitations, the goals of the proposed project are to: (1) describe real-world visual search in terms of directly observable and spatio-temporally exact eye movement behavior, and (2) introduce a computational model capable of accommodating real-world oculomotor search. Work on this interdisciplinary project will be accomplished in three phases. Phase I will implement the computational model. Filter-based image processing techniques will be used to represent the real-world search stimuli, and visual routines acting on these representations will endow the model with simulated oculomotor behavior. The visual information available to each of these eye movements will be constrained by a simulated fovea that moves over the scene as the model's "eye" gradually converges on the search target. Phase 2 will apply this behavioral and computational approach to address basic questions regarding real-world oculomotor search (set size effects, target presence/absence, etc). Behavioral studies will determine how people direct their gaze as they search for simple and real-world targets. Computational studies will then input to the model the same search scenes viewed by the human observers and compare the simulated eye movement behavior to the sequence of saccades and fixations obtained from the behavioral studies. Phase 3 will build on the results of Phase 2 by using the gaze patterns predicted by the model to test several novel questions regarding search processes and representations (e.g., What is the role of complex backgrounds in a search task? Should search items be treated as objects or spatially extensive image patches?, What are the relationships between visual search and memory?). Finding spatio-temporal agreement between human and simulated gaze patterns in these studies will not only provide the literature with a validated computational model of oculomotor search, but also open to researchers a (real) world of stimuli to challenge our understanding of visual search behavior.

描述（由申请人提供）：视觉搜索通常是使用依赖于按钮按下的测量和相当简单的刺激、方法选择来研究的，这些选择使得当前的搜索理论很难预测单个搜索运动的位置和持续时间，以实现特征复杂的现实。世界物体。为了应对这些限制，该项目的目标是：（1）根据直接可观察和时空精确的眼球运动行为来描述现实世界的视觉搜索，以及（2）引入一种能够适应真实世界的计算模型-世界动眼神经搜索。这个跨学科项目的工作将分三个阶段完成。第一阶段将实施计算模型。基于滤波器的图像处理技术将用于表示现实世界的搜索刺激，作用于这些表示的视觉例程将赋予模型模拟动眼行为。每个眼睛运动可用的视觉信息都将受到模拟中央凹的限制，随着模型的“眼睛”逐渐会聚在搜索目标上，该模拟中央凹在场景上移动。第二阶段将应用这种行为和计算方法来解决有关现实世界动眼神经搜索的基本问题（集合大小效应、目标存在/不存在等）。行为研究将确定人们在寻找简单且现实世界的目标时如何引导他们的目光。然后，计算研究将人类观察者看到的相同搜索场景输入到模型中，并将模拟的眼动行为与从行为研究中获得的眼跳和注视序列进行比较。第 3 阶段将建立在第 2 阶段结果的基础上，使用模型预测的注视模式来测试有关搜索过程和表示的几个新问题（例如，复杂背景在搜索任务中的作用是什么？搜索项是否应该被视为物体或空间广泛的图像块？，视觉搜索和记忆之间的关系是什么？）。在这些研究中找到人类和模拟注视模式之间的时空一致性不仅将为文献提供经过验证的动眼神经搜索计算模型，而且还为研究人员开放一个（真实）刺激世界，以挑战我们对视觉搜索行为的理解。