Cognitive Knowledge Structures in Scene Perception - Behavioral and Neural Correlates of Semantic and Syntactic Scene Processing

场景感知中的认知知识结构 - 语义和句法场景处理的行为和神经关联

• 批准号: 242736900
• 负责人: Professorin Dr. Melissa Le-Hoa Vo
• 金额: --
• 依托单位: Abteilung Allgemeine Psychologie I
• 依托单位国家: 德国
• 项目类别: Independent Junior Research Groups
• 财政年份: 2014
• 资助国家: 德国
• 起止时间: 2013-12-31 至 2017-12-31
• 项目状态: 已结题
• 来源: https://gepris.dfg.de/gepris/projekt/242736900?language=en
• 关键词: Cognitive; Knowledge; Structures; Scene; Perception

While our visual world is complex, its composition conforms to certain rules. For instance, most objects require a horizontal surface to rest upon and two objects seldom coexist in the very same location. Even beyond such basic knowledge about physical properties of objects, we seem to have detailed knowledge regarding what objects tend to be found where within certain scenes. The aim of this research program is to gain further insight into how cognitive knowledge structures and expectations regarding objects in scenes help us to efficiently guide our attention and action when viewing and interacting within naturalistic scenes.The proposed research has three major objectives: First, the program will be dedicated to identifying and then utilizing the rules that govern the composition of scenes. For this purpose, we will perform large-scale analyses of image statistics to create the “Real-World Lexicon” — an easily accessible database containing information regarding object frequencies and typical locations within and across scenes. In addition, we will create a corpus of highly controlled image material for experimental use. The second aim of the program concerns the development of scene knowledge. Similar to the grammar in language processing that allows us to understand an unlimited number of novel sentences, we seem to possess a “scene grammar” that guides us even in unfamiliar places. By studying both artificial rule learning in adults and the development of scene understanding in infants and toddlers, we hope to find out how such scene knowledge develops over time. The emergence of rule-governed expectations will be tracked by a combination of psychophysics, eye tracking, and the measurement of brain responses. The third objective of the research program concerns the use of scene knowledge during active exploration of real-world, 3D scenarios. Participants will search for and interact with objects, while wearing a mobile, headmounted eye tracker. This setup will allow us to test what sources of guidance become dominant once search takes place beyond 2D displays, and actually involves active body movements in the real world.Moreover, an essential part of the program will include the evaluation, further development, and use of emerging techniques, such as the co-registration of eye movements and brain responses to measure so-called fixation-related potentials (FRPs). Particularly during scene viewing, the online measurement of brain potentials in response to what an observer is currently looking at will allow us to better relate cognitive processes to the actual visual input sampled by each individual observer. The outcome of this program has great potential for many applications within and outside of science ranging from more cognitively inspired technical systems to early diagnosis of developmental disorders in infants and toddlers.

尽管我们的视觉世界很复杂，但其组成符合某些规则。例如，大多数对象都需要水平表面搁置，并且两个对象很少在同一位置共存。甚至除了对物体物理特性的基本知识之外，我们似乎也有关于在某些场景中倾向于在某些场景中找到哪些对象的详细知识。该研究计划的目的是进一步深入了解场景中对象的认知知识结构和期望如何有助于我们在自然主义场景中观看和互动时有效地指导我们的注意力和行动。拟议的研究具有三个主要对象：首先，该计划将专门用于识别场景的规则，以识别场景的规则。为此，我们将对图像统计信息进行大规模的分析，以创建“现实世界词典”，这是一个易于访问的数据库，其中包含有关对象频率和跨场景中典型位置的信息。此外，我们将创建一个高度控制的图像材料的语料库，以供实验使用。该计划的第二个目的涉及场景知识的发展。类似于语言处理中的语法，使我们能够理解无限数量的新句子，我们似乎拥有一个“场景语法”，即使在陌生的地方也可以指导我们。通过研究成年人的人工规则学习和婴儿和幼儿的场景理解的发展，我们希望了解这种场景知识如何随着时间的推移如何发展。通过心理物理学，眼睛跟踪和大脑反应的测量，将跟踪获得规则的期望的出现。研究计划的第三个目标涉及在现实世界中有效探索3D方案的现场知识的使用。参与者将佩戴移动式的，头部的眼动仪时搜索并与物体互动。该设置将使我们能够测试一旦搜索超出2D显示，并且实际上涉及现实世界中的主动运动，而实际上涉及到现实世界中的积极运动。此外，该计划的重要组成部分包括评估，进一步开发和使用新兴技术，例如眼动运动的共同指导和大脑对衡量所谓的固定潜力（所谓的固定潜力）。特别是在场景观看期间，对观察者目前正在寻找的响应大脑电位的在线测量将使我们能够更好地将认知过程与每个观察者采样的实际视觉输入相关联。该计划的结果具有科学内部和外部的许多应用的巨大潜力，范围从更具认知灵感的技术系统到婴儿和幼儿发育障碍的早期诊断。