VALUE: Vision, Action, and Language Unified by Embodiment

价值：通过具体化统一愿景、行动和语言

• 批准号: EP/F026471/1
• 负责人: Angelo Cangelosi
• 金额: $ 63.73万
• 依托单位: Plymouth University
• 依托单位国家: 英国
• 项目类别: Research Grant
• 财政年份: 2008
• 资助国家: 英国
• 起止时间: 2008 至 无数据
• 项目状态: 已结题
• 来源: https://gtr.ukri.org/projects?ref=EP%2FF026471%2F1
• 关键词: VALUE; Vision; Action; Language; Unified

The primary aim of this project is to develop a simulation of the processes involved in solving the following problem: how to select, based on the agent's knowledge and representations of the world, one object from several, grasp the object and use it in an appropriate manner. This mundane activity in fact requires the simultaneous solution of several deep problems at various levels. The agent's visual system must represent potential target objects, the target must be selected based on task instructions or the agent's knowledge of the functions of the represented objects, and the hand (in this case) must be moved to the target and shaped so as to grip it in a manner appropriate for its use. We propose to develop a robotic simulation model inspired by recent theories of embodied cognition, in which the vision, action and semantic systems are linked together, in a dynamic and mutually interactive manner, within a connectionist architecture. Human experimental work will constrain the temporal and dynamic properties of the system in an effort to develop a psychologically plausible model of embodied selection for action. As much of the cognitive mechanisms leading to the integration between action and vision for actions such as object assembly tasks are not fully known, new empirical studies in this project will also improve our insight of these embodied cognitive dynamics. New experiments and the use of the embodied cognitive model will also be used to further our understanding of language and cognition integration e.g. by providing further predictions and insights on the dynamics of language and action knowledge in object representation.This is an interdisciplinary project which involves expertise and methodologies from cognitive psychology, motor control, and computational/robotics modelling. The interdisciplinary nature of the project and the design and experimentation of cognitive agents make the project highly relevant to the Cognitive Systems Foresight programme

该项目的主要目的是开发一种模拟解决以下问题所涉及的过程：如何根据智能体的知识和对世界的表征，从多个对象中选择一个对象，掌握该对象并以适当的方式使用它方式。这种平凡的活动实际上需要同时解决各个层面的几个深层次问题。智能体的视觉系统必须代表潜在的目标物体，必须根据任务指令或智能体对所代表物体的功能的了解来选择目标，并且手（在本例中）必须移动到目标并形成形状，以便以适合其使用的方式握住它。我们建议开发一种机器人模拟模型，其灵感来自于最近的具身认知理论，其中视觉、动作和语义系统在联结主义架构中以动态和相互交互的方式连接在一起。人类实验工作将限制系统的时间和动态特性，以努力开发一个心理上合理的具体行动选择模型。由于导致诸如物体组装任务之类的行动和视觉整合的认知机制尚不完全清楚，因此该项目中的新实证研究也将提高我们对这些具体认知动态的洞察力。新的实验和具身认知模型的使用也将用于进一步我们对语言和认知整合的理解，例如：通过对对象表示中的语言和动作知识的动态提供进一步的预测和见解。这是一个跨学科项目，涉及认知心理学、运动控制和计算/机器人建模的专业知识和方法。该项目的跨学科性质以及认知代理的设计和实验使得该项目与认知系统预见计划高度相关

项目成果

Visual and linguistic cues to graspable objects.

可抓握物体的视觉和语言线索。

• DOI: http://dx.10.1007/s00221-013-3616-z
• 发表时间: 2013
• 期刊: Experimental brain research
• 影响因子: 2
• 作者: Myachykov A

Electrophysiological examination of embodiment in vision and action.

视觉和动作体现的电生理检查。

• DOI: http://dx.10.1177/0956797611429578
• 发表时间: 2012
• 期刊: Psychological science
• 影响因子: 8.2
• 作者: Goslin J

Grounding language in action and perception: from cognitive agents to humanoid robots.

将语言置于行动和感知中：从认知主体到人形机器人。

• DOI: http://dx.10.1016/j.plrev.2010.02.001
• 发表时间: 2010
• 期刊: Physics of life reviews
• 作者: Cangelosi A

Object affordance influences instruction span.

对象可供性影响教学广度。

• DOI: http://dx.10.1007/s00221-012-3251-0
• 发表时间: 2012
• 期刊: Experimental brain research
• 影响因子: 2
• 作者: Apel JK

Attention deployment during memorizing and executing complex instructions.

记忆和执行复杂指令时的注意力部署。

• DOI: http://dx.10.1007/s00221-011-2827-4
• 发表时间: 2011
• 期刊: Experimental brain research
• 影响因子: 2
• 作者: Apel JK