Coordinating Information in Sentence Processing

协调句子处理中的信息

• 批准号: 6932773
• 负责人: Michael Kehas Tanenhaus
• 金额: $ 25.49万
• 依托单位: UNIVERSITY OF ROCHESTER
• 依托单位国家: 美国
• 财政年份: 2005
• 资助国家: 美国
• 起止时间: 2005-05-24 至 2010-04-30
• 项目状态: 已结题
• 来源: https://reporter.nih.gov/project-details/6932773
• 关键词: behavioral /social science research tag; clinical research; comprehension; eye movements; human subject; paralinguistic behavior; psycholinguistics; sound frequency; speech recognition; visual tracking

DESCRIPTION (provided by applicant): This research monitors eye movements to objects in a visual workspace, which are closely time-locked to language production and comprehension, as participants perform natural tasks, such as following producing and following instructions, and conversing to solve problems using the objects. The goal is to understand how listeners coordinate linguistic and non-linguistic information as they understand language. Coordinating information is central to language comprehension because speech unfolds as a rapidly changing transient acoustic event. As a consequence, listeners encounter ambiguities at multiple levels of linguistic representation (e.g., phonetic, lexical, syntactic, semantic/discourse model, etc.). Many ambiguities are temporary in that subsequent linguistic information soon resolves the ambiguity; others are resolved by appeal to non-linguistic context-the particular circumstances under which an utterance is heard or read; others by appeal to real-world knowledge. The ambiguity problem is pervasive: even unambiguous words and phrases are temporarily ambiguous. Yet, comprehenders quickly coordinate multiple sources of information to arrive at provisional interpretations as the speech unfolds. The results of this research are used to develop and evaluate explicit mechanistic models that support real-time comprehension and can account for the major empirical phenomena. These models are essential for understanding normal comprehension and its development, developmental disabilities, and comprehension impairments that may arise from brain injury. The results and methods that arise from this investigation are also becoming increasingly relevant to informing and evaluating computer-based spoken dialog systems. These systems are beginning to find applications in health-related domains (e.g., systems that interact with humans using spoken language to answer queries) and prototypes are under development that offer advice, for example, in coordinating rapid response to medical emergencies.

描述（由申请人提供）：本研究监视视觉工作空间中对象的眼动，因为参与者执行自然任务，例如遵循生产和以下说明，以及使用对象来解决问题，因为参与者执行了自然任务，它们与语言的生产和理解密切相关。目的是了解听众在理解语言时如何协调语言和非语言信息。协调信息是语言理解的核心，因为语音作为快速变化的瞬态声学事件展开。 结果，听众在多个语言表示（例如语音，词汇，句法，语义/话语模型等）上遇到歧义。许多歧义是暂时的，因为随后的语言信息很快解决了歧义。其他人可以通过对非语言环境的呼吁解决 - 听到或阅读的特定情况；其他人通过呼吁现实世界知识。歧义问题是普遍的：即使是明确的单词和短语也暂时模棱两可。 但是，理解者迅速协调了多个信息来源，以在演讲中得出临时解释。 这项研究的结果用于开发和评估支持实时理解的明确机械模型，并可以解释主要的经验现象。 这些模型对于理解正常的理解及其发展，发育障碍和理解障碍至关重要。这项调查产生的结果和方法也与通知和评估基于计算机的口语对话框系统有关。这些系统开始在与健康相关的域中找到应用程序（例如，使用口头语言与人类互动的系统来回答查询），并且正在开发原型，以提供建议，例如协调对医疗紧急情况的快速反应。