CISE Research Resources: Discourse Penn Treebank and Multimodal FORM: Development of Two Richly Annotated Corpora

CISE 研究资源：Discourse Penn Treebank 和 Multimodal FORM：两个注释丰富的语料库的开发

• 批准号: 0224417
• 负责人: Aravind Joshi
• 金额: $ 99.78万
• 依托单位: University of Pennsylvania
• 依托单位国家: 美国
• 项目类别: Continuing Grant
• 财政年份: 2002
• 资助国家: 美国
• 起止时间: 2002-10-15 至 2006-09-30
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=0224417&HistoricalAwards=false
• 关键词: CISE; Research; Resources; Discourse; Penn

EIA-0224417Aravind K. JoshiMark LibermanUniversity of PennsylvaniaCISE RR: Discourse Penn Trebank and Multimodal FORM: Development of Two Richly Annotated CorporaThis project, providing critical resources for research discourse modeling and conversational interaction, aims at developing new technologies and systems for information retrieval and human computer interaction. Centering on the construction of annotated corpora, two large-scale resources, one in the discourse domain and one in the dialog domain will be built:1. Discourse Penn Treebank (DPTB) and2. MultiFORM: Augmenting the FORM corpus with body movements, speech, and intonation.The former project develops a large scale and reliably annotated corpus that will encode coherence relations associated with discourse connectives, including their argument structure and anaphoric links, thus exposing a clearly defined level of discourse structure and supporting the extraction of a range of inferences associated with discourse connectives. This annotation will be "on top of" the Penn Treebank (PTB) annotations as well as the predicate-argument annotations of PTB (called the Proposition Bank or Prop Bank). The latter involves a corpus of gesture-annotated videos, FORM that was designed to be extensible in order to eventually represent the entire multimodal experience of conversational interaction. This multimodal FORM , MultiFORM, will be created by adding body movement, speech and syntactic structure, and intonation. Large-scale annotated corpora have played a critical role in speech and natural language research by enabling large-scale integration of statistical knowledge (derived from the corpora) with linguistic knowledge (as represented in annotations) leading to scientific and technological advances. Representative examples constitute robust parsing and automatic extraction of relations and coreferences and their applications to information extraction, question answering, summarization, and machine translation. PTB, a resource developed a decade ago, represents an example of such a resource that impacts natural language processing worldwide. PTB deals with corpora at the sentence level warranting a new large scale and reliable discourse and dialog structure annotated corpora. Although intellectual and practical connections exist between studies of the structures of discourse and dialog, the initial requirements for resources to study these areas diverge while overlapping in conception. On the discourse side, we need for corpora that deals with the kinds of structures found in composed text such as journalistic articles. The dialog side needs to focus on interactions among people and on extemporized rather than pre-composed material.

EIA-0224417Aravind K. JoshiMark Liberman 宾夕法尼亚大学 CISE RR：Discourse Penn Trebank 和 Multimodal FORM：两个注释丰富的语料库的开发该项目为研究话语建模和会话交互提供关键资源，旨在开发用于信息检索和人机的新技术和系统相互作用。 围绕标注语料库建设，建设一是话语域、一是对话域两大规模资源： 1．话语 Penn Treebank (DPTB) 和 2。 MultiFORM：通过身体动作、言语和语调增强 FORM 语料库。前一个项目开发了一个大规模且可靠注释的语料库，它将编码与话语连接词相关的连贯关系，包括它们的论证结构和照应链接，从而暴露出明确定义的水平语篇结构并支持提取与语篇连接词相关的一系列推论。 该注释将位于 Penn Treebank (PTB) 注释以及 PTB 的谓词-论证注释（称为命题库或命题库）的“之上”。 后者涉及手势注释视频的语料库，其设计为可扩展的，以便最终代表对话交互的整个多模式体验。 这种多模态形式（MultiFORM）将通过添加身体运动、言语和句法结构以及语调来创建。 大规模注释语料库通过实现统计知识（源自语料库）与语言知识（如注释中所代表）的大规模整合，在语音和自然语言研究中发挥了关键作用，从而促进了科学和技术的进步。 代表性的例子包括关系和共指的鲁棒解析和自动提取及其在信息提取、问答、摘要和机器翻译中的应用。 PTB 是十年前开发的资源，代表了影响全球自然语言处理的资源的一个例子。 PTB 处理句子级别的语料库，保证新的大规模且可靠的话语和对话结构注释语料库。 尽管话语和对话结构的研究之间存在知识和实践上的联系，但研究这些领域的资源的最初要求是不同的，同时概念上也有重叠。 在话语方面，我们需要语料库来处理新闻文章等合成文本中的结构类型。 对话方面需要关注人与人之间的互动以及即兴而非预先创作的材料。