EAGER: PARTIAL: An Exploratory Study on Practical Approaches for Robust NLP Tools with Integrated Annotation Languages

EAGER: PARTIAL：关于具有集成注释语言的鲁棒 NLP 工具实用方法的探索性研究

• 批准号: 1352440
• 负责人: Noah Smith
• 金额: $ 10万
• 依托单位: Carnegie-Mellon University
• 依托单位国家: 美国
• 项目类别: Standard Grant
• 财政年份: 2013
• 资助国家: 美国
• 起止时间: 2013-09-01 至 2014-08-31
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=1352440&HistoricalAwards=false
• 关键词: EAGER; PARTIAL; Exploratory; Study; Practical

In order to develop natural language processing (NLP) technologies for text in a wider range of languages, dialects, genres, and styles, this Early Grant for Exploratory Research investigates a novel methodological approach. Conventionally, linguistic experts are employed to create gold-standard linguistically annotated datasets to which supervised machine learning algorithms are applied. This project frees annotators from the requirement that annotations be complete by moving more of the burden to learning algorithms. Algorithms are developed that are robust to partial evidence, annotator variation, and noise due to errors. As a result, any language enthusiast (not just trained experts) can provide annotations so that NLP can be developed for more kinds of text in more languages for less money. In this exploration, the focus is on dependency parsing, a fundamental NLP component that predicts the grammatical relationships between words in sentences, with experimentation on data in English (two genres), Chinese, and Farsi. The formal basis for the approach is a framework called Graph Fragment Language (GFL). The project assesses the quality of parsers learned from GFL and the productivity of annotators accorded this new flexibility.Beyond documentation and assessment of the new methodology, this project produces open-source software tools for gathering annotated data and constructing NLP tools using the data. It emphasizes the usability of these tools in classrooms, contributing exercises that can be used in NLP and linguistics courses to allow students to engage directly with data, with the models that make use of the data, and with the technological goals that data annotation supports.

为了开发自然语言处理（NLP）技术，以更广泛的语言，方言，流派和样式范围，这项早期的探索性研究授予研究了一种新颖的方法论方法。 通常，使用语言专家来创建金标准的语言注释的数据集，并将其应用于监督的机器学习算法。 该项目可以通过将更多的负担转移到学习算法来完成注释的要求中释放注释。开发了对部分证据，注释者变异和由于错误而稳健的算法。 结果，任何语言爱好者（不仅是训练有素的专家）都可以提供注释，因此可以以更少的钱为更多语言开发NLP。 在此探索中，重点是依赖解析，这是一种基本的NLP组件，可以预测句子中单词之间的语法关系，并对英语（两种类型），中文和Farsi进行了实验。 该方法的形式基础是称为图形片段语言（GFL）的框架。 该项目评估了从GFL学到的解析器的质量以及注释者的生产率。签署了这种新的灵活性。Beyond文档和新方法的评估，该项目生产开源软件工具，用于收集注释数据并使用数据构建NLP工具。 它强调了这些工具在课堂上的可用性，可以在NLP和语言学课程中使用的练习，以使学生可以直接与数据，使用数据的模型以及数据注释支持的技术目标。