SGER: Automatic Processing of Natural Language Code Switching

SGER：自然语言代码切换的自动处理

• 批准号: 0749062
• 负责人: Mona Diab
• 金额: --
• 依托单位: Columbia University
• 依托单位国家: 美国
• 项目类别: Standard Grant
• 财政年份: 2007
• 资助国家: 美国
• 起止时间: 2007-09-01 至 2009-02-28
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=0749062&HistoricalAwards=false
• 关键词: SGER; Automatic; Processing; Natural; Language

Code switching is a natural linguistic phenomenon in which a speaker mixes two or more languages or dialects, or two or more linguistic registers from the same language. Extensive sociolinguistic studies have been dedicated to this widespread and common phenomenon and there has been some prior work in formal linguistics, but to date it has not been considered a problem of interest to the computational linguistics community. However, in this age of globalization and the current explosion in information and web access, more and more spontaneously generated linguistic data from around the world are being made available to the computational research community. Such data abounds with code switching in its different forms, so there is a real need for computational linguists to address code switching as a central research problem. This exploratory research effort addresses the issues of how to process code switching automatically. It examines the different aspects of code switching, allowing for the creation of better-principled algorithms based on a clear understanding of the phenomenon. The main questions revolve around morphological and syntactic constraints on switching and how these constraints can be modeled computationally. One of the outcomes of this research is the annotation of significant amounts of data exhibiting code switching in different languages, most likely Arabic, Hindi and Spanish. This research aims at initiating a formal study of code switching in a computational framework, which both increases our understanding of the phenomenon, and develops algorithms for processing natural language data that manifests code switching.

代码切换是一种自然的语言现象，在该现象中，扬声器将两种或多种语言或方言混合在一起，或两个或多种语言的语言寄存器。广泛的社会语言学研究已致力于这种广泛和共同的现象，并且在形式语言学上已经有一些先前的工作，但是迄今为止，它尚未被认为是计算语言学界的兴趣问题。但是，在这个全球化的时代以及信息和网络访问中的当前爆炸式爆炸时，来自世界各地的语言数据越来越多地为计算研究社区提供。这些数据以不同形式的代码切换充斥，因此计算语言学家真正需要将代码切换作为中心研究问题解决。这项探索性研究工作解决了如何自动处理代码切换的问题。它检查了代码切换的不同方面，从而基于对现象的清晰了解，可以创建更好原理的算法。主要问题围绕着形态学和句法的约束，以及如何对这些约束进行计算建模。这项研究的结果之一是大量数据以不同语言（最有可能是阿拉伯语，印地语和西班牙语）转换的数据注释。这项研究旨在启动对计算框架中的代码切换的正式研究，这既增强了我们对现象的理解，又开发了用于处理表现出代码切换的自然语言数据的算法。