Spreading the Word: The Theory of Distributed Representations in Speech and Natural Language Processing

传播信息：语音和自然语言处理中的分布式表示理论

• 批准号: RGPIN-2015-04069
• 负责人: Penn, Gerald
• 金额: $ 3.13万
• 依托单位: University of Toronto
• 依托单位国家: 加拿大
• 项目类别: Discovery Grants Program - Individual
• 财政年份: 2016
• 资助国家: 加拿大
• 起止时间: 2016-01-01 至 2017-12-31
• 项目状态: 已结题
• 来源: https://www.nserc-crsng.gc.ca/ase-oro/Details-Detailles_eng.asp?id=612758
• 关键词: Spreading; Word; Theory; Distributed; Representations

Motivated by recent progress in the use of neural networks in areas such as speech recognition and machine translation, this grant will fund research into the application of neural networks to a wide variety of other tasks in language technology. Although much of the popular excitement over neural networks arises from their alleged correspondence to human cognitive mechanisms, what excites engineers and computer scientists about them is their utility as very compact sequence classifiers - tools that can accurately label long sequences of data, such as speech sounds or words of text, given only examples to train on. Undertaken by one of the research labs that pioneered the use of neural networks in the area of speech recognition, the projects funded by this grant will consider not merely the transcription of speech into text, but the understanding of what was said or written. This emphasis on meaning will enable a new generation of language technology applications that can, for example, summarize large newspaper articles into their most relevant 10 or 20 percent. A key challenge to doing this is determining how individual representations of words combine to form representations of phrases and whole sentences. There is a branch of applied mathematics that studies this sort of combination, called mathematical linguistics, which will play a crucial role in this research. We will study the use of neural networks in mimicking those combinations.

受神经网络在语音识别和机器翻译等领域应用的最新进展的推动，这笔赠款将资助神经网络在语言技术中各种其他任务中的应用研究。 尽管人们对神经网络的兴奋很大程度上源于它们所谓的与人类认知机制的对应，但让工程师和计算机科学家兴奋的是它们作为非常紧凑的序列分类器的实用性 - 可以准确标记长数据序列的工具，例如语音或文本单词，仅给出训练示例。 该资助项目由率先在语音识别领域使用神经网络的研究实验室之一进行，该项目不仅会考虑将语音转录为文本，还会考虑对所说或所写内容的理解。这种对意义的强调将使新一代语言技术应用成为可能，例如，可以将大型报纸文章总结为最相关的 10% 或 20%。这样做的一个关键挑战是确定单词的各个表示如何组合以形成短语和整个句子的表示。应用数学中有一个研究这种组合的分支，称为数学语言学，它将在这项研究中发挥至关重要的作用。我们将研究使用神经网络来模仿这些组合。