Articulatory Speech Synthesis for Natural User Interfaces

自然用户界面的发音合成

• 批准号: 463376-2014
• 负责人: Penn, Gerald
• 金额: $ 14.64万
• 依托单位: University of Toronto
• 依托单位国家: 加拿大
• 项目类别: Strategic Projects - Group
• 财政年份: 2015
• 资助国家: 加拿大
• 起止时间: 2015-01-01 至 2016-12-31
• 项目状态: 已结题
• 来源: https://www.nserc-crsng.gc.ca/ase-oro/Details-Detailles_eng.asp?id=577054
• 关键词: Articulatory; Speech; Synthesis; Natural; User

For years, articulatory synthesis research has been largely overshadowed by formant-based and acoustic-based speech synthesis techniques. While successful in some domains (e.g., voice-based databases), these techniques still cannot produce natural looking and sounding speech from text from an arbitrary speaker. Natural looking and sounding speech technology is one of the next major milestones in voice-based interaction for natural user interfaces. Articulatory speech synthesis has progressed steadily at the fringes of both industrial and academic interest and is now poised to provide the necessary platform to overcome basic problems in speech production and, we believe, represents the next major advance in speech synthesis technology. Because of the structural complexity of the human vocal tract and of speech production behaviour, prior research in 3-dimensional articulatory synthesis has been focused on analyzing and modeling narrowly defined aspects of speech production and vocal tract structure. Rather than modeling a few sub-components of the overall vocal tract for production of a limited set of unnatural utterances, a more complete platform is needed that will allow vocal tract sub-components to be integrated and tested within the context of a working articulatory speech synthesizer that utilizes the best available technologies for the entire vocal tract. For decades, the Haskins 2D Articulatory Speech Synthesizer has been commonly used, even with the well-known limitations of shapes and sounds it can produce, and the lack of accurate representations of either generic or speaker-specific production parameters. Advances, such as VTL by Birkholtz, have made progress in 3D articulatory speech synthesis, but remain visually undeveloped as well as lacking biomechanical foundations. To overcome these limitations and provide a platform for new research in articulatory speech synthesis, we propose to construct and evaluate an aerodynamically driven articulatory speech synthesizer based on a comprehensive, parameterized 3D biomechanical model of the vocal and facial articulators, that is capable of producing both visible and acoustic speech and non-speech.

多年来，发音合成研究在很大程度上被基于共振峰和基于声学的语音合成技术所掩盖。虽然在某些领域（例如基于语音的数据库）取得了成功，但这些技术仍然无法从任意说话者的文本中生成外观和听起来自然的语音。自然外观和听起来自然的语音技术是自然用户界面基于语音的交互的下一个主要里程碑之一。发音语音合成在工业和学术兴趣的边缘稳步发展，现在准备提供必要的平台来克服语音生成中的基本问题，我们相信，它代表了语音合成技术的下一个重大进步。 由于人类声道和语音产生行为的结构复杂性，先前的 3 维发音合成研究一直集中于对语音产生和声道结构的狭义定义方面进行分析和建模。我们需要一个更完整的平台，允许在工作发音语音的上下文中集成和测试声道子组件，而不是对整个声道的几个子组件进行建模以产生一组有限的非自然话语。合成器利用整个声道的最佳可用技术。 几十年来，Haskins 2D 发音语音合成器一直被广泛使用，尽管它可以产生的形状和声音存在众所周知的限制，并且缺乏通用或特定于扬声器的生产参数的准确表示。 Birkholtz 的 VTL 等先进技术在 3D 发音语音合成方面取得了进展，但在视觉上仍然不发达，并且缺乏生物力学基础。为了克服这些限制并为发音合成的新研究提供一个平台，我们建议构建和评估一个基于全面的、参数化的发声和面部发音器的 3D 生物力学模型的空气动力学驱动的发音合成器，该模型能够产生可见的和听觉的语音和非语音。