RI: Small: Speaker-Specific Articulatory Strategies

RI：小：特定于说话者的发音策略

• 批准号: 1908865
• 负责人: Shrikanth Narayanan
• 金额: $ 47.4万
• 依托单位: University of Southern California
• 依托单位国家: 美国
• 项目类别: Continuing Grant
• 财政年份: 2019
• 资助国家: 美国
• 起止时间: 2019-08-01 至 2023-07-31
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=1908865&HistoricalAwards=false
• 关键词: RI; Small; Speaker; Specific; Articulatory

Speech is a uniquely human act that involves the conversion of discrete cognitive, linguistic representations to continuous, complex movements of speech articulators. By helping to understand better the variability and constraints of this conversion mechanism in healthy speech production, this project contributes to assessing speech disorders associated with neurological disease, such as apraxia. Moreover, it paves the way for novel science-driven paradigms to automatic synthesis of speech from text; a technology of increasing importance for social inclusion. It also provides a unique interdisciplinary training opportunity for students, integrating exposure to various facets of speech science research. Novel dynamic imaging data of speech production, analysis results, and derived models are shared with the broader research community.The focus of this project is on the coordinative patterns governing the movement of speech articulators toward the achievement of speech production goals (articulatory strategies). The aim to develop a toolset for characterizing this variability, that will also enable mapping phonological representations to speaker-specific dynamics of the vocal tract. The project builds upon the frameworks of Articulatory Phonology and Task Dynamics that provide a model for generating vocal-tract dynamics from linguistic structures, in which the formation of linguistically relevant constrictions in the vocal tract is governed by the temporal deployment of dynamical systems: critically damped oscillators that are characterized temporally by parameters including targets (end goals of articulatory movements) and natural frequencies (time-course of the movement trajectories). This model is updated using vocal-tract real-time magnetic resonance imaging data from 32 speakers, in order to characterize their speech production behavior at three levels: (i) the vocal-tract deformations put forth in the act of speaking; (ii) the relative contributions of those deformations towards the achievement of phonological goals; and (iii) the temporal coordination of articulatory gestures for the production of well-formed utterances. Such characterizations of individual, speaker-specific articulatory strategies, as directly observed using state-of-the-art vocal-tract imaging technology, significantly contributes to our understanding of what underlies phonological constancy and what drives individual variability via phonetic context, speaker anatomy, and speaking style.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.

言语是一种独特的人类行为，涉及将离散的认知、语言表征转换为连续、复杂的发音器官运动。通过帮助更好地理解这种转换机制在健康言语产生中的可变性和限制，该项目有助于评估与神经系统疾病（例如失用症）相关的言语障碍。此外，它为新颖的科学驱动范例从文本自动合成语音铺平了道路；一项对于社会包容性日益重要的技术。它还为学生提供了独特的跨学科培训机会，整合了对语音科学研究各个方面的接触。语音产生的新颖动态成像数据、分析结果和派生模型与更广泛的研究界共享。该项目的重点是控制发音器官运动以实现语音产生目标（发音策略）的协调模式。目的是开发一个工具集来表征这种变异性，这也将能够将语音表征映射到说话者特定的声道动态。该项目建立在发音音系学和任务动力学的框架之上，提供了一个从语言结构生成声道动力学的模型，其中声道中语言相关收缩的形成受到动力系统的时间部署的控制：临界阻尼振荡器的特征是时间参数，包括目标（关节运动的最终目标）和自然频率（运动轨迹的时间过程）。该模型使用来自 32 个说话者的声道实时磁共振成像数据进行更新，以便在三个层面上表征他们的语音产生行为：（i）说话行为中提出的声道变形； (ii) 这些变形对实现语音目标的相对贡献； (iii) 发音姿势的时间协调，以产生结构良好的话语。使用最先进的声道成像技术直接观察到的个体、特定于说话者的发音策略的这种特征，极大地有助于我们理解语音恒定性的基础以及通过语音背景、说话者解剖学、该奖项反映了 NSF 的法定使命，并通过使用基金会的智力价值和更广泛的影响审查标准进行评估，被认为值得支持。

项目成果

Effect of vocal tract morphology on tongue shaping for American English /ɹ/

声道形态对美式英语 /É1/ 舌形的影响

• DOI: 10.1121/10.0008076
• 发表时间: 2021
• 期刊: The Journal of the Acoustical Society of America
• 作者: Lu, Yijing;Hsu, Haley;Goldstein, Louis;Toutios, Asterios
• 通讯作者: Toutios, Asterios

How an aglossic speaker produces an alveolar-like percept without a functional tongue tip.

无舌说话者如何在没有功能性舌尖的情况下产生类似齿槽的感知。

• DOI: 10.1121/10.0001329
• 发表时间: 2020
• 期刊: The Journal of the Acoustical Society of America
• 作者: Toutios,Asterios;Xu,Melissa;Byrd,Dani;Goldstein,Louis;Narayanan,Shrikanth
• 通讯作者: Narayanan,Shrikanth

Characteristics of articulatory gestures in stuttered speech: A case study using real-time magnetic resonance imaging

口吃言语中的发音姿势特征：基于实时磁共振成像的案例研究

• DOI: 10.1016/j.jcomdis.2022.106213
• 发表时间: 2022
• 期刊: Journal of Communication Disorders
• 影响因子: 1.7
• 作者: Lu, Yijing;Wiltshire, Charlotte E.E.;Watkins, Kate E.;Chiew, Mark;Goldstein, Louis
• 通讯作者: Goldstein, Louis

Effect of individual vocal tract geometry on the tongue shaping for American English /ɹ/.

个体声道几何形状对美式英语 /É1/ 舌头形状的影响。

• 发表时间: 0223
• 期刊: Proceedings of the 20th International Congress of Phonetic Sciences (ICPhS
• 作者: Lu, Y.

Modeling speaker-specific vocal tract kinematics from gestural scores

根据手势分数对特定说话者的声道运动学进行建模

• DOI: 10.1121/10.0008077
• 发表时间: 2021
• 期刊: The Journal of the Acoustical Society of America
• 作者: Lu, Yijing;Ly, Justin;Narayanan, Shrikanth;Goldstein, Louis;Toutios, Asterios
• 通讯作者: Toutios, Asterios