RI: Small: Speaker-Specific Articulatory Strategies

RI：小：特定于说话者的发音策略

• 批准号: 1908865
• 负责人: Shrikanth Narayanan
• 金额: $ 47.4万
• 依托单位: University of Southern California
• 依托单位国家: 美国
• 项目类别: Continuing Grant
• 财政年份: 2019
• 资助国家: 美国
• 起止时间: 2019-08-01 至 2023-07-31
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=1908865&HistoricalAwards=false
• 关键词: RI; Small; Speaker; Specific; Articulatory

Speech is a uniquely human act that involves the conversion of discrete cognitive, linguistic representations to continuous, complex movements of speech articulators. By helping to understand better the variability and constraints of this conversion mechanism in healthy speech production, this project contributes to assessing speech disorders associated with neurological disease, such as apraxia. Moreover, it paves the way for novel science-driven paradigms to automatic synthesis of speech from text; a technology of increasing importance for social inclusion. It also provides a unique interdisciplinary training opportunity for students, integrating exposure to various facets of speech science research. Novel dynamic imaging data of speech production, analysis results, and derived models are shared with the broader research community.The focus of this project is on the coordinative patterns governing the movement of speech articulators toward the achievement of speech production goals (articulatory strategies). The aim to develop a toolset for characterizing this variability, that will also enable mapping phonological representations to speaker-specific dynamics of the vocal tract. The project builds upon the frameworks of Articulatory Phonology and Task Dynamics that provide a model for generating vocal-tract dynamics from linguistic structures, in which the formation of linguistically relevant constrictions in the vocal tract is governed by the temporal deployment of dynamical systems: critically damped oscillators that are characterized temporally by parameters including targets (end goals of articulatory movements) and natural frequencies (time-course of the movement trajectories). This model is updated using vocal-tract real-time magnetic resonance imaging data from 32 speakers, in order to characterize their speech production behavior at three levels: (i) the vocal-tract deformations put forth in the act of speaking; (ii) the relative contributions of those deformations towards the achievement of phonological goals; and (iii) the temporal coordination of articulatory gestures for the production of well-formed utterances. Such characterizations of individual, speaker-specific articulatory strategies, as directly observed using state-of-the-art vocal-tract imaging technology, significantly contributes to our understanding of what underlies phonological constancy and what drives individual variability via phonetic context, speaker anatomy, and speaking style.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.

言语是一种独特的人类行为，涉及将离散的认知，语言表达转换为言语枢纽的连续，复杂的运动。通过帮助更好地理解健康语音生产中这种转换机制的可变性和约束，该项目有助于评估与神经系统疾病（例如失用症）相关的语音障碍。此外，它为新颖的科学范围范式铺平了道路，以自动综合文本中的语音。一种对社会包容的重要性的技术。它还为学生提供了独特的跨学科培训机会，并将暴露于语音科学研究的各个方面。语音生产，分析结果和衍生模型的新型动态成像数据与更广泛的研究社区共享。该项目的重点是管理语音敏锐者向实现语音生产目标（宣传策略）运动的协调模式。开发用于表征这种可变性的工具集的目的，该工具集还将使语音表示形式映射到声带的特定于说话者的动态。该项目建立在关节语音学和任务动态的框架上，这些框架提供了一个模型，这些模型是从语言结构中产生声音动态的，在语言结构中，声带中语言相关的约束的形成受到声音的限制的形成，受到了动态系统的时间部署的时间部署：迫切动作的动力学频率​​（包括自然的临时启发）（包括定性的目标），该动态（包括敏锐的振动者）（包括定性的目标），该目标是对动态的动态。 （运动轨迹的时刻）。该模型是使用来自32位扬声器的声音实时磁共振成像数据进行更新的，以表征其语音生产行为在三个层面上：（i）说话行为中提出的声音变形； （ii）这些变形对实现语音目标的相对贡献； （iii）发音表达的发音手势的时间协调。直接观察到的个人特定于说话者的特定于特定于说话者的表征，直接观察到使用最先进的声音图像成像技术，这极大地有助于我们理解什么基于语音构成的理解以及通过语音上下文，说话者解剖学和语言风格驱动个人可变性的原因，这些奖项通过NSF的法定宣传和宽广的影响，反映了NSF的范围。 标准。

项目成果

Effect of vocal tract morphology on tongue shaping for American English /ɹ/

声道形态对美式英语 /É1/ 舌形的影响

• DOI: 10.1121/10.0008076
• 发表时间: 2021
• 期刊: The Journal of the Acoustical Society of America
• 作者: Lu, Yijing;Hsu, Haley;Goldstein, Louis;Toutios, Asterios
• 通讯作者: Toutios, Asterios

How an aglossic speaker produces an alveolar-like percept without a functional tongue tip.

无舌说话者如何在没有功能性舌尖的情况下产生类似齿槽的感知。

• DOI: 10.1121/10.0001329
• 发表时间: 2020
• 期刊: The Journal of the Acoustical Society of America
• 作者: Toutios,Asterios;Xu,Melissa;Byrd,Dani;Goldstein,Louis;Narayanan,Shrikanth
• 通讯作者: Narayanan,Shrikanth

Characteristics of articulatory gestures in stuttered speech: A case study using real-time magnetic resonance imaging

口吃言语中的发音姿势特征：基于实时磁共振成像的案例研究

• DOI: 10.1016/j.jcomdis.2022.106213
• 发表时间: 2022
• 期刊: Journal of Communication Disorders
• 影响因子: 1.7
• 作者: Lu, Yijing;Wiltshire, Charlotte E.E.;Watkins, Kate E.;Chiew, Mark;Goldstein, Louis
• 通讯作者: Goldstein, Louis

Effect of individual vocal tract geometry on the tongue shaping for American English /ɹ/.

个体声道几何形状对美式英语 /É1/ 舌头形状的影响。

• 发表时间: 0223
• 期刊: Proceedings of the 20th International Congress of Phonetic Sciences (ICPhS
• 作者: Lu, Y.

Modeling speaker-specific vocal tract kinematics from gestural scores

根据手势分数对特定说话者的声道运动学进行建模

• DOI: 10.1121/10.0008077
• 发表时间: 2021
• 期刊: The Journal of the Acoustical Society of America
• 作者: Lu, Yijing;Ly, Justin;Narayanan, Shrikanth;Goldstein, Louis;Toutios, Asterios
• 通讯作者: Toutios, Asterios