RI: Small: Speaker-Specific Articulatory Strategies
RI:小:特定于说话者的发音策略
基本信息
- 批准号:1908865
- 负责人:
- 金额:$ 47.4万
- 依托单位:
- 依托单位国家:美国
- 项目类别:Continuing Grant
- 财政年份:2019
- 资助国家:美国
- 起止时间:2019-08-01 至 2023-07-31
- 项目状态:已结题
- 来源:
- 关键词:
项目摘要
Speech is a uniquely human act that involves the conversion of discrete cognitive, linguistic representations to continuous, complex movements of speech articulators. By helping to understand better the variability and constraints of this conversion mechanism in healthy speech production, this project contributes to assessing speech disorders associated with neurological disease, such as apraxia. Moreover, it paves the way for novel science-driven paradigms to automatic synthesis of speech from text; a technology of increasing importance for social inclusion. It also provides a unique interdisciplinary training opportunity for students, integrating exposure to various facets of speech science research. Novel dynamic imaging data of speech production, analysis results, and derived models are shared with the broader research community.The focus of this project is on the coordinative patterns governing the movement of speech articulators toward the achievement of speech production goals (articulatory strategies). The aim to develop a toolset for characterizing this variability, that will also enable mapping phonological representations to speaker-specific dynamics of the vocal tract. The project builds upon the frameworks of Articulatory Phonology and Task Dynamics that provide a model for generating vocal-tract dynamics from linguistic structures, in which the formation of linguistically relevant constrictions in the vocal tract is governed by the temporal deployment of dynamical systems: critically damped oscillators that are characterized temporally by parameters including targets (end goals of articulatory movements) and natural frequencies (time-course of the movement trajectories). This model is updated using vocal-tract real-time magnetic resonance imaging data from 32 speakers, in order to characterize their speech production behavior at three levels: (i) the vocal-tract deformations put forth in the act of speaking; (ii) the relative contributions of those deformations towards the achievement of phonological goals; and (iii) the temporal coordination of articulatory gestures for the production of well-formed utterances. Such characterizations of individual, speaker-specific articulatory strategies, as directly observed using state-of-the-art vocal-tract imaging technology, significantly contributes to our understanding of what underlies phonological constancy and what drives individual variability via phonetic context, speaker anatomy, and speaking style.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
言语是一种独特的人类行为,涉及将离散的认知,语言表达转换为言语枢纽的连续,复杂的运动。通过帮助更好地理解健康语音生产中这种转换机制的可变性和约束,该项目有助于评估与神经系统疾病(例如失用症)相关的语音障碍。此外,它为新颖的科学范围范式铺平了道路,以自动综合文本中的语音。一种对社会包容的重要性的技术。它还为学生提供了独特的跨学科培训机会,并将暴露于语音科学研究的各个方面。语音生产,分析结果和衍生模型的新型动态成像数据与更广泛的研究社区共享。该项目的重点是管理语音敏锐者向实现语音生产目标(宣传策略)运动的协调模式。开发用于表征这种可变性的工具集的目的,该工具集还将使语音表示形式映射到声带的特定于说话者的动态。该项目建立在关节语音学和任务动态的框架上,这些框架提供了一个模型,这些模型是从语言结构中产生声音动态的,在语言结构中,声带中语言相关的约束的形成受到声音的限制的形成,受到了动态系统的时间部署的时间部署:迫切动作的动力学频率(包括自然的临时启发)(包括定性的目标),该动态(包括敏锐的振动者)(包括定性的目标),该目标是对动态的动态。 (运动轨迹的时刻)。该模型是使用来自32位扬声器的声音实时磁共振成像数据进行更新的,以表征其语音生产行为在三个层面上:(i)说话行为中提出的声音变形; (ii)这些变形对实现语音目标的相对贡献; (iii)发音表达的发音手势的时间协调。直接观察到的个人特定于说话者的特定于特定于说话者的表征,直接观察到使用最先进的声音图像成像技术,这极大地有助于我们理解什么基于语音构成的理解以及通过语音上下文,说话者解剖学和语言风格驱动个人可变性的原因,这些奖项通过NSF的法定宣传和宽广的影响,反映了NSF的范围。 标准。
项目成果
期刊论文数量(7)
专著数量(0)
科研奖励数量(0)
会议论文数量(0)
专利数量(0)
Effect of vocal tract morphology on tongue shaping for American English /ɹ/
声道形态对美式英语 /É1/ 舌形的影响
- DOI:10.1121/10.0008076
- 发表时间:2021
- 期刊:
- 影响因子:0
- 作者:Lu, Yijing;Hsu, Haley;Goldstein, Louis;Toutios, Asterios
- 通讯作者:Toutios, Asterios
How an aglossic speaker produces an alveolar-like percept without a functional tongue tip.
无舌说话者如何在没有功能性舌尖的情况下产生类似齿槽的感知。
- DOI:10.1121/10.0001329
- 发表时间:2020
- 期刊:
- 影响因子:0
- 作者:Toutios,Asterios;Xu,Melissa;Byrd,Dani;Goldstein,Louis;Narayanan,Shrikanth
- 通讯作者:Narayanan,Shrikanth
Effect of individual vocal tract geometry on the tongue shaping for American English /ɹ/.
个体声道几何形状对美式英语 /É1/ 舌头形状的影响。
- DOI:
- 发表时间:0223
- 期刊:
- 影响因子:0
- 作者:Lu, Y.
- 通讯作者:Lu, Y.
Characteristics of articulatory gestures in stuttered speech: A case study using real-time magnetic resonance imaging
口吃言语中的发音姿势特征:基于实时磁共振成像的案例研究
- DOI:10.1016/j.jcomdis.2022.106213
- 发表时间:2022
- 期刊:
- 影响因子:1.7
- 作者:Lu, Yijing;Wiltshire, Charlotte E.E.;Watkins, Kate E.;Chiew, Mark;Goldstein, Louis
- 通讯作者:Goldstein, Louis
Modeling speaker-specific vocal tract kinematics from gestural scores
根据手势分数对特定说话者的声道运动学进行建模
- DOI:10.1121/10.0008077
- 发表时间:2021
- 期刊:
- 影响因子:0
- 作者:Lu, Yijing;Ly, Justin;Narayanan, Shrikanth;Goldstein, Louis;Toutios, Asterios
- 通讯作者:Toutios, Asterios
共 7 条
- 1
- 2
Shrikanth Narayanan其他文献
Clinical note section classification on doctor-patient conversations in low-resourced settings
资源匮乏地区医患对话的临床记录部分分类
- DOI:10.18653/v1/2023.nlpmc-1.110.18653/v1/2023.nlpmc-1.1
- 发表时间:20232023
- 期刊:
- 影响因子:0
- 作者:Zhuohao Chen;Jangwon Kim;Yang Liu;Shrikanth NarayananZhuohao Chen;Jangwon Kim;Yang Liu;Shrikanth Narayanan
- 通讯作者:Shrikanth NarayananShrikanth Narayanan
Latent acoustic topic models for unstructured audio classification
用于非结构化音频分类的潜在声学主题模型
- DOI:10.1017/atsip.2012.710.1017/atsip.2012.7
- 发表时间:20122012
- 期刊:
- 影响因子:3.2
- 作者:Samuel Kim;P. Georgiou;Shrikanth NarayananSamuel Kim;P. Georgiou;Shrikanth Narayanan
- 通讯作者:Shrikanth NarayananShrikanth Narayanan
Seeing speech: Capturing vocal tract shaping using real-time magnetic resonance imaging [Exploratory
看到语音:使用实时磁共振成像捕捉声道形状 [探索性
- DOI:
- 发表时间:20082008
- 期刊:
- 影响因子:0
- 作者:E. Bresch;Yoon;Krishna Nayak;Dani Byrd;Shrikanth NarayananE. Bresch;Yoon;Krishna Nayak;Dani Byrd;Shrikanth Narayanan
- 通讯作者:Shrikanth NarayananShrikanth Narayanan
HARMONIZE THIS MELODY: AUTOMATIC FOUR-PART HARMONY GENERATION USING NEO-RIEMANNIAN VOICE-LEADING
和谐此旋律:使用新黎曼语音主导自动生成四声部和声
- DOI:
- 发表时间:20212021
- 期刊:
- 影响因子:0
- 作者:Timothy Greer;Shrikanth NarayananTimothy Greer;Shrikanth Narayanan
- 通讯作者:Shrikanth NarayananShrikanth Narayanan
Cross-Lingual Features for Alzheimer’s Dementia Detection from Speech
通过语音检测阿尔茨海默病的跨语言特征
- DOI:10.21437/interspeech.2023-193410.21437/interspeech.2023-1934
- 发表时间:20232023
- 期刊:
- 影响因子:4.8
- 作者:Thomas Melistas;Lefteris Kapelonis;Nikos Antoniou;Petros Mitseas;Dimitris Sgouropoulos;Theodoros Giannakopoulos;Athanasios Katsamanis;Shrikanth NarayananThomas Melistas;Lefteris Kapelonis;Nikos Antoniou;Petros Mitseas;Dimitris Sgouropoulos;Theodoros Giannakopoulos;Athanasios Katsamanis;Shrikanth Narayanan
- 通讯作者:Shrikanth NarayananShrikanth Narayanan
共 9 条
- 1
- 2
Shrikanth Narayana...的其他基金
RI Core: Medium: Structured variability in vocal tract articulation dynamics in speech
RI 核心:中:言语中声道发音动态的结构变异
- 批准号:23116762311676
- 财政年份:2023
- 资助金额:$ 47.4万$ 47.4万
- 项目类别:Standard GrantStandard Grant
RI: Medium: Collaborative Research: Understanding Individual-Level Speech Variability: From Novel Articulatory Data to Robust Speaker Recognition
RI:媒介:协作研究:了解个体层面的语音变异性:从新颖的发音数据到强大的说话人识别
- 批准号:15145441514544
- 财政年份:2015
- 资助金额:$ 47.4万$ 47.4万
- 项目类别:Continuing GrantContinuing Grant
Be a Scientist!
成为一名科学家!
- 批准号:10083721008372
- 财政年份:2010
- 资助金额:$ 47.4万$ 47.4万
- 项目类别:Continuing GrantContinuing Grant
Collaborative Research: Computational Behavioral Science: Modeling, Analysis, and Visualization of Social and Communicative Behavior
合作研究:计算行为科学:社交和交流行为的建模、分析和可视化
- 批准号:10293731029373
- 财政年份:2010
- 资助金额:$ 47.4万$ 47.4万
- 项目类别:Continuing GrantContinuing Grant
RI: Large: An Integrated Approach to Creating Context Enriched Speech Translation Systems
RI:大型:创建上下文丰富的语音翻译系统的集成方法
- 批准号:09110090911009
- 财政年份:2009
- 资助金额:$ 47.4万$ 47.4万
- 项目类别:Continuing GrantContinuing Grant
SGER: Exploring Emotional Vocal Productions Through the Use of Real-Time Magnetic Resonance Imaging
SGER:通过使用实时磁共振成像探索情感声音作品
- 批准号:08442430844243
- 财政年份:2008
- 资助金额:$ 47.4万$ 47.4万
- 项目类别:Standard GrantStandard Grant
Collaborative Research: Modeling Creative and Emotive Improvisation in Theater Performance
合作研究:模拟戏剧表演中的创意和情感即兴创作
- 批准号:07574140757414
- 财政年份:2008
- 资助金额:$ 47.4万$ 47.4万
- 项目类别:Standard GrantStandard Grant
CAREER: Modeling and Optimizing User-Centric Mixed-Initiative Spoken Dialog Systems
职业:建模和优化以用户为中心的混合主动语音对话系统
- 批准号:02385140238514
- 财政年份:2003
- 资助金额:$ 47.4万$ 47.4万
- 项目类别:Continuing GrantContinuing Grant
IERI: Collaborative Research: Automating Early Assessment of Academic Standards for Very Young Native and Non-Native Speakers of American English
IERI:合作研究:对美国英语为母语和非母语的幼儿进行学术标准早期评估自动化
- 批准号:03262280326228
- 财政年份:2003
- 资助金额:$ 47.4万$ 47.4万
- 项目类别:Standard GrantStandard Grant
ITR: A User-centric Content-based Approach to Indexing, Query and Retrieval of Music through Signal Processing and Knowledge-based Methods
ITR:一种以用户为中心、基于内容的方法,通过信号处理和基于知识的方法对音乐进行索引、查询和检索
- 批准号:02199120219912
- 财政年份:2002
- 资助金额:$ 47.4万$ 47.4万
- 项目类别:Continuing GrantContinuing Grant
相似国自然基金
靶向Treg-FOXP3小分子抑制剂的筛选及其在肺癌免疫治疗中的作用和机制研究
- 批准号:32370966
- 批准年份:2023
- 资助金额:50 万元
- 项目类别:面上项目
化学小分子激活YAP诱导染色质可塑性促进心脏祖细胞重编程的表观遗传机制研究
- 批准号:82304478
- 批准年份:2023
- 资助金额:30 万元
- 项目类别:青年科学基金项目
靶向小胶质细胞的仿生甘草酸纳米颗粒构建及作用机制研究:脓毒症相关性脑病的治疗新策略
- 批准号:82302422
- 批准年份:2023
- 资助金额:30 万元
- 项目类别:青年科学基金项目
HMGB1/TLR4/Cathepsin B途径介导的小胶质细胞焦亡在新生大鼠缺氧缺血脑病中的作用与机制
- 批准号:82371712
- 批准年份:2023
- 资助金额:49 万元
- 项目类别:面上项目
小分子无半胱氨酸蛋白调控生防真菌杀虫活性的作用与机理
- 批准号:32372613
- 批准年份:2023
- 资助金额:50 万元
- 项目类别:面上项目
相似海外基金
Powering Small Craft with a Novel Ammonia Engine
用新型氨发动机为小型船只提供动力
- 批准号:1009989610099896
- 财政年份:2024
- 资助金额:$ 47.4万$ 47.4万
- 项目类别:Collaborative R&DCollaborative R&D
"Small performances": investigating the typographic punches of John Baskerville (1707-75) through heritage science and practice-based research
“小型表演”:通过遗产科学和基于实践的研究调查约翰·巴斯克维尔(1707-75)的印刷拳头
- 批准号:AH/X011747/1AH/X011747/1
- 财政年份:2024
- 资助金额:$ 47.4万$ 47.4万
- 项目类别:Research GrantResearch Grant
人工知能に基づく非線形高次元小標本データ解析とその社会的応用
基于人工智能的非线性高维小样本数据分析及其社会应用
- 批准号:24K1484724K14847
- 财政年份:2024
- 资助金额:$ 47.4万$ 47.4万
- 项目类别:Grant-in-Aid for Scientific Research (C)Grant-in-Aid for Scientific Research (C)
Fragment to small molecule hit discovery targeting Mycobacterium tuberculosis FtsZ
针对结核分枝杆菌 FtsZ 的小分子片段发现
- 批准号:MR/Z503757/1MR/Z503757/1
- 财政年份:2024
- 资助金额:$ 47.4万$ 47.4万
- 项目类别:Research GrantResearch Grant
Bacteriophage control of host cell DNA transactions by small ORF proteins
噬菌体通过小 ORF 蛋白控制宿主细胞 DNA 交易
- 批准号:BB/Y004426/1BB/Y004426/1
- 财政年份:2024
- 资助金额:$ 47.4万$ 47.4万
- 项目类别:Research GrantResearch Grant