Collaborative Research: Prosodic Analysis and Visualization of Phonetic Samples for Improved Understanding of Stress and Intonation

合作研究：语音样本的韵律分析和可视化，以提高对重音和语调的理解

基本信息

批准号：
2109654
负责人：
Min Chen
金额：
$ 14.04万
依托单位：
University of Washington
依托单位国家：
美国
项目类别：
Standard Grant
财政年份：
2021
资助国家：
美国
起止时间：
2021-09-01 至 2025-02-28
项目状态：
未结题

来源：
https://www.nsf.gov/awardsearch/showAward?AWD_ID=2109654&HistoricalAwards=false
关键词：
Collaborative Research Prosodic Analysis Visualization

项目摘要

Rhythm and intonation are important part of pronunciation. While there are some basic similarities in rhythm and intonation patterns across languages, there are also interesting differences. Some of these differences are linked to the way words are structured in languages, for example, are the words short or are they composed of many sub-parts. This project investigates and documents the rhythm and intonation, or prosodic system, of under-documented languages to better understand how humans modulate pitch movement (i.e. intonation) and segmental duration (i.e. the length of vowels and consonants). The project uses archived and new recordings to arrive at acoustic measurements and visualizations of pitch and duration, creating a database that can be mined for the study of the interplay of prosody and other domains such as the syllable, word, foot, prosodic word, prosodic phrase, and intonation unit. The project includes training for graduate students and undergraduate students from Aaniiih Nakoda College.The investigators mine archived recordings or new recordings of words, phrases and connected speech produced by native speakers to improve and understand the prosodic system of the morphologically complex languages for analysis. They represent their findings through the software in development by the team for this purpose. A major product of this project is a database with phonetic analyses across different prosodic domains, e.g, the syllable or word. These materials will be made available through an online webservice and will be useful for researchers working to analyze and represent other languages with significant modulations of pitch and duration. The software includes a self-pronunciation check feature allowing the user to listen, repeat, and check accuracy in reproducing the pitch and duration values of native speakers. This feature will be used to understand how well such overt input impacts second language pronunciation acquisition.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.

节奏和语调是发音的重要组成部分。尽管语言之间的节奏和语调模式存在一些基本的相似之处，但也存在有趣的差异。其中一些差异与单词以语言结构的方式相关，例如，单词短，或者是由许多子部分组成的。该项目调查并记录了不含文献的语言的节奏和语调或韵律系统，以更好地了解人类如何调节音高运动（即语调）和分段持续时间（即元音和辅音的长度）。该项目使用存档和新记录来得出音调和持续时间的声学测量和可视化，创建一个数据库，可以挖掘出韵律相互作用和其他领域的相互作用，例如syllable，word，word，foot，pootodic word，prosodic word，prosodic word，prosodic prosodic sprase和intonation单位。该项目包括对纳科达学院（Aaniiih Nakoda）学院的研究生和本科生的培训。为此，他们通过团队开发的软件代表他们的发现。该项目的主要产品是一个数据库，该数据库具有跨不同韵律域的语音分析，例如音节或单词。这些材料将通过在线Web服务提供，对于研究人员分析和代表具有重要调节时间和持续时间的其他语言的研究人员将有用。该软件包括一个自我引起的检查功能，允许用户聆听，重复和检查准确性，以重现母语者的音调和持续时间值。此功能将用于了解这种公开输入对第二语言发音的影响如何对习得进行了如何影响。该奖项反映了NSF的法定任务，并使用基金会的知识分子优点和更广泛的影响审查标准，被认为值得通过评估来获得支持。

项目成果

期刊论文数量（2）

专著数量（0）

科研奖励数量（0）

会议论文数量（0）

专利数量（0）

Reproducibility Companion Paper: MeTILDA - Platform for Melodic Transcription in Language Documentation and Application

再现性配套论文：MeTILDA - 语言文档和应用中的旋律转录平台

DOI：
10.1145/3591106.3592277
发表时间：
2023
期刊：
Proceedings of the 2023 ACM International Conference on Multimedia Retrieval
影响因子：
0
作者：
Lee, Mitchell;Lee, Chris;Penmetsa, Sanjay;Chen, Min;Miyashita, Mizuki;Fish, Naatosi;Wu, Bo;Khan, Omar
通讯作者：
Khan, Omar

Audio Classifier for Endangered Language Analysis and Education

用于濒危语言分析和教育的音频分类器