Links Between Production and Perception in Speech

言语产生和感知之间的联系

• 批准号: 10454146
• 负责人: Douglas H Whalen
• 金额: $ 47.66万
• 依托单位: HASKINS LABORATORIES, INC.
• 依托单位国家: 美国
• 财政年份: 1996
• 资助国家: 美国
• 起止时间: 1996-05-01 至 2023-03-31
• 项目状态: 已结题
• 来源: https://reporter.nih.gov/project-details/10454146
• 关键词: Accent; Accounting; Acoustics; Address; Adult; Affect; Age; Articulation; Articulators; Attention; Benign; Biofeedback; Categories; Characteristics; Clinical; Cognition; Communication; Disease; Electromagnetics; Foundations; Gestures; Goals; Grant; Human; Impairment; Individual; Knowledge; Language; Lead; Learning; Linguistics; Link; Lip structure; Measurement; Measures; Methods; Modeling; Modification; Monitor; Morphology; Movement; Noise; Nonlinear Dynamics; Obstruction; Outcome; Output; Perception; Persons; Population; Positioning Attribute; Posture; Production; Research; Shapes; Signal Transduction; Societies; Source; Speech; Speech Acoustics; Speech Perception; Structure; Stuttering; Systems Analysis; Techniques; Testing; Theoretical model; Tongue; Variant; Work; bird song; dynamic system; expectation; experience; experimental study; flexibility; healthy aging; indexing; innovation; kinematics; mathematical methods; mathematical model; novel; parity; relating to nervous system; remediation; repaired; sex; success; ultrasound

Project Summary/Abstract This project addresses ways in which speakers use the vocal tract to create speech (production) and listeners extract the underlying meaningful parts of the signal (perception). Speech is an essential part of human society, and great effort is put into learning to talk, speaking with others, and repairing difficulties in speech when necessary. Speech is also quite variable, and the variability is due to both structured and random factors. The structured variability provides information about, for example, the size of the speaker’s vocal tract, where the speaker comes from, and what speech segments are adjacent to the one being produced. The random variability is often seen as unhelpful, but recent work indicates that it can provide flexibility that is beneficial. In the current proposal, measurements of speech articulation and acoustics will be combined with mathematical modeling to distinguish flexibility from diminished control. Flexibility is also essential in perception, so that the wide range of speakers one encounters, with their individual speech characteristics, can still be understood. Flexibility around baseline control is important in production so that communication can be tuned to specific situations, such as speaking more clearly to someone who does not speak the language natively. The sources of variability in speech will be examined in production experiments where the tongue, lips and other articulators are measured with such approaches as ultrasound and electromagnetic articulometry, and in perception experiments, where the output of the vocal tract variability can be measured for its ability to convey a message. Mathematical methods that use nonlinear dynamics will separate the controlled and random variability present in the production signals. The results will provide a better foundation for assessing speech difficulties, such as second language accent or stuttering, and should suggest new means of remediation. In these studies, biofeedback will be used to show the speaker what their tongue is doing and what it should be doing. The topics explored—articulator movement, articulatory settings, and variability—are globally applicable to speech in any language. They are foundational issues and thus not likely to be fully understood from any one set of studies, but the current studies will considerably advance our knowledge and our ability to model that knowledge.

项目摘要/摘要 该项目介绍了说话者使用声带创建语音（制作）和听众的方式 提取信号的潜在有意义的部分（感知）。言语是人类社会的重要组成部分， 付出了巨大的努力，以学习与他人交谈，与他人交谈，并修复语音上的困难 必要的。语音也很可变，并且可变性是由于结构化和随机因素引起的。 结构化的可变性提供了有关说话者声道大小的信息，其中 演讲者来自，以及与所产生的言语段相邻的。随机变异性 通常被认为是无益的，但是最近的工作表明它可以提供有益的灵活性。在电流中 建议，语音关节和声学的测量将与数学建模相结合 控制下降的独特灵活性。灵活性在感知中也是必不可少的，因此 演讲者遇到具有个人言语特征的遇到仍然可以理解。灵活性 基线控制在生产中很重要，因此可以将沟通调整为特定情况，例如 更清楚地与不本地讲语言的人说话。可变性的来源 将在测量舌头，嘴唇和其他铰接器的生产实验中检查语音 采用超声和电磁的关节测定法和感知实验等方法 可以通过传达信息的能力来衡量声道变异性的输出。数学 使用非线性动力学的方法将分开生产中存在的受控和随机变异性 信号。结果将为评估语音难度提供更好的基础，例如第二语言 口音或口吃，应该提出新的补救手段。在这些研究中，将使用生物反馈 向演讲者展示他们的舌头在做什么以及应该做什么。探索的主题 - 定义器 运动，发音环境和可变性 - 全球适用于任何语言的语音。他们是 基本问题，因此不太可能从任何一组研究中完全理解，但是目前的研究 将大大提高我们的知识和建模知识的能力。