Links Between Production and Perception in Speech

言语产生和感知之间的联系

• 批准号: 7844217
• 负责人: Douglas H Whalen
• 金额: $ 1.19万
• 依托单位: HASKINS LABORATORIES, INC.
• 依托单位国家: 美国
• 财政年份: 2009
• 资助国家: 美国
• 起止时间: 2009-06-01 至 2010-09-30
• 项目状态: 已结题
• 来源: https://reporter.nih.gov/project-details/7844217
• 关键词: Accounting; Acoustics; American; Articulators; Autistic Disorder; Behavioral; Brain; Code; Communication; Computer Simulation; Development; Disease; Face; Feeling; Female; Fire - disasters; Gestures; Goals; Grant; Hearing; Human; Individual; Jaw; Joints; Language; Language Development; Language Disorders; Linguistics; Link; Lip structure; Maps; Measurement; Modeling; Modification; Monkeys; Noise; Optics; Output; Parkinson Disease; Pattern; Perception; Phase; Phonetics; Process; Production; Research; Research Personnel; Role; Scheme; Shapes; Signal Transduction; Source; Specific qualifier value; Speech; Speech Perception; Stimulus; System; Testing; Time; To specify; Ultrasonography; Variant; Visual; Voice; Work; base; male; mirror neuron; research study; social; speech recognition; theories; tool

Project Summary: Our long-term goal is to understand how humans organize their brains and vocal tracts so that they can speak; only through understanding normal function can we see what happens with disorders. Although it is uncontroversial that most of the speech we hear is produced by a human vocal tract, it is less accepted that speech production and speech perception are intricately linked. Many theorists hold that the vocal tract's acoustic output is dealt with in a purely acoustic manner and that the link would be seen in modifications of the vocal tract shape to achieve particular acoustics. An alternative approach holds that speech consists of gestures (the coordinated activity of articulators), such as the jaw and the lips, achieving a phonetic goal, such as lip closure. The gestural model has allowed an insightful interpretation of many speech production phenomena, and the models have begun to have testable predictions for perceptual theories as well. The proposed experiments expand on this research, showing how perception of gestures is possible in automatic speech recognition, how the consequences of articulation¿acoustic, visual and even haptic¿are used by perceivers, and how accommodations are made for differences between speakers. This theoretical outlook has been fruitfully applied to problems in language acquisition, language change, and certain language disabilities. The advances from the proposed research should allow even broader applications. The goal is to show how acoustic parameters that cohere because of their origin in articulation are used by listeners. This will be accomplished by acoustical modeling of natural productions, perception of natural speech under modified circumstances (e.g., impaired by noise or enhanced by feeling the articulators saying what is being heard), and measurement of speech with ultrasound and optical markers. These measurements provide a basis for input to our configurable articulatory synthesizer, which can match the size and acoustic output of individual speakers. Stimuli generated from this synthesizer can test hypotheses about what is important in the production patterns we see. The results of these experiments will show more clearly than ever the tight link between production and perception of speech. Relevance: Speech is the primary means most humans use to communicate and maintain social relationships, but it is vulnerable to a range of disorders. We have to understand how it is that speech works normally so we can know what to do when things go wrong. Research along the lines in the present project has already contributed to other grants dealing with such disorders as Parkinson's disease and autism.

项目摘要：我们的长期目标是了解人类如何组织自己的大脑和声音 道，以便他们可以说话；只有通过理解正常功能，我们才能看到会发生什么 疾病。尽管我们听到的大多数演讲都是由人类的声音产生的，但毫无争议 区域，言语产生和语音感知与之复杂相连并不是那么接受。许多理论家 认为声带的声学输出是以纯粹的声学方式处理的，链接将是 在人声形状的修改中可以看到特定的声学。另一种方法是 该讲话由手势（倾角的协调活动）组成，例如下巴和嘴唇， 实现语音目标，例如嘴唇闭合。手势模型允许对 许多语音生产现象，模型已经开始对 感知理论。拟议的实验扩展了这项研究，表明了对 在自动语音识别中，手势是可能的，表达的后果如何 甚至是触觉。 演讲者。这种理论前景已被有效地应用于语言获取的问题，语言 改变和某些语言障碍。拟议研究的进步甚至应该允许 更广泛的应用。目的是展示由于其起源而共同的声学参数 听众使用发音。这将通过自然生产的声学建模来实现 在经过修改的情况下对自然语音的感知（例如，噪声受损或通过感觉增强 插座者说的是听到的），以及用超声和光学的语音测量 标记。这些测量为我们的可配置的关节合成器提供了基础， 可以匹配单个扬声器的大小和声音输出。该合成器产生的刺激可以 测试假设关于我们看到的生产模式中重要的内容。这些实验的结果 将比以往任何时候都更清楚地显示出生产与言语感知之间的紧密联系。 相关性：言语是大多数人类用来交流和维持社会的主要方式 关系，但很容易受到一系列疾病的影响。我们必须了解演讲的工作方式 通常，我们可以知道出现问题时该怎么办。沿本项目的研究 已经为处理帕金森氏病和自闭症等疾病的其他赠款做出了贡献。