How, What and Who in Human Communication: Movement of Face and Voice

人类交流中的方式、内容和人物：面部和声音的运动

• 批准号: LX0455820
• 负责人: Prof Denis Burnham
• 金额: $ 1.69万
• 依托单位: Western Sydney University
• 依托单位国家: 澳大利亚
• 项目类别: Linkage - International
• 财政年份: 2004
• 资助国家: 澳大利亚
• 起止时间: 2004-09-23 至 2006-06-30
• 项目状态: 已结题
• 来源: https://dataportal.arc.gov.au/RGS/Web/Grants/LX0455820
• 关键词: How; What; Who; Human; Communication

The aim of this project is to identify the essential characteristics of tone, affect, and identity from face and voice using a combination of signal processing, biological, and behavioural techniques in order to develop a comprehensive model of auditory-visual speech processing and communication. This research will significantly improve understanding of the basis of auditory-visual perception and production in tonal languages and in affective communication, facilitate links between neurophysiological processes and auditory-visual speech processing; and contribute to applications in automatic person recognition, automatic speech recognition, text-to-speech systems, and talking head aids for the hearing impaired.

该项目的目的是使用信号处理，生物学和行为技术的结合来确定面部和声音的基本特征，以开发出听觉 - 视觉语音处理和交流的全面模型。这项研究将显着提高对听觉视觉感知和色调语言和情感交流的生产的理解，从而有助于神经生理过程与听觉 - 视觉言语处理之间的联系；并为自动识别，自动语音识别，文本到语音系统以及听力障碍的通话头部辅助工作做出贡献。