Automatic detection and modelling of acoustic markers of speech timing

语音计时声学标记的自动检测和建模

• 批准号: DP230101184
• 负责人: Prof Julien Epps
• 金额: $ 29.2万
• 依托单位: The University of New South Wales
• 依托单位国家: 澳大利亚
• 项目类别: Discovery Projects
• 财政年份: 2023
• 资助国家: 澳大利亚
• 起止时间: 2023-01-01 至 2025-12-31
• 项目状态: 未结题
• 来源: https://dataportal.arc.gov.au/RGS/Web/Grants/DP230101184
• 关键词: Automatic; detection; modelling; acoustic; markers

This project aims to create new automatic sensing, analysis and assessment of cognitive, affective, mental and physical state from voice for mobile and computing devices. This project expects to generate new understanding of the effects of these states on detailed timing indicators of speech motor control, and new signal processing and machine learning methods that best exploit it. Expected outcomes from this project include a new and accurate deep neural network framework for learning, analysing and detecting human states from speech automatically using articulatory timing markers. This should provide significant benefits, such as individually-tailored, frequent and low-cost automatic detection, monitoring and analytics for adverse states.

该项目旨在通过移动和计算设备的语音创建新的自动感知、分析和评估认知、情感、精神和身体状态。该项目期望对这些状态对语音运动控制的详细时序指标的影响产生新的理解，以及最好地利用它的新信号处理和机器学习方法。该项目的预期成果包括一个新的、准确的深度神经网络框架，用于使用发音计时标记自动从语音中学习、分析和检测人类状态。这应该会带来显着的好处，例如针对不良状态进行个性化定制、频繁且低成本的自动检测、监控和分析。