The effects of delayed auditory feedback on speech sequencing: acoustics, physiology, and computational modeling

延迟听觉反馈对语音排序的影响：声学、生理学和计算模型

基本信息

批准号：
2029245
负责人：
Jason Bohland
金额：
$ 39.34万
依托单位：
University of Pittsburgh
依托单位国家：
美国
项目类别：
Standard Grant
财政年份：
2019
资助国家：
美国
起止时间：
2019-09-01 至 2022-02-28
项目状态：
已结题

来源：
https://www.nsf.gov/awardsearch/showAward?AWD_ID=2029245&HistoricalAwards=false
关键词：
effects delayed auditory feedback speech

项目摘要

Healthy individuals continuously monitor their sound output while speaking, allowing them to perceive and correct errors quickly. When the content or timing of this auditory feedback signal is experimentally altered, most speakers rapidly modify their speech. This project will primarily address how the timing of auditory feedback impacts the speech production system and will assess individual differences in the use of auditory feedback. Results will guide development of a computational model of speech planning and production that has the potential to accelerate the design of new therapeutic approaches to developmental and acquired disorders of speech. Additional benefits to society will accrue from a series of teaching modules that will be developed that explore the role of auditory feedback in normal and disordered speech. The project team will also develop educational materials that bridge neuroscience and communication sciences and that provide formative experiences for undergraduate and K-12 students, including those from disadvantaged backgrounds and with disabilities, to attract them to future study in this area. All project materials will be made available as a public database.The investigators will use a combination of experimental and computational studies. The first research goal is to determine the role of delayed auditory feedback (DAF) on speech sequencing using multimodal experimental techniques. Acoustic data will be collected and analyzed to determine the impact of DAF on the production of non-word syllable sequences and sentences. These data will be used to assess the types of errors elicited by DAF and the relationship between these effects and responses to rapid shifts in the frequency content, rather than timing, of the feedback signal. The collected data and perceptual evaluations, obtained via a crowdsourcing platform, will enable the study of individual speaker variability. Data will also be made available as a large public database of speech under altered feedback conditions. The second research goal is to develop a computational model, informed also by kinematic measures of speech from a subset of participants, that can capture the interaction of auditory feedback with speech sequence production. The model will simulate a series of hypotheses about the interactions among speech perception and planning and production components and assess their ability to account for the patterns of errors observed in the experimental data. The model will also assess the sources of individual variation in susceptibility to the effects of DAF, as observed experimentally.

健康的人在讲话时不断监视他们的声音输出，使他们能够迅速感知并纠正错误。当实验更改此听觉反馈信号的内容或时机时，大多数扬声器会迅速修改他们的语音。该项目将主要解决听觉反馈的时间如何影响语音生产系统，并评估听觉反馈使用的个人差异。结果将指导语音计划和生产的计算模型的开发，该模型有可能加速新的治疗方法的发展和获得性疾病的语音疾病。将从一系列的教学模块中获得的其他好处，这些模块将开发出探讨听觉反馈在正常和无序言语中的作用。该项目团队还将开发教育材料，以弥合神经科学和沟通科学，并为本科生和K-12学生提供形成性的体验，包括来自处境不利的背景和残疾的学生，以吸引他们在该领域的未来学习。所有项目材料都将作为公共数据库提供。研究人员将使用实验和计算研究的组合。第一个研究目标是确定使用多模式实验技术延迟听觉反馈（DAF）在语音测序中的作用。将收集和分析声学数据，以确定DAF对非词音节序列和句子生产的影响。这些数据将用于评估DAF引起的错误类型以及这些效果与对反馈信号的频率含量快速变化的响应之间的关系。通过众包平台获得的收集的数据和感知评估将使单个说话者的可变性进行研究。在改变反馈条件下，数据还将作为大型公共语音数据库提供。第二个研究目标是开发一个计算模型，也通过一部分参与者的语音测量来实现，以捕获听觉反馈与语音序列产生的相互作用。该模型将模拟一系列关于语音感知与计划和生产组件之间相互作用的假设，并评估其计算实验数据中观察到的错误模式的能力。该模型还将评估实验观察到的对DAF影响敏感性敏感性的个体变异来源。