Mathematical modeling of the temporal acpects of speech based on human perceptual and cognitive mechanisms

基于人类感知和认知机制的语音时间方面的数学建模

基本信息

批准号：
16200016
负责人：
KATO Hiroaki
金额：
$ 31.62万
依托单位：
Advanced Telecommunications Research Institute International
依托单位国家：
日本
项目类别：
Grant-in-Aid for Scientific Research (A)
财政年份：
2004
资助国家：
日本
起止时间：
2004 至 2007
项目状态：
已结题

项目摘要

The purpose of this project was to find clues by which humans retrieve the temporal structure of speech, to understand their usage, and to establish a quantitative method to evaluate the temporal adequateness or naturalness of a given speech sound that can replicate the performance of human judgment. For this purpose, three fundamental investigative tasks were implemented a study at the psychophysical level, a study at the linguistic level, and the construction of an evaluation model. One distinguishing feature of this project is that it emphasized the psychophysical aspects nearly as much as the linguistic, even though its primary object was spoken language.Since a person can easily recognize fast speech, even in the case of a foreign language where the meaning is unknown, it is assumed that the processing of the temporal aspects of speech undoubtedly involve non-linguistic and therefore language-independent activities. By concentrating on such processing that is independent of a give … More n language, we developed the basic technology toward a system with small overhead for language processing as well as simple extensibility to multiple languages. The major results follow.(I) Psychophysical level : An algorithm was developed to predict temporal reference points in a given speech by replicating the function of human auditory processing. This algorithm's most important benefit is its applicability to virtually unlimited language variations since it doesn't require any linguistic knowledge.(II) Linguistic level : An empirical study levealed that factors, which affect the perception of prosodic units, vary depending on the particular language's choice of units. This finding provides practical implications concerning how much weight should be placed on prosodic factors when designing effective foreign-language training methods.(III) Modeling : By integrating auditory functions derived from investigation at the psychophysical level, a mathematical model was implemented to automatically evaluate the naturalness of the speech of the English learners. The model's performance closely approximated the subjective evaluation of a native-speaking English instructor. This result not only suggests the importance of psychophysical factors in the adequateness or naturalness evaluation of speech but it also implies potential extensibility of the proposed model to multiple languages. Less

目的是找到人类检索语音时间结构的线索，并建立一种评估给定声音的时间适当性，可以为此目的复制Humanant的表现，这是三个基本的调查任务，是由三个基本的调查任务。在心理物理级别，E评估模型的E分解是该项目的一个区别特征。假设言语的时间方面无疑涉及非语言和与语言无关的活动。语言处理和简单的扩展性，主要的结果是人类的听觉处理特定语言的单位选择在设计有效的外国语言培训方法（III）时，数学模型被迫评估英国学习者的自然性。讲师的结果是atens的成像性因素。