Research on singing rendering systems design based on an active auditory perception model

基于主动听觉感知模型的歌唱渲染系统设计研究

基本信息

批准号：
14380165
负责人：
KAWAHARA Hideki
金额：
$ 9.15万
依托单位：
Wakayama University
依托单位国家：
日本
项目类别：
Grant-in-Aid for Scientific Research (B)
财政年份：
2002
资助国家：
日本
起止时间：
2002 至 2004
项目状态：
已结题

项目摘要

The goal of this project is to investigate the source of reason why vocal music is attractive even without lyrics. This general goal was broken down to several sub-goal which consists of new research tool development and winning prize as the best artificial singing system at international contests. These goals were fulfilled even though the success introduced more questions than the answered questions. Firstly, the piece of chorus with artificially manipulated synthesized voices (that is an excerpt of a composition made by Toru Takemitsu titled "small sky") won the first prize among four synthetic singing systems at RENCON'04, the satellite event of the international conference on computer based entertainment systems (NIME'04) held in Shizuoka in 2004. The piece was made using a STRAIGHT based singing synthesis program. Secondly, the singing synthesis system is based on the auditory morphing algorithm invented for this research project. The morphing algorithm made a substantial impact … More on speech perception and music perception research and the algorithm is currently used in many research institutes worldwide. Thirdly, a new algorithm called "senza vibrato" was developed to made it possible to morph vibrato that is an essential ingredient of singing voice, and at the same time, is an obstacle that made morphing of singing voice very difficult. Fourthly, important experiences were obtained by performing actual investigations based on the "systematic downgrading strategy" that was proposed to characterize the current research project. Those accomplishments were reported at various international/domestic conferences and scientific journals. Those publications and the new research tools based on STRAIGHT made a research trend that is characterized by ecological views on auditory and speech perception. In conclusion, the project was a great success. However, it is important to note that even with all the accomplishments in this project, there still remains a huge gap between synthetic singers and human singers. There is a huge room for investigations to bridge this gap. The prospective research project may need to put attentions on methods for generalization from relatively small number of instances, because, based on experiences in this research project, it is generally impractical to provide sufficient number of singing voice instances to function the "systematic downgrading strategy" in its full extent. Less

该项目的目的是调查即使没有歌词的人声音乐也很有吸引力的原因。这个一般目标被分解为几个子目标，其中包括新的研究工具开发和获奖奖，作为国际比赛中最佳人工唱歌系统。即使成功提出的问题比回答的问题更多的问题也实现了这些目标。 Firstly, the piece of chorus with artificially manipulated synthesized Voices (that is an excerpt of a composition made by Toru Takemitsu titled "small sky") won the first prize among four synthetic singing systems at RENCON'04, the satellite event of the international conference on computer based entertainment systems (NIME'04) held in Shimaoka in 2004. The piece was made using a STRAIGHT based singing synthesis program.其次，唱歌合成系统基于该研究项目发明的听觉变形算法。这种变形算法产生了重大影响……更多地对语音感知和音乐感知研究和算法进行了更多影响，目前在全球许多研究机构中使用了算法。第三，开发了一种称为“ Senza Vibrato”的新算法是为了使颤音成为演唱声音的重要组成部分，与此同时，这是一个障碍，使演唱声音的变形非常困难。第四，通过基于“系统降级策略”进行实际调查来获得重要的经验，该研究提出了当前研究项目的特征。这些成就是在各种国际/国内会议和科学期刊上报告的。这些出版物和基于直系的新研究工具使研究趋势以对听觉和语音感知的生态观点为特征。总之，该项目取得了巨大的成功。但是，重要的是要注意，即使有了这个项目中的所有成就，合成歌手和人类歌手之间仍然存在巨大差距。有一个巨大的投资空间来弥合这一差距。前瞻性研究项目可能需要注意相对少数实例的概括方法，因为根据该研究项目的经验，提供足够数量的歌声实例以全面运行“系统性降级策略”通常是不切实际的。较少的