ITR/IM (CSE): Musical Signal Recognition

ITR/IM (CSE)：音乐信号识别

• 批准号: 0113496
• 负责人: Christopher Raphael
• 金额: $ 37.49万
• 依托单位: University of Massachusetts Amherst
• 依托单位国家: 美国
• 项目类别: Standard Grant
• 财政年份: 2001
• 资助国家: 美国
• 起止时间: 2001-09-01 至 2004-12-31
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=0113496&HistoricalAwards=false
• 关键词: ITR; IM; CSE; Musical; Signal

The World Wide Web contains a vast and ever-growing collection of music audio files representing nearly every musical style, ensemble, genre, country, culture, and time period. However, with the exception of the information conveyed in the title, the contents of such audio files can only be understood by listening to the files. Thus searches of audio files analogous to those performed by text-based search engines are currently impossible. In this project the PI will study and implement solutions to the "Signal to Score" problem in which an audio file is transcribed into a format capturing information similar to that contained in a printed musical score. The PI's approach splits the task into two components: "Signal to Piano Roll" in which the musical signal is transcribed into a MIDI-like representation, and "Rhythmic Parsing" in which the piano roll representation is further transcribed into a musical score or equivalent representation. The goal is to allow the generation of searchable data bases that contain high level music descriptions, which could be used to algorithmically answer questions on musical content such as "Is the audio file likely to be a blues song?" or "What is the time signature of the music?"

万维网包含大量且不断增长的音乐音频文件集合，代表了几乎所有音乐风格、合奏、流派、国家、文化和时期。 然而，除了标题中传达的信息之外，此类音频文件的内容只能通过收听文件来理解。 因此，与基于文本的搜索引擎执行的搜索类似的音频文件搜索目前是不可能的。 在该项目中，PI 将研究并实施“信号到乐谱”问题的解决方案，其中音频文件被转录为捕获与打印乐谱中包含的信息类似的信息的格式。 PI 的方法将任务分为两个部分：“信号到钢琴卷帘”，其中音乐信号被转录为类似 MIDI 的表示，以及“节奏解析”，其中钢琴卷帘表示被进一步转录为乐谱或等效内容表示。 目标是允许生成包含高级音乐描述的可搜索数据库，这些数据库可用于通过算法回答有关音乐内容的问题，例如“音频文件可能是布鲁斯歌曲吗？”或“音乐的拍号是什么？”