HRI: The Robotic Musician - Facilitating Novel Musical Experiences and Outcomes through Human Robot Interaction

HRI：机器人音乐家 - 通过人机交互促进新颖的音乐体验和成果

• 批准号: 0713269
• 负责人: Gil Weinberg
• 金额: $ 44.91万
• 依托单位: Georgia Tech Research Corporation
• 依托单位国家: 美国
• 项目类别: Standard Grant
• 财政年份: 2007
• 资助国家: 美国
• 起止时间: 2007-10-01 至 2011-09-30
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=0713269&HistoricalAwards=false
• 关键词: HRI; Robotic; Musician; Facilitating; Novel

The objective of this project is to develop a robotic musician that will create meaningful and inspiring musical interactions with humans, leading to novel musical experiences and outcomes. The robot will combine computational modeling of music perception, interaction, and improvisation, with the capacity to produce melodic and harmonic acoustic responses in physical and visual manners. The PI's underlying hypothesis is that real-time collaboration between humans and computer-based players can capitalize on the combination of their unique strengths to produce new and compelling music. The project, therefore, aims to combine human creativity, emotion, and aesthetic judgment with the algorithmic computational capability of computers. The PI believes that a perceptual and improvisatory robot will best facilitate such interactions by bringing the computer into the physical world both acoustically and visually. Unlike computer- and speaker-based interactive music systems, a physical anthropomorphic robot will create familiar, acoustically rich, and visual interactions with humans. In order to create intuitive as well as inspiring social collaboration with people, the robot will analyze live music based on computational models of human perception, and will generate algorithmic responses that are humanly impossible. Building on and extending the PI's previous work on a perceptual robotic drummer that was primarily focused on rhythm, this project will develop a robot that can listen to, analyze, and play melodic and harmonic music as well. It will use a four-arm mechanism to play the marimba (a melodic mallet-based instrument), and infer musical meaning from live input based on a set of cognitive models of musical percepts such as melodic attraction, tension, and similarity. Based on this analysis, the robot will generate musical responses informed by mathematical constructs such as fractals, cellular automata and genetic algorithms. The interaction schemes to be developed for the robot will include synchronous and sequential operations, and will address aspects such as beat tracking and style adaptation. Project outcomes will include fundamental contributions to music perception and cognition, human-robotic interaction, computer assisted collaboration, and improvisation. Broader Impacts: Building on the engaging power of music, this project will help bring the exciting potential of HRI to the attention of the general public through workshops and high visibility concerts, which will be designed in particular to capture the interest and imagination of students who are not regularly drawn to music, mathematics, engineering, and the sciences. Within the HRI research community, project outcomes relating to sound perception, and to the integration of human expression, emotion, and aesthetics with robotic analytical and mechanical capabilities, will help researchers develop productive human-robot collaborations in a variety of non-musical domains. The PI expects the project will also play a pivotal role for the research center in music technology that he has initiated at Georgia Tech.

该项目的目的是开发一个机器人音乐家，该音乐家将与人类创造有意义而鼓舞人心的音乐互动，从而带来新颖的音乐体验和成果。 机器人将结合音乐感知，相互作用和即兴创作的计算建模，并在物理和视觉方式中产生旋律和谐波声音响应的能力。 PI的基本假设是，人类和基于计算机的玩家之间的实时合作可以利用其独特的优势结合，以制作新的和引人入胜的音乐。 因此，该项目旨在将人类的创造力，情感和审美判断与计算机的算法计算能力相结合。 PI认为，感知和即兴的机器人将通过听觉和视觉上将计算机带入物理世界，最好地促进这种相互作用。 与基于计算机和扬声器的交互式音乐系统不同，物理拟人化机器人将与人类创造熟悉，富有声学和视觉互动。 为了建立直觉并激发与人的社交合作，机器人将根据人类感知的计算模型分析现场音乐，并会产生算法响应，这些响应是人类不可能的。 该项目将基于PI的先前作品，主要是集中于节奏的知觉机器人鼓手，该项目将开发一个机器人，该机器人也可以聆听，分析和播放旋律和和声音乐。 它将使用四臂机制播放Marimba（一种基于旋律的槌槌乐器），并根据一组音乐知觉的认知模型从现场输入中推断出音乐含义，例如旋律吸引力，紧张和相似性。 基于此分析，机器人将产生由分形，细胞自动机和遗传算法等数学构造所告知的音乐响应。 为机器人开发的相互作用方案将包括同步操作和顺序操作，并将解决诸如节拍跟踪和样式适应之类的方面。 项目成果将包括对音乐感知和认知，人类 - 动物互动，计算机辅助协作和即兴创作的基本贡献。更广泛的影响：建立音乐的引人入胜的力量，该项目将通过研讨会和高知名度音乐会的注意，将HRI的激动人心的潜力引起公众的注意，这些音乐会将特别是为了吸引不经常吸引音乐，数学，工程学和科学的学生的兴趣和想象力。 在HRI研究界，与声音感知有关的项目成果，以及人类表达，情感和美学与机器人分析和机械能力的整合，将有助于研究人员在各种非音乐领域中发展生产性的人类机器人协作。 PI预计该项目还将为他在佐治亚理工学院发起的音乐技术研究中心发挥关键作用。