HRI: The Robotic Musician - Facilitating Novel Musical Experiences and Outcomes through Human Robot Interaction

HRI：机器人音乐家 - 通过人机交互促进新颖的音乐体验和成果

• 批准号: 0713269
• 负责人: Gil Weinberg
• 金额: $ 44.91万
• 依托单位: Georgia Tech Research Corporation
• 依托单位国家: 美国
• 项目类别: Standard Grant
• 财政年份: 2007
• 资助国家: 美国
• 起止时间: 2007-10-01 至 2011-09-30
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=0713269&HistoricalAwards=false
• 关键词: HRI; Robotic; Musician; Facilitating; Novel

The objective of this project is to develop a robotic musician that will create meaningful and inspiring musical interactions with humans, leading to novel musical experiences and outcomes. The robot will combine computational modeling of music perception, interaction, and improvisation, with the capacity to produce melodic and harmonic acoustic responses in physical and visual manners. The PI's underlying hypothesis is that real-time collaboration between humans and computer-based players can capitalize on the combination of their unique strengths to produce new and compelling music. The project, therefore, aims to combine human creativity, emotion, and aesthetic judgment with the algorithmic computational capability of computers. The PI believes that a perceptual and improvisatory robot will best facilitate such interactions by bringing the computer into the physical world both acoustically and visually. Unlike computer- and speaker-based interactive music systems, a physical anthropomorphic robot will create familiar, acoustically rich, and visual interactions with humans. In order to create intuitive as well as inspiring social collaboration with people, the robot will analyze live music based on computational models of human perception, and will generate algorithmic responses that are humanly impossible. Building on and extending the PI's previous work on a perceptual robotic drummer that was primarily focused on rhythm, this project will develop a robot that can listen to, analyze, and play melodic and harmonic music as well. It will use a four-arm mechanism to play the marimba (a melodic mallet-based instrument), and infer musical meaning from live input based on a set of cognitive models of musical percepts such as melodic attraction, tension, and similarity. Based on this analysis, the robot will generate musical responses informed by mathematical constructs such as fractals, cellular automata and genetic algorithms. The interaction schemes to be developed for the robot will include synchronous and sequential operations, and will address aspects such as beat tracking and style adaptation. Project outcomes will include fundamental contributions to music perception and cognition, human-robotic interaction, computer assisted collaboration, and improvisation. Broader Impacts: Building on the engaging power of music, this project will help bring the exciting potential of HRI to the attention of the general public through workshops and high visibility concerts, which will be designed in particular to capture the interest and imagination of students who are not regularly drawn to music, mathematics, engineering, and the sciences. Within the HRI research community, project outcomes relating to sound perception, and to the integration of human expression, emotion, and aesthetics with robotic analytical and mechanical capabilities, will help researchers develop productive human-robot collaborations in a variety of non-musical domains. The PI expects the project will also play a pivotal role for the research center in music technology that he has initiated at Georgia Tech.

该项目的目标是开发一种机器人音乐家，它将与人类创造有意义且鼓舞人心的音乐互动，从而带来新颖的音乐体验和成果。 该机器人将结合音乐感知、交互和即兴创作的计算模型，并能够以物理和视觉方式产生旋律和和声响应。 PI 的基本假设是，人类和计算机演奏者之间的实时协作可以利用他们独特的优势组合来创作新的、引人注目的音乐。 因此，该项目旨在将人类的创造力、情感和审美判断与计算机的算法计算能力结合起来。 PI 认为，感知和即兴机器人将通过将计算机在听觉和视觉上带入物理世界，最好地促进这种交互。 与基于计算机和扬声器的交互式音乐系统不同，物理拟人机器人将与人类创建熟悉的、丰富的声音和视觉交互。 为了与人们建立直观且鼓舞人心的社交协作，机器人将根据人类感知的计算模型分析现场音乐，并生成人类不可能的算法响应。 该项目以 PI 之前关于感知机器人鼓手（主要关注节奏）的工作为基础并进行扩展，将开发一种能够聆听、分析和演奏旋律与和声音乐的机器人。 它将使用四臂机构来演奏马林巴琴（一种基于旋律木槌的乐器），并根据一组音乐感知的认知模型（例如旋律吸引力、张力和相似性）从实时输入中推断音乐含义。 基于此分析，机器人将根据分形、元胞自动机和遗传算法等数学结构产生音乐反应。 为机器人开发的交互方案将包括同步和顺序操作，并将解决节拍跟踪和风格适应等方面的问题。 项目成果将包括对音乐感知和认知、人机交互、计算机辅助协作和即兴创作的基本贡献。更广泛的影响：以音乐的吸引力为基础，该项目将通过研讨会和高知名度的音乐会，帮助将 HRI 的令人兴奋的潜力吸引到公众的注意力，这些活动将专门为吸引学生的兴趣和想象力而设计。不经常被音乐、数学、工程和科学所吸引。 在 HRI 研究社区内，与声音感知以及人类表达、情感和美学与机器人分析和机械能力的整合相关的项目成果将帮助研究人员在各种非音乐领域发展富有成效的人机协作。 PI 预计该项目也将为他在佐治亚理工学院发起的音乐技术研究中心发挥关键作用。