ABSTRACT
This paper describes the implementation of a leader-follower model in a musical HRI based on beat detection analysis and a novel turn taking scheme. The project enables Haile, a robotic percussionist, to fluidly interact with humans in the context of an improvisatory jam session. The long-term goal of this work is to facilitate dynamic interactions between humans and machines that will lead to novel and inspiring musical outcomes.
- Aubio, a library for audio labeling. http://aubio.org. Accessed December 2008.Google Scholar
- Davies, Matthew and Plumbley, Mark. Context-Dependent Beat Tracking of Music and Audio. IEEE Transactions on Audio, Speech, and Language Processing, 15:3 (March 2007), 1009--1020. Google ScholarDigital Library
- Robotic Musicianship jam session - Jazz. Youtube. http://www.youtube.com/watch?v=MSxeN00C20g&feature=channelGoogle Scholar
- Robotic Musicianship jam session - Eastern. Youtube. http://www.youtube.com/watch?v=5DYOqSTmGDAGoogle Scholar
- Weinberg, Gil and Driscoll, Scott."The Interactive Robotic Percussionist: New Developments in Form, Mechanics, Perception and Interaction Design."In Proceedings of the ACM/IEEE international conference on Human-robot interaction. HRI 2007. (Arlington, VA, USA, March 10-12, 2007). ACM Press, New York, NY. 97 -- 104. http://doi.acm.org/10.1145/1228716.1228730 Google ScholarDigital Library
- Weinberg, Gil and Driscoll, Scott. Towards Robotic Musicianship. Computer Music Journal. 30:4 (Winter 2006), 28--45. Google ScholarDigital Library
- Weinberg, G. and M. Godfrey, A. Rae, J. Rhoads. A Real-Time Genetic Algorithm in Human-Robot Musical Improvisation. In Proceedings of the International Computer Music Conference. ICMC 2007. (Copenhagen, Denmark, August 27-31,2008). International Computer Music Association, San Francisco, 192--195 Google ScholarDigital Library
Index Terms
- A leader-follower turn-taking model incorporating beat detection in musical human-robot interaction
Recommendations
Sound in Human-Robot Interaction
HRI '21 Companion: Companion of the 2021 ACM/IEEE International Conference on Human-Robot InteractionRobot sound spans a wide continuum, from subtle motor hums, through music, bleeps and bloops, to human-inspired vocalizations, and can be an important means of communication for robotic agents. This first workshop on sound in HRI aims to bring together ...
Robot-human interaction with an anthropomorphic percussionist
CHI '06: Proceedings of the SIGCHI Conference on Human Factors in Computing SystemsThe paper presents our approach for human-machine interaction with an anthropomorphic mechanical percussionist that can listen to live players, analyze perceptual musical aspects in real-time, and use the product of this analysis to play along in a ...
Shimon: an interactive improvisational robotic marimba player
CHI EA '10: CHI '10 Extended Abstracts on Human Factors in Computing SystemsShimon is an autonomous marimba-playing robot designed to create interactions with human players that lead to novel musical outcomes. The robot combines music perception, interaction, and improvisation with the capacity to produce melodic and harmonic ...
Comments