Anna Xambó
Eva Hornecker
Paul Marshall
Skip Abstract Section
Skip Supplemental Material SectionAbstract
There has been little research on how interactions with tabletop and Tangible User Interfaces (TUIs) by groups of users change over time. In this article, we investigate the challenges and opportunities of a tabletop tangible interface based on constructive building blocks. We describe a long-term lab study of groups of expert musicians improvising with the Reactable, a commercial tabletop TUI for music performance. We examine interaction, focusing on interface, tangible, musical, and social phenomena. Our findings reveal a practice-based learning between peers in situated contexts, and new forms of participation, all of which is facilitated by the Reactable's tangible interface, if compared to traditional musical ensembles. We summarise our findings as a set of design considerations and conclude that construction processes on interactive tabletops support learning by doing and peer learning, which can inform constructivist approaches to learning with technology.
Supplemental Material
Available for Download
zip
xambo.zip (145 MB)
Supplemental movie, appendix, image and software files for, Let's jam the reactable: Peer learning during musical improvisation with a tabletop tangible interface
- D. Bailey. 1993. Improvisation: Its Nature And Practice In Music. Da Capo Press, New York.Google Scholar
- T. Blaine and S. Fels. 2003. Contexts of collaborative musical experiences. In Proceedings of the 2003 Conference on New Interfaces for Musical Expression (NIME’03). McGill University, Montreal, 129--134. Google ScholarDigital Library
- G. Booth and M. Gurevich. 2012. Collaborative composition and socially constituted instruments: Ensemble laptop performance through the lens of ethnography. In Proceedings of the International Conference on New Interfaces for Musical Expression (NIME’12). University of Michigan, Ann Arbor, 61--65.Google Scholar
- A. Brown. 2006. Code jamming. M/C Journal. 9, 6. Retrieved April 11, 2012 from http://journal.media-culture.org.au/0612/03-brown.php.Google ScholarCross Ref
- N. Bryan-Kinns. 2013. Mutual engagement and collocation with shared representations. Int. J. Hum-Comput. St. 71, 1, 76--90. Google ScholarDigital Library
- J. Cage. 1961. Silence: Lectures and Writings. Wesleyan University Press, Middletown, CT.Google Scholar
- X. Cao, S. E. Lindley, J. Helmes, and A. Sellen. 2010. Telling the whole story: Anticipation, inspiration and reputation in a field deployment of TellTable. In Proceedings of the 2010 ACM conference on Computer Supported Cooperative Work (CSCW’10). ACM, New York, 251--260. Google ScholarDigital Library
- W. Day. 2010. The ends of improvisation. J. Aesthet. Art Critic. 68, 3, 291--296.Google Scholar
- P. Dillenbourg and M. Evans. 2011. Interactive tabletops in education. Comp. S. Coll. Learn. 6, 4, 491--514.Google ScholarCross Ref
- S. Do-Lenh, F. Kaplan, and P. Dillenbourg. 2009. Paper-based concept map: The effects of tabletop on an expressive collaborative learning task. In Proceedings of the 23rd British HCI Group Annual Conference on People and Computers: Celebrating People and Technology (BCS-HCI’09). ACM, New York, 149--158. Google ScholarDigital Library
- R. Fencott and N. Bryan-Kinns. 2010. Hey man, you’re invading my personal space! Privacy and awareness in collaborative music. In Proceedings of the 2010 Conference on New Interfaces for Musical Expression (NIME’10). University of Technology, Sydney, 198--203.Google Scholar
- D. R. Forsyth. 2006. Group Dynamics. Wadsworth, Belmont.Google Scholar
- F. Fröbel. 1887. The Education of Man. D. Appleton and company, New York.Google Scholar
- J. Grudin. 1994. Groupware and social dynamics: Eight challenges for developers. In Readings in Human Computer Interaction: Toward the Year 2000 (2nd. ed.), R. Baecker, J. Grudin, W. Buxton, and S. Greenberg, Eds., Morgan-Kaufmann Los Altos, CA, 762--774. Google ScholarDigital Library
- A. Harris, J. Rick, V. Bonnett, N. Yuill, R. Fleck, P. Marshall, and Y. Rogers. 2009. Around the table: Are multiple-touch surfaces better than single-touch for children's collaborative interactions? In Proceedings of the 9th International Conference on Computer Supported Collaborative Learning (CSCL’09). International Society of the Learning Sciences, Rhodes, 335--344. Google ScholarDigital Library
- P. G. T. Healey, J. Leach, and N. Bryan-Kinns. 2005. Inter-play: Understanding group music improvisation as a form of everyday interaction. In Proceedings of the 1st International Forum on Less is More—Simple Computing in an Age of Complexity. Microsoft Research, Cambridge.Google Scholar
- S. E. Higgins, E. Mercier, E. Burd, and A. Hatch. 2011. Multi-touch tables and the relationship with collaborative classroom pedagogies: A synthetic review. Com. S. Coll. Learn. 6, 4, 515--538.Google ScholarCross Ref
- U. Hinrichs and S. Carpendale. 2011. Gestures in the wild: Studying multi-touch gesture sequences on interactive tabletop exhibits. In Proceedings of the 2011 Annual Conference on Human Factors in Computing Systems (CHI’11). ACM, New York, 3023--3032. Google ScholarDigital Library
- M. Horn, Z. Atrash Leong, F. Block, J. Diamond, E. M. Evans, B. Phillips, and C. Shen. 2012. Of BATs and APEs: An interactive tabletop game for natural history museums. In Proceedings of the 2012 ACM Annual Conference on Human Factors in Computing Systems (CHI’12). ACM, New York, 2059--2068. Google ScholarDigital Library
- M. S. Horn, E. T. Solovey, and R. J. K. Jacob. 2008. Tangible programming and informal science learning: Making TUIs work for museums. In Proceedings of the Interaction Design and Children Conference (IDC’08). ACM Press, 194--201. Google ScholarDigital Library
- E. Hornecker. 2008. “I don't understand it either, but it is cool”: Visitor interactions with a multi-touch table in a museum. In Proceedings of the 3rd IEEE International Workshop on Horizontal Interactive Human-Computer Systems (TABLETOP’08). IEEE Computer Society, 121--128.Google Scholar
- E. Hornecker, P. Marshall, S. Dalton, and Y. Rogers. 2008. Collaboration and interference: Awareness with mice or touch input. In Proceedings of the 2008 ACM Conference on Computer Supported Cooperative Work (CSCW’08). ACM, New York, 167--176. Google ScholarDigital Library
- H. Ishii, D. Lakatos, L. Bonanni, and J.-B. Labrune. 2012. Radical atoms: Beyond tangible bits, toward transformable materials. Interactions. 19, 1, 38--51. Google ScholarDigital Library
- A. R. Jensenius, M. M. Wanderley, R. I. Godøy, and M. Leman. 2010. Musical gestures: Concepts and methods in research. In Musical gestures: Sound, Movement, and Meaning, R. I. Godøy and M. Leman, Eds., Routledge, New York, 12--35.Google Scholar
- S. Jordà. 2004. Digital instruments and players: Part II--diversity, freedom and control. In Proceedings of the International Computer Music Conference (ICMC’04). Miami, 706--710.Google Scholar
- S. Jordà. 2005. Multi-user instruments: Models, examples and promises. In Proceedings of the 2005 Conference on New Interfaces for Musical Expression (NIME’05). University of British Columbia, Vancouver, 23--26. Google ScholarDigital Library
- S. Jordà. 2008. On stage: The reactable and other musical tangibles go real. Int. J. Art. Tech. 1, 3/4, 268--287.Google Scholar
- B. Jordan and A. Henderson. 1995. Interaction analysis: Foundations and practice. J. Learn. Sci. 4, 1, 39--103.Google ScholarCross Ref
- M. Kaltenbrunner, G. Geiger, and S. Jordà. 2004. Dynamic patches for live musical performance. In Proceedings of the 2004 Conference on New Interfaces for Musical Expression (NIME’04). National University of Singapore, Singapore, 19--22. Google ScholarDigital Library
- S. Kawase. 2009. An exploratory study of gazing behavior during live performance. In Proceedings of the 7th Triennial Conference of European Society for the Cognitive Sciences of Music (ESCOM’09). University of Jyväskylä, Jyväskylä, 227--232.Google Scholar
- P. E. Keller. 2008. Joint action in music performance. In Enacting Intersubjectivity: A Cognitive and Social Perspective on the Study of Interactions, F. Morganti, A. Carassa, and G. Riva, Eds., IOS Press, Amsterdam, 205--221.Google Scholar
- R. Laney, C. Dobbyn, A. Xambó, M. Schirosa, D. Miell, K. Littleton, and N. Dalton. 2010. Issues and techniques for collaborative music making on multi-touch surfaces. In Proceedings of the 7th Sound and Music Computing Conference (SMC’10). Universitat Pompeu Fabra, Barcelona, 146--153.Google Scholar
- J. Lave and E. Wenger. 1991. Situated Learning: Legitimate Peripheral Participation. Cambridge University Press, Cambridge.Google ScholarCross Ref
- P. Manuel. 1998. Improvisation in Latin Dance Music: History and style. In In the Course of Performance: Studies in the World of Musical Improvisation, B. Nettl and M. Russell, Eds., University of Chicago Press, Chicago, 219--236.Google Scholar
- P. Marshall, R. Fleck, A. Harris, J. Rick, E. Hornecker, Y. Rogers, N. Yuill, and N. S. Dalton. 2009. Fighting for control: Children's embodied interactions when using physical and digital representations. In Proceedings of the 27th International Conference on Human Factors in Computing Systems (CHI’09). ACM, New York, 2149--2152. Google ScholarDigital Library
- P. Marshall, R. Morris, Y. Rogers, S. Kreitmayer, and M. Davies. 2011. Rethinking “multi-user”: An in-the-wild study of how groups approach a walk-up-and-use tabletop interface. In Proceedings of the 2011 Annual Conference on Human Factors in Computing Systems (CHI’11). ACM, New York, 3033--3042. Google ScholarDigital Library
- M. McCaleb. 2011. Embodied knowledge in ensemble performance: The case of informed observation. In Proceedings of the Conference on Performance Studies (PERFORMA’11). University of Aveiro, Aveiro.Google Scholar
- J. McCartney. 2002. Rethinking the computer music language: SuperCollider. Comput. Music J. 26, 4, 61--68. Google ScholarDigital Library
- D. Merrill, J. Kalanithi, and P. Maes. 2007. Siftables: Towards sensor network user interfaces. In Proceedings of the First International Conference on Tangible and Embedded Interaction (TEI’07). ACM, New York, 75--78. Google ScholarDigital Library
- I. T. Monson. 1996. Saying Something: Jazz Improvisation and Interaction. University of Chicago Press, Chicago.Google Scholar
- M. Montessori. 1912. The Montessori Method. Frederick A. Stokes Company, New York.Google Scholar
- R. Moog. 1965. Voltage-controlled electronic music modules. J. Audio Eng. Soc. 13, 200--206.Google Scholar
- M. R. Morris, K. Ryall, C. Shen, C. Forlines, and F. Vernier. 2004. Beyond “social protocols”: Multi-user coordination policies for co-located groupware. In Proceedings of the 2004 ACM Conference on Computer Supported Cooperative Work (CSCW’04). ACM, New York, 262--265. Google ScholarDigital Library
- B. Nardi, A. Kuchinsky, S. Whittaker, R. Leichner, and H. Schwarz. 1995. Video-as-data: Technical and social aspects of a collaborative multimedia application. Comp. Support. Coop. W. 4, 1, 73--100. Google ScholarDigital Library
- B. Nettl. 1986. Improvisation. In The New Harvard Dictionary of Music, D. M. Randel, Ed., Harvard University Press, Cambridge, MA, 392--394.Google Scholar
- B. Nettl and M. Russell. 1998. In the Course of Performance: Studies in the World of Musical Improvisation. University of Chicago Press, Chicago.Google Scholar
- H. Newton-Dunn, H. Nakano, and J. Gibson. 2003. Block Jam: A tangible interface for interactive music. In Proceedings of the 2003 Conference on New Interfaces for Musical Expression (NIME’03). McGill University, Montreal, 170--177. Google ScholarDigital Library
- I. C. Olson, Z. A. Leong, and M. S. Horn. 2011. “It's just a toolbar!” Using tangibles to help children manage conflict around a multi-touch tabletop. In Proceedings of the Tangible, Embedded, and Embodied Interaction Conference (TEI’11). ACM, New York, 29--36. Google ScholarDigital Library
- S. Papert. 1980. Mindstorms: Children, Computers, and Powerful Ideas. Basic Books, Inc., New York. Google ScholarDigital Library
- A. M. Piper and J. D. Hollan. 2009. Tabletop displays for small group study: Affordances of paper and digital materials. In Proceedings of the 27th International Conference on Human Factors in Computing Systems (CHI’09). ACM, New York, 1227--1236. Google ScholarDigital Library
- T. Pontual Falcão and S. Price. 2011. Interfering and resolving: How tabletop interaction facilitates co-construction of argumentative knowledge. Int. J. Comp-Supp. Coll. 6, 539--559.Google Scholar
- J. Pressing. 1984. Cognitive processes in improvisation. In Cognitive Processes in the Perception of Art, W. R. Crozier and A. J. Chapman, Eds., Elsevier, Amsterdam, 345--363.Google Scholar
- J. Pressing. 1988. Improvisation: Methods and models. In Generative Processes in Music: The Psychology of Performance, Improvisation and Composition. J. A. Sloboda, Ed., Oxford University Press, London, 130--177.Google Scholar
- M. Puckette. 2002. Max at seventeen. Comput. Music J. 26, 4, 31--43. Google ScholarDigital Library
- R. Pugliese, K. Tahiroglu, C. Goddard, and J. Nesfield. 2012. Augmenting human-human interaction in mobile group improvisation. In Proceedings of the International Conference on New Interfaces for Musical Expression (NIME’12). University of Michigan, Ann Arbor, 27--30.Google Scholar
- J. Rick, P. Marshall, and N. Yuill. 2011. Beyond one-size-fits-all: How interactive tabletops support collaborative learning. In Proceedings of the 10th International Conference on Interaction Design and Children (IDC’11). ACM, New York, 109--117. Google ScholarDigital Library
- C. Roads. 1996. The Computer Music Tutorial. MIT Press, Cambridge, Massachusetts. Google ScholarDigital Library
- J. Rooksby. 2013. Wild in the laboratory: A discussion of plans and situated actions. ACM TOCHI. 20, 3, 19:1--19:17. Google ScholarDigital Library
- J. Roschelle. 1992. Learning by collaborating: Convergent conceptual change. J. Learn. Sci. 2, 3, 235-276.Google ScholarCross Ref
- R. K. Sawyer. 2003. Group Creativity: Music, Theater, Collaboration. Lawrence Erlbaum Associates, Mahwah.Google Scholar
- B. Schneider, M. Strait, L. Muller, S. Elfenbein, O. Shaer, and C. Shen. 2012. Phylo-Genie: Engaging students in collaborative “tree-thinking” through tabletop techniques. In Proceedings of the 2012 ACM Annual Conference on Human Factors in Computing Systems (CHI’12). ACM, New York, 3071--3080. Google ScholarDigital Library
- S. D. Scott and S. Carpendale. 2010. Theory of tabletop territoriality. In Tabletops—Horizontal Interactive Displays, C. Müller-Tomfelde, Ed., Springer-Verlag, London.Google Scholar
- S. D. Scott, M. S. T. Carpendale, and K. M. Inkpen. 2004. Territoriality in collaborative tabletop workspaces. In Proceedings of the 2004 ACM Conference on Computer Supported Cooperative Work (CSCW’04). ACM, New York, 294--303. Google ScholarDigital Library
- F. A. Seddon. 2005. Modes of communication during jazz improvisation. Brit. J. Music Ed. 22, 47--61.Google ScholarCross Ref
- O. Shaer and E. Hornecker. 2010. Tangible user interfaces: Past, present and future directions. Found. Trends HCI. 3, 1--2, 1--138. Google ScholarDigital Library
- O. Shaer, G. Kol, M. Strait, C. Fan, C. Grevet, and S. Elfenbein. 2010. G-nome surfer: A tabletop interface for collaborative exploration of genomic data. In Proceedings of the 28th International Conference on Human Factors in Computing Systems (CHI’10). ACM, New York, 1427--1436. Google ScholarDigital Library
- J. A. Sloboda, J. W. Davidson, M. J. A. Howe, and D. G. Moore. 1996. The role of practice in the development of performing musicians. Brit. J. Psychol. 87, 2, 287--309.Google ScholarCross Ref
- H. Sloetjes and P. Wittenburg. 2008. Annotation by category: ELAN and ISO DCR. In Proceedings of the 6th International Conference on Language Resources and Evaluation (LREC’08). 816--820.Google Scholar
- T. Speelpenning, A. N. Antle, T. Doering, and E. van den Hoven. 2011. Exploring how tangible tools enable collaboration in a multi-touch tabletop game. In Proceedings of the 13th IFIP TC 13 International Conference on Human-Computer Interaction, Volume Part II (INTERACT’11). Springer-Verlag, Berlin, 605--621. Google ScholarDigital Library
- L. Suchman. 1987. Plans and Situated Actions: The Problem of Human-Machine Communication. Cambridge University Press, Cambridge. Google ScholarDigital Library
- B. Swift. 2012. Becoming-sound: Affect and assemblage in improvisational digital music making. In Proceedings of the 2012 ACM Annual Conference on Human Factors in Computing Systems (CHI’12). ACM, New York, 1815--1824. Google ScholarDigital Library
- L. Vigotsky. 1978. Mind in Society. Harvard University Press, London.Google Scholar
- T. Viswanathan and J. Cormack. 1998. Melodic improvisation in Karnatak Music: The manifestations of Raga. In In the Course of Performance: Studies in the World of Musical Improvisation, B. Nettl and M. Russell, Eds., University of Chicago Press, Chicago, 219--236.Google Scholar
- M. M. Wanderley and B. Vines. 2006. Origins and functions of clarinettists’ ancillary gestures. In Music and Gesture, A. Gritten and E. King, Eds., Ashgate, Hampshire, 165--191.Google Scholar
- Q. Wang, A. Battocchi, I. Graziola, F. Pianesi, D. Tomasini, M. Zancanaro, and C. Nass. 2006. The role of psychological ownership and ownership markers in collaborative working environment. In Proceedings of the 8th International Conference on Multimodal Interfaces (ICMI’06). ACM, New York, 225--232. Google ScholarDigital Library
- G. Weinberg. 2005. Interconnected musical networks: Toward a theoretical framework. Comput. Music J. 29, 2, 23--39. Google ScholarDigital Library
- D. Wigdor, G. Penn, K. Ryall, A. Esenther, and C. Shen. 2007. Living with a tabletop: Analysis and observations of long term office use of a multi-touch table. In Proceedings of 2nd IEEE International Workshop on Horizontal Interactive Human-Computer Systems (TABLETOP’07). IEEE Computer Society, Newport, Rhode Island, 60--67.Google Scholar
- O. Zuckerman, S. Arida, and M. Resnick. 2005. Extending tangible interfaces for education: Digital Montessori-inspired manipulatives. In Proceedings of the 2005 Conference on Human Factors in Computing Systems (CHI’05). ACM, New York, 859--868. Google ScholarDigital Library
Index Terms
- Let's jam the reactable: Peer learning during musical improvisation with a tabletop tangible interface
Recommendations
The reactable: tangible and tabletop music performance
CHI EA '10: CHI '10 Extended Abstracts on Human Factors in Computing SystemsIn this paper we present the Reactable, a new electronic musical instrument with a simple and intuitive tabletop interface that turns music into a tangible and visual experience, enabling musicians to experiment with sound, change its structure, control ...
The reacTable: exploring the synergy between live music performance and tabletop tangible interfaces
TEI '07: Proceedings of the 1st international conference on Tangible and embedded interactionIn recent years we have seen a proliferation of musical tables. Believing that this is not just the result of a tabletop trend, in this paper we first discuss several of the reasons for which live music performance and HCI in general, and musical ...
LEGO music: learning composition with bricks
IDC '15: Proceedings of the 14th International Conference on Interaction Design and ChildrenWe present a multi-touch tabletop application that utilizes LEGO bricks as physical representations for musical notes to create a novel digital learning environment for musical composition principles. Our application makes use of the physical qualities ...
Comments