Beacon: Exploring Physicality in Digital Performance

ABSTRACT

Live performances which involve digital technology often strive toward clear correspondences between distinct media modes, particularly those works which combine audio and video. Often, the process of creating and executing such performances involves mapping schemes which are encased within the digital system, producing content which is tightly synchronized but with relationships which can feel rigid and unexpressive. Within this paper we present a collaborative process between visualist and musician, which builds toward a method for promoting co-creativity in multimedia performance and prioritizes the performer's physical presence and interaction with digital content. Through the development of two autonomous systems, a novel physical interface and an interactive music system, we summarize our creative process of co-exploration of system capabilities, and extended periods of experimentation and exploration. From this experience, we offer an early-stage framework for approaching engaging digital audiovisual relationships in live performance settings.

References

1. Johannes Birringer. 2008. After Choreography. Performance Research 13, 1 (2008), 118--122.
2. Antonio Camurri, Gualtiero Volpe, Giovanni De Poli, and Marc Leman. 2005. Communicating Expressiveness and Affect in Multimodal Interactive Systems. IEEE Multimedia 12, 1 (2005), 43--53.
3. Nick Collins, Alex McLean, Julian Rohrhuber, and Adrian Ward. 2003. Live Coding in Laptop Performance. Organised Sound 8, 3 (2003), 321--330.
4. Steve Dixon. 2007. Digital Performance: A History of New Media in Theater, Dance, Performance Art, and Installation. MIT press.
5. Rolf Inge Godøy and Marc Leman. 2010. Musical Gestures: Sound, Movement, and Meaning. Routledge, New York.
6. Michael Gurevich and Jeffrey Trevi no. 2007. Expression and its Discontents: Toward an Ecology of Musical Creation. In Proceedings of the 7th International Conference on New Interfaces for Musical Expression. ACM, 106--111.
7. Tomie Hahn. 1996. Sensational Knowledge: Transmitting Japanese Dance and Music. Ph.D. Dissertation. Wesleyan University.
8. Alexander Refsum Jensenius, Rolf Inge Godøy, and Marcelo M Wanderley. 2005. Developing Tools for Studying Musical Gestures within the Max/MSP/Jitter Environment. In Proceedings of the International Computer Music Conference. 282--285.
9. James McCartney. 2002. Rethinking the Computer Music Language: SuperCollider. Computer Music Journal 26, 4 (2002), 61--68.
10. Carrie Noland. 2010. Agency and Embodiment. Harvard University Press.
11. John Rink, Neta Spiro, and Nicolas Gold. 2011. Motive, Gesture, and the Analysis of Performance. New Perspectives on Music and Gesture (2011), 267--292.
12. Pierre Schaeffer. 2016. Traité des Objets Musicaux. Le Seuil.
13. Federico Visi, Rodrigo Schramm, and Eduardo Miranda. 2014. Gesture in Performance with Traditional Musical Instruments and Electronics: Use of Embodied Music Cognition and Multimodal Motion Capture to Design Gestural Mapping Strategies. In Proceedings of the 2014 International Workshop on Movement and Computing. ACM, 100:100--100:105.
14. Anna Weisling. 2017. The Distaff: A Physical Interface to Facilitate Interdisciplinary Collaborative Performance. In Proceedings of the 2017 Conference on Designing Interactive Systems. ACM, 1365--1368.

Index Terms

• Applied computing

  • Arts and humanities

    • Sound and music computing

• Hardware

  • Communication hardware, interfaces and storage

    • Tactile and hand-based interfaces

      • Haptic devices