Stuart Reeves
Steve Benford
ABSTRACT
Interaction is increasingly a public affair, taking place in our theatres, galleries, museums, exhibitions and on the city streets. This raises a new design challenge for HCI - how should spectators experience a performer's interaction with a computer? We classify public interfaces (including examples from art, performance and exhibition design) according to the extent to which a performer's manipulations of an interface and their resulting effects are hidden, partially revealed, fully revealed or even amplified for spectators. Our taxonomy uncovers four broad design strategies: 'secretive,' where manipulations and effects are largely hidden; 'expressive,' where they tend to be revealed enabling the spectator to fully appreciate the performer's interaction; 'magical,' where effects are revealed but the manipulations that caused them are hidden; and finally 'suspenseful,' where manipulations are apparent but effects are only revealed as the spectator takes their turn.
- Agre, P. E., Changing Places, Contexts of Awareness in Computing. In Human Computer Interaction, 16 (2-4), pp. 177--192, 2001. Google Scholar
Digital Library
- Aoki, P.M., Grinter, R.E., Hurst, A., Szymanski, M.H., Thornton, J.D. and Woodruff, A. Sotto Voce: exploring the interplay of conversation and mobile audio spaces. In Proc. CHI 2002, pp. 431--438, ACM Press. Google ScholarDigital Library
- Bellotti, V., Back, M., Edwards, W.K., Grinter, R.E., Henderson, A. and Lopes, C. Making sense of sensing systems: Five questions for designers and researchers. In Proc. CHI 2002, pp. 415--422, ACM Press. Google ScholarDigital Library
- Benford, S., Flintham, M., Drozd, A., Anastasi, R., Rowland, D., Tandavanitj, N., Adams, M., Row-Farr, J., Oldroyd, A. and Sutton, J. Uncle Roy All Around You: Implicating the City in a Location-Based Performance. In Proc. Advances in Computer Entertainment (ACE 2004), ACM Press.Google Scholar
- Borchers, J. A Pattern Approach to Interaction Design. John Wiley & Sons, Inc., 2001. Google ScholarDigital Library
- Bowers, J., TONETABLE: A Multi-User, Mixed Media, Interactive Installation. In Proc. COST G-6 Conference on Digital Audio Effects (DAFX-01), 2001.Google Scholar
- Bowers, J. and Hellström, S.O., Simple interfaces to complex sound in improvised music. In Proc. CHI 2000 Extended Abstracts, pp. 125--126, ACM Press. Google ScholarDigital Library
- Davies, C. and Harrison, J. "Osmose: Towards Broadening the Aesthetics of Virtual Reality," ACM Computer Graphics: Virtual Reality, Vol. 30 (4) (1996). Google ScholarDigital Library
- Drozd, A., Bowers, J., Benford, S., Greenhalgh, C. and Fraser, M. Collaboratively Improvising Magic: An Approach to Managing Participation in an On-Line Drama. In Proc. European Conference on Computer-Supported Cooperative Work (ECSCW), pp. 159--178, Kluwer, 2001. Google ScholarDigital Library
- Fraser, M., Stanton, D., Ng, K. H., Benford, S., O'Malley, S., Bowers, J., Taxén, G., Ferris, K. and Hindmarsh, J. Assembling history: Achieving coherent experiences with diverse technologies. In Proc. of European Conference on Computer Supported Cooperative Work (ECSCW), pp. 179--198. Oulu University Press, 2003. Google ScholarDigital Library
- Gaver, W. W., Beaver, J. and Benford, S, Ambiguity as a Resource for Design. In Proc. CHI 2003, pp. 233--240, ACM Press. Google ScholarDigital Library
- Geser, H., Towards a Sociological Theory of the Mobile Phone, University of Zürich, 2001.Google Scholar
- Heath, C. and Luff, P. K. Collaboration and Control: Crisis management and multimedia technology in London Underground Line Control Rooms. In Journal of Computer Supported Cooperative Work, 1 (1-2), pp. 69--94, Kluwer, 1992.Google ScholarCross Ref
- Heath, C., Luff, P. K., vom Lehn, D., Hindmarsh, J., and Cleverly, J. Crafting participation: Designing ecologies, configuring experience. In Visual Communication, 1(1), 2002, pp. 9--34.Google ScholarCross Ref
- Koleva, B., Schnädelbach, H., Benford, S., Greenhalgh, C. Traversable interfaces between real and virtual worlds. In Proc. CHI 2000, pp. 233--240, ACM Press. Google ScholarDigital Library
- Koleva, B., Taylor, I., Benford, S., Fraser, M., Greenhalgh, C., Schnådelbach, H., Lehn, D.v., Heath, C., Row-Farr J., and Adams, M. Orchestrating a mixed reality performance. In Proc. CHI 2001, pp. 38--45, ACM Press. Google ScholarDigital Library
- Lamont, P. and Wiseman, R. Magic in Theory: An introduction to the theoretical and psychological elements of conjouring. University of Hertfordshire Press, 1999.Google Scholar
- Laurel, B., Computers as Theatre, Addison-Wesley, 1993. Google ScholarDigital Library
- vom Lehn, D., Heath, C. and Hindmarsh, J. Exhibiting interaction: Conduct and collaboration in museums and galleries. In Symbolic Interaction, 24(2), pp. 189--216.Google ScholarCross Ref
- Maynes-Aminzade, D., Pausch, R. and Seitz, S. Techniques for Interactive Audience Participation. In Proc. IEEE International Conference on Multimodal Interfaces (ICMI), 2002. Google ScholarDigital Library
- Reeves, S., Fraser. M. and Benford, S., Engaging Augmented Reality, Presentation at alt.chi2005, in Adjunct Proceedings of CHI 2005, Portland, Oregon, 2005, ACM.Google Scholar
- Rosen, C. Piano Notes: The Hidden World of the Pianist. Penguin Press, 2002.Google Scholar
- Sanneblad, J. and Holmquist, L. E. "Why is everyone inside me?!" Using Shared Displays in Mobile Computer Games. In Proc. of International Conference on Entertainment Computing (ICEC), 2004.Google ScholarCross Ref
- Schnädelbach, H., Koleva, B., Flintham, M., Fraser, M., Izadi, S., Chandler, P., Foster, M., Benford, S., Greenhalgh, C. and Rodden, T. The Augurscope: A mixed reality interface for outdoors. In Proc. CHI 2002, pp. 9--16, ACM Press. Google ScholarDigital Library
- Sheridan, J., Dix, A., Lock, S. and Bayliss, A. Understanding Interaction in Ubiquitous Guerrilla Performances in Playful Arenas. In Proc. British HCI Conference, 2004.Google Scholar
- Stewart, J., Bederson, B. and Druin, A., Single Display Groupware: a Model for Co-present Collaboration. In Proc. CHI 1999, pp. 286--293, ACM Press. Google ScholarDigital Library
- Sudnow, D., Ways of the Hand: The Organization of Improvised Conduct, Routledge & Kegan Paul, 1978.Google Scholar
- Wilson, S., Information Arts: Intersections of art, science and technology, The MIT Press, 2002.Google Scholar
- Z, P., Audible Image/Visible Sound: Donald Swearingen's Living off the List. 21st Century Music, 8 (1).Google Scholar
Index Terms
- Designing the spectator experience
Recommendations
Designing for Aesthetic Experience
C&C '21: Proceedings of the 13th Conference on Creativity and CognitionDigital ways of representing fine art are significantly changing the way art is put on display. New exhibition formats including digital projections of fine art allow us to rethink how we can use technology to create art experiences. However, ...
Creating the spectacle: Designing interactional trajectories through spectator interfaces
An ethnographic study reveals how professional artists created a spectator interface for the interactive game Day of the Figurines, designing the size, shape, height and materials of two tabletop interfaces before carefully arranging them in a local ...
see me, feel me, touch me, hear me: trajectories and interpretation in a sculpture garden
CHI '13: Proceedings of the SIGCHI Conference on Human Factors in Computing SystemsWe apply the HCI concept of trajectories to the design of a sculpture trail. We crafted a trajectory through each sculpture, combining textual and audio instructions to drive directed viewing, movement and touching while listening to accompanying music. ...
Reviews
Joe L. Podolsky
These British researchers studied the question, "How should a spectator experience a user's interaction with a computer__ __" The issue is becoming important because interactive technologies are becoming more common in cultural, artistic, and entertainment applications. They developed a taxonomy that places all interactions on a two-dimensional grid. The y-axis shows effects (hidden; partially revealed/hidden, transformed; revealed; and amplified). The x-axis shows manipulations, which contain the same range of topics as the y-axis. So, in the lower left of the grid (hidden effects, hidden manipulations), we see what is traditionally considered to be private interaction, an example being any interface located in a private booth such as [a] photo kiosk. On the top-right, we see the most public interactions in which both the effects and manipulations that caused them are revealed to the spectators. An interactive white board belongs in this area, as do many conventional examples of single display groupware (SDG) in which people collaborate openly around a shared display. The authors have given the four segments of their grid more dramatic and memorable labels. The lower left (hidden effects, hidden manipulations) is called secretive; the upper left (revealed effects, hidden manipulations) is called magical; the lower right (hidden effects, revealed manipulations) is called suspenseful; and the upper right (both effects and manipulations revealed) is called expressive. The point of all this, of course, is for performers to be conscious of the spectators' impact on the activity. Performances can be orchestrated to involve spectators in a predictable way, rather than having it happen in a haphazard manner. Orchestration is obvious in stage performances, but "orchestration may also be seen in exhibitions where docents manage visitor flow and explain concepts and technologies." The authors, "believe that designing the customer experience will become an increasingly important aspect of mainstream human computer interface as computers continue to migrate from the workspace into our everyday lives, more often appearing in our public spaces our theaters, galleries, museums, exhibitions and even the city streets."
Access critical reviews of Computing literature here
Become a reviewer for Computing Reviews.
Comments