Meredith Ringel Morris
Anqi Huang
Andreas Paepcke
Terry Winograd
ABSTRACT
Multi-user, touch-sensing input devices create opportunities for the use of cooperative gestures -- multi-user gestural interactions for single display groupware. Cooperative gestures are interactions where the system interprets the gestures of more than one user as contributing to a single, combined command. Cooperative gestures can be used to enhance users' sense of teamwork, increase awareness of important system events, facilitate reachability and access control on large, shared displays, or add a unique touch to an entertainment-oriented activity. This paper discusses motivating scenarios for the use of cooperative gesturing and describes some initial experiences with CollabDraw, a system for collaborative art and photo manipulation. We identify design issues relevant to cooperative gesturing interfaces, and present a preliminary design framework. We conclude by identifying directions for future research on cooperative gesturing interaction techniques.
- Baudel, T. and Beaudoin-Lafon, M. Charade: Remote Control of Objects Using Free-Hand Gestures. Communications of the ACM. 36(7), 28--35. Google Scholar
Digital Library
- Baudisch, P., Cutrell, E., Robbins, D., Czerwinski, M., Tandler, P., Bederson, B., and Zierlinger, A. Drag-and-Pop and Drag-and-Pick: Techniques for Accessing Remote Screen Content on Touch- and Pen-operated Systems. Interact 2003.Google Scholar
- Bratman, M. 1999. Faces of Intention. Cambridge, MA: Cambridge University Press.Google Scholar
- Buxton, W. Chunking and Phrasing and the Design of Human-Computer Dialogues. IFIP Conference, 1986, 475--480.Google Scholar
- Cappelletti, A., Gelmini, G., Pianesi, F., Rossi, F., and Zancanaro, M. Enforcing Cooperative Storytelling: First Studies. ICALT 2004. Google ScholarDigital Library
- Dietz, P. and Leigh, D. DiamondTouch: A Multi-User Touch Technology. UIST 2001, 219--226. Google ScholarDigital Library
- Everitt, K., Shen, C., Ryall, K., and Forlines, F. Modal Spaces: Spatial Multiplexing to Mediate Direct-Touch Input on Large Displays. CHI 2005 Extended Abstracts, 1359--1362. Google ScholarDigital Library
- GeiBler, J. Shuffle, throw, or take it! Working Efficiently with an Interactive Wall. CHI 1998 Extended Abstracts, 265--266. Google ScholarDigital Library
- Grossman, T., Wigdor, D., and Balakrishnan, R. Multi-Finger Gestural Interaction with 3D Volumetric Displays. UIST 2004. Google ScholarDigital Library
- Guimbretiere, F., Stone, M., and Winograd, T. Fluid Interaction with High-Resolution Wall-Size Displays. UIST 2001, 21--30. Google ScholarDigital Library
- Guiard, Y. Asymmetric division of labor in human skilled bimanual action: the kinematic chain as a model. Journal of Motor Behaviour. 19 (4), 1987, 486--517.Google ScholarCross Ref
- Hall, E.T. The Hidden Dimension. New York: Anchor Books, 1966.Google Scholar
- Hinckley, K. Synchronous Gestures for Multiple Persons and Computers. UIST 2003, 149--158. Google ScholarDigital Library
- Hinckley, K., Ramos, G., Guimbretiere, F., Baudisch, P., and Smith, M. Stitching: Pen Gestures that Span Multiple Displays. AVI 2004, 23--31. Google ScholarDigital Library
- Holmquist, L., Mattern, F., Schiele, B., Alahuhta, P., Beigl, M., and Gellersen, H. Smart-Its Friends: A Technique for Users to Easily Establish Connections between Smart Artefacts. UbiComp 2001, 116--122. Google ScholarDigital Library
- Joyce, W.B. On the Free-Rider Problem in Cooperative Learning. Journal of Educational Business. 74(5), 271--274, May-June 1999.Google ScholarCross Ref
- Krueger, M.W., Gionfriddo, T., and Hinrichsen, K. VIDEOPLACE - An Artificial Reality. CHI 1985, 35--40. Google ScholarDigital Library
- Malik, S., Ranjan, A., Balakrishnan, R. Interacting with Large Displays from a Distance with Vision-Tracked Multi-Finger Gestural Input. UIST 2005, 43--52. Google ScholarDigital Library
- Maynes-Aminzade, D., Pausch, R., and Seitz, S. Techniques for Interactive Audience Participation. ICMI 2002, 15 -- 20. Google ScholarDigital Library
- McCullagh, P. and Nelder, J.A. Generalized Linear Models. Chapman and Hall, 2nd edition, 1989.Google Scholar
- Morris, M.R., Ryall, K., Shen, C., Forlines, C., and Vernier, F. Beyond ""Social Protocols"": Multi-User Coordination Polices for Co-located Groupware. CSCW 2004, 262--265. Google ScholarDigital Library
- Oka, K., Sato, Y., and Koike, H. Real-time tracking of multiple fingertips and gesture recognition for augmented desk interface systems. IEEE International Conference on Automatic Face and Gesture Recognition, 2002, 429--434. Google ScholarDigital Library
- Piper, A.M., O'Brien, E., Morris, M.R., and Winograd, T. SIDES: A Collaborative Tabletop Computer Game for Social Skills Development. Stanford Univ. Technical Report, 2005.Google Scholar
- Rekimoto, J. SmartSkin: An Infrastructure for Freehand Manipulation on Interactive Surfaces. CHI 2002, 113--120. Google ScholarDigital Library
- Rekimoto, J. SyncTap: Synchronous User Operation for Spontaneous Network Connection. Personal and Ubiquitous Computing, 8(2), May 2004, 126--134. Google ScholarDigital Library
- Reynolds, M., Schoner, B., Richards, J., Dobson, K., and Gershenfeld, N. An Immersive, Multi-User, Musical Stage Environment. SIGGRAPH 2001, 553--560. Google ScholarDigital Library
- Ringel, M., Ryall, K., Shen, C., Forlines, C., and Vernier, F. Release, Relocate, Reorient, Resize: Fluid Techniques for Document Sharing on Multi-User Interactive Tables. CHI 2004 Extended Abstracts, 1441--1444. Google ScholarDigital Library
- Ringel, M., Berg, H., Jin, Y. and Winograd, T. Barehands: Implement-Free Interaction with a Wall-Mounted Display. CHI 2001 Extended Abstracts, 367--368. Google ScholarDigital Library
- Rogers, Y. and Lindley, S. Collaborating Around Large Interactive Displays: Which Way is Best to Meet? Interacting with Computers, 2004.Google Scholar
- Ryall, K., Esenther, A., Everitt, K., Forlines, C., Morris, M.R., Shen, C., Shipman, S. and Vernier, F. iDwidgets: Parameterizing Widgets by User Identity. Interact 2005. Google ScholarDigital Library
- Searle, J.R. Collective intentions and actions. In P. R. Cohen, J. Morgan, and M. E. Pollack, editors, Intentions in Communication, chapter 19, pages 401--416. MIT Press, Camridge, MA, 1990.Google Scholar
- Scott, S.D., Carpendale, M.S.T., and Inkpen, K. Territoriality in Collaborative Tabletop Workspaces. CSCW 2004, 294--303. Google ScholarDigital Library
- Shen, C., Vernier, F., Forlines, C., and Ringel, M. DiamondSpin: An Extensible Toolkit for Around-the-Table Interaction. CHI 2004, 167--174. Google ScholarDigital Library
- Stewart, J., Bederson, B., and Druin, A. Single Display Groupware: A Model for Co-present Collaboration. CHI 1999. Google ScholarDigital Library
- Taxén, G., Hellström, S.-O., Tobiasson, H., Back, M., and Bowers, J. The Well of Inventions -- Learning, Interaction and Participatory Design in Museum Installations. ICHIM 2003.Google Scholar
- Ulyate, R. and Bianciardi, D. The Interactive Dance Club: Avoiding Chaos in a Multi Participant Environment. CHI 2001 Workshop on New Interfaces for Musical Expression. Google ScholarDigital Library
- Vogel, D. and Balakrishnan, R. Interactive Public Ambient Displays: Transitioning from Implicit to Explicit, Public to Personal, Interaction with Multiple Users. UIST 2004. Google ScholarDigital Library
- Wellner, P. Interacting with Paper on the DigitalDesk. Communications of the ACM, 36(7), 1993, 87--96. Google ScholarDigital Library
- Wolf, C. and Rhyne, J. Gesturing with Shared Drawing Tools. CHI 1993 Extended Abstracts, 137--138. Google ScholarDigital Library
- Wu, M. and Balakrishnan, R. Multi-Finger and Whole Hand Gestural Interaction Techniques for Multi-User Tabletop Displays. UIST 2003, 193--202. Google ScholarDigital Library
- Wu, M., Shen, C., Ryall, K., Forlines, C., and Balakrishnan, R. Gesture Registration, Relaxation, and Reuse for Multi-Point Direct-Touch Surfaces. IEEE Tabletop 2006, 183--190. Google ScholarDigital Library
Index Terms
- Cooperative gestures: multi-user gestural interactions for co-located groupware
Recommendations
Mediating Group Dynamics through Tabletop Interface Design
A Stanford University research group explores how design alternatives for tabletop interfaces can impact group dynamics to promote effective teamwork. They built and evaluated a series of novel prototypes that explore Multi-User Coordination Policies ...
TeamTag: exploring centralized versus replicated controls for co-located tabletop groupware
CHI '06: Proceedings of the SIGCHI Conference on Human Factors in Computing SystemsWe explore how the placement of control widgets (such as menus) affects collaboration and usability for co-located tabletop groupware applications. We evaluated two design alternatives: a centralized set of controls shared by all users, and separate per-...
Issues of designing gestures into online interactions: implications for communicating in virtual environments
SIGDOC '07: Proceedings of the 25th annual ACM international conference on Design of communicationThis paper describes the use and design of gestures for online virtual environment interactions. Virtual Environments (VEs), are three dimensional virtual worlds that combine sound, text, and gestures in computer-mediated communication (CMC) processes. ...
Comments