Can you see me now?

Abstract

We present a study of a mobile mixed reality game called Can You See Me Now? in which online players are chased through a virtual model of a city by ‘runners’ (professional performers equipped with GPS and WiFi technologies) who have to run through the actual city streets in order to catch the players. We present an ethnographic study of the game as it toured through two different cities and draws upon video recordings of online players, runners, technical support crew, and also on system logs of text communication. Our study reveals the diverse ways in which online players experienced the uncertainties inherent in GPS and WiFi, including being mostly unaware of them, but sometimes seeing them as problems, or treating the as a designed feature of the game, and even occasionally exploiting them within gameplay. In contrast, the runners and technical crew were fully aware of these uncertainties and continually battled against them through an ongoing and distributed process of orchestration. As a result, we encourage designers to deal with such uncertainties as a fundamental characteristic of location-based experiences rather than treating them as exceptions or bugs that might be ironed out in the future. We argue that designers should explicitly consider four potential states of being of a mobile participant: connected and tracked, connected but not tracked, tracked but not connected, and neither connected nor tracked. We then introduce five strategies that might be used to deal with uncertainty in these different states for different kinds of participant: remove it, hide it, manage it, reveal it, and exploit it. Finally, we present proposals for new orchestration interfaces that reveal the ‘seams’ in the underlying technical infrastructure by visualizing the recent performance of GPS and WiFi and predicting the likely future performance of GPS.

References

1. Antifakos, S., Schwaninger, A., and Schiele, B. 2004. Evaluating the effects of displaying uncertainty in context-aware applications. In Proceedings of the 6th International Conference on Ubiquitous Computing, Nottingham, UK, September, Springer-Verlag, 54--69.]]
2. Bellotti, V., Back, M., Edwards, W., Grinter, R., Lopes, C., and Henderson, A. 2002. Making sense of sensing systems: Five questions for designers and researchers. In Proceedings of the 2002 CHI Conference on Human Factors in Computing Systems, Minneapolis, Minnesota, April, ACM Press, 415--422.]]
3. Benford, S., Anastasi, R., Flintham, M., Drozd, A., Crabtree, A., Greenhalgh, C., Tandavanitj, N., Adams, M., and Row-Farr, J. 2003. Coping with uncertainty in a location-based game. In IEEE Pervasive Computing 2, 3, 34--41.]]
4. Benford, S., Rowland, D., Flintham, M., Hull, R., Reid, J., Morrison, J., Facer, K., and Clayton, B. 2004a. Designing a location-based game simulating lion behaviour. Paper presen- ted at the Proceedings of the ACM SIGCHI Conference on Advanced Computer Entertainment 2004, Singapore, June, ACM Press. http://www.nestafuturelab.org/research/draft/05draft01.htm.]]
5. Benford, S., Seagar, W., Flintham, M., Anastasi, R., Rowland, D., Humble, J., Stanton, D., Bowers, J., Tandavanitj, N., Adams, M., Row-Farr, J., Oldroyd, A., and Sutton, J. 2004b. The error of our ways: The experience of self-reported position in a location-based game. In Proceedings of the 6th International Conference on Ubiquitous Computing, Nottingham, UK, September, Springer-Verlag, 70--87.]]
6. Björk, S., Falk, J., Hansson, R., and Ljungstrand, P. 2001. Pirates!---using the physical world as a game board. Paper presented at the Proceedings of IFIP TC. 13 Conference on Human-Computer Interaction, Tokyo, Japan, July, International Federation for Information Processing, http://play.tii.se/publications/2001/piratesshort.pdf]]
7. Chalmers, M. and Galani, A. 2004. Seamful interweaving: Heterogeneity in the theory and design of interactive systems. In Proceedings of the 2004 ACM Symposium on Designing Interactive Systems, August, Cambridge, Massachusetts, ACM Press, 243--252.]]
8. Chalmers, M., Dieberger, A., HöÖk, K., and Rudström, Å. 2004. Social navigation and seamful design. In Cognitive Studies: Bulletin of the Japanese Cognitive Science Society, vol. 11, 3, 171--181.]]
9. Cheverst, K., Davies, N., Mitchell, K., Friday, A., and Efstratiou, C. 2000. Developing a context-aware electronic tourist guide: Some issues and experiences. In Proceedings of the 2000 CHI Conference on Human Factors in Computing Systems, The Hague, Netherlands, April, ACM Press, 17--24.]]
10. Crabtree, A. 2003. Designing Collaborative Systems: A Practical Guide to Ethnography. Springer-Verlag, London.]]
11. Crabtree, A. 2004. Design in the absence of practice: Breaching experiments. In Proceedings of the 2004 ACM Symposium on Designing Interactive Systems, Cambridge, Massachusetts, August, ACM Press, 59--68.]]
12. Crabtree, A., Benford, S., Rodden, T., Greenhalgh, C., Flintham, M., Anastasi, R., Drozd, A., Adams, M., Row-Farr, J., Tandavanitj, N., and Steed, A. 2004. Orchestrating a mixed reality game ‘on the ground’. In Proceedings of the 2004 CHI Conference on Human Factors in Computing Systems, Vienna, Austria, April, ACM Press, 391--398.]]
13. Dey, A. K., Mankoff, J., Abowd, G., and Carter, S. 2002. Distributed mediation of ambiguous context in aware environments. In Proceedings of the 15th Annual Symposium on User Interface Software and Technology, Paris, France, October, ACM Press, 121--130.]]
14. Drozd, A., Bowers, J., Benford, S., Greenhalgh, C., and Fraser, M. 2001. Collaboratively improvising magic: An approach to managing participation in an online drama. In Proceedings of the 7th European Conference on Computer Supported Cooperative Work, Bonn, Germany, September, Kluwer Academic Publishers, 159--178.]]
15. Flintham, M. 2005. Painting the town red: Configuring location-based experiences by colouring maps. In Proceedings of Advanced Computer Entertainment (ACE 2005), Madrid, Spain, ACM.]]
16. Gaver, W., Beaver, J., and Benford, S. 2003. Ambiguity as a resource for design. In Proceedings of the 2003 CHI Conference on Human Factors in Computing Systems, Florida, USA, April, ACM Press, 233--240.]]
17. Gutwin, C., Benford, S., Dyck, J., Fraser, M., Vaghi, I., and Greenhalgh, C. 2004. Revealing delay in collaborative environments. In Proceedings of the 2004 CHI Conference on Human Factors in Computing Systems, Vienna, Austria, April, ACM Press, 503--510.]]
18. Heath, C. and Luff, P. 1991. Collaborative activity and technology design: Task coordination in london underground control rooms. In Proceedings of the Second European Conference on Computer Supported Cooperative Work, Amsterdam, The Netherlands, September, Kluwer Academic Publishers, 65--80.]]
19. Hightower J. and Borriello, G. 2004. Particle filters for locations estimation in ubiquitous computing: A Case Study. In Proceedings of the 6th International Conference on Ubiquitous Computing, Nottingham, UK, September, Springer-Verlag, 88--106.]]
20. Hull, R., Clayton, C., and Melamed, T. 2004. Rapid authoring of mediascapes. Proceedings of Ubicomp 2004. Springer, 125--142.]]
21. Juhlin, O. and Weilenmann, A. 2001. Decentralizing the control room: Mobile work and institutional order. In Proceedings of the 7th European Conference on Computer Supported Cooperative Work, Bonn, Germany, September 2001, Kluwer Academic Publishers, 379--398.]]
22. Kidd, C., Orr, R., Abowd, G., Atkeson, C., Essa, I., Macintyre, B., Mynatt, E., Starner, T. E., and Newstetter, W. 1999. The aware home: A living laboratory for ubiquitous computing research. In Proceedings of the 2nd International Workshop on Cooperative Buildings, Pittsburgh, USA, October, Springer-Verlag, 191--198.]]
23. Koleva, B., Taylor, I., Benford, S., Fraser, M., Greenhalgh, C., Schnädelbach, H., Vom lehn, D., Heath, C., Row-farr, J., and Adams, M. 2001. Orchestrating a mixed reality performance. In Proceedings of the 2001 CHI Conference on Human Factors in Computing Systems, Seattle, Washington, ACM Press, 38--45.]]
24. Mankoff, J., Hudson, S., and Abowd, G. 2000. Interaction techniques for ambiguity resolution in recognition-based interfaces. In Proceedings of the 13th Annual ACM Symposium on User Interface and Software Technology, San Diego, California, November, ACM Press, 11--20.]]
25. Mynatt, E. and Nguyen, D. 2001. Making ubiquitous computing visible. In Proceedings of the 2001 CHI Conference on Human Factors in Computing Systems (Workshop 10. Building the Ubiquitous Computing User Experience), Seattle, Washington, April 2001, ACM. Press. http://www2.parc.com/csl/projects/ubicomp-workshop/positionpapers/mynatt.pdf]]
26. Newberger, A. and Dey, A. 2003. System support For context monitoring and control. Position paper presented at Proceedings of the 5th International Conference on Ubiquitous Computing (Workshop 7. At the Crossroads: The Interaction of HCI and Systems Issues), Seattle, Washington, October, Springer-Verlag, http://ubihcisys.stanford.edu/online-proceedings/Ubi03w7-Newberger-final.pdf]]
27. Piekarski, W. and Thomas, B. 2002. ARQuake: The outdoors augmented reality system. Comm. ACM 45, 1, 36--38.]]
28. Satoh, K., Ohshima, T., Tamamoto, H., and Tamuara, H. 1998. Case studies of see-through augmentation in a mixed reality project. In Proceedings of the 1st IEEE International Workshop on Augmented Reality, San Francisco, November, IEEE Computer Society, 3--18.]]
29. Schutz, A. and Luckmann, T. 1974. The Structures of the Lifeworld, Heinemann, London.]]
30. Starner, T., Leibe, B., Singletary, B., and Pair, J. 2000. MIND-WARPING: Towards creating a compelling collaborative augmented reality game. In Proceedings of the 5th International Conference on Intelligent User Interfaces 2000, New Orleans, January, ACM Press, 256--259.]]
31. Wu, H., Siegel, M., and Ablay, S. 2002. Sensor fusion for context understanding. In Proceedings of the 19th IEEE Instrument and Measurement Technology Conference, Anchorage, Alaska, May, Institute of Electrical and Electronic Engineers, http://www.ri.cmu.edu/pubs/download]]

Index Terms

• Applied computing

  • Computers in other domains

    • Personal computers and PC applications

      • Computer games

  • Law, social and behavioral sciences

    • Sociology

• Human-centered computing

  • Collaborative and social computing

• Information systems

  • Information systems applications

    • Multimedia information systems

      • Massively multiplayer online games

• Software and its engineering

  • Software organization and properties

    • Contextual software domains

      • Virtual worlds software

        • Interactive games

    • Software system structures

      • Distributed systems organizing principles

        • Organizing principles for web applications