Sensing and visualizing spatial relations of mobile devices

ABSTRACT

Location information can be used to enhance interaction with mobile devices. While many location systems require instrumentation of the environment, we present a system that allows devices to measure their spatial relations in a true peer-to-peer fashion. The system is based on custom sensor hardware implemented as USB dongle, and computes spatial relations in real-time. In extension of this system we propose a set of spatialized widgets for incorporation of spatial relations in the user interface. The use of these widgets is illustrated in a number of applications, showing how spatial relations can be employed to support and streamline interaction with mobile devices.

References

1. G. Abowd, C. Atkeson, J. Hong, S. Long, R. Kooper, and M. Pinkerton. Cyberguide: A mobile context-aware tour guide. ACM Wireless Networks, 3(5):421--433, 1997.
2. Mike Addlesee, Rupert Curwen, Steve Hodges, Joe Newman, Pete Steggles, Andy Ward, and Andy Hopper. Implementing a sentient computing system. IEEE Computer, 34(8):50--56, August 2001.
3. S. Björk, J. Falk, R. Hansson, and P. Ljungstrand. Pirates! - using the physical world as a game board. In Proceedings Interact 2001, IFIP TC.13 Conference on Human-Computer Interaction, Tokyo, Japan, July 9-13 2001.
4. R. Borovoy, B. Silverman, T. Gorton, J. Klann, M. Notowidigdo, B. Knep, and M. Resnick. Folk computing: Revisiting oral tradition as a scaffold for co-present communities. In Proceedings of the CHI 2001 Conference on Human Factors in Computing Systems, pages 466--473, New York, USA, 2001. ACM Press.
5. P. Brown, W. Burleston, M. Lamming, O. Rahlff, G. Romano, J. Scholtz, and D. Snowdon. Context-awareness: Some compelling applications. In Proceedings the CH12000 Workshop on The What, Who, Where, When, Why and How of Context-Awareness, April 2000.
6. B. Brumitt, J. Krumm, B. Meyers, and S. Shafer. Ubiquitous computing and the role of geometry. IEEE Personal Communications, pages 41--43, October 2000.
7. K. Cheverst, N. Davies, A. Friday, and Ch. Efstratiou. Developing a context-aware electronic tourist guide: Some issues and experiences. In Proceedings of CHI 2000, pages 17--24. ACM Press, 2000.
8. Eliseo Clementini, Paolino Di Felice, and Daniel Hernández. Qualitative representation of positional information. Artificial Intelligence, 95(2):317--356, 1997.
9. A. Danesh, K. Inkpen, F. Lau, K. Shu, and K. Booth. Geney: Designing a collaborative activity for the palm handheld computer. In Proceedings of CHI, Conference on Human Factors in Computing Systems (CHI 2001), pages 388--395, Seattle, USA, April 2001. ACM Press.
10. D. Lopez de Ipina, P. Mendonca, and A. Hopper. Trip: A low-cost vision-based location system for ubiquitous computing. Personal and Ubiquitous Computing, 6(3):206--219, May 2002.
11. A. K. Dey and G. D. Abowd. The context toolkit: Aiding the development of context-aware applications. In Workshop on Software Engineering for Wearable and Pervasive Computing, Limerick, Ireland, June 2000.
12. George W. Fitzmaurice. Situated information spaces and spatially aware palmtop computers. Communications of the ACM, 36(7):39--49, July 1993.
13. C. Gutwin and S. Greenberg. A descriptive framework of workspace awareness for real-time groupware. Journal of Computer-Supported Cooperative Work, pages 411--446, 2002.
14. A. Harter, A. Hopper, P. Steggles, A. Ward, and P. Webster. The anatomy of a context-aware application. In Mobile Computing and Networking, pages 59--68. ACM Press, 1999.
15. Mike Hazas, Christian Kray, Hans Gellersen, Henoc Agbota, Gerd Kortuem, and Albert Krohn. A relative positioning system for co-located mobile devices. In Proceedings of MobiSys 2005: Third International Conference on Mobile Systems, Applications, and Services, pages 177--190, Seattle, USA, June 2005.
16. Jeffrey Hightower and Gaetano Borriello. Location systems for ubiquitous computing. IEEE Computer, 34(8):57--66, August 2001.
17. K. Hinckley. Synchronous gestures for multiple users and computers. In Proceedings of UIST 2003, pages 149--158. ACM Press, 2003.
18. L.E. Holmquist, J. Falk, and J. Wigström. Supporting group collaboration with inter-personal awareness devices. Journal of Personal Technologies, 3(1--2), 1999.
19. John Krumm and Ken Hinckley. The NearMe wireless proximity server. In Proceedings of Ubicomp: Ubiquitous Computing, pages 283--300, Nottingham, UK, September 2004. Springer.
20. Yang Li, Jason I. Hong, and James~A. Landay. Topiary: A tool for prototyping location-enhanced applications. In Symposium on User Interface Software and Technology - UIST 2004, pages 217--226, Santa Fe, New Mexico, USA, 2004. ACM Press.
21. Masateru Minami, Yasuhiro Fukuju, Kazuki Hirasawa, Shigeaki Yokoyama, Moriyuki Mizumachi, Hiroyuki Morikawa, and Tomonori Aoyama. DOLPHIN: a practical approach for implementing a fully distributed indoor ultrasonic positioning system. In Proceedings of Ubicomp: Ubiquitous Computing, pages 347--365, Nottingham, UK, September 2004. Springer.
22. Mark W. Newman, Jana Z. Sedivy, Christine M. Neuwirth, W. Keith Edwards, Jason I. Hong, Shahram Izadi, Karen Marcelo, and Trevor F. Smith. Designing for serendipity: Supporting end-user configuration of ubiquitous computing environment. In Proceedings of DIS '02, pages 147--155, London, England, 2002. ACM Press.
23. Nissanka B. Priyantha, Allen K. L. Miu, Hari Balakrishnan, and Seth Teller. The Cricket Compass for context-aware mobile applications. In Proceedings of the Seventh International Conference on Mobile Computing and Networking (MobiCom), pages 1--14, Rome, Italy, July 2001.
24. Jun Rekimoto. Pick-and-drop: a direct manipulation technique for multiple computer environments. In Proceedings of the 10th annual ACM symposium on User interface software and technology, pages 31--39, Banff, Alberta, Canada, October 1997. ACM Press.
25. A. Savvides, C.C. Han, and M. B. Srivastava. Dynamic fine grained localization in ad-hoc sensor networks. In Proceedings of the Fifth International Conference on Mobile Computing and Networking (Mobicom), pages 166--179, Rome, Italy, July 2001.
26. Bill N. Schilit, Norman I. Adams, and Roy Want. Context-aware computing applications. In Proceedings of the Workshop on Mobile Computing Systems and Applications (WMCSA), pages 85--90, Santa Cruz, CA, USA, December 1994. IEEE Computer Society.
27. Andy Ward, Alan Jones, and Andy Hopper. A new location technique for the active office. IEEE Personal Communications, 4(5):42--47, October 1997.

Index Terms

• Human-centered computing

  • Human computer interaction (HCI)

    • Interaction paradigms

      • Graphical user interfaces