SLAP widgets: bridging the gap between virtual and physical controls on tabletops

ABSTRACT

We present Silicone iLluminated Active Peripherals (SLAP), a system of tangible, translucent widgets for use on multitouch tabletops. SLAP Widgets are cast from silicone or made of acrylic, and include sliders, knobs, keyboards, and buttons. They add tactile feedback to multi-touch tables, improving input accuracy. Using rear projection, SLAP Widgets can be relabeled dynamically, providing inexpensive, battery-free, and untethered augmentations. Furthermore, SLAP combines the flexibility of virtual objects with physical affordances. We evaluate how SLAP Widgets influence the user experience on tabletops compared to virtual controls. Empirical studies show that SLAPWidgets are easy to use and outperform virtual controls significantly in terms of accuracy and overall interaction time.

References

1. H. Benko, A. D. Wilson, and P. Baudisch. Precise selection techniques for multi-touch screens. In CHI '06: Proceedings of the SIGCHI conference on Human Factors in computing systems, pages 1263--1272, New York, NY, USA, 2006. ACM.
2. F. Block, M. Haller, H. Gellersen, C. Gutwin, and M. Billinghurst. VoodooSketch: extending interactive surfaces with adaptable interface palettes. In TEI '08: Proceedings of the 2nd international conference on Tangible and embedded interaction, pages 55--58, New York, NY, USA, 2008. ACM.
3. P. L. Davidson and J. Y. Han. Synthesis and control on large scale multi-touch sensing displays. In NIME '06: Proceedings of the 2006 conference on New interfaces for musical expression, pages 216--219, Paris, France, France, 2006. IRCAM - Centre Pompidou.
4. G. W. Fitzmaurice, H. Ishii, and W. A. S. Buxton. Bricks: laying the foundations for graspable user interfaces. In CHI '95: Proceedings of the SIGCHI conference on Human factors in computing systems, pages 442--449, New York, NY, USA, 1995. ACM Press/Addison-Wesley Publishing Co.
5. J. Y. Han. Low-cost multi-touch sensing through frustrated total internal reflection. In UIST '05: Proceedings of the 18th annual ACM symposium on User interface software and technology, pages 115--118, New York, NY, USA, 2005. ACM.
6. U. Hinrichs, M. S. Hancock, M. S. T. Carpendale, and C. Collins. Examination of text-entry methods for tabletop displays. In Tabletop, pages 105--112, 2007.
7. J. A. Johnson, T. L. Roberts, W. Verplank, D. C. Smith, C. H. Irby, M. Beard, and K. Mackey. The Xerox Star: A retrospective. IEEE Computer, 22(9):11--29, 1989.
8. S. Jorda, G. Geiger, M. Alonso, and M. Kaltenbrunner. The reacTable: exploring the synergy between live music performance and tabletop tangible interfaces. In TEI '07: Proceedings of the 1st international conference on Tangible and embedded interaction, pages 139--146, New York, NY, USA, 2007. ACM.
9. T. Kienzl, U. Marsche, N. Kapeller, and A. Gokcezade. tangible workbench "TW": with changeable markers. In SIGGRAPH '08: ACM SIGGRAPH 2008 new tech demos, page 1, New York, NY, USA, 2008. ACM.
10. N. Matsushita and J. Rekimoto. HoloWall: designing a finger, hand, body, and object sensitive wall. In UIST '97: Proceedings of the 10th annual ACM symposium on User interface software and technology, pages 209--210, New York, NY, USA, 1997. ACM.
11. M. R. Morris, A. Huang, A. Paepcke, and T. Winograd. Cooperative gestures: multi-user gestural interactions for co-located groupware. In CHI '06: Proceedings of the SIGCHI conference on Human Factors in computing systems, pages 1201--1210, New York, NY, USA, 2006. ACM.
12. J. Patten, B. Recht, and H. Ishii. Audiopad: a tag-based interface for musical performance. In NIME '02: Proceedings of the 2002 conference on New interfaces for musical expression, pages 1--6, Singapore, Singapore, 2002. National University of Singapore.
13. J. Raskin. The humane interface : new directions for designing interactive systems. Addison-Wesley, Reading, Mass. {u.a.}, 2. print. edition, 2000.
14. J. Rekimoto. SmartSkin: an infrastructure for freehand manipulation on interactive surfaces. In CHI '02: Proceedings of the SIGCHI conference on Human factors in computing systems, pages 113--120, New York, NY, USA, 2002. ACM.
15. J. Rekimoto, B. Ullmer, and H. Oba. DataTiles: a modular platform for mixed physical and graphical interactions. In CHI '01: Proceedings of the SIGCHI conference on Human factors in computing systems, pages 269--276, New York, NY, USA, 2001. ACM.
16. M. Waldner, J. Hauber, J. Zauner, M. Haller, and M. Billinghurst. Tangible tiles: design and evaluation of a tangible user interface in a collaborative tabletop setup. In OZCHI '06: Proceedings of the 18th Australia conference on Computer-Human Interaction, pages 151--158, New York, NY, USA, 2006. ACM.
17. W. White. Method for optical comparison of skin friction-ridge patterns, 1965. U.S. Patent 3,200,701, 13.12.2002.

Index Terms

• Human-centered computing

  • Human computer interaction (HCI)

    • Interaction devices

      • Touch screens