Low-cost multi-touch sensing through frustrated total internal reflection

ABSTRACT

This paper describes a simple, inexpensive, and scalable technique for enabling high-resolution multi-touch sensing on rear-projected interactive surfaces based on frustrated total internal reflection. We review previous applications of this phenomenon to sensing, provide implementation details, discuss results from our initial prototype, and outline future directions.

References

1. Buxton, W., Hill, R., and Rowley, P. 1985. Issues and Techniques in Touch-Sensitive Tablet Input. In Proceedings of the 12th Annual Conference on Computer Graphics and Interactive Techniques SIGGRAPH '85. ACM Press, New York, NY, 215--224.
2. Dietz, P. and Leigh, D. 2001. DiamondTouch: A Multi-User Touch Technology. In Proceedings of the 14th Annual ACM Symposium on User Interface Software and Technology (Orlando, Florida, November 11 - 14, 2001). UIST '01. ACM Press, New York, NY, 219--226.
3. Fingerworks. iGesturePad. http://www.fingerworks.com/
4. Fujieda, I., Haga, H. 1997. Fingerprint Input based on Scattered-Light Detection. Applied Optics-IP, 36, 35, 9152-9156
5. Greene, R. 1985. The Drawing Prism: A Versatile Graphic Input Device. In Proceedings of the 12th Annual Conference on Computer Graphics and Interactive Techniques SIGGRAPH '85. ACM Press, New York, NY, 103--110.
6. Hillis, W. D. 1982. A High Resolution Imaging Touch Sensor. International Journal of Robotics Research, 1982, 1, 2, 33--44.
7. Johnson, R. and Fryberger, D. 1972. Touch Actuable Data Input Panel Assembly. U.S. Patent 3,673,327. Jun. 1972.
8. Kamiyama, K., Vlack, K., Mizota, T., Kajimoto, H., Kawakami, N., and Tachi, S. 2005. Vision-Based Sensor for Real-Time Measuring of Surface Traction Fields. IEEE Comput. Graph. Appl. 25, 1 (Jan. 2005), 68--75.
9. Kasday, L. 1984. Touch Position Sensitive Surface. U.S. Patent 4,484,179. Nov. 1984.
10. Kunz, A. M. and Spagno, C. P. 2002. Technical System for Collaborative Work. In Proceedings of the Workshop on Virtual Environments 2002 (Barcelona, Spain, May 30 - 31, 2002). W. Sturzlinger and S. Muller, Eds. ACM International Conference Proceeding Series, vol. 23. Eurographics Association, Airela-Ville, Switzerland, 73--80.
11. Lee, S., Buxton, W., and Smith, K. C. 1985. A Multi-Touch Three Dimensional Touch-Sensitive Tablet. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (San Francisco, California, United States). CHI '85. ACM Press, New York, NY, 21--25.
12. Malik, S. and Laszlo, J. 2004. Visual Touchpad: A Two-Handed Gestural Input Device. In Proceedings of the 6th International Conference on Multimodal Interfaces (State College, PA, USA, October 13 - 15, 2004). ICMI '04. ACM Press, New York, NY, 289-296.
13. Mallos, J. 1982. Touch Position Sensitive Surface. U.S. Patent 4,346,376. Aug. 1982.
14. Matsushita, M., Iida, M., Ohguro, T., Shirai, Y., Kakehi, Y., and Naemura, T. 2004. Lumisight Table: A Face-to-face Collaboration Support System That Optimizes Direction of Projected Information to Each Stakeholder. In Proceedings of the 2004 ACM Conference on Computer Supported Cooperative Work (Chicago, Illinois, USA, November 06 - 10, 2004), CSCW '04. ACM Press, New York, NY, 274--283.
15. Matsushita, N. and Rekimoto, J. 1997. HoloWall: Designing a Finger, Hand, Body, and Object Sensitive Wall. In Proceedings of the 10th Annual ACM Symposium on User Interface Software and Technology (Banff, Alberta, Canada, October 14 - 17, 1997). UIST '97. ACM Press, New York, NY, 209--210.
16. Mott, D. H., Lee, M. H., and Nicholls, H. 1986. An Experimental Very High Resolution Tactile Sensor Array. In Robot Sensors Vol. 2: Tactile and Non-Vision, Pugh, A., Ed. Springer-Verlag, Berlin, 179--188.
17. Mueller, R. 1974. Direct Television Drawing and Image Manipulating System. U.S. Patent 3,846,826. Nov. 1974.
18. Nicol, K., and Hennig, E. M. C. 1979. Apparatus for the Time-Dependant Measurement of Physical Quantities. U.S. Patent 4,134,063. Jan. 1979.
19. Rekimoto, J. 2002. SmartSkin: An Infrastructure for Freehand Manipulation on Interactive Surfaces. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. CHI '02. ACM Press, New York, NY, 113-120.
20. Tactex. Smart Fabric Technology. http://www.tactex.com/
21. Tanie, K., Komoriya, K., Kaneko, M., Tachis, S., and Fujikava, A. 1986. A High Resolution Tactile Sensor. In Robot Sensors Vol. 2: Tactile and Non-Vision, Pugh, A., Ed. Springer-Verlag, Berlin, 189--198.
22. Westerman, W. and Elias, J. G. 2001. Method and Apparatus for Integrating Manual Input. U.S. Patent 6,323,846. Nov. 2001.
23. Westerman, W., Elias, J. G., and Hedge, A. 2001. Multi-Touch: A New Tactile 2-D Gesture Interface for Human-Computer Interaction. In Proceedings of the Human Factors and Ergonomics Society 45th Annual Meeting (Minneapolis/St. Paul, MN, Oct. 2001), 632--636.
24. White, R. M. 1987. Tactile Sensor Employing a Light Conducting Element and a Resiliently Deformable Sheet. U.S. Patent 4,668,861. May 1987.
25. White, W. 1965. Method for Optical Comparison of Skin Friction-Ridge Patterns. U.S. Patent 3,200,701. Aug. 1965.
26. Wilson, A. D. 2004. TouchLight: An Imaging Touch Screen and Display for Gesture-Based Interaction. In Proceedings of the 6th International Conference on Multimodal Interfaces (State College, PA, USA, October 13 - 15, 2004). ICMI '04. ACM Press, New York, NY, 69--76.
27. Wu, M. and Balakrishnan, R. 2003. Multi-Finger and Whole Hand Gestural Interaction Techniques for Multi-User Tabletop Displays. In Proceedings of the 16th Annual ACM Symposium on User Interface Software and Technology (Vancouver, Canada, November 02 - 05, 2003). UIST '03. ACM Press, New York, NY, 193--202.

Index Terms

• Human-centered computing

  • Human computer interaction (HCI)

    • Interaction devices

      • Touch screens