Capacitive fingerprinting: exploring user differentiation by sensing electrical properties of the human body

ABSTRACT

At present, touchscreens can differentiate multiple points of contact, but not who is touching the device. In this work, we consider how the electrical properties of humans and their attire can be used to support user differentiation on touchscreens. We propose a novel sensing approach based on Swept Frequency Capacitive Sensing, which measures the impedance of a user to the environment (i.e., ground) across a range of AC frequencies. Different people have different bone densities and muscle mass, wear different footwear, and so on. This, in turn, yields different impedance profiles, which allows for touch events, including multitouch gestures, to be attributed to a particular user. This has many interesting implications for interactive design. We describe and evaluate our sensing approach, demonstrating that the technique has considerable promise. We also discuss limitations, how these might be overcome, and next steps.

References

1. Annett, M., Grossman, T., Wigdor, D., and Fitzmaurice, G. Medusa: a proximity-aware multi-touch tabletop. In Proc. UIST '11. 337--346.
2. Augsten, T., Kaefer, K., Meusel, R., Fetzer, C., Kanitz, D., Stoff, T., Becker, T., Holz, C., and Baudisch, P. Multitoe: high-precision interaction with back-projected floors based on high-resolution multi-touch input. In Proc. UIST '10. 209--218.
3. Bly, S. A., and Minneman, S. L. Commune: A Shared Drawing Surface. In SIGOIS Bulletin, Massachusetts, 1990. 184--192.
4. Burges, C.J. A Tutorial on Support Vector Machines for Pattern Recognition. Data Mining and Know. Disc., 2.2, June 1998. 121--167.
5. Buxton, W., and Myers, B. A study in two-handed input. In Proc. CHI '86. 321--326.
6. Cao, X., Wilson, A., Balakrishnan, R., Hinckley, K., and Hudson, S.E. ShapeTouch: Leveraging contact shape on in- teractive surfaces. In Proc. TABLETOP '08. 129--136.
7. Cheney, M., Isaacson, D., and Newell, J. C. Electrical impedance tomography. SIAM Review, 41(1), 1999. 85--101.
8. Dang, C. T., Straud, M., and Andre, E. Hand distinction for multi-touch tabletop interaction. In Proc. ITS '09. 101--108.
9. Dietz, P. and Leigh, D. DiamondTouch: a multi-user touch technology. In Proc. UIST '01. 219--226.
10. Dietz, P. H., Harsham, B., Forlines, C., Leigh, D., Yerazunis, W., Shipman, S., Schmidt-Nielsen, B., and Ryall, K. DT controls: adding identity to physical interfaces. In Proc. UIST '05. 245--252.
11. Foster, K. R. and Lukaski, H. C. Whole-body impedance - what does it measure? The American Jour. of Clinical Nutrition, 64 (3), 1996. 388S-396S.
12. Gutwin, C., Greenberg, S., Blum, R. and Dyck, J. Supporting Informal Collaboration in Shared Workspace Group-ware. HCI Report 2005-01, U. Saskatchewan, Canada. 2005.
13. Hall, M., Frank, E., Holmes, G., Pfahringer, B., Reutemann, P., and Witten, I. H. The WEKA Data Mining Software: An Update. SIGKDD Explor., 11(1), 2009.
14. Harrison, C., Schwarz, J., and Hudson, S. E. TapSense: enhancing finger interaction on touch surfaces. In Proc. UIST '11. 627--636.
15. Holz, C. and Baudisch, P. The generalized perceived input point model and how to double touch accuracy by extracting fingerprints. In Proc. CHI '10. 581--590.
16. Lucero, A., Holopainen, J., and Jokela, T. Pass-them- around: collaborative use of mobile phones for photo sharing. In Proc. CHI '11. 1787--1796.
17. Lukaski, H., Johnson, P., Bolonchuk, W., and Lykken, G. Assessment of fat-free mass using bioelectrical impedance measurements of the human body. The American Jour. of Clinical Nutrition. 41, 4 (1985), 810--817.
18. Mandryk, R. L. and Inkpen, K. M. Physiological indicators for the evaluation of co-located collaborative play. In Proc. CSCW '04. 102--111.
19. Marquardt, N., Kiemer, J., Ledo, D., Boring, S., and Greenberg, S. Designing user-, hand-, and handpart-aware tabletop interactions with the TouchID toolkit. In Proc. ITS '11. 21--30.
20. Matsushita, N. and Rekimoto, J. HoloWall: Designing a Finger; Hand, Body, and Object Sensitive Wall. In Proc. UIST '97. 209--210.
21. Meyer, T. and Schmidt, D. IdWristbands: IR-based user identification on multi-touch surfaces. In Proc. ITS '10. 277--278.
22. Moore, M. M. and Dua, U. A galvanic skin response interface for people with severe motor disabilities. In Proc. ASSETS '04. 48--54.
23. Partridge, G. A. and Irani, P. P. IdenTTop: a flexible platform for exploring identity-enabled surfaces. In CHI EA '09. 4411--4416.
24. Roth, V., Schmidt, P., and Guldenring, B. The IR ring: Authenticating users' touches on a multi-touch display. In Proc. UIST '10. 259--262.
25. Ryall, K., Esenther, A., Everitt, K., Forlines, C., Morris, M. R., Shen, C., Shipman, S., and Vernier, F. iDwidgets: Parameterizing widgets by user identity. In Proc. INTERACT '05. 1124--1128.
26. Sato, M. Poupyrev, I, and Harrison, C. Touché: Enhancing Touch Interaction on Humans, Screens, Liquids, and Everyday Objects. In Proc. CHI '12. 483--492.
27. Schmidt, D., Chong, M. K. and Gellersen, H. HandsDown: hand-contour-based user identification for interactive surfaces. In Proc. NordiCHI '10. 432--441.
28. Shen, C., Vernier, F. D., Forliens, C., and Ringel M. DiamondSpin: an extensible toolkit for around-the-table interaction. In Proc. CHI '04. 167--174.
29. Stefik, M., Bobrow, D. G., Foster, G., Lanning, S., and Tatar, D. WYSIWIS Revised: Early experiences with multiuser interfaces. IEEE Transactions on Office Information Systems, 5(2), 1987. 147--167.
30. Stewart, J. Bederson, B., and Druin, A. Single Display Groupware: A Model for Co-present Collaboration. In Proc. CHI '99. 286--293.
31. Sugiura, A. and Koseki, Y. A user interface using fingerprint recognition: holding commands and data objects on fingers. In Proc. UIST '98. 71--79.
32. Wacom tablet. http://wacom.com/en/Products/Intuos.aspx.
33. Webster, J., Editor. Medical instrumentation: Application and design. 4th ed. 2008, Wiley. p. 641.
34. Whac-a-mole. http://en.wikipedia.org/wiki/Whac-A-Mole
35. Zhao, W., Chellappa, R., Phillips, P. J., and Rosenfeld, A. Face recognition: A literature survey. ACM Comput. Surv. 35(4), Dec. 2003. 399--458.

Index Terms

• Human-centered computing

  • Human computer interaction (HCI)