skip to main content
survey

The Feet in Human--Computer Interaction: A Survey of Foot-Based Interaction

Published:24 September 2015Publication History
Skip Abstract Section

Abstract

Foot-operated computer interfaces have been studied since the inception of human--computer interaction. Thanks to the miniaturisation and decreasing cost of sensing technology, there is an increasing interest exploring this alternative input modality, but no comprehensive overview of its research landscape. In this survey, we review the literature on interfaces operated by the lower limbs. We investigate the characteristics of users and how they affect the design of such interfaces. Next, we describe and analyse foot-based research prototypes and commercial systems in how they capture input and provide feedback. We then analyse the interactions between users and systems from the perspective of the actions performed in these interactions. Finally, we discuss our findings and use them to identify open questions and directions for future research.

References

  1. Jason Alexander, Teng Han, William Judd, Pourang Irani, and Sriram Subramanian. 2012. Putting your best foot forward: Investigating real-world mappings for foot-based gestures. In Proceedings of the 2012 ACM Annual Conference on Human Factors in Computing Systems (CHI’12). ACM, New York, New York, 1229. Google ScholarGoogle ScholarDigital LibraryDigital Library
  2. Michael Argyle. 1988. Bodily communication. Routledge, New York, NY.Google ScholarGoogle Scholar
  3. Thomas Augsten, Konstantin Kaefer, René Meusel, Caroline Fetzer, Dorian Kanitz, Thomas Stoff, Torsten Becker, Christian Holz, and Patrick Baudisch. 2010. Multitoe: High-precision interaction with back-projected floors based on high-resolution multi-touch input. In Proceedings of the 23rd Annual ACM Symposium on User Interface Software and Technology (UIST’10). ACM, New York, NY, 209--218. Google ScholarGoogle ScholarDigital LibraryDigital Library
  4. Ravin Balakrishnan, George Fitzmaurice, Gordon Kurtenbach, Karan Singh, and King Street East. 1999. Exploring interactive curve and surface manipulation using a bend and twist sensitive input strip. In Proceedings of the 1999 Symposium on Interactive 3D Graphics. ACM, New York, NY, 111--118. Google ScholarGoogle ScholarDigital LibraryDigital Library
  5. Ralph M. Barnes, Henry Hardaway, and Odif Podolsky. 1942. Which pedal is best. Factory Management and Maintenance 100, 98--99.Google ScholarGoogle Scholar
  6. Ralph L. Barnett. 2009. Foot controls: Riding the pedal. The Ergonomics Open Journal 2, 13--16.Google ScholarGoogle ScholarCross RefCross Ref
  7. Steffi Beckhaus, Kristopher J. Blom, and Matthias Haringer. 2005a. Intuitive, hands-free travel interfaces for virtual environments. In Proceedings of the New Directions in 3D User Interfaces Workshop of IEEE VR. 57--60.Google ScholarGoogle Scholar
  8. Steffi Beckhaus, Kristopher J. Blom, and Matthias Haringer. 2005b. A new gaming device and interaction method for a First-Person-Shooter. In Proceedings of the Computer Science and Magic 2005.Google ScholarGoogle Scholar
  9. Steffi Beckhaus, Kristopher J. Blom, and Matthias Haringer. 2007. ChairIO--the chair-based Interface. Concepts and Technologies for Pervasive Games: A Reader for Pervasive Gaming Research 1, 231--264.Google ScholarGoogle Scholar
  10. Eric Bergman and Earl Johnson. 1995. Towards accessible human-computer interaction. Advances in Human-Computer Interaction 5, 1, 87--114. Google ScholarGoogle ScholarDigital LibraryDigital Library
  11. Gerald Bieber and Holger Diener. 2005. Stepmanemdasha new kind of music interaction. In Proceedings of the International Conference on Human--Computer Interaction (HCI International).Google ScholarGoogle Scholar
  12. Mark Billinghurst and Bill Buxton. 2011. Gesture based interaction. Human Input to Computer Systems: Theories, Techniques and Technology 24.Google ScholarGoogle Scholar
  13. Alan Bränzel, Christian Holz, Daniel Hoffmann, Dominik Schmidt, Marius Knaust, Patrick Lühne, René Meusel, Stephan Richter, and Patrick Baudisch. 2013. GravitySpace: Tracking users and their poses in a smart room using a pressure-sensing floor. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, New York, NY, 725--734. Google ScholarGoogle ScholarDigital LibraryDigital Library
  14. David C. Brogan, Ronald A. Metoyer, and Jessica K. Hodgins. 1998. Dynamically simulated characters in virtual environments. Computer Graphics and Applications, IEEE 18, 5, 58--69. Google ScholarGoogle ScholarDigital LibraryDigital Library
  15. Luís Bruno, João Pereira, and Joaquim Jorge. 2013. A new approach to walking in place. In Human-Computer Interaction--INTERACT 2013. Springer, 370--387.Google ScholarGoogle Scholar
  16. Giovanni Buccino, Lucia Riggio, Giorgia Melli, Ferdinand Binkofski, Vittorio Gallese, and Giacomo Rizzolatti. 2005. Listening to action-related sentences modulates the activity of the motor system: A combined TMS and behavioral study. Cognitive Brain Research 24, 3, 355--363.Google ScholarGoogle ScholarCross RefCross Ref
  17. Maria Chiara Carrozza, Alessandro Persichetti, Cecilia Laschi, Fabrizio Vecchi, Roberto Lazzarini, Pierpaolo Vacalebri, and Paolo Dario. 2007. A wearable biomechatronic interface for controlling robots with voluntary foot movements. IEEE/ASME Transactions on Mechatronics, 12, 1, 1--11.Google ScholarGoogle ScholarCross RefCross Ref
  18. Angel O. K. Chan, Alan H. S. Chan, Annie W. Y. Ng, and B. L. Luk. 2010. A preliminary analysis of movement times and subjective evaluations for a visually-controlled foot-tapping task on touch pad device. In Proceedings of the International MultiConference of Engineers and Computer Scientists, Vol. 3. 17--19.Google ScholarGoogle Scholar
  19. Ken W. L. L. Chan and Alan H. S. S. Chan. 2009. Spatial stimulus--response (SR) compatibility for foot controls with visual displays. International Journal of Industrial Ergonomics 39, 2, 396--402.Google ScholarGoogle ScholarCross RefCross Ref
  20. Tanya L. Chartrand and John A. Bargh. 1999. The chameleon effect: The perception--behavior link and social interaction. Journal of Personality and Social Psychology 76, 6, 893.Google ScholarGoogle ScholarCross RefCross Ref
  21. Meng Chen, Bufu Huang, and Yangsheng Xu. 2008. Intelligent shoes for abnormal gait detection. In Proceedings of the IEEE International Conference on Robotics and Automation, 2008 (ICRA’08). IEEE, 2019--2024.Google ScholarGoogle Scholar
  22. Insook Choi and Carlos Ricci. 1997. Foot-mounted gesture detection and its application in virtual environments. In Proceedings of the IEEE International Conference on Systems, Man, and Cybernetics, 1997. Computational Cybernetics and Simulation, Vol. 5. IEEE, 4248--4253.Google ScholarGoogle ScholarCross RefCross Ref
  23. Andrew Crossan, Stephen Brewster, and Alexander Ng. 2010. Foot tapping for mobile interaction. In Proceedings of the 24th BCS Interaction Specialist Group Conference (BCS’10). British Computer Society, Swinton, UK, 418--422. Google ScholarGoogle ScholarDigital LibraryDigital Library
  24. Florian Daiber, J. Schöning, and A. Krüger. 2009. Whole body interaction with geospatial data. In Smart Graphics, Andreas Butz, Brian Fisher, Marc Christie, Antonio Krager, Patrick Olivier, and Roberto Thern (Eds.). Lecture Notes in Computer Science, Vol. 5531. Springer, Berlin, 81--92. DOI:http://dx.doi.org/10.1007/978-3-642-02115-2_7 Google ScholarGoogle ScholarDigital LibraryDigital Library
  25. Rudolph P. Darken, William R. Cockayne, and David Carmein. 1997. The omni-directional treadmill: A locomotion device for virtual worlds. In Proceedings of the 10th Annual ACM Symposium on User Interface Software and Technology. ACM, New York, NY, 213--221. Google ScholarGoogle ScholarDigital LibraryDigital Library
  26. Edward J. C. Dawe and James Davis. 2011. Anatomy and biomechanics of the foot and ankle. Orthopaedics and Trauma 25, 4, 279--286.Google ScholarGoogle ScholarCross RefCross Ref
  27. David Dearman, Amy Karlson, Brian Meyers, and Ben Bederson. 2010. Multi-modal text entry and selection on a mobile device. In Proceedings of Graphics Interface 2010. Canadian Information Processing Society, 19--26. Google ScholarGoogle ScholarDigital LibraryDigital Library
  28. Wilfrid Taylor Dempster. 1955. Space Requirements of the Seated Operator: Geometrical, Kinematic, and Mechanical Aspects of the Body, with Special Reference to the Limbs. Technical Report. Wright Patterson Air Force Base, Wright Patterson AFB, OH.Google ScholarGoogle Scholar
  29. Giannis Drossis, Dimitris Grammenos, Maria Bouhli, Ilia Adami, and Constantine Stephanidis. 2013. Comparative evaluation among diverse interaction techniques in three dimensional environments. In Distributed, Ambient, and Pervasive Interactions. Springer, 3--12.Google ScholarGoogle Scholar
  30. Colin G. Drury. 1975. Application of Fitts’ Law to foot-pedal design. Human Factors: The Journal of the Human Factors and Ergonomics Society 17, 4, 368--373.Google ScholarGoogle ScholarCross RefCross Ref
  31. Douglas Engelbart. 1984. Doug Engelbart Discusses Mouse Alternatives. (May 1984).Google ScholarGoogle Scholar
  32. William K. English, Douglas C. Engelbart, and Melvyn L. Berman. 1967. Display-selection techniques for text manipulation. IEEE Transactions on Human Factors in Electronics 1, 5--15.Google ScholarGoogle ScholarCross RefCross Ref
  33. Jeff Feasel, Mary C. Whitton, and Jeremy D. Wendt. 2008. LLCM-WIP: Low-latency, continuous-motion walking-in-place. In Proceedings of the IEEE Symposium on 3D User Interfaces, 2008 (3DUI’08). IEEE, 97--104. Google ScholarGoogle ScholarDigital LibraryDigital Library
  34. Mikael Fernström and Niall Griffith. 1998. Litefoot--auditory display of footwork. In Proceeding of the 5th International Conference on Auditory Display (ICAD), Vol. 98. Google ScholarGoogle ScholarDigital LibraryDigital Library
  35. Carl Fischer, Poorna Talkad Sukumar, and Mike Hazas. 2013. Tutorial: Implementation of a pedestrian tracker using foot-mounted inertial sensors. IEEE Pervasive Computing 12, 2, 17--27. Google ScholarGoogle ScholarDigital LibraryDigital Library
  36. Paul M. Fitts. 1954. The information capacity of the human motor system in controlling the amplitude of movement. Journal of Experimental Psychology 47, 6, 381.Google ScholarGoogle ScholarCross RefCross Ref
  37. Martin Frey. 2007. CabBoots: Shoes with integrated guidance system. In Proceedings of the 1st International Conference on Tangible and Embedded Interaction. ACM, New York, NY, 245--246. Google ScholarGoogle ScholarDigital LibraryDigital Library
  38. Davrondzhon Gafurov, Patrick Bours, and Einar Snekkenes. 2011. User authentication based on foot motion. Signal, Image and Video Processing 5, 4, 457--467.Google ScholarGoogle ScholarCross RefCross Ref
  39. Fredrick P. Garcia and Kim-Phuong L. Vu. 2009. Effects of practice with foot-and hand-operated secondary input devices on performance of a word-processing task. In Human Interface and the Management of Information. Designing Information Environments. Springer, 505--514. Google ScholarGoogle ScholarDigital LibraryDigital Library
  40. Fredrick P. Garcia and Kim-Phuong L. Vu. 2011. Effectiveness of hand- and foot-operated secondary input devices for word-processing tasks before and after training. Computers in Human Behavior 27, 1, 285--295. Google ScholarGoogle ScholarDigital LibraryDigital Library
  41. Francine Gemperle, Chris Kasabach, John Stivoric, Malcolm Bauer, and Richard Martin. 1998. Design for wearability. In Proceedings of the 2nd International Symposium on Wearable Computers, 1998. Digest of Papers. IEEE, 116--122. Google ScholarGoogle ScholarDigital LibraryDigital Library
  42. Raymond W. Gibbs. 2006. Embodiment and Cognitive Science. Cambridge University Press, New York, NY.Google ScholarGoogle Scholar
  43. Fabian Göbel, Konstantin Klamka, Andreas Siegel, Stefan Vogt, Sophie Stellmach, and Raimund Dachselt. 2013. Gaze-supported foot interaction in zoomable information spaces. In CHI’13 Extended Abstracts on Human Factors in Computing Systems (CHI EA’13). ACM, New York, NY, 3059. Google ScholarGoogle ScholarDigital LibraryDigital Library
  44. Tammy S. Gregersen. 2005. Nonverbal cues: Clues to the detection of foreign language anxiety. Foreign Language Annals 38, 3, 388--400.Google ScholarGoogle ScholarCross RefCross Ref
  45. Kaj Grønbæk, Ole S. Iversen, Karen Johanne Kortbek, Kaspar Rosengreen Nielsen, and Louise Aagaard. 2007. IGameFloor: A platform for co-located collaborative games. In Proceedings of the International Conference on Advances in Computer Entertainment Technology. ACM, New York, NY, 64--71. Google ScholarGoogle ScholarDigital LibraryDigital Library
  46. Edward Hall. 1966. The Hidden Dimension. Doubleday, Garden City, NY.Google ScholarGoogle Scholar
  47. Teng Han, Jason Alexander, Abhijit Karnik, Pourang Irani, and Sriram Subramanian. 2011. Kick: Investigating the use of kick gestures for mobile interactions. In Proceedings of the 13th International Conference on Human Computer Interaction with Mobile Devices and Services. ACM, New York, NY, 29--32. Google ScholarGoogle ScholarDigital LibraryDigital Library
  48. Jinni A. Harrigan, Thomas E. Oxman, and Robert Rosenthal. 1985. Rapport expressed through nonverbal behavior. Journal of Nonverbal Behavior 9, 2, 95--110.Google ScholarGoogle ScholarCross RefCross Ref
  49. Olaf Hauk, Ingrid Johnsrude, and Friedemann Pulvermüller. 2004. Somatotopic representation of action words in human motor and premotor cortex. Neuron 41, 2, 301--307.Google ScholarGoogle ScholarCross RefCross Ref
  50. William E. Hick. 1952. On the rate of gain of information. Quarterly Journal of Experimental Psychology 4, 1, 11--26.Google ScholarGoogle ScholarCross RefCross Ref
  51. Hideaki Higuchi and Takuya Nojima. 2010. Shoe-shaped I/O interface. In Adjunct Proceedings of the 23rd Annual ACM Symposium on User Interface Software and Technology (UIST’10). ACM, New York, NY, 423--424. Google ScholarGoogle ScholarDigital LibraryDigital Library
  52. Ken Hinckley, R. Jacob, and Colin Ware. 2004. Input/output devices and interaction techniques. In The Computer Science Handbook, 2nd edition. A. B. Tucker (Ed.). Chapman and Hlal/CRC Press, Boca Raton, FL.Google ScholarGoogle Scholar
  53. Ken Hinckley and Daniel Wigdor. 2012. Input technologies and techniques. In The Human Computer Interaction Handbook: Fundamentals, Evolving Technologies, and Emerging Applications (3rd. ed.). Julie A. Jacko (Ed.). CRC Press, Boca Raton, FL. Google ScholarGoogle ScholarDigital LibraryDigital Library
  54. Jason A. Hockman, Marcelo M. Wanderley, and Ichiro Fujinaga. 2009. Real-time phase vocoder manipulation by runners pace. In Proceedings of the International Conference on New Interfaces for Musical Expression (NIME). 90--93.Google ScholarGoogle Scholar
  55. Errol R. Hoffmann. 1991. A comparison of hand and foot movement times. Ergonomics 34, 4, 397--406.Google ScholarGoogle ScholarCross RefCross Ref
  56. John M. Hollerbach. 2002. Locomotion interfaces. In Handbook of Virtual Environments: Design, Implementation, and Applications. Kelly S. Hale and Kay M. Stanney (Eds.). Lawrence Erlbaum Associates, Mahway, NJ. 239--254.Google ScholarGoogle Scholar
  57. Richard Zhi-Ling Hu, Adam Hartfiel, James Tung, Adel Fakih, Jesse Hoey, and Pascal Poupart. 2011. 3D Pose tracking of walker users’ lower limb with a structured-light camera on a moving platform. In Proceedings of the 2011 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops (CVPRW). IEEE, 29--36.Google ScholarGoogle Scholar
  58. Bufu Huang, Meng Chen, Weizhong Ye, and Yangsheng Xu. 2006. Intelligent shoes for human identification. In Proceedings of the IEEE International Conference on Robotics and Biomimetics, 2006 (ROBIO’06). 601--606.Google ScholarGoogle ScholarCross RefCross Ref
  59. Bernd Huber. 2013. Foot position as indicator of spatial interest at public displays. In CHI’13 Extended Abstracts on Human Factors in Computing Systems (CHI EA’13). New York, NY, 2695. Google ScholarGoogle ScholarDigital LibraryDigital Library
  60. Scott E. Hudson, Chris Harrison, Beverly L. Harrison, and Anthony LaMarca. 2010. Whack gestures: Inexact and inattentive interaction with mobile devices. In Proceedings of the 4th International Conference on Tangible, Embedded, and Embodied Interaction. ACM, New York, NY, 109--112. Google ScholarGoogle ScholarDigital LibraryDigital Library
  61. Ray Hyman. 1953. Stimulus information as a determinant of reaction time. Journal of Experimental Psychology 45, 3, 188.Google ScholarGoogle ScholarCross RefCross Ref
  62. Hiroo Iwata, Hiroaki Yano, and Fumitaka Nakaizumi. 2001. Gait master: A versatile locomotion interface for uneven virtual terrain. In Proceedings IEEE Virtual Reality, 2001. IEEE, 131--137. Google ScholarGoogle ScholarDigital LibraryDigital Library
  63. Shahram Jalaliniya, Jeremiah Smith, Miguel Sousa, Lars Büthe, and Thomas Pederson. 2013. Touch-less interaction with medical images using hand & foot gestures. In Proceedings of the 2013 ACM Conference on Pervasive and Ubiquitous Computing Adjunct Publication (UbiComp’13 Adjunct). ACM Press, New York, NY, 1265. Google ScholarGoogle ScholarDigital LibraryDigital Library
  64. Frédéric Jean and Alexandra Branzan Albu. 2008. The visual keyboard: Real-time feet tracking for the control of musical meta-instruments. Signal Processing: Image Communication 23, 7, 505--515. Google ScholarGoogle ScholarDigital LibraryDigital Library
  65. Ricardo Jota, Pedro Lopes, Daniel Wigdor, and Joaquim A. Jorge. 2014. Let’s kick it: How to stop wasting the bottom third of your large-scale display. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. 1411--1414. Google ScholarGoogle ScholarDigital LibraryDigital Library
  66. Gregory Juckett. 2005. Cross-cultural medicine. American Family Physician 72, 11, 2267--2274.Google ScholarGoogle Scholar
  67. Maria Karam and m. c. schraefel. 2005. A Taxonomy of Gestures in Human Computer Interactions. Technical Report. University of Southampton.Google ScholarGoogle Scholar
  68. Sang-Hwan Kim and David B. Kaber. 2009. Design and evaluation of dynamic text-editing methods using foot pedals. International Journal of Industrial Ergonomics 39, 2, 358--365.Google ScholarGoogle ScholarCross RefCross Ref
  69. Kyoungchul Kong and Masayoshi Tomizuka. 2009. A gait monitoring system based on air pressure sensors embedded in a shoe. IEEE/ASME Transactions on Mechatronics 14, 3, 358--370.Google ScholarGoogle ScholarCross RefCross Ref
  70. Karl H. E. Kroemer. 1971. Foot operation of controls. Ergonomics 14, 3, 333--361.Google ScholarGoogle ScholarCross RefCross Ref
  71. Peter Krogh, Martin Ludvigsen, and Andreas Lykke-Olesen. 2007. “Help me pull that cursor”: A collaborative interactive floor enhancing community interaction. Australasian Journal of Information Systems 11, 2, 75--87.Google ScholarGoogle Scholar
  72. Yuichiro Kume, Akihiko Shirai, and Masaru Sato. 1998. Foot interface: Fantastic Phantom Slipper. In Proceedings of the ACM SIGGRAPH 98 Conference Abstracts and Applications (SIGGRAPH’98). ACM, New York, NY, 114. Google ScholarGoogle ScholarDigital LibraryDigital Library
  73. Joseph J. LaViola Jr., Daniel Acevedo Feliz, Daniel F. Keefe, and Robert C. Zeleznik. 2001. Hands-free multi-scale navigation in virtual environments. In Proceedings of the 2001 Symposium on Interactive 3D graphics. ACM, New York, NY, 9--15. Google ScholarGoogle ScholarDigital LibraryDigital Library
  74. Anatole Lécuyer, Maud Marchal, Adrien Hamelin, David Wolinski, Federico Fontana, Marco Civolani, Stefano Papetti, Stefania Serafin, and others. 2011. Shoes-your-style: Changing sound of footsteps to create new walking experiences. In Proceedings of the Workshop on Sound and Music Computing for Human-Computer Interaction (CHItaly). 13--16.Google ScholarGoogle Scholar
  75. Lynn S. Lippert. 2011. Clinical Kinesiology and Anatomy. F. A. Davis, Philadelphia PA.Google ScholarGoogle Scholar
  76. Pedro André Santos Afonso Lopes, Guilherme Fernandes, and Joaquim Jorge. 2010. Trainable DTW-based classifier for recognizing feet-gestures. In Proceedings of the 16th Portuguese Conference on Pattern Recognition (RecPad’10).Google ScholarGoogle Scholar
  77. C. Owen Lovejoy. 1988. Evolution of human walking. Science America 259, 5, 118--25.Google ScholarGoogle ScholarCross RefCross Ref
  78. I. Scott MacKenzie. 1992. Fitts’ Law as a research and design tool in human-computer interaction. Human-Computer Interaction 7, 1, 91--139. Google ScholarGoogle ScholarDigital LibraryDigital Library
  79. Steve Mann. 1997. Smart clothing: The wearable computer and wearcam. Personal Technologies 1, 1, 21--27.Google ScholarGoogle ScholarCross RefCross Ref
  80. Denys J. C. Matthies, Franz Müller, Christoph Anthes, and Dieter Kranzlmüller. 2013. ShoeSoleSense: Proof of concept for a wearable foot interface for virtual and real environments. In Proceedings of the 19th ACM Symposium on Virtual Reality Software and Technology (VRST’13). ACM, New York, NY, 93. Google ScholarGoogle ScholarDigital LibraryDigital Library
  81. Lisa McElligott, Michelle Dillon, Krispin Leydon, Bruce Richardson, Mikael Fernström, and Joseph A. Paradiso. 2002. ForSe FIElds-force sensors for interactive environments. In Proceedings of the 2002 International Conference on Ubiquitous Computing. Springer, 168--175. Google ScholarGoogle ScholarDigital LibraryDigital Library
  82. Daniel C. McFarlane and Steven M. Wilder. 2009. Interactive dirt: Increasing mobile work performance with a wearable projector-camera system. In Proceedings of the 11th International Conference on Ubiquitous Computing. ACM, New York, NY, 205--214. Google ScholarGoogle ScholarDigital LibraryDigital Library
  83. Albert Mehrabian. 1968. Some referents and measures of nonverbal behavior. Behavior Research Methods & Instrumentation 1, 6, 203--207.Google ScholarGoogle ScholarCross RefCross Ref
  84. Bart Moens, Leon van Noorden, and Marc Leman. 2010. D-Jogger: Syncing music with walking. In 7th Sound and Music Computing Conference 2010, Barcelona, Spain.Google ScholarGoogle Scholar
  85. Farhan Mohamed and Sidney Fels. 2002. LMNKui: Overlaying computer controls on a piano keyboard. In CHI’02 Extended Abstracts on Human Factors in Computing Systems (CHI’02), Vol. 100. ACM, New York, NY, 140. Google ScholarGoogle ScholarDigital LibraryDigital Library
  86. Robert E. Morley Jr, Edward J. Richter, Joseph W. Klaesner, Katrina S. Maluf, Michael J. Mueller, and R. E. Morley. 2001. In-shoe multisensory data acquisition system. IEEE Transactions on Biomedical Engineering 48, 7, 815--820.Google ScholarGoogle ScholarCross RefCross Ref
  87. Desmond Morris. 2002. Peoplewatching. Random House, New York, NY.Google ScholarGoogle Scholar
  88. Joe Navarro and Marvin Karlins. 2009. What Everybody Is Saying. HarperCollins, New York, NY.Google ScholarGoogle Scholar
  89. Devin Odom, Krishana Wooding, and Jesse Longoria. 2006. Thigh-controlled piano pedal. In NSF 2006 Engineering Senior Design Projects to Aid Persons with Disabilities.Google ScholarGoogle Scholar
  90. Giulia Orecchini, Li Yang, M. Tentzeris, and Luca Roselli. 2011. Smart Shoe: An autonomous inkjet-printed RFID system scavenging walking energy. In Proceedings of the 2011 IEEE International Symposium on Antennas and Propagation (APSURSI). IEEE, 1417--1420.Google ScholarGoogle ScholarCross RefCross Ref
  91. Robert J. Orr and Gregory D. Abowd. 2000. The smart floor: A mechanism for natural user identification and tracking. In CHI’00 Extended Abstracts on Human Factors in Computing Systems. ACM, New York, NY, 275--276. Google ScholarGoogle ScholarDigital LibraryDigital Library
  92. Volker Paelke, Christian Reimann, and Dirk Stichling. 2004. Foot-based mobile interaction with games. In Proceedings of the 2004 ACM SIGCHI International Conference on Advances in Computer Entertainment Technology. ACM, New York, NY, 321--324. Google ScholarGoogle ScholarDigital LibraryDigital Library
  93. Toni Pakkanen and Roope Raisamo. 2004. Appropriateness of foot interaction for non-accurate spatial tasks. In CHI’04 Extended Abstracts on Human Factors in Computing Systems (CHI EA’04). ACM, New York, NY, 1123--1126. Google ScholarGoogle ScholarDigital LibraryDigital Library
  94. Stefano Papetti, Marco Civolani, and Federico Fontana. 2011. Rhythm and Shoes: A wearable foot tapping interface with audio-tactile feedback. In Proceedings of the International Conference on New Interfaces for Musical Expression. 473--476.Google ScholarGoogle Scholar
  95. Joseph Paradiso, Craig Abler, Kai-yuh Hsiao, and Matthew Reynolds. 1997. The magic carpet: Physical sensing for immersive environments. In CHI’97 Extended Abstracts on Human Factors in Computing Systems. ACM, New York, NY, 277--278. Google ScholarGoogle ScholarDigital LibraryDigital Library
  96. Joseph A. Paradiso, Kai-yuh Hsiao, Ari Y. Benbasat, and Zoe Teegarden. 2000. Design and implementation of expressive footwear. IBM Systems Journal 39, 3.4, 511--529. Google ScholarGoogle ScholarDigital LibraryDigital Library
  97. Joseph A. Paradiso, Kai-Yuh Hsiao, and Eric Hu. 1999a. Interactive music for instrumented dancing shoes. In Proceedings of the 1999 International Computer Music Conference. 453--456.Google ScholarGoogle Scholar
  98. Joseph A. Paradiso and Eric Hu. 1997. Expressive footwear for computer-augmented dance performance. In Proceedings of the 1st International Symposium on Wearable Computers, 1997. Digest of Papers. IEEE, 165--166. Google ScholarGoogle ScholarDigital LibraryDigital Library
  99. Joseph A. Paradiso, Eric Hu, and Kai-yuh Hsiao. 1998. Instrumented footwear for interactive dance. In Proceedings of the XII Colloquium on Musical Informatics. 24--26.Google ScholarGoogle Scholar
  100. Joseph A. Paradiso, Eric Hu, and Kai-yuh Y Hsiao. 1999b. The CyberShoe: A wireless multisensor interface for a dancer’s feet. Proceedings of International Dance and Technology 99, 57--60.Google ScholarGoogle Scholar
  101. Joseph A. Paradiso, Stacy J. Morris, Ari Y. Benbasat, and Erik Asmussen. 2004. Interactive therapy with instrumented footwear. In CHI’04 Extended Abstracts on Human Factors in Computing Systems. ACM, New York, NY, 1341--1343. Google ScholarGoogle ScholarDigital LibraryDigital Library
  102. Glenn Pearson and Mark Weiser. 1986. Of moles and men: The design of foot controls for workstations. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI’86). ACM, New York, NY, 333--339. Google ScholarGoogle ScholarDigital LibraryDigital Library
  103. Glenn Pearson and Mark Weiser. 1988a. Exploratory evaluation of a planar foot-operated cursor-positioning device. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI’88). ACM, New York, NY, 13--18. Google ScholarGoogle ScholarDigital LibraryDigital Library
  104. Glenn Pearson and Mark Weiser. 1988b. Exploratory evaluations of two versions of a foot-operated cursor-positioning device in a target-selection task. ACM SIGCHI Bulletin 19, 3, 70--75. Google ScholarGoogle ScholarDigital LibraryDigital Library
  105. Francis Quek, Roger Ehrich, and Thurmon Lockhart. 2008. As go the feet...: on the estimation of attentional focus from stance. In Proceedings of the 10th International Conference on Multimodal Interfaces. ACM, New York, NY, 97--104. Google ScholarGoogle ScholarDigital LibraryDigital Library
  106. Francis Quek, David McNeill, Robert Bryll, Susan Duncan, Xin-Feng Ma, Cemil Kirbas, Karl E. McCullough, and Rashid Ansari. 2002. Multimodal human discourse: Gesture and speech. ACM Transactions on Computer-Human Interaction (TOCHI) 9, 3, 171--193. Google ScholarGoogle ScholarDigital LibraryDigital Library
  107. Bruce Richardson, Krispin Leydon, Mikael Fernstrom, and Joseph A. Paradiso. 2004. Z-Tiles: Building blocks for modular, pressure-sensing floorspaces. In CHI’04 Extended Abstracts on Human Factors in Computing Systems. ACM, New York, NY, 1529--1532. Google ScholarGoogle ScholarDigital LibraryDigital Library
  108. Stephan Richter, Christian Holz, and Patrick Baudisch. 2012. Bootstrapper: Recognizing tabletop users by their shoes. In Proceedings of the 2012 ACM Annual Conference on Human Factors in Computing Systems. ACM, New York, NY, 1249--1252. Google ScholarGoogle ScholarDigital LibraryDigital Library
  109. Asbjørn Roaas and Gunnar B. J. Andersson. 1982. Normal range of motion of the hip, knee and ankle joints in male subjects, 30--40 years of age. Acta Orthopaedica 53, 2, 205--208.Google ScholarGoogle ScholarCross RefCross Ref
  110. Sandra P. Rosenblum. 1993. Pedaling the piano: A brief survey from the eighteenth century to the present. Performance Practice Review 6, 2, 8.Google ScholarGoogle ScholarCross RefCross Ref
  111. A. F. Rovers and H. A. Van Essen. 2005. FootIO—design and evaluation of a device to enable foot interaction over a computer network. In Proceedings of the Eurohaptics Conference, 2005 and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems, 2005. World Haptics 2005. First Joint. 521--522. Google ScholarGoogle ScholarDigital LibraryDigital Library
  112. A. F. Rovers and H. A .Van Essen. 2006. Guidelines for haptic interpersonal communication applications: An exploration of foot interaction styles. Virtual Reality 9, 2--3, 177--191. Google ScholarGoogle ScholarDigital LibraryDigital Library
  113. Dan Saffer. 2008. Designing Gestural Interfaces: Touchscreens and Interactive Devices. O’Reilly Media, Inc., Sebastopol, CA. Google ScholarGoogle ScholarDigital LibraryDigital Library
  114. Nuttapol Sangsuriyachot, Haipeng Mi, and Masanori Sugimoto. 2011. Novel interaction techniques by combining hand and foot gestures on tabletop environments. In ACM International Conference on Interactive Tabletops and Surfaces (ITS’11). ACM, New York, NY, 268--269. Google ScholarGoogle ScholarDigital LibraryDigital Library
  115. William Saunders and Daniel Vogel. 2015. The performance of indirect foot pointing using discrete taps and kicks while standing. In Proceedings of Graphics Interface. Google ScholarGoogle ScholarDigital LibraryDigital Library
  116. Albrecht Schmidt. 2000. Implicit human computer interaction through context. Personal Technologies 4, 2--3, 191--199.Google ScholarGoogle ScholarCross RefCross Ref
  117. Dominik Schmidt, Raf Ramakers, Esben Pedersen, Johannes Jasper, Sven Köhler, Aileen Pohl, Hannes Rantzsch, Andreas Rau, Patrick Schmidt, Christoph Sterz, Yanina Yurchenko, and Patrick Baudisch. 2014. Kickables: Tangibles for feet. In CHI’14. Google ScholarGoogle ScholarDigital LibraryDigital Library
  118. Johannes Schöning, Florian Daiber, Antonio Krüger, and Michael Rohs. 2009. Using hands and feet to navigate and manipulate spatial data. In CHI’09 Extended Abstracts on Human Factors in Computing Systems (CHI EA’09). ACM, New York, NY, 4663--4668. Google ScholarGoogle ScholarDigital LibraryDigital Library
  119. Claudia Scorolli and Anna M. Borghi. 2007. Sentence comprehension and action: Effector specific modulation of the motor system. Brain Research 1130, 119--124.Google ScholarGoogle ScholarCross RefCross Ref
  120. Jeremy Scott, David Dearman, Koji Yatani, and Khai N. Truong. 2010. Sensing foot gestures from the pocket. In Proceedings of the 23rd Annual ACM Symposium on User Interface Software and Technology (UIST’10). ACM, New York, NY, 199--208. Google ScholarGoogle ScholarDigital LibraryDigital Library
  121. Abigail J. Sellen, Gordon P. Kurtenbach, and William A. S. Buxton. 1992. The prevention of mode errors through sensory feedback. Human-Computer Interaction 7, 2, 141--164. Google ScholarGoogle ScholarDigital LibraryDigital Library
  122. Sameen Shaukat, Muhammad Haroon Yousaf, and Hafiz Adnan Habib. 2010. Real-time feet movement detection and tracking for controlling a toy car. In Proceedings of the 2010 3rd International Conference on Advanced Computer Theory and Engineering (ICACTE’10), Vol. 6. IEEE, 5.Google ScholarGoogle ScholarCross RefCross Ref
  123. Adalberto Simeone, Eduardo Velloso, Jason Alexander, and Hans Gellersen. 2014. Feet movement in desktop 3D interaction. In Proceedings of the 2014 IEEE Symposium on 3D User Interfaces. IEEE.Google ScholarGoogle ScholarCross RefCross Ref
  124. Riitta L. Simonen, Tapio Videman, Michele C. Battié, and Laura E. Gibbons. 1995. Comparison of foot and hand reaction times among men: A methodologic study using simple and multiple-choice repeated measurements. Perceptual and Motor Skills.Google ScholarGoogle Scholar
  125. Mel Slater, Martin Usoh, and Anthony Steed. 1995. Taking steps: The influence of a walking technique on presence in virtual reality. ACM Transactions on Computer-Human Interaction (TOCHI) 2, 3, 201--219. Google ScholarGoogle ScholarDigital LibraryDigital Library
  126. Johannes Springer and Christa Siebes. 1996. Position controlled input device for handicapped: Experimental studies with a footmouse. International Journal of Industrial Ergonomics 17, 2, 135--152.Google ScholarGoogle ScholarCross RefCross Ref
  127. Frank Steinicke, Yon Visell, Jennifer Campos, and Anatole Lécuyer. 2013. Human Walking in Virtual Environments. Springer. Google ScholarGoogle ScholarDigital LibraryDigital Library
  128. Jelle Stienstra, Kees Overbeeke, and Stephan Wensveen. 2011. Embodying complexity through movement sonification: Case study on empowering the speed-skater. In Proceedings of the 9th ACM SIGCHI Italian Chapter International Conference on Computer-Human Interaction: Facing Complexity. ACM, 39--44. Google ScholarGoogle ScholarDigital LibraryDigital Library
  129. Jonathan Sykes and Simon Brown. 2003. Affective gaming: Measuring emotion through the gamepad. In CHI’03 Extended Abstracts on Human Factors in Computing Systems. ACM, New York, NY, 732--733. Google ScholarGoogle ScholarDigital LibraryDigital Library
  130. Yanbo Tao, Tin Lun Lam, Huihuan Qian, and Yangsheng Xu. 2012. A real-time intelligent shoe-keyboard for computer input. In 2012 IEEE International Conference on Robotics and Biomimetics (ROBIO). IEEE, 1488--1493.Google ScholarGoogle ScholarCross RefCross Ref
  131. James N. Templeman, Patricia S. Denbrook, and Linda E. Sibert. 1999. Virtual locomotion: Walking in place through virtual environments. Presence 8, 6, 598--617. Google ScholarGoogle ScholarDigital LibraryDigital Library
  132. Edward O. Thorp. 1998. The invention of the first wearable computer. In Proceedings of the 2nd International Symposium on Wearable Computers. 4--8. Google ScholarGoogle ScholarDigital LibraryDigital Library
  133. Cuong Tran, Anup Doshi, and Mohan Manubhai Trivedi. 2012. Modeling and prediction of driver behavior by foot gesture analysis. Computer Vision and Image Understanding 116, 3, 435--445. Google ScholarGoogle ScholarDigital LibraryDigital Library
  134. Donald J. Trombley. 1966. Experimental Determination of an Optimal Foot Pedal Design. Technical Report. Central Library Texas, Technological College, Lubbock, TX.Google ScholarGoogle Scholar
  135. Shafiq ur Réhman, Abdullah Khan, Haibo Li, and Applied Physics. 2012. Interactive Feet for Mobile Immersive Interaction. In MobileHCI 2012 : Mobile Vision (MobiVis) Vision-based Applications and HCI, Vol. 2011. MOBIVIS.Google ScholarGoogle Scholar
  136. Eduardo Velloso, Jason Alexander, Andreas Bulling, and Hans Gellersen. 2015a. Interactions under the desk: A characterisation of foot movements for input in a seated position. In Proceedings of the 15th IFIP International Conference (INTERACT).Google ScholarGoogle ScholarCross RefCross Ref
  137. Eduardo Velloso, Carl Oechsner, Katharina Sachmann, Markus Wirth, and Hans Gellersen. 2015b. Arcade+: A platform for public deployment and evaluation of multi-modal games. In Proceedings of the 2nd ACM SIGCHI Annual Symposium on Computer-Human Interaction in Play. ACM, New York, NY. Google ScholarGoogle ScholarDigital LibraryDigital Library
  138. Julie Wagner, Mathieu Nancel, Sean G. Gustafson, Stephane Huot, and Wendy E. Mackay. 2013. Body-centric design space for multi-surface interaction. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI’13). ACM, New York, NY, 1299. Google ScholarGoogle ScholarDigital LibraryDigital Library
  139. Junji Watanabe, Hideyuki Ando, and Taro Maeda. 2005. Shoe-shaped interface for inducing a walking cycle. In Proceedings of the 2005 International Conference on Augmented Tele-existence. ACM, New York, NY, 30--34. Google ScholarGoogle ScholarDigital LibraryDigital Library
  140. Timothy D. Weaver and R. G. Klein. 2006. The evolution of human walking. In Human Walking. Jessica Rose and James G. Gamble (Eds.). Lippincott Williams & Wilkins, Philadelphia, PA.Google ScholarGoogle Scholar
  141. Jeremy D. Wendt, Mary C. Whitton, and Frederick P. Brooks Jr. 2010. GUD WIP: Gait-understanding-driven walking-in-place. In Proceedings of the 2010 IEEE Virtual Reality Conference (VR). IEEE, 51--58. Google ScholarGoogle ScholarDigital LibraryDigital Library
  142. Betsy Williams, Stephen Bailey, Gayathri Narasimham, Muqun Li, and Bobby Bodenheimer. 2011. Evaluation of walking in place on a Wii balance board to explore a virtual environment. ACM Transactions on Applied Perception (TAP) 8, 3, 19. Google ScholarGoogle ScholarDigital LibraryDigital Library
  143. Erivaldo Xavier, De Lima Filho, Mateus Bisotto Nunes, Luciana Nedel, Porto Alegre, Erivaldo Xavier de Lima Filho, and Joao Comba. 2011. Why not with the foot? In Proceedings of the 2011 Brazilian Symposium on Games and Digital Entertainment. IEEE, 270--281. Google ScholarGoogle ScholarDigital LibraryDigital Library
  144. T. Yamamoto, M. Tsukamoto, and T. Yoshihisa. 2008. Foot-step input method for operating information devices while jogging. In Proceedings of the International Symposium on Applications and the Internet, 2008 (SAINT’08). 173--176. Google ScholarGoogle ScholarDigital LibraryDigital Library
  145. Takashi Yamauchi. 2013. Mouse trajectories and state anxiety: Feature selection with random forest. In Proceedings of the 2013 Humaine Association Conference on Affective Computing and Intelligent Interaction (ACII). IEEE, 399--404. Google ScholarGoogle ScholarDigital LibraryDigital Library
  146. Weizhong Ye, Yangsheng Xu, and Ka Keung Lee. 2005. Shoe-Mouse: An integrated intelligent shoe. In Proceedings of the 2005 IEEE/RSJ International Conference on Intelligent Robots and Systems, 2005 (IROS’05). IEEE, 1163--1167.Google ScholarGoogle Scholar
  147. Muhammad Haroon Yousaf and Hafiz Adnan Habib. 2012. Adjustable pedals by gesture recognition: A novel approach for user interface in automotive. Middle-East Journal of Scientific Research 11, 11, 1575--1583.Google ScholarGoogle Scholar
  148. Ye Zheng, Matthew McCaleb, Courtney Strachan, and Betsy Williams. 2012. Exploring a virtual environment by walking in place using the Microsoft Kinect. In Proceedings of the ACM Symposium on Applied Perception. ACM, New York, NY, 131. Google ScholarGoogle ScholarDigital LibraryDigital Library
  149. Kang Zhong, Feng Tian, and Hongan Wang. 2011. Foot menu: Using heel rotation information for menu selection. In Proceedings of the 2011 15th Annual International Symposium on Wearable Computers. IEEE, 115--116. Google ScholarGoogle ScholarDigital LibraryDigital Library

Index Terms

  1. The Feet in Human--Computer Interaction: A Survey of Foot-Based Interaction

          Recommendations

          Comments

          Login options

          Check if you have access through your login credentials or your institution to get full access on this article.

          Sign in

          Full Access

          • Published in

            cover image ACM Computing Surveys
            ACM Computing Surveys  Volume 48, Issue 2
            November 2015
            615 pages
            ISSN:0360-0300
            EISSN:1557-7341
            DOI:10.1145/2830539
            • Editor:
            • Sartaj Sahni
            Issue’s Table of Contents

            Copyright © 2015 ACM

            Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

            Publisher

            Association for Computing Machinery

            New York, NY, United States

            Publication History

            • Published: 24 September 2015
            • Revised: 1 July 2015
            • Accepted: 1 July 2015
            • Received: 1 November 2014
            Published in csur Volume 48, Issue 2

            Permissions

            Request permissions about this article.

            Request Permissions

            Check for updates

            Qualifiers

            • survey

          PDF Format

          View or Download as a PDF file.

          PDF

          eReader

          View online with eReader.

          eReader