skip to main content
research-article

Expanding Side Touch Input on Mobile Phones: Finger Reachability and Two-Dimensional Taps and Flicks using the Index and Thumb

Published:04 November 2020Publication History
Skip Abstract Section

Abstract

We investigate the performance of one-handed touch input on the side of a mobile phone. A first experiment examines grip change and subjective preference when reaching for side targets using different fingers. Results show all locations can be reached with at least one finger, but the thumb and index are most preferred and require less grip change for positions along the sides. Two following experiments examine taps and flicks using the thumb and index finger in a new two-dimensional input space. A side-touch sensor is simulated with a combination of capacitive sensing and motion tracking to distinguish touches on the lower, middle, or upper edges. When tapping, index and thumb speeds are similar with thumb more accurate and comfortable, and the lower edge is most reliable with the middle edge most comfortable. When flicking with the thumb, the upper edge is fast and rated highly.

Skip Supplemental Material Section

Supplemental Material

v4issa206.mp4

mp4

30.6 MB

References

  1. Joanna Bergstrom-Lehtovirta and Antti Oulasvirta. 2014. Modeling the Functional Area of the Thumb on Mobile Touchscreen Surfaces. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems . Association for Computing Machinery, New York, NY, USA, 1991--2000. https://doi.org/10.1145/2556288.2557354Google ScholarGoogle ScholarDigital LibraryDigital Library
  2. Rachel Eardley, Anne Roudaut, Steve Gill, and Stephen J. Thompson. 2017. Understanding Grip Shifts: How Form Factors Impact Hand Movements on Mobile Phones. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (Denver, Colorado, USA) (CHI '17). Association for Computing Machinery, New York, NY, USA, 4680--4691. https://doi.org/10.1145/3025453.3025835Google ScholarGoogle Scholar
  3. Sergio Garrido-Jurado, Rafael Mu n oz-Salinas, Francisco Madrid-Cuevas, and Rafael Medina-Carnicer. 2015. Generation of fiducial marker dictionaries using Mixed Integer Linear Programming. Pattern Recognition, Vol. 51 (2015). https://doi.org/10.1016/j.patcog.2015.09.023Google ScholarGoogle Scholar
  4. Anthony D Hall, James B Cunningham, Richard P Roache, and Julie W Cox. 1988. Factors affecting performance using touch-entry systems: Tactual recognition fields and system accuracy. Journal of Applied Psychology, Vol. 73, 4 (1988), 711--720. https://doi.org/10.1037/0021--9010.73.4.711Google ScholarGoogle ScholarCross RefCross Ref
  5. David Holman, Andreas Hollatz, Amartya Banerjee, and Roel Vertegaal. 2013. Unifone: Designing for Auxiliary Finger Input in One-Handed Mobile Interactions. In Proceedings of the 7th International Conference on Tangible, Embedded and Embodied Interaction (Barcelona, Spain) (TEI'13). Association for Computing Machinery, New York, NY, USA, 177--184. https://doi.org/10.1145/2460625.2460653Google ScholarGoogle ScholarDigital LibraryDigital Library
  6. Sungjae Hwang and Kwang-yun Wohn. 2012. PseudoButton: Enabling Pressure-Sensitive Interaction by Repurposing Microphone on Mobile Device. In CHI '12 Extended Abstracts on Human Factors in Computing Systems (Austin, Texas, USA) (CHI EA'12). Association for Computing Machinery, New York, NY, USA, 1565--1570. https://doi.org/10.1145/2212776.2223673Google ScholarGoogle ScholarDigital LibraryDigital Library
  7. Sungjune Jang, Lawrence H. Kim, Kesler Tanner, Hiroshi Ishii, and Sean Follmer. 2016. Haptic Edge Display for Mobile Tactile Interaction. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (San Jose, California, USA) (CHI '16). Association for Computing Machinery, New York, NY, USA, 3706--3716. https://doi.org/10.1145/2858036.2858264Google ScholarGoogle ScholarDigital LibraryDigital Library
  8. Nikhita Joshi and Daniel Vogel. 2019. An Evaluation of Touch Input at the Edge of a Table. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (Glasgow, Scotland Uk) (CHI '19). ACM, New York, NY, USA, Article 246, bibinfonumpages12 pages. https://doi.org/10.1145/3290605.3300476Google ScholarGoogle ScholarDigital LibraryDigital Library
  9. Amy K Karlson, Benjamin B Bederson, and Jose L Contreras-Vidal. 2008. Understanding one-handed use of mobile devices. In Handbook of research on user interface design and evaluation for mobile technology. IGI Global, 86--101.Google ScholarGoogle Scholar
  10. Kunihiro Kato and Homei Miyashita. 2015. ExtensionSticker: A Proposal for a Striped Pattern Sticker to Extend Touch Interfaces and Its Assessment. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (Seoul, Republic of Korea) (CHI '15). Association for Computing Machinery, New York, NY, USA, 1851--1854. https://doi.org/10.1145/2702123.2702500Google ScholarGoogle ScholarDigital LibraryDigital Library
  11. S. Kolkur, D. Kalbande, P. Shimpi, C. Bapat, and J. Jatakia. 2016/12. Human Skin Detection Using RGB, HSV and YCbCr Color Models. In Proceedings of the International Conference on Communication and Signal Processing 2016 (ICCASP 2016). Atlantis Press, 324--332. https://doi.org/10.2991/iccasp-16.2017.51Google ScholarGoogle ScholarCross RefCross Ref
  12. Huy Viet Le, Sven Mayer, Patrick Bader, and Niels Henze. 2018b. Fingers' Range and Comfortable Area for One-Handed Smartphone Interaction Beyond the Touchscreen. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems. Association for Computing Machinery, New York, NY, USA, 1--12. https://doi.org/10.1145/3173574.3173605Google ScholarGoogle ScholarDigital LibraryDigital Library
  13. Huy Viet Le, Sven Mayer, and Niels Henze. 2018a. InfiniTouch: Finger-Aware Interaction on Fully Touch Sensitive Smartphones. In Proceedings of the 31st Annual ACM Symposium on User Interface Software and Technology (Berlin, Germany) (UIST '18). Association for Computing Machinery, New York, NY, USA, 779--792. https://doi.org/10.1145/3242587.3242605Google ScholarGoogle ScholarDigital LibraryDigital Library
  14. Huy Viet Le, Sven Mayer, Benedict Steuerlein, and Niels Henze. 2019. Investigating Unintended Inputs for One-Handed Touch Interaction Beyond the Touchscreen. In Proceedings of the 21st International Conference on Human-Computer Interaction with Mobile Devices and Services (Taipei, Taiwan) (MobileHCI'19). Association for Computing Machinery, New York, NY, USA, Article 34, bibinfonumpages14 pages. https://doi.org/10.1145/3338286.3340145Google ScholarGoogle ScholarDigital LibraryDigital Library
  15. Huy Viet Le, Sven Mayer, Katrin Wolf, and Niels Henze. 2016. Finger Placement and Hand Grasp during Smartphone Interaction. In Proceedings of the 2016 CHI Conference Extended Abstracts on Human Factors in Computing Systems (San Jose, California, USA) (CHI EA '16). Association for Computing Machinery, New York, NY, USA, 2576--2584. https://doi.org/10.1145/2851581.2892462Google ScholarGoogle ScholarDigital LibraryDigital Library
  16. Sven Mayer, Huy Viet Le, Markus Funk, and Niels Henze. 2019. Finding the Sweet Spot: Analyzing Unrestricted Touchscreen Interaction In-the-Wild. In Proceedings of the 2019 ACM International Conference on Interactive Surfaces and Spaces (Daejeon, Republic of Korea) (ISS '19). Association for Computing Machinery, New York, NY, USA, 171--179. https://doi.org/10.1145/3343055.3359705Google ScholarGoogle ScholarDigital LibraryDigital Library
  17. William McGrath and Yang Li. 2014. Detecting Tapping Motion on the Side of Mobile Devices by Probabilistically Combining Hand Postures. In Proceedings of the 27th Annual ACM Symposium on User Interface Software and Technology (Honolulu, Hawaii, USA) (UIST '14). Association for Computing Machinery, New York, NY, USA, 215--219. https://doi.org/10.1145/2642918.2647363Google ScholarGoogle ScholarDigital LibraryDigital Library
  18. phoneArena.com. 2018. Phone Finder. https://www.phonearena.com/phones. Accessed: 2018-07--17.Google ScholarGoogle Scholar
  19. Alan Poston. 2000. Human Engineering Design Data Digest. (2000), 159.Google ScholarGoogle Scholar
  20. R. L. Potter, L. J. Weldon, and B. Shneiderman. 1988. Improving the Accuracy of Touch Screens: An Experimental Evaluation of Three Strategies. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Washington, D.C., USA) (CHI '88). Association for Computing Machinery, New York, NY, USA, 27--32. https://doi.org/10.1145/57167.57171Google ScholarGoogle ScholarDigital LibraryDigital Library
  21. Philip Quinn, Seungyon Claire Lee, Melissa Barnhart, and Shumin Zhai. 2019. Active Edge: Designing Squeeze Gestures for the Google Pixel 2. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (Glasgow, Scotland Uk) (CHI '19). ACM, New York, NY, USA, Article 274, bibinfonumpages13 pages. https://doi.org/10.1145/3290605.3300504Google ScholarGoogle ScholarDigital LibraryDigital Library
  22. Francisco J. Romero-Ramirez, Rafael Muñoz-Salinas, and Rafael Medina-Carnicer. 2018. Speeded up detection of squared fiducial markers. Image and Vision Computing, Vol. 76 (2018), 38 -- 47. https://doi.org/10.1016/j.imavis.2018.05.004Google ScholarGoogle ScholarCross RefCross Ref
  23. Volker Roth and Thea Turner. 2009. Bezel Swipe: Conflict-Free Scrolling and Multiple Selection on Mobile Touch Screen Devices. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Boston, MA, USA) (CHI '09). Association for Computing Machinery, New York, NY, USA, 1523--1526. https://doi.org/10.1145/1518701.1518933Google ScholarGoogle ScholarDigital LibraryDigital Library
  24. Joey Scarr, Andy Cockburn, Carl Gutwin, and Philip Quinn. 2011. Dips and Ceilings: Understanding and Supporting Transitions to Expertise in User Interfaces. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Vancouver, BC, Canada) (CHI '11). Association for Computing Machinery, New York, NY, USA, 2741--2750. https://doi.org/10.1145/1978942.1979348Google ScholarGoogle ScholarDigital LibraryDigital Library
  25. Julia Schwarz, Robert Xiao, Jennifer Mankoff, Scott E. Hudson, and Chris Harrison. 2014. Probabilistic Palm Rejection Using Spatiotemporal Touch Features and Iterative Classification. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Toronto, Ontario, Canada) (CHI '14). Association for Computing Machinery, New York, NY, USA, 2009--2012. https://doi.org/10.1145/2556288.2557056Google ScholarGoogle ScholarDigital LibraryDigital Library
  26. Karsten Seipp and Kate Devlin. 2014. BackPat: One-Handed off-Screen Patting Gestures. In Proceedings of the 16th International Conference on Human-Computer Interaction with Mobile Devices & Services (Toronto, ON, Canada) (MobileHCI '14). Association for Computing Machinery, New York, NY, USA, 77--80. https://doi.org/10.1145/2628363.2628396Google ScholarGoogle ScholarDigital LibraryDigital Library
  27. Marcos Serrano, Eric Lecolinet, and Yves Guiard. 2013. Bezel-Tap Gestures: Quick Activation of Commands from Sleep Mode on Tablets. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Paris, France) (CHI '13). Association for Computing Machinery, New York, NY, USA, 3027--3036. https://doi.org/10.1145/2470654.2481421Google ScholarGoogle ScholarDigital LibraryDigital Library
  28. Ben Shneiderman. 1991. Touch screens now offer compelling uses. Software, IEEE, Vol. 8, 2 (mar 1991), 93--94. https://doi.org/10.1109/52.73754Google ScholarGoogle ScholarDigital LibraryDigital Library
  29. R. William Soukoreff and I. Scott MacKenzie. 2004. Towards a Standard for Pointing Device Evaluation, Perspectives on 27 Years of Fitts' Law Research in HCI. Int. J. Hum.-Comput. Stud., Vol. 61, 6 (Dec. 2004), 751--789. https://doi.org/10.1016/j.ijhcs.2004.09.001Google ScholarGoogle Scholar
  30. Daniel Spelmezan, Caroline Appert, Olivier Chapuis, and Emmanuel Pietriga. 2013a. Controlling Widgets with One Power-up Button. In Proceedings of the 26th Annual ACM Symposium on User Interface Software and Technology (St. Andrews, Scotland, United Kingdom) (UIST '13). Association for Computing Machinery, New York, NY, USA, 71--74. https://doi.org/10.1145/2501988.2502025Google ScholarGoogle ScholarDigital LibraryDigital Library
  31. Daniel Spelmezan, Caroline Appert, Olivier Chapuis, and Emmanuel Pietriga. 2013b. Side Pressure for Bidirectional Navigation on Small Devices. In Proceedings of the 15th International Conference on Human-Computer Interaction with Mobile Devices and Services (Munich, Germany) (MobileHCI '13). Association for Computing Machinery, New York, NY, USA, 11--20. https://doi.org/10.1145/2493190.2493199Google ScholarGoogle ScholarDigital LibraryDigital Library
  32. The Verge. 2019. I held the future in my hands, and it was foldable . https://www.theverge.com/2019/2/25/18239565/huawei-mate-x-foldable-phone-hands-on-design-mwc-2019 . Accessed: 2019-09--19.Google ScholarGoogle Scholar
  33. Daniel Vogel and Ravin Balakrishnan. 2010. Occlusion-aware Interfaces. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '10). ACM, New York, NY, USA, 263--272. https://doi.org/10.1145/1753326.1753365Google ScholarGoogle Scholar
  34. Daniel Vogel and Patrick Baudisch. 2007. Shift: A Technique for Operating Pen-Based Interfaces Using Touch. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (San Jose, California, USA) (CHI '07). Association for Computing Machinery, New York, NY, USA, 657--666. https://doi.org/10.1145/1240624.1240727Google ScholarGoogle ScholarDigital LibraryDigital Library
  35. Graham Wilson, Stephen Brewster, and Martin Halvey. 2013. Towards Utilising One-Handed Multi-Digit Pressure Input. In CHI '13 Extended Abstracts on Human Factors in Computing Systems (Paris, France) (CHI EA '13). Association for Computing Machinery, New York, NY, USA, 1317--1322. https://doi.org/10.1145/2468356.2468591Google ScholarGoogle Scholar
  36. Jacob O. Wobbrock, Leah Findlater, Darren Gergle, and James J. Higgins. 2011. The Aligned Rank Transform for Nonparametric Factorial Analyses Using Only Anova Procedures. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Vancouver, BC, Canada) (CHI '11). Association for Computing Machinery, New York, NY, USA, 143--146. https://doi.org/10.1145/1978942.1978963Google ScholarGoogle ScholarDigital LibraryDigital Library
  37. Xiaomi. 2020. Mi Mix Alpha 5G . https://in.event.mi.com/in/mi-mix-alphaGoogle ScholarGoogle Scholar
  38. Hyunjin Yoo, Jungwon Yoon, and Hyunsoo Ji. 2015. Index Finger Zone: Study on Touchable Area Expandability Using Thumb and Index Finger. In Proceedings of the 17th International Conference on Human-Computer Interaction with Mobile Devices and Services Adjunct (Copenhagen, Denmark) (MobileHCI '15). Association for Computing Machinery, New York, NY, USA, 803--810. https://doi.org/10.1145/2786567.2793704Google ScholarGoogle ScholarDigital LibraryDigital Library

Index Terms

  1. Expanding Side Touch Input on Mobile Phones: Finger Reachability and Two-Dimensional Taps and Flicks using the Index and Thumb

        Recommendations

        Comments

        Login options

        Check if you have access through your login credentials or your institution to get full access on this article.

        Sign in

        Full Access

        • Published in

          cover image Proceedings of the ACM on Human-Computer Interaction
          Proceedings of the ACM on Human-Computer Interaction  Volume 4, Issue ISS
          ISS
          November 2020
          488 pages
          EISSN:2573-0142
          DOI:10.1145/3433930
          Issue’s Table of Contents

          Copyright © 2020 ACM

          Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

          Publisher

          Association for Computing Machinery

          New York, NY, United States

          Publication History

          • Published: 4 November 2020
          Published in pacmhci Volume 4, Issue ISS

          Permissions

          Request permissions about this article.

          Request Permissions

          Check for updates

          Qualifiers

          • research-article

        PDF Format

        View or Download as a PDF file.

        PDF

        eReader

        View online with eReader.

        eReader