Abstract
We investigate the performance of one-handed touch input on the side of a mobile phone. A first experiment examines grip change and subjective preference when reaching for side targets using different fingers. Results show all locations can be reached with at least one finger, but the thumb and index are most preferred and require less grip change for positions along the sides. Two following experiments examine taps and flicks using the thumb and index finger in a new two-dimensional input space. A side-touch sensor is simulated with a combination of capacitive sensing and motion tracking to distinguish touches on the lower, middle, or upper edges. When tapping, index and thumb speeds are similar with thumb more accurate and comfortable, and the lower edge is most reliable with the middle edge most comfortable. When flicking with the thumb, the upper edge is fast and rated highly.
Supplemental Material
Available for Download
# Supplementary files ## reachability_viewer.html
- Joanna Bergstrom-Lehtovirta and Antti Oulasvirta. 2014. Modeling the Functional Area of the Thumb on Mobile Touchscreen Surfaces. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems . Association for Computing Machinery, New York, NY, USA, 1991--2000. https://doi.org/10.1145/2556288.2557354Google ScholarDigital Library
- Rachel Eardley, Anne Roudaut, Steve Gill, and Stephen J. Thompson. 2017. Understanding Grip Shifts: How Form Factors Impact Hand Movements on Mobile Phones. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (Denver, Colorado, USA) (CHI '17). Association for Computing Machinery, New York, NY, USA, 4680--4691. https://doi.org/10.1145/3025453.3025835Google Scholar
- Sergio Garrido-Jurado, Rafael Mu n oz-Salinas, Francisco Madrid-Cuevas, and Rafael Medina-Carnicer. 2015. Generation of fiducial marker dictionaries using Mixed Integer Linear Programming. Pattern Recognition, Vol. 51 (2015). https://doi.org/10.1016/j.patcog.2015.09.023Google Scholar
- Anthony D Hall, James B Cunningham, Richard P Roache, and Julie W Cox. 1988. Factors affecting performance using touch-entry systems: Tactual recognition fields and system accuracy. Journal of Applied Psychology, Vol. 73, 4 (1988), 711--720. https://doi.org/10.1037/0021--9010.73.4.711Google ScholarCross Ref
- David Holman, Andreas Hollatz, Amartya Banerjee, and Roel Vertegaal. 2013. Unifone: Designing for Auxiliary Finger Input in One-Handed Mobile Interactions. In Proceedings of the 7th International Conference on Tangible, Embedded and Embodied Interaction (Barcelona, Spain) (TEI'13). Association for Computing Machinery, New York, NY, USA, 177--184. https://doi.org/10.1145/2460625.2460653Google ScholarDigital Library
- Sungjae Hwang and Kwang-yun Wohn. 2012. PseudoButton: Enabling Pressure-Sensitive Interaction by Repurposing Microphone on Mobile Device. In CHI '12 Extended Abstracts on Human Factors in Computing Systems (Austin, Texas, USA) (CHI EA'12). Association for Computing Machinery, New York, NY, USA, 1565--1570. https://doi.org/10.1145/2212776.2223673Google ScholarDigital Library
- Sungjune Jang, Lawrence H. Kim, Kesler Tanner, Hiroshi Ishii, and Sean Follmer. 2016. Haptic Edge Display for Mobile Tactile Interaction. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (San Jose, California, USA) (CHI '16). Association for Computing Machinery, New York, NY, USA, 3706--3716. https://doi.org/10.1145/2858036.2858264Google ScholarDigital Library
- Nikhita Joshi and Daniel Vogel. 2019. An Evaluation of Touch Input at the Edge of a Table. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (Glasgow, Scotland Uk) (CHI '19). ACM, New York, NY, USA, Article 246, bibinfonumpages12 pages. https://doi.org/10.1145/3290605.3300476Google ScholarDigital Library
- Amy K Karlson, Benjamin B Bederson, and Jose L Contreras-Vidal. 2008. Understanding one-handed use of mobile devices. In Handbook of research on user interface design and evaluation for mobile technology. IGI Global, 86--101.Google Scholar
- Kunihiro Kato and Homei Miyashita. 2015. ExtensionSticker: A Proposal for a Striped Pattern Sticker to Extend Touch Interfaces and Its Assessment. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (Seoul, Republic of Korea) (CHI '15). Association for Computing Machinery, New York, NY, USA, 1851--1854. https://doi.org/10.1145/2702123.2702500Google ScholarDigital Library
- S. Kolkur, D. Kalbande, P. Shimpi, C. Bapat, and J. Jatakia. 2016/12. Human Skin Detection Using RGB, HSV and YCbCr Color Models. In Proceedings of the International Conference on Communication and Signal Processing 2016 (ICCASP 2016). Atlantis Press, 324--332. https://doi.org/10.2991/iccasp-16.2017.51Google ScholarCross Ref
- Huy Viet Le, Sven Mayer, Patrick Bader, and Niels Henze. 2018b. Fingers' Range and Comfortable Area for One-Handed Smartphone Interaction Beyond the Touchscreen. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems. Association for Computing Machinery, New York, NY, USA, 1--12. https://doi.org/10.1145/3173574.3173605Google ScholarDigital Library
- Huy Viet Le, Sven Mayer, and Niels Henze. 2018a. InfiniTouch: Finger-Aware Interaction on Fully Touch Sensitive Smartphones. In Proceedings of the 31st Annual ACM Symposium on User Interface Software and Technology (Berlin, Germany) (UIST '18). Association for Computing Machinery, New York, NY, USA, 779--792. https://doi.org/10.1145/3242587.3242605Google ScholarDigital Library
- Huy Viet Le, Sven Mayer, Benedict Steuerlein, and Niels Henze. 2019. Investigating Unintended Inputs for One-Handed Touch Interaction Beyond the Touchscreen. In Proceedings of the 21st International Conference on Human-Computer Interaction with Mobile Devices and Services (Taipei, Taiwan) (MobileHCI'19). Association for Computing Machinery, New York, NY, USA, Article 34, bibinfonumpages14 pages. https://doi.org/10.1145/3338286.3340145Google ScholarDigital Library
- Huy Viet Le, Sven Mayer, Katrin Wolf, and Niels Henze. 2016. Finger Placement and Hand Grasp during Smartphone Interaction. In Proceedings of the 2016 CHI Conference Extended Abstracts on Human Factors in Computing Systems (San Jose, California, USA) (CHI EA '16). Association for Computing Machinery, New York, NY, USA, 2576--2584. https://doi.org/10.1145/2851581.2892462Google ScholarDigital Library
- Sven Mayer, Huy Viet Le, Markus Funk, and Niels Henze. 2019. Finding the Sweet Spot: Analyzing Unrestricted Touchscreen Interaction In-the-Wild. In Proceedings of the 2019 ACM International Conference on Interactive Surfaces and Spaces (Daejeon, Republic of Korea) (ISS '19). Association for Computing Machinery, New York, NY, USA, 171--179. https://doi.org/10.1145/3343055.3359705Google ScholarDigital Library
- William McGrath and Yang Li. 2014. Detecting Tapping Motion on the Side of Mobile Devices by Probabilistically Combining Hand Postures. In Proceedings of the 27th Annual ACM Symposium on User Interface Software and Technology (Honolulu, Hawaii, USA) (UIST '14). Association for Computing Machinery, New York, NY, USA, 215--219. https://doi.org/10.1145/2642918.2647363Google ScholarDigital Library
- phoneArena.com. 2018. Phone Finder. https://www.phonearena.com/phones. Accessed: 2018-07--17.Google Scholar
- Alan Poston. 2000. Human Engineering Design Data Digest. (2000), 159.Google Scholar
- R. L. Potter, L. J. Weldon, and B. Shneiderman. 1988. Improving the Accuracy of Touch Screens: An Experimental Evaluation of Three Strategies. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Washington, D.C., USA) (CHI '88). Association for Computing Machinery, New York, NY, USA, 27--32. https://doi.org/10.1145/57167.57171Google ScholarDigital Library
- Philip Quinn, Seungyon Claire Lee, Melissa Barnhart, and Shumin Zhai. 2019. Active Edge: Designing Squeeze Gestures for the Google Pixel 2. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (Glasgow, Scotland Uk) (CHI '19). ACM, New York, NY, USA, Article 274, bibinfonumpages13 pages. https://doi.org/10.1145/3290605.3300504Google ScholarDigital Library
- Francisco J. Romero-Ramirez, Rafael Muñoz-Salinas, and Rafael Medina-Carnicer. 2018. Speeded up detection of squared fiducial markers. Image and Vision Computing, Vol. 76 (2018), 38 -- 47. https://doi.org/10.1016/j.imavis.2018.05.004Google ScholarCross Ref
- Volker Roth and Thea Turner. 2009. Bezel Swipe: Conflict-Free Scrolling and Multiple Selection on Mobile Touch Screen Devices. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Boston, MA, USA) (CHI '09). Association for Computing Machinery, New York, NY, USA, 1523--1526. https://doi.org/10.1145/1518701.1518933Google ScholarDigital Library
- Joey Scarr, Andy Cockburn, Carl Gutwin, and Philip Quinn. 2011. Dips and Ceilings: Understanding and Supporting Transitions to Expertise in User Interfaces. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Vancouver, BC, Canada) (CHI '11). Association for Computing Machinery, New York, NY, USA, 2741--2750. https://doi.org/10.1145/1978942.1979348Google ScholarDigital Library
- Julia Schwarz, Robert Xiao, Jennifer Mankoff, Scott E. Hudson, and Chris Harrison. 2014. Probabilistic Palm Rejection Using Spatiotemporal Touch Features and Iterative Classification. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Toronto, Ontario, Canada) (CHI '14). Association for Computing Machinery, New York, NY, USA, 2009--2012. https://doi.org/10.1145/2556288.2557056Google ScholarDigital Library
- Karsten Seipp and Kate Devlin. 2014. BackPat: One-Handed off-Screen Patting Gestures. In Proceedings of the 16th International Conference on Human-Computer Interaction with Mobile Devices & Services (Toronto, ON, Canada) (MobileHCI '14). Association for Computing Machinery, New York, NY, USA, 77--80. https://doi.org/10.1145/2628363.2628396Google ScholarDigital Library
- Marcos Serrano, Eric Lecolinet, and Yves Guiard. 2013. Bezel-Tap Gestures: Quick Activation of Commands from Sleep Mode on Tablets. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Paris, France) (CHI '13). Association for Computing Machinery, New York, NY, USA, 3027--3036. https://doi.org/10.1145/2470654.2481421Google ScholarDigital Library
- Ben Shneiderman. 1991. Touch screens now offer compelling uses. Software, IEEE, Vol. 8, 2 (mar 1991), 93--94. https://doi.org/10.1109/52.73754Google ScholarDigital Library
- R. William Soukoreff and I. Scott MacKenzie. 2004. Towards a Standard for Pointing Device Evaluation, Perspectives on 27 Years of Fitts' Law Research in HCI. Int. J. Hum.-Comput. Stud., Vol. 61, 6 (Dec. 2004), 751--789. https://doi.org/10.1016/j.ijhcs.2004.09.001Google Scholar
- Daniel Spelmezan, Caroline Appert, Olivier Chapuis, and Emmanuel Pietriga. 2013a. Controlling Widgets with One Power-up Button. In Proceedings of the 26th Annual ACM Symposium on User Interface Software and Technology (St. Andrews, Scotland, United Kingdom) (UIST '13). Association for Computing Machinery, New York, NY, USA, 71--74. https://doi.org/10.1145/2501988.2502025Google ScholarDigital Library
- Daniel Spelmezan, Caroline Appert, Olivier Chapuis, and Emmanuel Pietriga. 2013b. Side Pressure for Bidirectional Navigation on Small Devices. In Proceedings of the 15th International Conference on Human-Computer Interaction with Mobile Devices and Services (Munich, Germany) (MobileHCI '13). Association for Computing Machinery, New York, NY, USA, 11--20. https://doi.org/10.1145/2493190.2493199Google ScholarDigital Library
- The Verge. 2019. I held the future in my hands, and it was foldable . https://www.theverge.com/2019/2/25/18239565/huawei-mate-x-foldable-phone-hands-on-design-mwc-2019 . Accessed: 2019-09--19.Google Scholar
- Daniel Vogel and Ravin Balakrishnan. 2010. Occlusion-aware Interfaces. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '10). ACM, New York, NY, USA, 263--272. https://doi.org/10.1145/1753326.1753365Google Scholar
- Daniel Vogel and Patrick Baudisch. 2007. Shift: A Technique for Operating Pen-Based Interfaces Using Touch. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (San Jose, California, USA) (CHI '07). Association for Computing Machinery, New York, NY, USA, 657--666. https://doi.org/10.1145/1240624.1240727Google ScholarDigital Library
- Graham Wilson, Stephen Brewster, and Martin Halvey. 2013. Towards Utilising One-Handed Multi-Digit Pressure Input. In CHI '13 Extended Abstracts on Human Factors in Computing Systems (Paris, France) (CHI EA '13). Association for Computing Machinery, New York, NY, USA, 1317--1322. https://doi.org/10.1145/2468356.2468591Google Scholar
- Jacob O. Wobbrock, Leah Findlater, Darren Gergle, and James J. Higgins. 2011. The Aligned Rank Transform for Nonparametric Factorial Analyses Using Only Anova Procedures. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Vancouver, BC, Canada) (CHI '11). Association for Computing Machinery, New York, NY, USA, 143--146. https://doi.org/10.1145/1978942.1978963Google ScholarDigital Library
- Xiaomi. 2020. Mi Mix Alpha 5G . https://in.event.mi.com/in/mi-mix-alphaGoogle Scholar
- Hyunjin Yoo, Jungwon Yoon, and Hyunsoo Ji. 2015. Index Finger Zone: Study on Touchable Area Expandability Using Thumb and Index Finger. In Proceedings of the 17th International Conference on Human-Computer Interaction with Mobile Devices and Services Adjunct (Copenhagen, Denmark) (MobileHCI '15). Association for Computing Machinery, New York, NY, USA, 803--810. https://doi.org/10.1145/2786567.2793704Google ScholarDigital Library
Index Terms
- Expanding Side Touch Input on Mobile Phones: Finger Reachability and Two-Dimensional Taps and Flicks using the Index and Thumb
Recommendations
Touch+Finger: Extending Touch-based User Interface Capabilities with "Idle" Finger Gestures in the Air
UIST '18: Proceedings of the 31st Annual ACM Symposium on User Interface Software and TechnologyIn this paper, we present Touch+Finger, a new interaction technique that augments touch input with multi-finger gestures for rich and expressive interaction. The main idea is that while one finger is engaged in a touch event, a user can leverage the ...
Air+touch: interweaving touch & in-air gestures
UIST '14: Proceedings of the 27th annual ACM symposium on User interface software and technologyWe present Air+Touch, a new class of interactions that interweave touch events with in-air gestures, offering a unified input modality with expressiveness greater than each input modality alone. We demonstrate how air and touch are highly complementary: ...
WordGesture-GAN: Modeling Word-Gesture Movement with Generative Adversarial Network
CHI '23: Proceedings of the 2023 CHI Conference on Human Factors in Computing SystemsWord-gesture production models that can synthesize word-gestures are critical to the training and evaluation of word-gesture keyboard decoders. We propose WordGesture-GAN, a conditional generative adversarial network that takes arbitrary text as input to ...
Comments