Leah Findlater
Jacob Wobbrock
ABSTRACT
Although many techniques have been proposed to improve text input on touch screens, the vast majority of this research ignores non-alphanumeric input (i.e., punctuation, symbols, and modifiers). To support this input, widely adopted commercial touch-screen interfaces require mode switches to alternate keyboard layouts for most punctuation and symbols. Our approach is to augment existing ten-finger QWERTY keyboards with multi-touch gestural input that can exist as a complement to the moded-keyboard approach. To inform our design, we conducted a study to elicit user-defined gestures from 20 participants. The final gesture set includes both multi-touch and single-touch gestures for commonly used non-alphanumeric text input. We implemented and conducted a preliminary evaluation of a touch-screen keyboard augmented with this technique. Findings show that using gestures for non-alphanumeric input is no slower than using keys, and that users strongly prefer gestures to a moded-keyboard interface.
- Anthony, L. and Wobbrock, J. O. 2010. A lightweight multistroke recognizer for user interface prototypes. Proc. GI '10, 245--252. Google Scholar
Digital Library
- Brewster, S. A., and Hughes, M. 2009. Pressure-based text entry for mobile devices. Proc. MobileHCI '09, 73--76. Google ScholarDigital Library
- Isokoski, P.. 2004. Performance of menu-augmented soft keyboards. Proc. CHI '04, 423--430. Google ScholarDigital Library
- Kristensson, P. and Zhai, S. 2004. SHARK2 : a large vocabulary shorthand writing system for pen-based computers. Proc. UIST '04, 43--52. Google ScholarDigital Library
- MacKenzie, I. S., Soukoreff, R. W. 2002. Text entry for mobile computing: models and methods, theory and practice. Human-Computer Interaction 17 (2), 147--198.Google ScholarCross Ref
- MacKenzie, I. S., Zhang, S. X. 1997. The immediate usability of Graffiti. Proc. GI '97, 129--137. Google ScholarDigital Library
- Soukoreff , R. W. and MacKenzie, I. S. 2003. Metrics for text entry research: an evaluation of MSD and KSPC, and a new unified error metric. Proc. CHI '03, 113--120. Google ScholarDigital Library
- Wobbrock, J. O., Aung, H. H., Rothrock, B. and Myers, B. A. (2005). Maximizing the guessability of symbolic input. Extended Abstracts CHI '05, 1869--1872. Google ScholarDigital Library
- Wobbrock, J. O., Morris, M. R., and Wilson, A. D. 2009. User-defined gestures for surface computing. Proc. CHI '09, 1083--1092. Google ScholarDigital Library
- Zhai, S., Hunter, M., and Smith, B. A. 2002. Performance optimization of virtual keyboards. HumanComputer Interaction 17 (3), 89--129.Google Scholar
Index Terms
- Beyond QWERTY: augmenting touch screen keyboards with multi-touch gestures for non-alphanumeric input
Recommendations
Gestural Text Input Using a Smartwatch
AVI '16: Proceedings of the International Working Conference on Advanced Visual InterfacesOne challenge with modern smartwatches is text input. In this paper we explore the use of gestural interaction with a smartwatch to support text input. The inertial measurement unit of a smartwatch is used to capture gestural interaction by a user, and ...
Text entry from power wheelchairs: edgewrite for joysticks and touchpads
Power wheelchair joysticks have been used to control a mouse cursor on desktop computers, but they offer no integrated text entry solution, confining users to point-and-click or point-and-dwell with on-screen keyboards. But on-screen keyboards reduce ...
MicroRolls: expanding touch-screen input vocabulary by distinguishing rolls vs. slides of the thumb
CHI '09: Proceedings of the SIGCHI Conference on Human Factors in Computing SystemsThe input vocabulary for touch-screen interaction on handhelds is dramatically limited, especially when the thumb must be used. To enrich that vocabulary we propose to discriminate, among thumb gestures, those we call MicroRolls, characterized by zero ...
Comments