Abstract
This article describes the experiences of the first author, who was diagnosed with the neuromuscular disease Friedreich's Ataxia more than 25 years ago, with the innovative approach to human-computer interaction characterized by the software tool OnScreenDualScribe. Originally developed by (and for!) the first author, the tool replaces the standard input devices—that is, keyboard and mouse—with a small numeric keypad, making optimal use of his abilities. This work attempts to illustrate some of the difficulties the first author usually has to face when operating a computer, due to considerable motor problems. The article will discuss what he tried in the past, and why OnScreenDualScribe, offering various assistive techniques—including word prediction, an ambiguous keyboard, and stepwise pointing operations—is indeed a viable alternative. In a pilot study that was repeated multiple times with slight variations over a period of 3 years, the first author's entry rate with OnScreenDualScribe (including early versions of the tool) increased from 1.38wpm to 6.16wpm, while his achievable typing rate went from 12wpm to 3.5wpm in the course of 24 years. However, the ultimate goal is to help not just one single person, but to make the system—which not only accelerates entry, but also clearly reduces the required effort—available to anyone with similar conditions.
- Brendan Z. Allison, Elizabeth Winter Wolpaw, and Jonathan R. Wolpaw. 2007. Brain-computer interface systems: Progress and prospects. Expert Rev. Med. Devices 4, 4 (2007), 463--474. DOI:http://dx.doi.org/ 10.1586/17434440.4.4.463Google ScholarCross Ref
- Melanie Baljko and Andrew Tam. 2006. Indirect text entry using one or two keys. In Proceedings of the 8th International ACM SIGACCESS Conference on Computers and Accessibility (Assets'06). ACM, New York, NY, 18--25. DOI:http://dx.doi.org/10.1145/1168987.1168992 Google ScholarDigital Library
- Mohammed Belatar and Franck Poirier. 2008. Text entry for mobile devices and users with severe motor impairments: Handiglyph, a primitive shapes based onscreen keyboard. In Proceedings of the 10th International ACM SIGACCESS Conference on Computers and Accessibility (Assets'08). ACM, New York, NY, 209--216. DOI:http://dx.doi.org/10.1145/1414471.1414510 Google ScholarDigital Library
- Jeff A. Bilmes, Xiao Li, Jonathan Malkin, Kelley Kilanski, Richard Wright, Katrin Kirchhoff, Amarnag Subramanya, Susumu Harada, James A. Landay, Patricia Dowden, and Howard Chizeck. 2005. The vocal joystick: A voice-based human-computer interface for individuals with motor impairments. In Proceedings of the Conference on Human Language Technology and Empirical Methods in Natural Language Processing (HLT '05). Association for Computational Linguistics, Stroudsburg, PA, 995--1002. DOI:http://dx.doi.org/10.3115/1220575.1220700 Google ScholarDigital Library
- Robert Cowley (Ed.). 2001. The Collected “What If?”. American Historical Publications, Inc.Google Scholar
- Martin B. Delatycki, Robert Williamson, and Susan Forrest. 2000. Friedreich ataxia: An overview. J. Med. Genet. 37, 1 (Jan. 2000), 1--8.Google ScholarCross Ref
- Torsten Felzer. 2009. Effortlessly embracing the power of modern technology. In Proceedings of the AGOSCI 2009 Communication Feel the Power, Biennial National Conference. AGOSCI, 1--2.Google Scholar
- Torsten Felzer, Philipp Beckerle, Stephan Rinderknecht, and Rainer Nordmann. 2010. Leveraging retained physical capabilities to improve quality of life as assessed by persons with severe motor impairments. Disabil. Rehabil.: Assist. Technol. 5, 4 (2010), 272--278.Google ScholarCross Ref
- Torsten Felzer, Ian Scott MacKenzie, Philipp Beckerle, and Stephan Rinderknecht. 2010. Qanti: A software tool for quick ambiguous non-standard text input. In Lecture Notes in Computer Science—Computers Helping People with Special Needs 2010, Part II, LNCS 6180. Springer-Verlag, Berlin, Heidelberg, 128--135. Google ScholarDigital Library
- Torsten Felzer, Ian Scott MacKenzie, and Stephan Rinderknecht. 2012. DualScribe: A keyboard replacement for those with Friedreich's Ataxia and related diseases. In Lecture Notes in Computer Science—Computers Helping People with Special Needs 2012, Part II, LNCS 7383. Springer-Verlag, Berlin, 431--438. Google ScholarDigital Library
- Torsten Felzer, Ian Scott MacKenzie, and Stephan Rinderknecht. 2013. OnScreenDualScribe: A computer operation tool for users with a neuromuscular disease. In Proceedings of HCI International 2013, UAHCI/HCII 2013, Part I, LNCS 8009. Springer-Verlag, 474--483. Google ScholarDigital Library
- Torsten Felzer and Rainer Nordmann. 2006a. Alternative text entry using different input methods. In Proceedings of the 8th International ACM SIGACCESS Conference on Computers and Accessibility (Assets'06). ACM, New York, NY, 10--17. DOI:http://dx.doi.org/10.1145/1168987.1168991 Google ScholarDigital Library
- Torsten Felzer and Rainer Nordmann. 2006b. Speeding up hands-free text entry. In Proceedings of the 3rd Cambridge Workshop on UNIVERSAL ACCESS and ASSISTIVE TECHNOLOGY. Cambridge University Press, Cambridge, UK, 27--36.Google Scholar
- Torsten Felzer and Rainer Nordmann. 2008. Using intentional muscle contractions as input signals for various hands-free control applications. In Proceedings of the 2nd International Convention on Rehabilitation Engineering & Assistive Technology (iCREATe'08). Singapore Therapeutic, Assistive & Rehabilitative Technologies (START) Centre, Kaki Bukit TechPark II, Singapore, 87--91. Google ScholarDigital Library
- Torsten Felzer, Rainer Nordmann, and Stephan Rinderknecht. 2009. Scanning-based human-computer interaction using intentional muscle contractions. In Universal Access in HCI, Part II, HCII 2009, LNCS 5615, C. Stephanidis (Ed.). Springer-Verlag, Berlin, 509--518. Google ScholarDigital Library
- Torsten Felzer and Stephan Rinderknecht. 2011. Using a game controller for text entry to address abilities and disabilities specific to persons with neuromuscular diseases. In Proceedings of the 13th International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS'11). ACM, New York, NY, 299--300. DOI:http://dx.doi.org/10.1145/2049536.2049616 Google ScholarDigital Library
- Torsten Felzer and Stephan Rinderknecht. 2013. Mouse mode of OnScreenDualScribe: Three types of keyboard-driven mouse replacement. In CHI '13 Extended Abstracts on Human Factors in Computing Systems (CHI EA'13). ACM, New York, NY, 1593--1598. DOI:http://dx.doi.org/10.1145/2468356.2468641 Google ScholarDigital Library
- Torsten Felzer, Bruno Strah, and Rainer Nordmann. 2008. Automatic and self-paced scanning for alternative text entry. In Proceedings of the IASTED International Conference on Telehealth/Assistive Technologies (Telehealth/AT'08). ACTA Press, Anaheim, CA, 1--6. Google ScholarDigital Library
- James Gips, Margrit Betke, and Peter Fleming. 2000. The camera mouse: Preliminary investigation of automated visual tracking for computer access. In Proceedings of RESNA 2000. RESNA Press, Arlington, VA, 98--100.Google Scholar
- Susumu Harada, Jacob O. Wobbrock, Jonathan Malkin, Jeff A. Bilmes, and James A. Landay. 2009. Longitudinal study of people learning to use continuous voice-based cursor control. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI'09). ACM, New York, NY, 347--356. DOI:http://dx.doi.org/10.1145/1518701.1518757 Google ScholarDigital Library
- Zakria Hussain, Kitsuchart Pasupa, and John Shawe-Taylor. 2010. Learning relevant eye movement feature spaces across users. In Proceedings of the 2010 Symposium on Eye-Tracking Research & Applications (ETRA'10). ACM, New York, NY, 181--185. DOI:http://dx.doi.org/10.1145/1743666.1743711 Google ScholarDigital Library
- Alex Jansen, Leah Findlater, and Jacob O. Wobbrock. 2011. From the lab to the world: Lessons from extending a pointing technique for real-world use. In CHI '11 Extended Abstracts on Human Factors in Computing Systems (CHI EA'11). ACM, New York, NY, 1867--1872. DOI:http://dx.doi.org/10.1145/1979742.1979888 Google ScholarDigital Library
- Manu Kumar, Andreas Paepcke, and Terry Winograd. 2007. EyePoint: Practical pointing and selection using gaze and keyboard. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI'07). ACM, New York, NY, 421--430. DOI:http://dx.doi.org/10.1145/1240624.1240692 Google ScholarDigital Library
- Ian Scott Mackenzie and Torsten Felzer. 2010. SAK: Scanning ambiguous keyboard for efficient one-key text entry. ACM Trans. Comput.-Hum. Interact. 17, 3, Article 11 (July 2010), 39 pages. DOI:http://dx.doi.org/10.1145/1806923.1806925 Google ScholarDigital Library
- Dennis J. McFarland, William A. Sarnacki, Theresa M. Vaughan, and Jonathan R. Wolpaw. 2003. EMG contamination of EEG: Spectral and topographical characteristics. Clin. Neurophysiol. 114 (2003), 1580--1593.Google ScholarCross Ref
- Dennis J. McFarland, William A. Sarnacki, Theresa M. Vaughan, and Jonathan R. Wolpaw. 2005. Brain-computer interface (BCI) operation: Signal and noise during early training sessions. Expert Rev. Med. Devices 116 (2005), 56--62.Google Scholar
- Ondřej Poláček, Zdeněk Míkovec, Adam J. Sporka, and Pavel Slavík. 2010. New way of vocal interface design: Formal description of non-verbal vocal gestures. In Proceedings of the 5th Cambridge Workshop on Universal Access and Assistive Technology. Cambridge University Press, 137--144.Google Scholar
- Richard C. Simpson and Heidi Horstmann Koester. 1994. Modeling the speed of text entry with a word prediction interface. IEEE Trans. Rehab. Eng. 2, 3 (1994), 177--187. DOI:http://dx.doi.org/10.1109/86.331567Google ScholarCross Ref
- Richard C. Simpson and Heidi Horstmann Koester. 1999. Adaptive one-switch row-column scanning. IEEE Trans. Rehab. Eng. 7, 4 (1999), 464--473. DOI:http://dx.doi.org/10.1109/86.808950Google ScholarCross Ref
- Adam J. Sporka, Torsten Felzer, Sri Hastuti Kurniawan, Ondřej Poláček, Paul Haiduk, and Ian Scott MacKenzie. 2011. CHANTI: Predictive text entry using non-verbal vocal input. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI'11). ACM, New York, NY, 2463--2472. DOI:http://dx.doi.org/10.1145/1978942.1979302 Google ScholarDigital Library
- Adam J. Sporka, Sri Hastuti Kurniawan, and Pavel Slavík. 2004. Whistling user interface (U3I). In Proceedings of the 8th ERCIM Workshop on “User Interfaces For All,” User-Centered Interaction Paradigms for Universal Access in the Information Society, LNCS 3196. Springer-Verlag, Berlin, 472--478.Google ScholarCross Ref
- Tonio Wandmacher, Jean-Yves Antoine, Franck Poirier, and Jean-Paul Départe. 2008. Sibylle, an assistive communication system adapting to the context and its user. ACM Trans. Access. Comput. 1, 1 (May 2008), Article 6, 30 pages. DOI:http://dx.doi.org/10.1145/1361203.1361209 Google ScholarDigital Library
- David J. Ward, Alan F. Blackwell, and David J. C. MacKay. 2000. Dasher—A data entry interface using continuous gestures and language models. In Proceedings of the 13th Annual ACM Symposium on User Interface Software and Technology (UIST'00). ACM, New York, NY, 129--137. DOI:http://dx.doi.org/10.1145/354401.354427 Google ScholarDigital Library
- Richard Watts and Peter Robinson. 1999. Controlling computers by whistling. In Proceedings of Eurographics UK.Google Scholar
- Wei Zhang, Vincent G. Duffy, Richard Linn, and Ameersing Luximon. 1999. Voice recognition based human-computer interface design. Comput. Ind. Eng. 37, 1--2 (Oct. 1999), 305--308. DOI:http://dx.doi.org/10.1016/S0360-8352(99)00080-7 Google ScholarDigital Library
Index Terms
- Experiences of Someone with a Neuromuscular Disease in Operating a PC (and Ways to Successfully Overcome Challenges)
Recommendations
Personalizable Alternative Mouse and Keyboard Interface for People with Motor Disabilities of Neuromuscular Origin
ASSETS '22: Proceedings of the 24th International ACM SIGACCESS Conference on Computers and AccessibilityPeople with motor disabilities of neuromuscular origin often struggle with operating the computer through a commercially available mouse and QWERTY keyboard. This work presents an alternative mouse and keyboard interface, which is personalizable to meet ...
How someone with a neuromuscular disease experiences operating a PC (and how to successfully counteract that)
ASSETS '13: Proceedings of the 15th International ACM SIGACCESS Conference on Computers and AccessibilityThis paper describes the experiences of the first author, who has been diagnosed with the neuromuscular disease Friedreich's Ataxia more than 25 years ago, with the innovative approach to human-computer interaction characterized by the software tool ...
Text entry using a compact keypad with OSDS
ASSETS '14: Proceedings of the 16th international ACM SIGACCESS conference on Computers & accessibilityThis demo is about OSDS, a very powerful tool allowing computer users who cannot use a standard keyboard to replace that with a compact number-pad-like device, the so-called DualPad. The idea is to offer efficient text entry despite the smaller number ...
Comments