Tactile taps teach rhythmic text entry: passive haptic learning of morse code

ABSTRACT

Passive Haptic Learning (PHL) is the acquisition of sensorimotor skills with little or no active attention to learning. This technique is facilitated by wearable computing, and applications are diverse. However, it is not known whether rhythm-based information can be conveyed passively. In a 12 participant study, we investigate whether Morse code, a rhythmbased text entry system, can be learned through PHL using the bone conduction transducer on Google Glass. After four hours of exposure to passive stimuli while focusing their attention on a distraction task, PHL participants achieved a 94% accuracy rate keying a pangram (a phrase with all the letters of the alphabet) using Morse code on Glass's trackpad versus 53% for the control group. Most PHL participants achieved 100% accuracy before the end of the study. In written tests, PHL participants could write the codes for each letter of the alphabet with 98% accuracy versus 59% for control. When perceiving Morse code, PHL participants also performed significantly better than control: 83% versus 46% accuracy.

References

1. Adams R. J., Klowden D., and Hannaford B. Virtual training for a manual assembly task. Haptics-e, 2, 2 (2001).
2. Bi, X., Smith, B. A., and Zhai, S. Quasi-qwerty soft keyboard optimization. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, ACM, 2010, pp. 283--286.
3. D. Feygin, M. Keehner, and F. Tendick. Haptic guidance: Experimental evaluation of a haptic training. In IEEE Haptics Symposium, 2002, pp. 40--47.
4. Green, N., Kruger, J., Faldu, C, and St Amant, R. A reduced QWERTY keyboard for mobile text entry. In CHI'04 extended abstracts on Human Factors in Computing Systems, ACM, 2004, pp. 1429--1432.
5. Huang, K., Do, E. L., and Starner, T. PianoTouch: A wearable haptic piano instruction system for passive learning of piano skills. In Proceedings the International Symposium on Wearable Computers, IEEE, 2008, pp. 41--44.
6. Huang, K., Starner, T., Do, E., Weiberg, G., Kohlsdorf, D., Ahlrichs, C, and Leibrandt, R. Mobile music touch: mobile tactile stimulation for passive learning. In Proceedings of the SIGCHI conference on human factors in computing systems, ACM 2010, pp. 791--800.
7. Jones, M., Bokinsky, A., Tretter, T. and Negishi, A. A comparison of learning with haptic and visual modalities. Haptics-e, 3, 6 (May 2005).
8. Kohlsdorf, D., and Starner, T. Mobile music touch: The effect of primary tasks on passively learning piano sequences. In Proc. ISWC, IEEE, 2010, pp. 1--8.
9. Kristensson, P. O. Five challenges for intelligent text entry methods. AI Magazine, 30, 4 (2009) 85.
10. Krugman, H.E. and Hartley, E.L. Passive learning from television. The Public Opinion Quarterly, 34, 2 (1970), 184--190.
11. MacKenzie, I. S., and Tanaka-Ishii, K. Text entry systems: Mobility, accessibility, universality. Morgan Kaufmann, Burlington, MA USA, 2010.
12. Matias, E., MacKenzie, I. S., and Buxton, W. Half-QWERTY: A one-handed keyboard facilitating skill transfer from QWERTY. In Proceedings of SIGCHI Conference on Human Factors in Computing Systems (May). ACM, 1993, pp. 88--94.
13. Morris, D., Tan, H., Barbagli, F, Chang, T. and Salisbury, K. Haptic feedback enhances force skill learning. In Second Joint EuroHaptics Conference and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems, (Washington DC) IEEE Computer Society, 2007, pp. 21--26.
14. "Morse Code at 140 WPM." National Assoc. for Amateur Radio. 2008. http://www.arrl.org/news/morse-code-at-140-wpm.
15. Patton, J. and Mussa-Ivaldi, F. Robot-assisted adaptive training: Custom force fields for teaching movement patterns. IEEE Transactions on Biomedical Engineering, 51, 4 (2004), 636--646.
16. Seim, C., Chandler, J., DesPortes, K., Dhingra, S., Park, M., and Starner, T. Passive haptic learning of Braille typing. In Proceedings the International Symposium on Wearable Computers, (June), ACM, 2015, pp. 111--118.
17. Seim, C., Estes, T., and Starner, T. Towards Passive Haptic Learning of piano songs. In it World Haptics Conference, IEEE, 2015, pp. 445--450
18. Srimathveeravalli, G. and Thenkurussi, K.. Motor skill training assistance using haptic attributes. In WHC '05: Proceedings of the First Joint Eurohaptics Conference and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems, (Washington, DC), IEEE Computer Society, 2005, pp. 452--457.
19. Starner, T. How wearables worked their way into the mainstream. IEEE Pervasive Computing, (4), 2014, 10--15.
20. Yang, C. H., Huang, H. C., Chuang, L. Y., and Yang, C. H. A mobile communication aid system for persons with physical disabilities. Mathematical and Computer Modelling, 47, 3 (2008), 318--327.

Index Terms

• Human-centered computing

  • Human computer interaction (HCI)