Buzzing to play: lessons learned from an in the wild study of real-time vibrotactile feedback

ABSTRACT

Vibrotactile feedback offers much potential for facilitating and accelerating how people learn sensory-motor skills that typically take hundreds of hours to learn, such as learning to play a musical instrument, skiing or swimming. However, there is little evidence of this benefit materializing outside of research lab settings. We describe the findings of an in-the-wild study that explored how to integrate vibrotactile feedback into a real-world teaching setting. The focus of the study was on exploring how children of different ages, learning to play the violin, can use real-time vibrotactile feedback. Many of the findings were unexpected, showing how students and their teachers appropriated the technology in creative ways. We present some 'lessons learned' that are also applicable to other training settings, emphasizing the need to understand how vibrotactile feedback can switch between being foregrounded and backgrounded depending on the demands of the task, the teacher's role in making it work and when feedback is most relevant and useful. Finally, we discuss how vibrotactile feedback can provide a new language for talking about the skill being learned that may also play an instrumental role in enhancing learning.

References

1. Animazoo IGS-190-M http://www.animazoo.co.
2. Alamri, A., Eid, M., Iglesias, R., Shirmohammadi, S. and El Saddik, A. Haptic virtual rehabilation exercises for poststroke diagnosis. IEEE Trans. Instrumentation and Measurement, 59, (2008), 1876--1884.
3. Bhargava, A., Scott, M., Traylor, R., Chung, R., Mrozek, K., Wolter, J. and Tan, H. Effect of cognitive load on tactor location identification in zero-g. Proc 2005 World Haptics Conference (WHC05): First Joint Eurohaptics Conference and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems (2005) 56--62.
4. Bloomfield, A. and Badler, N. Virtual training via vibrotactile arrays. Presence, 2008, vol. 17, 103--120.
5. Grindlay, G. C. The impact of haptic guidance on musical motor learning, Masters Thesis, Massachusetts Institute of Technology, 2006.
6. Grosshauser, T. and Hermann, T. Augmented Haptics - An Interactive Feedback System for Musicians. Proc. Haptic and Audio Interaction Design, (2009), 100--108.
7. Hale, K. S. and Stanney, K. M. Deriving haptic design guidelines from human physiological, psychophysical, and neurological foundations. Computer Graphics and Applications. 24(2), (2004) 33--39.
8. Hoggan, E. and Brewster, S. A. CrossTrainer: Testing the Use of Multimodal Interfaces in Situ. Proc. CHI 2010, ACM (2010), 333--342.
9. Holland, S., Bouwer, A. J., Dalgelish, M., and Hurtig, T. M. Feeling the beat where it counts: fostering multi-limb rhythm skills with the haptic drum kit. Proc. TEI 2010, ACM (2010), 21--28.
10. Huang, K., Starner, T., Do, E., Weiberg, G., Kohlsdorf, D., Ahlrichs, C. and Leibrandt, R. Mobile music touch: mobile tactile stimulation for passive learning, Proc. CHI 2010, ACM (2010), 791--800.
11. Jambon, F. and Meillon, B. User experience evaluation in the wild. In Proc. CHI 2009, ACM (2009), 4069--4074.
12. Karapanos, E., Zimmerman, J. Forlizzi, J. and Martens, J. B. User Experience Over Time: An Initial Framework. Proc. CHI 2009, ACM (2009), 719--738.
13. Konczak, J., vander Velden, H. and Jaeger, L. Learning to play the violin: Motor control by freezing, not freeing degrees of freedom. Journal of Motor Behavior, vol. 41, no. 3, (2009) 243--252.
14. Lieberman, J. and Breazeal, C. TIKL: Development of a wearable vibrotactile feedback suit for improved human motor learning, In IEEE Transactions on Robotics, (2007), 919--926.
15. Ng, K. C., Weyde, T., Larkin, O., Neubarth, K., Koerselman, T. and Ong, B. 3D augmented mirror: a multimodal interface for string instrument learning and teaching with gesture support, Proc. ICMI 2007, ACM, (2007), 339--345.
16. Pielot, M. and Boll, S. Tactile Wayfinder: Comparison of Tactile Waypoint Navigation with Commercial pedestrian navigation Systems. Proc Pervasive Computing, LNCS (2010), 76--93.
17. Precision microdrive motor. http://www.precisionmicrodrives.co.
18. Rogers, Y., Connelly, K., Tedesco, L., Hazlewood, W., Kurtz, A., Hall, B., Hursey, J. and Toscos, T. Why it's worth the hassle: The value of in-situ studies when designing UbiComp. UbiComp 2007 Proceedings, LNCS 4717, Springer-Verlag, (2007) 336--353.
19. Schoonderwaldt, E. Mechanics and acoustics of violin bowing: Freedom, constraints and control in performance. Ph.D. dissertation, KTH - School Comput. Sci. Commun., Stockholm, Sweden, 2009.
20. Spelmezan, D., Jacobs, M., Hilgers, A. and Borchers, J. Tactile motion instructions for physical activities. In Proc. CHI 2009, ACM (2009), 2243--2252.
21. van der Linden, J. Schoonderwalt, E., Bird, J. and Johnson, R. MusicJacket: Combining Motion Capture and Vibrotactile Feedback to Teach Violin Bowing. In IEEE Transactions on Instrumentation and Measurement, 60 (1), 2011 (in press).
22. van der Linden, J., Schoonderwaldt, E. and Bird, J. Towards a real-time system for teaching novices good violin bowing technique. Proc. IEEE HAVE, (2009), 81--86.

Index Terms

• Applied computing

• Human-centered computing

  • Human computer interaction (HCI)