Interactive therapy with instrumented footwear

ABSTRACT

Musical feedback can aid in learning to move properly, for example in physical therapy, sports medicine, or training. By appropriately instrumenting the body to detect the correct motion (or the motion to be avoided), and mapping its characteristics causally onto an interactive musical stream, a patient can, in certain cases, be discouraged from making the incorrect motion and encouraged to move properly. We describe a heavily instrumented pair of shoes that were developed to function as a wearable gait laboratory, and overview some of the initial work performed using these shoes for real-time interactive therapy based exploiting musical feedback.

References

1. Wigram, T., Nygaard Pedersen, I., Ole Bonde, L. A Comprehensive Guide to Music Therapy: Theory, Clinical Practice, Research and Training, Jessica Kingsley Publishers, London, England (2003).
2. Rosenboom, D. (ed.), Biofeedback and the Arts: Results of Early Experiments, Vancouver: A.R.C. Publications (1976).
3. Gromala, D., et al, Meditation Chamber, SIGGRAPH 2001 Conf. Abstracts and Applications, ACM Press (2001), p. 127.
4. Ellis, P., "The music of sound: a new approach for children with severe and profound and multiple learning difficulties," In: British Journal of Music Education, 14:2 (1997), pp. 173--186.
5. Winkler, T., "Creating Interactive Dance with the Very Nervous System," Proc. of the Connecticut College Symposium on Art and Technology, New London, CT., February 27 - March 2 (1997) pp. 212--217.
6. Gerasimov, V., "Swings That Think," see: http://vadim.www.media.mit.edu/stt/bat.html.
7. Paradiso, J., Hsiao K. Benbasat A., and Teegarden Z., "Design and Implementation of Expressive Footwear," IBM Systems Journal, 39(3&4), October (2000), pp. 511--529.
8. Morris, S.J. "A Wireless Wearable System for Gait Analysis," Ph.D. thesis, MIT Media Lab and MIT Health Sciences Technology (HST) Program, April (2004).
9. Benbasat, A.Y., Morris, S.J. and Paradiso, J.A. "A Wireless Modular Sensor Architecture and its Application in On-Shoe Gait Analysis," in the Proc. of the IEEE International Conference on Sensors, Oct. 21-24 (2003), pp. 1086--1091.
10. Thaut, M.H., Kenyon, G.P., Schauer, M.L. and McIntosh, G.C. "The Connection Between Rhythmicity and Brain Function," Proc. of IEEE Engineering in Medicine & Biology, March/April (1999), pp. 101--107.
11. Pachetti, C., Mancini, F., Aglieri, R., Fundaro, C., Martignoni, E. and Nappi, G. "Active Music Therapy in Parkinson's Disease: An Integrative Method for Motor and Emotional Rehabilitation," Psychosomatic Medicine, 62 (2000), pp. 386--393.
12. Asmussen, E., "An Auditory Biofeedback Program for Gait Analysis," Responsive Environments Group Technical Report, MIT Media Lab, August (2003).

Index Terms

• Applied computing

  • Arts and humanities

    • Sound and music computing

• Human-centered computing

  • Human computer interaction (HCI)

• Information systems

  • Information retrieval

    • Specialized information retrieval

      • Multimedia and multimodal retrieval

        • Music retrieval