Communicating emotions in online chat using physiological sensors and animated text

ABSTRACT

We present a chat system that uses animateddynamic text associated with emotional information to show the affective state of the user. The system obtains the affective state of a chat user from a physiological sensor attached to the user's body. This paper describes preliminary experiments and provides examples of possible applications of our chat system. Observations from informal experiments comparing our animated chat system with a conventional system suggest that an online interface that conveys emotional information helps online users to interact with each other more efficiently.

References

1. Birdwhistell, R. Kinetics and Context:Essays on Body Motion Communication, University of Pennsylvania Press, 1970.
2. Picard, R., Affective Computing. Cambridge: MIT Press, 1995.
3. Conati, C., Chabbal, R., Maclaren, H. A Study on using biometric sensors for monitoring user emotions in educational games. Workshop on Assessing and Adapting to User Attitudes and Affect: Why, When and How?,, in conjunction with User Modeling (UM-03), Johnstown, USA, 2003.
4. Ford, S., Forlizzi, J., and Ishizaki, S. Kinetic typography: Issues in time-based extended abstracts, In Proceedings of CHI97 Conference Extended Abstracts, 1997, pp 269--270.
5. Ishizaki, S. On Kkinetic Ttypography Sstatements, American Center for Design Journal Vol. 12 No.1, 1998.
6. Lee, J., Forlizzi, J., and Hudson, S. The kinetic typography engine: an extensible system for animating expressive text, In Proceedings of UIST02, 2002, pp 81--90.
7. Forlizzi, J., Lee, J., and Hudson, S. Kinedit system: Affective messages using dynamic texts, In Proceedings of CHI, ACM Press, 2003, pp 377--384.
8. Bodine, K., and Pignol, M. Kinetic typography-based instant messaging, In Proceedings of CHI2003, Demonstration, 2003.
9. Klein, J., Moon, Y., and Picard, R. This computer responds to user frustration: Theory, design, and results. Interacting with Computers, 2002, pp 119--140.
10. Prendinger, H., Mayer, S., Mori, J., and Ishizuka, M. Persona effect revisited. Using bio-signals to measure and reflect the impact of character-based interfaces. 4th Working Conference on Intelligent Virtual Agents, Germany,2003, pp 283--291.
11. Vyzas, E., Minka, T., and Healey, J., Emotion Recognition in an Actor, MIT Media Lab ProjectVyzas, E., Recognition of Emotional and Cognitive States Using Physiological Data, Mechanical Engineer's Degree Thesis, MIT, June 1999
12. Lang, P. J., The emotion probe: Studies of motivation and attention. American Psychologist, 50(5), 1995, pp 372.
13. ProComp UNIT, Thought Technology Ltd., http://www.thoughttechnology.com/
14. Natatsu, R., Tadenuma. M., Maekawa, T., Computer technologies that support Kansei expression using the body, In Proceedings of 9th ACM Multimedia, Ottawa, 2001Canada, pp 358--364.

Index Terms

• Computing methodologies

  • Computer graphics

    • Animation

  • Modeling and simulation

    • Simulation types and techniques

      • Simulation by animation

• Human-centered computing

  • Human computer interaction (HCI)

    • HCI theory, concepts and models

    • Interaction paradigms

      • Web-based interaction

  • Interaction design

    • Interaction design theory, concepts and paradigms