Does computer-generated speech manifest personality? an experimental test of similarity-attraction

ABSTRACT

This study examines whether people would interpret and respond to paralinguistic personality cues in computer-generated speech in the same way as they do human speech. Participants used a book-buying website and heard five book reviews in a 2 (synthesized voice personality: extrovert vs. introvert) by 2 (participant personality: extrovert vs. introvert) balanced, between-subjects experiment. Participants accurately recognized personality cues in TTS and showed strong similarity-attraction effects. Although the content was the same for all participants, when the personality of the computer voice matched their own personality: 1) participants regarded the computer voice as more attractive, credible, and informative; 2) the book review was evaluated more positively; 3) the reviewer was more attractive and credible; and 4) participants were more likely to buy the book. Match of user voice characteristics with TTS had no effect, confirming the social nature of the interaction. We discuss implications for HCI theory and design.

References

1. 1.Beutnagel, M., Conkie, A., Schroeter, J., Stylianou, Y. & Syrdal, A. The A T&T Next-Gen 7TS system. Paper presented at joint meeting of ASA, EAA, and DAGA, Berlin, Germany, March, 1999. {Online} Available at http ://www. research, att. com/proj ects/tts/papers/1999_ ASA_Berlin/nextgen.pdf
2. 2.Giles, H. & Powesland, P. F. Speech style and social evaluation. Academic Press, London. 1975.
3. 3.Hall, J. A. Nonverbal sex differences. Johns Hopkins University Press, Baltimore, MD, 1980.
4. 4.Isbister, K. & Nass, C. Consistency of personality in interactive characters: verbal cues, non-verbal cues, and user characteristics. International Journal of Human-Computer Interaction, in press.
5. 5.James, F. Representing structured information in audio interfaces: A framework for selecting audio marking techniques to represent document structures. Ph.D. Dissertation, Stanford University, 1998.
6. 6.Kamm, C., Walker, M. and Rabiner, L. The role of speech processing in human-computer intelligent communication. Paper presented at NSF Workshop on human-centered systems: Information, interactivity, and intelligence, February, 1997. {Online} Available at http ://www. ifp. uiuc. edu/nsfhcs/talks/rabiner, html
7. 7.Massaro, D. M. Perceiving talking faces." From speech perception to a behavioral principle. MIT Press, Cambridge, MA, 1997
8. 8.Moon, Y. When the computer is the "salesperson" Computer responses to computer "personalities" in interactive marketing situations. Working paper No. 99-041, Harvard Business School. Boston, MA, 1998.
9. 9.Murray, J. B. Review of research on the Myers-Briggs type indicator. Perceptual and Motor Skills, 70. 1187- 1202, 1990.
10. 10.Nass, C. & Gong, L. Maximized modality or constrained consistence? Paper presented at audiovisual speech processing conference, August, 1999.
11. 11.Nass, C. & Moon, Y. Machines and mindlessness" Social responses to computers, journal of Social Issues, in press.
12. 12.Nass, C., Moon, Y., Fogg, B. J., Reeves, B., & Dryer, D. C. Can computer personalities be human personalities? International Journal of Human- Computer Studies, 43, 223-239, 1995.
13. 13.Olive, J. P. The talking computer: Text to speech synthesis, in D. Stork (ed.) Hal's legacy: 2001's computer as dream and reality. 101-130. The MIT Press, Cambridge, MA, 1997.
14. 14.Oren, T., Salomon, G., Kreitman, K., & Don, A. Guides: Characterizing the interface. In B. Laurel (Ed.) The art of human-computer interface design. Addison-Wesley, Reading, MA, 1990.
15. 15.Pittam, J. Voice in social interaction: An interdisciplinary approach. Sage, Thousand Oaks, CA, 1994.
16. 16.Ramsay, R. W. Personality and speech. Journal of Personality and Social Psychology, 4, 116-118. 1966.
17. 17.Reeves, B. & Nass, C. The media equation: How people treat computers, television, and new media like real people and places. Cambridge University Press, New York, NY, 1996.
18. 18.Sawlmey, N. and Schmandt, C. Design of spatialized audio in nomadic environments. Paper presented at the international conference on auditory display (ICAD'97), November, 1997. {Online} Available at http://www.media.mit.eelu/-~nitin/NomadicRadio/ICA D97/ICAD97_paper/iCAD97.html
19. 19.Stmeiderman, B. Designing the user Interface: Strategies for effective HCI (3rd ed.). Addison- Wesley, Reading, MA, 1997.
20. 20.Smith, B. L., Brown, B.L., Strong, W.J., & Rencher, A.C. Effects of speech rate on personality perceptions. Language and Speech, 18, 145-152, 1975.
21. 21.Turkle, S., The second self" Computers and ~the human spirit. Simon and Schuster, New York, NY, 1984.
22. 22.Wheeless, L. R. & Grotz, J. The measurement of trust and its relationship to serf-disclosure. Human Communication Research, 3(3), 250-257, 1977.
23. 23.Wiggins, J. S. A psychological taxonomy of traitdescriptive terms: The interpersonal domain. Journal of Personality and Social Psychology, 37(3), 395-412, 1979.
24. 24.Woodall, W. G., & Burgoon, J.K. Talking fast and changing attitudes: A critique and clarification. Journal of Nonverbal Behavior, 8, 126-142, 1983

Index Terms

• Computing methodologies

  • Artificial intelligence

    • Natural language processing

      • Speech recognition

• Human-centered computing

  • Human computer interaction (HCI)