Evaluating Animated Characters: Facial Motion Magnitude Influences Personality Perceptions

Abstract

Animated characters are expected to fulfill a variety of social roles across different domains. To be successful and effective, these characters must display a wide range of personalities. Designers and animators create characters with appropriate personalities by using their intuition and artistic expertise. Our goal is to provide evidence-based principles for creating social characters. In this article, we describe the results of two experiments that show how exaggerated and damped facial motion magnitude influence impressions of cartoon and more realistic animated characters. In our first experiment, participants watched animated characters that varied in rendering style and facial motion magnitude. The participants then rated the different animated characters on extroversion, warmth, and competence, which are social traits that are relevant for characters used in entertainment, therapy, and education. We found that facial motion magnitude affected these social traits in cartoon and realistic characters differently. Facial motion magnitude affected ratings of cartoon characters’ extroversion and competence more than their warmth. In contrast, facial motion magnitude affected ratings of realistic characters’ extroversion but not their competence nor warmth. We ran a second experiment to extend the results of the first. In the second experiment, we added emotional valence as a variable. We also asked participants to rate the characters on more specific aspects of warmth, such as respectfulness, calmness, and attentiveness. Although the characters’ emotional valence did not affect ratings, we found that facial motion magnitude influenced ratings of the characters’ respectfulness and calmness but not attentiveness. These findings provide a basis for how animators can fine-tune facial motion to control perceptions of animated characters’ personalities.

References

1. Steven J. Ackerman and Mark J. Hilsenroth. 2003. A review of therapist characteristics and techniques positively impacting the therapeutic alliance. Clinical Psychology Review 23, 1 (2003), 1--33.
2. Zara Ambadar, Jonathan W. Schooler, and Jeffrey F. Cohn. 2005. Deciphering the enigmatic face: The importance of facial dynamics in interpreting subtle facial expressions. Psychological Science 16, 5 (2005), 403--410.
3. Cameron Anderson, Oliver P. John, Dacher Keltner, and Ann M. Kring. 2001. Who attains social status? Effects of personality and physical attractiveness in social groups. Journal of Personality and Social Psychology 81, 1 (2001), 116--132.
4. Elisa Back, Timothy R. Jordan, and Sharon M. Thomas. 2009. The recognition of mental states from dynamic and static facial expressions. Visual Cognition 17, 8 (2009), 1271--1286.
5. Gary Bente, Nicole C. Krämer, Anita Petersen, and Jan Peter de Ruiter. 2001. Computer animated movement and person perception: Methodological advances in nonverbal behavior research. Journal of Nonverbal Behavior 25, 3 (2001), 151--166.
6. Steven M. Boker, Jeffrey F. Cohn, Barry-John Theobald, Iain Matthews, Timothy R. Brick, and Jeffrey R. Spies. 2009. Effects of damping head movement and facial expression in dyadic conversation using real-time facial expression tracking and synthesized avatars. Philosophical Transactions of the Royal Society B: Biological Sciences 364, 1535 (2009), 3485--3495.
7. David H. Brainard. 1997. The psychophysics toolbox. Spatial Vision 10 (1997), 433--436.
8. Justine Cassell. 2000. Nudge nudge wink wink: Elements of face-to-face conversation for embodied conversational agents. In Embodied Conversational Agents, Justine Cassell, Joseph Sullivan, Scott Prevost, and Elizabeth Churchill (Eds.). MIT Press, 1--27.
9. Timothy F. Cootes, Gareth J. Edwards, and Christopher J. Taylor. 2001. Active appearance models. IEEE Transactions on Pattern Analysis and Machine Intelligence 23, 6 (2001), 681--685.
10. Timothy F. Cootes, Gavin V. Wheeler, Kevin N. Walker, and Christopher J. Taylor. 2002. View-based active appearance models. Image and Vision Computing 20, 9 (2002), 657--664.
11. John M. Digman. 1990. Personality structure: Emergence of the five-factor model. Annual Review of Psychology 41, 1 (1990), 417--440.
12. Judith Donath. 2001. Mediated faces. In Cognitive Technology: Instruments of Mind, Meurig Beynon, Chrystopher L. Nehaniv, and Kerstin Dautenhahn (Eds.). Lecture Notes in Computer Science, Vol. 2117. Springer, Berlin, 373--390.
13. Cynthia Doucet and Robert M. Stelmack. 1997. Movement time differentiates extraverts from introverts. Personality and Individual Differences 23, 5 (1997), 775--786.
14. Paul Ekman, Wallace V. Friesen, and Maureen O’Sullivan. 1988. Smiles when lying. Journal of Personality and Social Psychology 54, 3 (1988), 414.
15. Paul Ekman, Wallace V. Friesen, Maureen O’Sullivan, and Klaus Scherer. 1980. Relative importance of face, body, and speech in judgments of personality and affect. Journal of Personality and Social Psychology 38, 2 (1980), 270--277.
16. Paula M. Ellis and Joanna J. Bryson. 2005. The significance of textures for affective interfaces. In Intelligent Virtual Agents. Springer, 394--404.
17. Susan T. Fiske, Amy J. C. Cuddy, Peter Glick, and Jun Xu. 2002. A model of (often mixed) stereotype content: Competence and warmth respectively follow from perceived status and competition. Journal of Personality and Social Psychology 82, 6 (2002), 878--902.
18. Howard S. Friedman, Ronald E. Riggio, and Daniel F. Casella. 1988. Nonverbal skill, personal charisma, and initial attraction. Personality and Social Psychology Bulletin 14, 1 (1988), 203--211.
19. Peggy E. Gallaher. 1992. Individual differences in nonverbal behavior: Dimensions of style. Journal of Personality and Social Psychology 63, 1 (1992), 133--145.
20. Robert Gifford. 1991. Mapping nonverbal behavior on the interpersonal circle. Journal of Personality and Social Psychology 61, 2 (1991), 279--288.
21. Samuel Gosling, Peter Rentfrow, and William Swann. 2003. A very brief measure of the big-five personality domains. Journal of Research in Personality 37, 6 (2003), 504--528.
22. Ursula Hess, Sylvie Blairy, and Robert E. Kleck. 1997. The intensity of emotional facial expressions and decoding accuracy. Journal of Nonverbal Behavior 21, 4 (1997), 241--257.
23. Gray Hodgkinson. 2009. The seduction of realism. In Proceedings of the 2nd ACM SIGGRAPH Conference and Exhibition on Computer Graphics and Interactive Techniques in Asia (SIGGRAPH ASIA’09 Educators Program). ACM, 1--4.
24. Jennifer Hyde, Elizabeth J. Carter, Sara Kiesler, and Jessica K. Hodgins. 2013. Perceptual effects of damped and exaggerated facial motion in animated characters. In Proceedings of the 10th International Conference and Workshops on Automatic Face and Gesture Recognition (FG’13). IEEE, 1--6.
25. Jennifer Hyde, Elizabeth J. Carter, Sara Kiesler, and Jessica K. Hodgins. 2014. Assessing naturalness and emotional intensity: A perceptual study of animated facial motion. In Proceedings of the Symposium on Applied Perception (SAP’14). ACM, 15--22.
26. Carroll E. Izard. 1994. Innate and universal facial expressions: Evidence from developmental and cross-cultural research. Psychological Bulletin 115, 2 (1994), 288--299.
27. Mario Kleiner, David Brainard, and Denis Pelli. 2007. What’s new in psychtoolbox-3? Perception 36, 14 (2007). European Conference on Visual Perception (ECVP) Abstract Supplement.
28. John Lasseter. 1987. Principles of traditional animation applied to 3D computer animation. In Proceedings of the 14th Annual Conference on Computer Graphics and Interactive Techniques (SIGGRAPH’87). ACM, 35--44.
29. James R. Lewis. 1989. Pairs of latin squares to counterbalance sequential effects and pairing of conditions and stimuli. In Proceedings of the 33rd Annual Human Factors and Ergonomics Society Meeting, Vol. 33. 1223--1227.
30. Iain Matthews and Simon Baker. 2004. Active appearance models revisited. International Journal of Computer Vision 60, 2 (2004), 135--164.
31. Rachel McDonnell, Martin Breidt, and Heinrich H. Bülthoff. 2012. Render me real? Investigating the effect of render style on the perception of animated virtual humans. ACM Transactions on Graphics 31, 4 (2012), 91:1--91:11.
32. Richard L. Moreland and Robert B. Zajonc. 1982. Exposure effects in person perception: Familiarity, similarity, and attraction. Journal of Experimental Social Psychology 18, 5 (1982), 395--415.
33. Radosław Niewiadomski, Virginie Demeure, and Catherine Pelachaud. 2010. Warmth, competence, believability and virtual agents. In Intelligent Virtual Agents. Springer, 272--285.
34. Nikolaas N. Oosterhof and Alexander Todorov. 2008. The functional basis of face evaluation. Proceedings of the National Academy of Sciences 105, 32 (2008), 11087--11092.
35. Denis G. Pelli. 1997. The videotoolbox software for visual psychophysics: Transforming numbers into movies. Spatial Vision 10, 4 (1997), 437--442.
36. Heidi R. Riggio and Ronald E. Riggio. 2002. Emotional expressiveness, extraversion, and neuroticism: A meta-analysis. Journal of Nonverbal Behavior 26, 4 (2002), 195--218.
37. Leonhard Schilbach, Afra M. Wohlschlaeger, Nicole C. Kraemer, Albert Newen, N. Jon Shah, Gereon R. Fink, and Kai Vogeley. 2006. Being with virtual others: Neural correlates of social interaction. Neuropsychologia 44, 5 (2006), 718--730.
38. Lee Sproull, Mani Subramani, Sara Kiesler, Janet H. Walker, and Keith Waters. 1996. When the interface is a face. Human-Computer Interaction 11, 2 (1996), 97--124.
39. Robert M. Stelmack, Michael Houlihan, and Patricia A. McGarry-Roberts. 1993. Personality, reaction time, and event-related potentials. Journal of Personality and Social Psychology 65, 2 (1993), 399--409.
40. Kazuki Takashima, Yasuko Omori, Yoshiharu Yoshimoto, Yuich Itoh, Yoshifumi Kitamura, and Fumio Kishino. 2008. Effects of avatar’s blinking animation on person impressions. In Proceedings of Graphics Interface (GI’08). Canadian Information Processing Society, 169--176.
41. Barry-John Theobald, Iain Matthews, Michael Mangini, Jeffrey R. Spies, Timothy R. Brick, Jeffrey F. Cohn, and Steven M. Boker. 2009. Mapping and manipulating facial expression. Language and Speech 52, 2/3 (2009), 369--386.
42. Frank Thomas and Ollie Johnston. 1981. Disney Animation: The Illusion of Life. Abbeville Press, New York.
43. David Weibel, Daniel Stricker, Bartholomäus Wissmath, and Fred W. Mast. 2010. How socially relevant visual characteristics of avatars influence impression formation. Journal of Media Psychology 22, 1 (2010), 37--43.
44. John C. Wickett and Philip A. Vernon. 2000. Replicating the movement time--extraversion link … with a little help from IQ. Personality and Individual Differences 28, 2 (2000), 205--215.
45. Janine Willis and Alexander Todorov. 2006. First impressions: Making up your mind after a 100-ms exposure to a face. Psychological Science 17, 7 (2006), 592--598.
46. Suzanne Young and Dale G. Shaw. 1999. Profiles of effective college and university teachers. Journal of Higher Education 70, 6 (1999), 670--686.
47. Leslie A. Zebrowitz. 1997. Reading Faces: Window to the Soul? Westview Press.
48. Leslie A. Zebrowitz and Joann M. Montepare. 2008. Social psychological face perception: Why appearance matters. Social and Personality Psychology Compass 2, 3 (2008), 1497.

Index Terms

• Computing methodologies

  • Computer graphics

    • Animation

• Information systems

  • Information systems applications

    • Multimedia information systems

      • Multimedia content creation