To stylize or not to stylize?: the effect of shape and material stylization on the perception of computer-generated faces

Abstract

Virtual characters contribute strongly to the entire visuals of 3D animated films. However, designing believable characters remains a challenging task. Artists rely on stylization to increase appeal or expressivity, exaggerating or softening specific features. In this paper we analyze two of the most influential factors that define how a character looks: shape and material. With the help of artists, we design a set of carefully crafted stimuli consisting of different stylization levels for both parameters, and analyze how different combinations affect the perceived realism, appeal, eeriness, and familiarity of the characters. Moreover, we additionally investigate how this affects the perceived intensity of different facial expressions (sadness, anger, happiness, and surprise). Our experiments reveal that shape is the dominant factor when rating realism and expression intensity, while material is the key component for appeal. Furthermore our results show that realism alone is a bad predictor for appeal, eeriness, or attractiveness.

References

1. Alexander, O., Rogers, M., Lambeth, W., Chiang, J.-Y., Ma, W.-C., Wang, C.-C., and Debevec, P. 2010. The Digital Emily project: Achieving a photorealistic digital actor. IEEE Computer Graphics and Applications 30, 4.
2. Alley, T. R., and Cunningham, M. R. 1991. Averaged faces are attractive, but very attractive faces are not average. Psychological Science 2, 2.
3. Beeler, T., Bickel, B., Beardsley, P., Sumner, B., and Gross, M. 2010. High-quality single-shot capture of facial geometry. ACM Transactions on Graphics 29, 4.
4. Benson, P., and Perrett, D. 1992. Face to face with the perfect image. New Scientist 133, 1809.
5. Burleigh, T. J., Schoenherr, J. R., and Lacroix, G. L. 2013. Does the Uncanny Valley exist? An empirical test of the relationship between eeriness and the human likeness of digitally created faces. Computers in Human Behavior 29, 3.
6. Calder, A. J. 1996. Facial emotion recognition after bilateral amygdala damage: Differentially severe impairment of fear. Cognitive Neuropsychology 13, 5.
7. Chen, H., Russell, R., and Nakayama, K. 2010. Crossing the "Uncanny Valley": Adaptation to cartoon faces can influence perception of human faces. Perception, 39.
8. Cunningham, D., and Wallraven, C. 2011. Experimental Design: From User Studies to Psychophysics. AK Peters/CRC Press.
9. Dill, V., Flach, L. M., Hocevar, R., Lykawka, C., Musse, S. R., and Pinho, M. S. 2012. Evaluation of the Uncanny Valley in CG characters. In Intelligent Virtual Agents.
10. Ekman, P. 1972. Universal and cultural differences in facial expression of emotion. Proceedings of Nebraska Symposium on Motivation 19.
11. Fan, S., Ng, T.-T., Herberg, J. S., Koenig, B. L., and Xin, S. 2012. Real or fake? Human judgments about photographs and computer-generated images of faces. In SIGGRAPH Asia 2012 Technical Briefs.
12. Ferrey, A. E., Burleigh, T. J., and Fenske, M. J. 2015. Stimulus-category competition, inhibition, and affective devaluation: a novel account of the uncanny valley. Frontiers in psychology 6.
13. Fink, B., and Matts, P. J. 2008. The effects of skin colour distribution and topography cues on the perception of female facial age and health. Journal of the European Academy of Dermatology and Venereology 22, 4.
14. Fink, B., Grammer, K., and Matts, P. J. 2006. Visible skin color distribution plays a role in the perception of age, attractiveness, and health in female faces. Evolution and Human Behavior 27, 6.
15. Fink, B., Bunse, L., Matts, P. J., and D'Emiliano, D. 2012. Visible skin colouration predicts perception of male facial age, health and attractiveness. International Journal of Cosmetic Science 34, 4.
16. Geller, T. 2008. Overcoming the Uncanny Valley. IEEE Computer Graphics and Applications 28, 4.
17. Gooch, B., Reinhard, E., and Gooch, A. 2004. Human facial illustrations: Creation and psychophysical evaluation. ACM Transactions on Graphics 23, 1.
18. Green, R. D., MacDorman, K. F., Ho, C.-C., and Vasudevan, S. 2008. Sensitivity to the proportions of faces that vary in human likeness. Computers in Human Behavior 24, 5.
19. Hanson, D. 2005. Expanding the Aesthetics Possibilities for Humanlike Robots. In Proceedings of IEEE Humanoid Robotics Conference, special session on the Uncanny Valley.
20. Ho, C.-C., and MacDorman, K. F. 2010. Revisiting the uncanny valley theory: Developing and validating an alternative to the godspeed indices. Computers in Human Behavior 26, 6.
21. Jack, D. R., Garrod, M. O., and Schyns, P. 2014. Dynamic facial expressions of emotion transmit an evolving hierarchy of signals over time. Current Biology 24, 2.
22. Jimenez, J., Zsolnai, K., Jarabo, A., Freude, C., Auzinger, T., Wu, X.-C., von der Pahlen, J., Wimmer, M., and Gutierrez, D. 2015. Separable subsurface scattering. Computer Graphics Forum.
23. Klehm, O., Rousselle, F., Papas, M., Bradley, D., Hery, C., Bickel, B., Jarosz, W., and Beeler, T. 2015. Recent advances in facial appearance capture. Computer Graphics Forum (Proceedings of Eurographics) 34, 2.
24. Little, A. C., and Hancock, P. J. 2002. The role of masculinity and distinctiveness in judgments of human male facial attractiveness. British Journal of Psychology 93, 4.
25. MacDorman, K. F., Green, R. D., Ho, C.-C., and Koch, C. T. 2009. Too real for comfort? Uncanny responses to computer generated faces. Computers in Human Behavior 25, 3.
26. MacDorman, K. F. 2006. Subjective ratings of robot video clips for human likeness, familiarity, and eeriness: An exploration of the Uncanny Valley. In Proceedings of ICCS/CogSci Long Symposium: Toward Social Mechanisms of Android Science.
27. McCloud, S. 1993. Understanding Comics. William Morrow Paperbacks.
28. McDonnell, R., Breidt, M., and Bülthoff, H. H. 2012. Render me real? Investigating the effect of render style on the perception of animated virtual humans. ACM Transactions on Graphics 31, 4.
29. Mori, M., MacDorman, K. F., and Kageki, N. 2012. The Uncanny Valley {From the field}. IEEE Robotics and Automation Magazine 19, 2.
30. Nitzsche, B., and Rose, K. 2011. Bodyshop: The Photoshop Retouching Guide for the Face and Body. Wiley.
31. Saygin, A., Chaminade, T., Ishiguro, H., Driver, J., and Frith, C. 2012. The thing that should not be: Predictive coding and the Uncanny Valley in perceiving human and humanoid robot actions. Social Cognitive Affective Neuroscience 7, 4.
32. Schneider, E., Wang, Y., and Yang, S. 2007. Exploring the Uncanny Valley with japanese video game characters. In Situated Play: Proceedings of the Digital Games Research Association Conference.
33. Seyama, J., and Nagayama, R. S. 2007. The Uncanny Valley: Effect of realism on the impression of artificial human faces. Presence: Teleoperators and Virtual Environments 16, 4.
34. Tinwell, A., and Grimshaw, M. 2009. Bridging the uncanny: An impossible traverse? In Proceedings of the 13th International MindTrek Conference: Everyday Life in the Ubiquitous Era.
35. Tinwell, A., Grimshaw, M., Nabi, D. A., and Williams, A. 2011. Facial expression of emotion and perception of the Uncanny Valley in virtual characters. Computers in Human Behavior 27, 2.
36. Tinwell, A., Grimshaw, M., and Williams, A. 2011. The Uncanny Wall. International Journal of Arts and Technology 4, 3.
37. Tinwell, A. 2014. The Uncanny Valley in Games and Animation. AK Peters / CRC Press.
38. Wallraven, C., Bülthoff, H. H., Cunningham, D. W., Fischer, J., and Bartz, D. 2007. Evaluation of real-world and computer-generated stylized facial expressions. ACM Transactions on Applied Perception 4, 3.
39. Wallraven, C., Breidt, M., Cunningham, D. W., and Bülthoff, H. H. 2008. Evaluating the perceptual realism of animated facial expressions. ACM Transactions on Applied Perceptiona 4, 4.
40. Weise, T., Bouaziz, S., Li, H., and Pauly, M. 2011. Real-time performance-based facial animation. ACM Transactions on Graphics 30, 4.
41. Zell, E., and Botsch, M. 2013. ElastiFace: Matching and blending textured faces. In Proceedings of the Symposium on Non-Photorealistic Animation and Rendering.
42. Zhu, J.-Y., Agarwala, A., Efros, A. A., Shechtman, E., and Wang, J. 2014. Mirror mirror: Crowdsourcing better portraits. ACM Transactions on Graphics 33, 6.
43. Zibrek, K., and McDonnell, R. 2014. Does render style affect perception of personality in virtual humans? In Proceedings of the ACM Symposium on Applied Perception.

Index Terms

• Computing methodologies

  • Computer graphics

    • Image manipulation

      • Texturing