Abstract
In this article, we investigate the perception of gender from the motion of virtual humans under different emotional conditions and explore the effect of emotional bias on gender perception (e.g., anger being attributed to males more than females). As motion types can present different levels of physiological cues, we also explore how two types of motion (walking and conversations) are affected by emotional bias. Walking typically displays more physiological cues about gender (e.g., hip sway) and therefore is expected to be less affected by emotional bias. To investigate these effects, we used a corpus of captured facial and body motions from four male and four female actors, performing basic emotions through conversation and walk. We expected that the appearance of the model would also influence gender perception; therefore, we displayed both male and female motions on two virtual models of different sex. Two experiments were then conducted to assess gender judgments from these motions. In both experiments, participants were asked to rate how male or female they considered the motions to be under different emotional states, then classified the emotions to determine how accurately they were portrayed by actors. Overall, both experiments showed that gender ratings were affected by the displayed emotion. However, we found that conversations were influenced by gender stereotypes to a greater extent than walking motions. This was particularly true for anger, which was perceived as male on both male and female motions, and sadness, which was perceived as less male when portrayed by male actors. We also found a slight effect of the model when observing gender on different types of virtual models. These results have implications for the design and animation of virtual humans.
Supplemental Material
Available for Download
Supplemental movie and image files for, Perceptual Tolerance to Stereoscopic 3D Image Distortion
- Anthony P. Atkinson, Winand H. Dittrich, Andrew J. Gemmell, and Andrew W. Young. 2004. Emotion perception from dynamic and static body expressions in point-light and full-light displays. Perception 33, 6, 717--746.Google ScholarCross Ref
- Hillel Aviezer, Yaacov Trope, and Alexander Todorov. 2012. Body cues, not facial expressions, discriminate between intense positive and negative emotions. Science 338, 6111, 1225--1229.Google Scholar
- John N. Bassili. 1978. Facial motion in the perception of faces and of emotional expression. Journal of Experimental Psychology—Human Perception and Performance 4, 373--379.Google Scholar
- Alberto Battocchi, Fabio Pianesi, and Dina Goren-Bar. 2005. A first evaluation study of a database of kinetic facial expressions (DaFEx). In Proceedings of the 7th International Conference on Multimodal Interfaces (ICMI’05). 214--221. Google ScholarDigital Library
- Boaz M. Ben-David, Pascal H. H. M. van Lieshout, and Talia Leszcz. 2011. A resource of validated affective and neutral sentences to assess identification of emotion in spoken language after a brain injury. Brain Injury 25, 2, 206--220.Google ScholarCross Ref
- Marilynn B. Brewer. 1988. A Dual Process Model of Impression Formation. Lawrence Erlbaum, Hillsdale, NJ.Google Scholar
- Leslie R. Brody and Judith A. Hall. 2000. Gender, emotion, and expression. In Handbook of Emotions, M. Lewis and J. Haviland-Jones (Eds.). Guilford, 338--349.Google Scholar
- Thierry Chaminade, Jessica Hodgins, and Mitsuo Kawato. 2007. Anthropomorphism influences perception of computer-animated characters’ actions. Social Cognitive and Affective Neuroscience 2, 3, 206--216.Google ScholarCross Ref
- Céline Clavel, Justine Plessier, Jean-Claude Martin, Laurent Ach, and Benoit Morel. 2009. Combining facial and postural expressions of emotions in a virtual character. In Proceedings of the 9th International Conference on Intelligent Virtual Agents (IVA’09). 287--300. Google ScholarDigital Library
- Elizabeth Crane and Melissa Gross. 2007. Motion capture and emotion: Affect detection in whole body movement. In Affective Computing and Intelligent Interaction. Lecture Notes in Computer Science, Vol. 4738. Springer, 95--101. Google ScholarDigital Library
- James E. Cutting. 1978. Generation of synthetic male and female walkers through manipulation of a biomechanical invariant. Perception 7, 4, 393--405.Google ScholarCross Ref
- Marco De Meijer. 1989. The contribution of general features of body movement to the attribution of emotions. Journal of Nonverbal Behavior 13, 4, 247--268.Google ScholarCross Ref
- Kay Deaux. 1993. Commentary: Sorry, wrong number: A reply to gentile’s call. Psychological Science 4, 2, 125--126.Google ScholarCross Ref
- Paul Ekman. 1992. An argument for basic emotions. Cognition and Emotion 6, 3--4, 169--200.Google ScholarCross Ref
- Cathy Ennis, Ludovic Hoyet, Arjan Egges, and Rachel McDonnell. 2013. Emotion capture: Emotionally expressive characters for games. In Proceedings of Motion on Games (MIG’13). ACM, New York, NY, 53--60. Google ScholarDigital Library
- Agneta H. Fischer. 1993. Sex differences in emotionality: Fact or stereotype? Feminism and Psychology 3, 3, 303--318.Google ScholarCross Ref
- Agneta H. Fischer, Patricia M. Rodriguez Mosquera, Annelies E. M. Van Vianen, and Antony S. R. Manstead. 2004. Gender and culture differences in emotion. Emotion 4, 1, 87--94.Google ScholarCross Ref
- Ursula Hess, Reginald B. Adams, and Robert E. Kleck. 2004. Facial appearance, gender, and emotion expression. Emotion 4, 4, 378--388.Google ScholarCross Ref
- Harold Hill, Yuri Jinno, and Alan Johnston. 2003. Comparing solid-body with point-light animations. Perception 32, 5, 561--566.Google ScholarCross Ref
- Harold Hill and Alan Johnston. 2001. Categorizing sex and identity from the biological motion of faces. Current Biology 11, 11, 880--885.Google ScholarCross Ref
- Jessica Hodgins, Sophie Jörg, Carol O’Sullivan, Sang Il Park, and Moshe Mahler. 2010. The saliency of anomalies in animated human characters. ACM Transactions on Applied Perception 7, 4, 22:1--22:14. Google ScholarDigital Library
- Nadine Hugill, Bernhard Fink, and Nick Neave. 2010. The role of human body movements in mate selection. Evolutionary Psychology 8, 1, 66--89.Google ScholarCross Ref
- Gunnar Johansson. 1973. Visual perception of biological motion and a model for its analysis. Perception and Psychophysics 14, 2, 201--211.Google ScholarCross Ref
- Kerri L. Johnson, Lawrie S. McKay, and Frank E. Pollick. 2011. He throws like a girl (but only when he’s sad): Emotion affects sex-decoding of biological motion displays. Cognition 119, 2, 265--280.Google ScholarCross Ref
- Kerri L. Johnson and Louis G. Tassinary. 2005. Perceiving sex directly and indirectly meaning in motion and morphology. Psychological Science 16, 11, 890--897.Google ScholarCross Ref
- Sophie Jörg, Jessica Hodgins, and Carol O’Sullivan. 2010. The perception of finger motions. In Proceedings of the 7th Symposium on Applied Perception in Graphics and Visualization. 129--133. Google ScholarDigital Library
- Lynn T. Kozlowski and James E. Cutting. 1977. Recognizing the sex of a walker from a dynamic point-light display. Perception and Psychophysics 21, 6, 575--580.Google ScholarCross Ref
- Rachel McDonnell, Sophie Jörg, Jessica K. Hodgins, Fiona Newell, and Carol O’Sullivan. 2009. Evaluating the effect of motion and body shape on the perceived sex of virtual characters. ACM Transactions on Applied Perception 5, 4, 20:1--20:14. Google ScholarDigital Library
- Edward R. Morrison, Lisa Gralewski, Neill Campbell, and Ian S. Penton-Voak. 2007. Facial movement varies by sex and is related to attractiveness. Evolution and Human Behavior 28, 3, 186--192.Google ScholarCross Ref
- E. Ashby Plant, Janet Shibley Hyde, Dacher Keltner, and Patricia G. Devine. 2000. The gender stereotyping of emotions. Psychology of Women Quarterly 24, 1, 81--92.Google ScholarCross Ref
- Frank E. Pollick, Helena M. Paterson, Armin Bruderlin, and Anthony J. Sanford. 2001. Perceiving affect from arm movement. Cognition 82, 2, B51--B61.Google ScholarCross Ref
- Philippe G. Schyns, Lucy S. Petro, and Marie L. Smith. 2009. Transmission of facial expressions of emotion co-evolved with their efficient decoding in the brain: Behavioral and brain evidence. PLoS One 4, 5, e5625.Google ScholarCross Ref
- Rhoda Kesler Unger. 1979. Toward a redefinition of sex and gender. American Psychologist 34, 11, 1085--1094.Google ScholarCross Ref
- Ekaterina P. Volkova, Betty J. Mohler, Trevor J. Dodds, Joachim Tesch, and Heinrich H. Bülthoff. 2014. Emotion categorization of body expressions in narrative scenarios. Frontiers in Psychology 5, 623, 1--11.Google Scholar
- Anna C. Wellerdiek, Markus Leyrer, Ekaterina Volkova, Dong-Seon Chang, and Betty Mohler. 2013. Recognizing your own motions on virtual avatars: Is it me or not? In Proceedings of the ACM Symposium on Applied Perception (SAP’13). 138. Google ScholarDigital Library
Index Terms
- Exploring the Effect of Motion Type and Emotions on the Perception of Gender in Virtual Humans
Recommendations
Gender Stereotypes in Virtual Agents
IVA '20: Proceedings of the 20th ACM International Conference on Intelligent Virtual AgentsVisual, behavioral and verbal cues for gender are often used in designing virtual agents to take advantage of their stereotypical effects on the users. However, recent studies point towards a more gender-balanced view of stereotypical traits and roles ...
Evaluating the effect of emotion on gender recognition in virtual humans
SAP '13: Proceedings of the ACM Symposium on Applied PerceptionIn this paper, we investigate the ability of humans to determine the gender of conversing characters, based on facial and body cues for emotion. We used a corpus of simultaneously captured facial and body motions from four male and four female actors. ...
Intersections of gender and sexual minority status
The present study refined existing bullying literature by examining differences in risk of three types of bullying victimization (offline only, cyberbullying only, and co-occurring victimization) for four different gender-sexual minority status groups ...
Comments