How Smart Does Your Profile Image Look?: Estimating Intelligence from Social Network Profile Images

ABSTRACT

Profile images on social networks are users' opportunity to present themselves and to affect how others judge them. We examine what Facebook images say about users' perceived and measured intelligence. 1,122 Facebook users completed a matrices intelligence test and shared their current Facebook profile image. Strangers also rated the images for perceived intelligence. We use automatically extracted image features to predict both measured and perceived intelligence. Intelligence estimation from images is a difficult task even for humans, but experimental results show that human accuracy can be equalled using computing methods. We report the image features that predict both measured and perceived intelligence, and highlight misleading features such as "smiling'' and "wearing glasses'' that are correlated with perceived but not measured intelligence. Our results give insights into inaccurate stereotyping from profile images and also have implications for privacy, especially since in most social networks profile images are public by default.

References

1. T. Ahonen, A. Hadid, and M. Pietikainen. Face description with local binary patterns: Application to face recognition. IEEE Trans. Pattern Anal. Mach. Intell., 28(12):2037--2041, Dec 2006.
2. S. Baert. Do they find you on facebook? facebook profile picture and hiring chances. IZA Discussion Paper, 9584, 2015.
3. D. J. Bartholomew. Measuring intelligence: Facts and fallacies. Cambridge University Press, 2004.
4. S. Bhattacharya, B. Nojavanasghari, T. Chen, D. Liu, S.-F. Chang, and M. Shah. Towards a comprehensive computational model foraesthetic assessment of videos. In ACM Int. Conf. Multimedia (MM), pages 361--364, 2013.
5. D. V. Cicchetti. Guidelines, criteria, and rules of thumb for evaluating normed and standardized assessment instruments in psychology. Psychol. assessment, 6(4):284, 1994.
6. M. Cristani, A. Vinciarelli, C. Segalin, and A. Perina. Unveiling the multimedia unconscious: Implicit cognitive processes and multimedia content analysis. In ACM Int. Conf. Multimedia (MM), pages 213--222, 2013.
7. S. C. Guntuku, L. Qiu, S. Roy, W. Lin, and V. Jakhetiya. Do others perceive you as you want them to?: Modeling personality based on selfies. In Int. Workshop on Affect and Sentiment in Multimedia ASM, pages 21--26, 2015.
8. S. C. Guntuku, J. T. Zhou, S. Roy, L. Weisi, and I. W. Tsang. Asian Conf. Computer Vision (ACCV), chapter Deep Representations to Model User 'Likes', pages 3--18. 2015.
9. M. C. Keller, C. E. Garver-Apgar, M. J. Wright, N. G. Martin, R. P. Corley, M. C. Stallings, J. K. Hewitt, and B. P. Zietsch. The genetic correlation between height and IQ: Shared genes or assortative mating? PLoS Genet, 9(4):1--10, 04 2013.
10. K. Kleisner, V. Chvátalová, and J. Flegr. Perceived intelligence is associated with measured intelligence in men but not women. PLoS ONE, 9(3):1--7, 03 2014.
11. I. Kokkinos. Bounding part scores for rapid detection with deformable part models. In European Conf. Computer Vision (ECCV), pages 41--50, 2012.
12. M. Kosinski, D. Stillwell, and T. Graepel. Private traits and attributes are predictable from digital records of human behavior. PNAS, 110(15):5802--5805, 2013.
13. L. Leqi, D. Preoţiuc-Pietro, Z. Riahi, M. E. Moghaddam, and L. Ungar. Analyzing personality through social media profile picture choice. In Int. AAAI Conf. Web and Social Media (ICWSM), 2016.
14. D. G. Lowe. Distinctive image features from scale-invariant keypoints. Int. J. Comput. Vision, 60(2):91--110, 2004.
15. J. Machajdik and A. Hanbury. Affective image classification using features inspired by psychology and art theory. In ACM Int. Conf. Multimedia (MM), pages 83--92, New York, NY, USA, 2010. ACM.
16. K. O. McGraw and S. P. Wong. Forming inferences about some intraclass correlation coefficients. Psychol. methods, 1(1):30, 1996.
17. J. Raven, J. Raven, and J. Court. Manual for raven's progressive matrices and vocabulary scales. San Antonio, TX: Harcourt Assessment, 2003.
18. M. Redi, D. Quercia, L. Graham, and S. Gosling. Like partying? your face says it all. predicting the ambiance of places with profile pictures. In Int. AAAI Conf. Web and Social Media (ICWSM), 2015.
19. F. E. Saal, R. G. Downey, and M. A. Lahey. Rating the ratings: Assessing the psychometric quality of rating data. Psychol. Bull., 88(2):413, 1980.
20. H. A. Schwartz, J. C. Eichstaedt, M. L. Kern, L. Dziurzynski, S. M. Ramones, M. Agrawal, A. Shah, M. Kosinski, D. Stillwell, M. E. P. Seligman, and L. H. Ungar. Personality, gender, and age in the language of social media: The open-vocabulary approach. PLoS ONE, 8(9):1--16, 09 2013.
21. C. Segalin, A. Perina, M. Cristani, and A. Vinciarelli. The pictures we like are our image: Continuous mapping of favorite pictures into self-assessed and attributed personality traits. IEEE Trans. Affect. Comput., PP(99):1--1, 2016.
22. F. Steele, D. C. Evans, and R. K. Green. Is your profile picture worth 1000 words' photo characteristics associated with personality impression agreement. In Int. AAAI Conf. Web and Social Media (ICWSM), 2009.
23. S. N. Talamas, K. I. Mavor, J. Axelsson, T. Sundelin, and D. I. Perrett. Eyelid-openness and mouth curvature influence perceived intelligence beyond attractiveness. J. Exp. Psychol.-Gen., 145(5):603, 2016.
24. S. N. Talamas, K. I. Mavor, and D. I. Perrett. Blinded by beauty: Attractiveness bias and accurate perceptions of academic performance. PLoS ONE, 11(2):1--18, 02 2016.
25. H. C. Triandis and E. M. Suh. Cultural influences on personality. Annu. rev. psychol., 53(1):133--160, 2002.
26. A. Vinciarelli and G. Mohammadi. A survey of personality computing. IEEE Trans. Affect. Comput., 5(3):273--291, July 2014.
27. W. Youyou, M. Kosinski, and D. Stillwell. Computer-based personality judgments are more accurate than those made by humans. PNAS, 112(4):1036--1040, 2015.
28. J. L. Zagorsky. Do you have to be smart to be rich? the impact of IQ on wealth, income and financial distress. Intelligence, 35(5):489 -- 501, 2007.
29. E. Zhou, H. Fan, Z. Cao, Y. Jiang, and Q. Yin. Extensive facial landmark localization with coarse-to-fine convolutional network cascade. In IEEE Int. Conf. Computer Vision Workshops (ICCVW), pages 386--391, Dec. 2013.
30. X. Zhu, H. I. Suk, and D. Shen. Matrix-similarity based loss function and feature selection for alzheimer's disease diagnosis. In IEEE Conf. Computer Vision and Pattern Recognition (CVPR), pages 3089--3096, June 2014.

Index Terms

• Applied computing

  • Law, social and behavioral sciences

    • Psychology

• Human-centered computing

  • Collaborative and social computing

    • Collaborative and social computing theory, concepts and paradigms

      • Social networks