Vivek K. Singh
ABSTRACT
Photographs are one of the most fundamental ways for human beings to capture their social experiences and smiling is one of the most common actions associated with photo-taking. Photos, thus provide a unique opportunity to study the phenomena of mixing of different people and also the smiles expressed by individuals in these social settings. In this work, we study whether a social media-based computational framework can be employed to obtain smile and diversity scores at very fine, individual relationship resolution, and study their associations. We analyze two data sets from different social networks, Twitter and Instagram, over different time periods. Primarily looking at photographs, using computer vision APIs, we capture the diversity of social interactions in terms of age, gender, and race of those present, and smile levels. Analysis of both data sets suggest similar and significant findings: (a) people, in general, tend to smile more in the presence of others; and (b) people tend to smile more in a more diverse company. The results can help scale, test, and validate multiple theories related to affect and diversity in sociology, psychology, biology, and urban planning, and inform future mechanisms for encouraging people to smile more often in everyday settings
- Saeed Abdullah, Elizabeth L. Murnane, Jean M.R. Costa, and Tanzeem Choudhury. 2015. Collective Smile: Measuring Societal Happiness from Geolocated Images Proceedings of the 18th ACM Conference on Computer Supported Cooperative Work & Social Computing (CSCW '15). ACM, New York, NY, USA, 361--374. Google Scholar
Digital Library
- Ernest L Abel and Michael L Kruger. 2010. Smile intensity in photographs predicts longevity. Psychological Science Vol. 21, 4 (2010), 542--544.Google ScholarCross Ref
- MILLICENT H Abel and REBECCA Hester. 2002. The therapeutic effects of smiling. an empirical reflection on the smile. Mellen Stud in Psychol Vol. 4 (2002), 217--253.Google Scholar
- Muhammad Adnan, Guy Lansley, and Paul A Longley. 2013. A geodemographic analysis of the ethnicity and identity of Twitter users in Greater London Proceedings of the 21st Conference on GIS Research UK (GISRUK). 1--6.Google Scholar
- Michela Arnaboldi, Marco Brambilla, Beatrice Cassottana, Paolo Ciuccarelli, Davide Ripamonti, Simone Vantini, and Riccardo Volonterio. 2016. Studying Multicultural Diversity of Cities and Neighborhoods through Social Media Language Detection. In Tenth International AAAI Conference on Web and Social Media.Google Scholar
- Saeideh Bakhshi, David A Shamma, and Eric Gilbert. 2014. Faces engage us: Photos with faces attract more likes and comments on instagram Proc. ACM CHI. ACM, 965--974. Google ScholarDigital Library
- Lisa Feldman Barrett, Lucy Robin, Paula R Pietromonaco, and Kristen M Eyssell. 1998. Are women the "more emotional" sex? Evidence from emotional experiences in social context. Cognition & Emotion, Vol. 12, 4 (1998), 555--578.Google ScholarCross Ref
- Johan Bollen, Huina Mao, and Alberto Pepe. 2011. Modeling public mood and emotion: Twitter sentiment and socio-economic phenomena. ICWSM Vol. 11 (2011), 450--453.Google Scholar
- Leslie R Brody and Judith A Hall. 2010. Gender, emotion, and socialization. Handbook of gender research in psychology. Springer, 429--454.Google Scholar
- Luigino Bruni. 2007. Handbook on the Economics of Happiness. Edward Elgar Publishing.Google Scholar
- Gregorio Caetano and Vikram Maheshri. 2015. Homophily and Sorting Within Neighborhoods. (2015).Google Scholar
- James A Davis. 1984. New money, and old man/lady and "Two's company": Subjective Welfare in the NORC General Social Surveys, 1972--1982. Social indicators research Vol. 15, 4 (1984), 319--350.Google Scholar
- Munmun De Choudhury, Michael Gamon, and Scott Counts. 2012. Happy, nervous or surprised? classification of human affective states in social media Sixth International AAAI Conference on Weblogs and Social Media.Google Scholar
- Francine M Deutsch. 1990. Status, sex, and smiling: The effect of role on smiling in men and women. Personality and Social Psychology Bulletin Vol. 16, 3 (1990), 531--540.Google ScholarCross Ref
- Abhinav Dhall, Jyoti Joshi, Karan Sikka, Roland Goecke, and Nicu Sebe. 2015. The more the merrier: Analysing the affect of a group of people in images Automatic Face and Gesture Recognition (FG), 2015 11th IEEE International Conference and Workshops on, Vol. Vol. 1. IEEE, 1--8.Google Scholar
- Hamdi Dibeklioglu, Roberto Valenti, Albert Ali Salah, and Theo Gevers. 2010. Eyes do not lie: Spontaneous versus posed smiles. Proceedings of the 18th ACM international conference on Multimedia. ACM, 703--706. Google ScholarDigital Library
- John F Dovidio, Michelle Hebl, Jennifer A Richeson, and J Nicole Shelton. 2006. Nonverbal communication, race, and intergroup interaction. The Sage handbook of nonverbal communication (2006), 481--500.Google ScholarCross Ref
- Richard A Easterlin. 2001. Life cycle welfare: trends and differences. Journal of happiness studies Vol. 2, 1 (2001), 1--12.Google ScholarCross Ref
- Christopher G Ellison. 1990. Family ties, friendships, and subjective well-being among Black Americans. Journal of Marriage and the Family (1990), 298--310.Google Scholar
- Nicole B Ellison, Charles Steinfield, and Cliff Lampe. 2011. Connection strategies: Social capital implications of Facebook-enabled communication practices. New media & society, Vol. 13, 6 (2011), 873--892.Google Scholar
- Nicole B Ellison, Jessica Vitak, Rebecca Gray, and Cliff Lampe. 2014. Cultivating social resources on social network sites: Facebook relationship maintenance behaviors and their role in social capital processes. Journal of Computer-Mediated Communication Vol. 19, 4 (2014), 855--870. Google ScholarDigital Library
- Everything We Know About Facebook's Secret Mood Manipulation Experiment. 2014. Mapbox. (2014). Online: https://www.theatlantic.com/technology/archive/2014/06/everything-we-know-about-facebooks-secret-mood-manipulation-experiment/373648/Google Scholar
- Eric Fischer. 2014. Mapbox. (2014). Online: https://www.mapbox.com/bites/00245/locals/.Google Scholar
- Seth Flaxman, Sharad Goel, and Justin M Rao. 2016. Filter bubbles, echo chambers, and online news consumption. Public Opinion Quarterly Vol. 80, S1 (2016), 298--320.Google ScholarCross Ref
- Alan J Fridlund. 2014. Human facial expression: An evolutionary view. Academic Press.Google Scholar
- Samuel L Gaertner and John F Dovidio. 1986. The aversive form of racism. Academic Press.Google Scholar
- Jim Giles. 2012. Making the links. Nature, Vol. 488, 7412 (2012), 448--450.Google Scholar
- LeeAnne Harker and Dacher Keltner. 2001. Expressions of positive emotion in women's college yearbook pictures and their relationship to personality and life outcomes across adulthood. Journal of personality and social psychology, Vol. 80, 1 (2001), 112.Google ScholarCross Ref
- Marvin A Hecht and Marianne LaFrance. 1998. License or obligation to smile: The effect of power and sex on amount and type of smiling. Personality and Social Psychology Bulletin Vol. 24, 12 (1998), 1332--1342.Google ScholarCross Ref
- John F Helliwell, Robert D Putnam, and others. 2004. The social context of well-being. Philosophical transactions-royal society of London series B biological sciences (2004), 1435--1446.Google Scholar
- Javier Hernandez, Mohammed Ehsan Hoque, Will Drevo, and Rosalind W Picard. 2012. Mood meter: counting smiles in the wild. In Proceedings of the 2012 ACM Conference on Ubiquitous Computing. ACM, 301--310. Google ScholarDigital Library
- Matthew J Hertenstein, Carrie A Hansel, Alissa M Butts, and Sarah N Hile. 2009. Smile intensity in photographs predicts divorce later in life. Motivation and Emotion Vol. 33, 2 (2009), 99--105.Google ScholarCross Ref
- Ursula Hess and Patrick Bourgeois. 2010. You smile--I smile: Emotion expression in social interaction. Biological psychology Vol. 84, 3 (2010), 514--520.Google Scholar
- J Hillier and P Healy. 2008. Vol. 2: Political economy, diversity and pragmatism. Aldershot {etc.}: Ashgate.Google Scholar
- Michael A Hogg and Dominic Abrams. 2007. Social cognition and attitudes. (2007).Google Scholar
- Michael Hughes and Melvin E Thomas. 1998. The continuing significance of race revisited: A study of race, class, and quality of life in America, 1972 to 1996. American Sociological Review (1998), 785--795.Google Scholar
- Clayton J Hutto and Eric Gilbert. 2014. Vader: A parsimonious rule-based model for sentiment analysis of social media text Eighth international AAAI conference on weblogs and social media.Google Scholar
- Carol Nagy Jacklin and Eleanor E Maccoby. 1978. Social behavior at thirty-three months in same-sex and mixed-sex dyads. Child Development (1978), 557--569.Google Scholar
- Eric Jaffe. 2010. The Psychological Study of Smiling. (2010). Online: https://www.psychologicalscience.org/observer/the-psychological-study-of-smiling.Google Scholar
- Adam DI Kramer, Jamie E Guillory, and Jeffrey T Hancock. 2014. Experimental evidence of massive-scale emotional contagion through social networks. Proceedings of the National Academy of Sciences, Vol. 111, 24 (2014), 8788--8790.Google ScholarCross Ref
- Marianne LaFrance, Marvin A Hecht, and Elizabeth Levy Paluck. 2003. The contingent smile: a meta-analysis of sex differences in smiling. Psychological bulletin Vol. 129, 2 (2003), 305.Google Scholar
- JS Lockard, CE Fahrenbruch, JL Smith, and CJ Morgan. 1977. Smiling and laughter: Different phyletic origins? Bulletin of the Psychonomic Society Vol. 10, 3 (1977), 183--186.Google ScholarCross Ref
- Eleanor E Maccoby. 1990. Gender and relationships: A developmental account. American psychologist Vol. 45, 4 (1990), 513.Google Scholar
- Michael T Maly. 2000. The neighborhood diversity index: a complementary measure of racial residential settlement. Journal of Urban Affairs Vol. 22, 1 (2000), 37--47.Google ScholarCross Ref
- Carol T Miller and Anna M Myers. 1998. Compensating for prejudice: How heavyweight people (and others) control outcomes despite prejudice. (1998).Google Scholar
- Myriam D Munezero, Calkin Suero Montero, Erkki Sutinen, and John Pajunen. 2014. Are they different? affect, feeling, emotion, sentiment, and opinion detection in text. IEEE transactions on affective computing Vol. 5, 2 (2014), 101--111.Google Scholar
- Christopher Oveis, June Gruber, Dacher Keltner, Juliet L Stamper, and W Thomas Boyce. 2009. Smile intensity and warm touch as thin slices of child and family affective style. Emotion, Vol. 9, 4 (2009), 544.Google ScholarCross Ref
- S Page. 2007. Diversity Powers Innovation. (2007). Online: https://www.americanprogress.org/.Google Scholar
- Rosalind W Picard. 1997. Affective computing. Vol. Vol. 252. MIT press Cambridge. Google ScholarDigital Library
- Robert R Provine. 1992. Contagious laughter: Laughter is a sufficient stimulus for laughs and smiles. Bulletin of the Psychonomic Society Vol. 30, 1 (1992), 1--4.Google ScholarCross Ref
- Robert R Provine. 1997. Yawns, laughs, smiles, tickles, and talking: Naturalistic and laboratory studies of facial action and social communication. The psychology of facial expression (1997), 158.Google Scholar
- Darshan Santani and Daniel Gatica-Perez. 2013. Speaking swiss: languages and venues in foursquare Proceedings of the 21st ACM international conference on Multimedia. ACM, 501--504. Google ScholarDigital Library
- Mark Schilling. 2002. Measuring diversity in the United States. Math Horizons, Vol. 9, 4 (2002), 29--30.Google ScholarCross Ref
- Karen L Schmidt, Jeffrey F Cohn, and Yingli Tian. 2003. Signal characteristics of spontaneous facial expressions: Automatic movement in solitary and social smiles. Biological Psychology Vol. 65, 1 (2003), 49--66.Google ScholarCross Ref
- J Patrick Seder and Shigehiro Oishi. 2012. Intensity of smiling in Facebook photos predicts future life satisfaction. Social Psychological and Personality Science, Vol. 3, 4 (2012), 407--413.Google ScholarCross Ref
- Andrew Perrin Shannon Greenwood and Maeve Duggan. 2016. Social Media Update 2016. (2016). Online: http://www.pewinternet.org/2016/11/11/social-media-update-2016.Google Scholar
- J Nicole Shelton, Jennifer A Richeson, and Jessica Salvatore. 2005. Expecting to be the target of prejudice: Implications for interethnic interactions. Personality and Social Psychology Bulletin Vol. 31, 9 (2005), 1189--1202.Google ScholarCross Ref
- Dov Shmotkin. 1990. Subjective well-being as a function of age and gender: A multivariate look for differentiated trends. Social indicators research Vol. 23, 3 (1990), 201--230.Google Scholar
- Jim Sidanius and Felicia Pratto. 2001. Social dominance: An intergroup theory of social hierarchy and oppression. Cambridge University Press.Google Scholar
- Jennifer S Silk, Erika E Forbes, Diana J Whalen, Jennifer L Jakubcak, Wesley K Thompson, Neal D Ryan, David A Axelson, Boris Birmaher, and Ronald E Dahl. 2011. Daily emotional dynamics in depressed youth: A cell phone ecological momentary assessment study. Journal of experimental child psychology Vol. 110, 2 (2011), 241--257.Google ScholarCross Ref
- Vivek Singh, Saket Hegde, and Akanksha Atrey. 2017. Towards Measuring Fine-Grained Diversity Using Social Media Photographs International AAAI conference on weblogs and social media. AAAI, 668--671.Google Scholar
- @smfrogers. 2014. What Fuels a Tweet's Engagement? (2014). Online: https://blog.twitter.com/2014/what-fuels-a-tweets-engagement.Google Scholar
- Walter G Stephan and Cookie White Stephan. 1985. Intergroup anxiety. Journal of social issues Vol. 41, 3 (1985), 157--175.Google ScholarCross Ref
- Mark Turner, Steve Love, and Mark Howell. 2008. Understanding emotions experienced when using a mobile phone in public: The social usability of mobile (cellular) telephones. Telematics and Informatics Vol. 25, 3 (2008), 201--215. Google ScholarDigital Library
- Nancy Van House, Marc Davis, Morgan Ames, Megan Finn, and Vijay Viswanathan. 2005. The uses of personal networked digital imaging: an empirical study of cameraphone photos and sharing. In CHI'05 extended abstracts on Human factors in computing systems. ACM, 1853--1856. Google ScholarDigital Library
- Gary R VandenBos. 2007. APA dictionary of psychology.American Psychological Association.Google Scholar
- Yu Wang, Yuncheng Li, and Jiebo Luo. 2016. Deciphering the 2016 US Presidential campaign in the Twitter sphere: A comparison of the Trumpists and Clintonists. arXiv preprint arXiv:1603.03097 (2016).Google Scholar
- Yang Yang. 2008. Social Inequalities in Happiness in the United States, 1972 to 2004: An Age-Period-Cohort Analysis. American Sociological Review Vol. 73, 2 (2008), 204--226.Google Scholar
- Jianbo Yuan, Quanzeng You, and Jiebo Luo. 2015. Sentiment Analysis Using Social Multimedia. Multimedia Data Mining and Analytics. Springer, 31--59.Google Scholar
Index Terms
- Do Individuals Smile More in Diverse Social Company?: Studying Smiles and Diversity Via Social Media Photos
Recommendations
Faces engage us: photos with faces attract more likes and comments on Instagram
CHI '14: Proceedings of the SIGCHI Conference on Human Factors in Computing SystemsPhotos are becoming prominent means of communication online. Despite photos' pervasive presence in social media and online world, we know little about how people interact and engage with their content. Understanding how photo content might signify ...
Social media and loneliness
Social media use continues to grow and is especially prevalent among young adults. It is surprising then that, in spite of this enhanced interconnectivity, young adults may be lonelier than other age groups, and that the current generation may be the ...
The Social Structuration of Six Major Social Media Platforms in the United Kingdom: Facebook, LinkedIn, Twitter, Instagram, Google+ and Pinterest
SMSociety '16: Proceedings of the 7th 2016 International Conference on Social Media & SocietySociological studies on the Internet have often examined digital inequalities. These studies show how Internet access, skills, uses and outcomes vary between different population segments. However, we know more about social inequalities in general ...
Comments