Yuhang Zhao
Shaomei Wu
Skip Abstract Section
Abstract
Like sighted people, visually impaired people want to share photographs on social networking services, but find it difficult to identify and select photos from their albums. We aimed to address this problem by incorporating state-of-the-art computer-generated descriptions into Facebook's photo-sharing feature. We interviewed 12 visually impaired participants to understand their photo-sharing experiences and designed a photo description feature for the Facebook mobile application. We evaluated this feature with six participants in a seven-day diary study. We found that participants used the descriptions to recall and organize their photos, but they hesitated to upload photos without a sighted person's input. In addition to basic information about photo content, participants wanted to know more details about salient objects and people, and whether the photos reflected their personal aesthetic. We discuss these findings from the lens of self-disclosure and self-presentation theories and propose new computer vision research directions that will better support visual content sharing by visually impaired people.
- R. Achanta, S. Hemami, F. Estrada, and S. Susstrunk. 2009. Frequency-tuned salient region detection. In 2009 IEEE Conference on Computer Vision and Pattern Recognition, 1597--1604.Google Scholar
- Dustin Adams, Sri Kurniawan, Cynthia Herrera, Veronica Kang, and Natalie Friedman. 2016. Blind Photographers and VizSnap?: A Long-Term Study. In ASSETS '16 The 18th International ACM SIGACCESS Conference on Computers and Accessibility, 201--208. Google ScholarDigital Library
- Irwin Altman. 1975. The Environment and Social Behavior: Privacy, Personal Space, Territory, and Crowding. Retrieved April 25, 2017 from https://eric.ed.gov/?id=ED131515Google Scholar
- Mitja D. Back, Juliane M. Stopfer, Simine Vazire, Sam Gaddis, Stefan C. Schmukle, Boris Egloff, and Samuel D. Gosling. 2010. Facebook Profiles Reflect Actual Personality, Not Self-Idealization. Source: Psychological Science 21, 3: 372--374.Google ScholarCross Ref
- John A. Bargh and Katelyn Y. A. McKenna. 2004. The Internet and Social Life. Annual Review of Psychology 55, 1: 573--590.Google ScholarCross Ref
- Roy F. Baumeister. 1982. Self-esteem, self-presentation, and future Interaction: A dilemma of reputation. Journal of Personality 50, 1: 29--45.Google ScholarCross Ref
- Roy F. Baumeister and Roy F. 1982. A self-presentational view of social phenomena. Psychological Bulletin 91, 1: 3--26.Google ScholarCross Ref
- Roy F. Baumeister and Debra G. Hutton. 1987. Self-Presentation Theory: Self-Construction and Audience Pleasing. Theories of Group Behavior, 1982: 71--87.Google Scholar
- Natalya N. Bazarova. 2012. Public Intimacy: Disclosure Interpretation and Social Judgments on Facebook. Journal of Communication 62, 5: 815--832.Google ScholarCross Ref
- Natalya N. Bazarova and Yoon Hyung Choi. 2014. Self-disclosure in social media: Extending the functional approach to disclosure motivations and characteristics on social network sites. Journal of Communication 64, 4: 635--657.Google ScholarCross Ref
- Aaron Ben-Ze'ev. 2003. Privacy, emotional closeness, and openness in cyberspace. Computers in Human Behavior 19, 4: 451--467.Google ScholarCross Ref
- Michael S. Bernstein, Desney Tan, Greg Smith, Mary Czerwinski, and Eric Horvitz. 2010. Personalization via friendsourcing. ACM Transactions on Computer-Human Interaction 17, 2: 1--28. Google ScholarDigital Library
- Jeffrey P. Bigham, Chandrika Jayant, Hanjie Ji, Greg Little, Andrew Miller, Robert C. Miller, Robin Miller, Aubrey Tatarowicz, Brandyn White, Samuel White, Tom Yeh, and College Park. 2010. VizWiz: Nearly Real-time Answers to Visual Questions.Google Scholar
- Danah Boyd and Alice Marwick. 2011. Social Privacy in Networked Publics: Teens' Attitudes, Practices, and Strategies. A Decade in Internet Time: Symposium on the Dynamics of the Internet and Society, September 2011: 1--29.Google Scholar
- Erin Brady. 2015. Getting Fast, Free, and Anonymous Answers to Questions Asked by People with Visual Impairments. SIGACCESS Access. Comput., 112: 16--25. Google ScholarDigital Library
- Erin Brady and Jeffrey P. Bigham. 2015. Crowdsourcing Accessibility: Human-Powered Access Technologies. Foundations and Trends® in Human--Computer Interaction 8, 4: 273--372.Google Scholar
- Erin Brady, Meredith Ringel Morris, and Jeffrey P. Bigham. 2015. Gauging Receptiveness to Social Microvolunteering. 1055--1064. Google ScholarDigital Library
- Erin Brady, Yu Zhong, Meredith Ringel Morris, and Jeffrey P. Bigham. 2013. Investigating the Appropriateness of Social Network Question Asking as a Resource for Blind Users. 1225--1236. Google ScholarDigital Library
- P. Burnard. 1991. A method of analysing interview transcripts in qualitative research. Nurse education today 11, 6: 461--466.Google Scholar
- Jenny Corbett. 1994. A Proud Label: Exploring the Relationship between Disability Politics and Gay Pride. Disability & Society 9, 3: 343--357.Google ScholarCross Ref
- Julia Davies. 2007. Display, Identity and the Everyday: Self-presentation through online image sharing. Discourse: Studies in the Cultural Politics of Education 28, 4: 549--564.Google ScholarCross Ref
- Bella M. DePaulo and Jeffrey D. Fisher. 2010. The Costs of Asking for Help. Basic and Applied Social Psychology 1, 1: 93--102.Google Scholar
- Joan Morris Dimicco and David R. Millen. 2007. Identity Management: Multiple Presentations of Self in Facebook. Group'07: 0--3.Google Scholar
- Facebook. 2013. A Focus on Efficiency. A whitepaper from Facebook, Ericsson and Qualcomm : 1--71. Retrieved from papers3://publication/uuid/FB40BABC-2141-4890-AABE-1A0C1BBA9497Google Scholar
- Leon A. Gatys, Alexander S. Ecker, and Matthias Bethge. 2015. A Neural Algorithm of Artistic Style. Retrieved April 25, 2017 from http://arxiv.org/abs/1508.06576Google Scholar
- E. Goffman. 1990. The Presentation of Self in Everyday Life. Penguin Books Ltd.Google Scholar
- Google. Get started on Android with TalkBack -- Android Accessibility Help. Retrieved March 6, 2017 from https://support.google.com/accessibility/android/answer/6283677?hl=enGoogle Scholar
- Kathryn Greene, Valerian J. Derlega, and Mathews Alicia. 2006. Self-disclosure in personal relationships. The Cambridge handbook of personal relationships, 409--427.Google Scholar
- Oliver L. Haimson, Jed R. Brubaker, Lynn Dombrowski, and Gillian R. Hayes. 2015. Disclosure, Stress, and Support During Gender Transition on Facebook. Proceedings of the 18th ACM Conference on Computer Supported Cooperative Work & Social Computing - CSCW '15: 1176--1190. Google ScholarDigital Library
- S. Harada, Daisuke Sato, and Dw Adams. 2013. Accessible photo album: enhancing the photo sharing experience for people with visual impairment. Proceedings of CHI 2013: 2127--2136. Google ScholarDigital Library
- Chandrika Jayant. 2010. MobileAccessibility: Camera Focalization for Blind and Low-vision Users on the Go. SIGACCESS Access. Comput., 96: 37--40. Google ScholarDigital Library
- Chandrika Jayant, Hanjie Ji, Samuel White, and Jeffrey P. Bigham. 2011. Supporting blind photography. The proceedings of the 13th international ACM SIGACCESS conference on Computers and accessibility - ASSETS '11: 203--210. Google ScholarDigital Library
- E. E. Jones & Pittman, T.S. 1982. Toward a general theory of strategic self-presentation. February: 231--262.Google Scholar
- Hernisa Kacorri, Kris M. Kitani, Jeffrey P. Bigham, and Chieko Asakawa. 2017. People with Visual Impairment Training Personal Object Recognizers': Feasibility and Challenges. March. Google ScholarDigital Library
- Matthew Kay, Shwetak N. Patel, and Julie A. Kientz. 2015. How Good is 85%?: A Survey Tool to Connect Classifier Evaluation to Acceptability of Accuracy. Proceedings of the ACM Conference on Human Factors in Computing Systems (CHI 2015): 347--356. https://doi.org/bqd5 Google ScholarDigital Library
- Melissa A. Lewis and Clayton Neighbors. 2005. Self-Determination and the Use of Self-Presentation Strategies. 145, 4: 469--490.Google Scholar
- Haley Macleod, Cynthia L. Bennett, Meredith Ringel Morris, and Edward Cutrell. 2017. Understanding Blind People's Experiences with Computer-Generated Captions of Social Media Images. Google ScholarDigital Library
- Meredith Ringel Morris, Jaime Teevan, and Katrina Panovich. 2010. A comparison of information seeking using search engines and social networks. Proceedings of the Fourth International AAAI Conference on Weblogs and Social Media A (ICWSM): 291--294. Retrieved from http://www.aaai.org/ocs/index.php/ICWSM/ICWSM10/paper/download/1518/1879Google Scholar
- Meredith Ringel Morris, Annuska Zolyomi, Catherine Yao, Sina Bahram, Jeffrey P. Bigham, and Shaun K. Kane. 2016. "With most of it being pictures now, I rarely use it": Understanding Twitter's Evolving Accessibility to Blind Users. Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems - CHI '16: 5506--5516. Google ScholarDigital Library
- Gwendolyn Seidman. 2013. Self-presentation and belonging on Facebook: How personality influences social media use and motivations. Personality and Individual Differences 54, 3: 402--407.Google ScholarCross Ref
- Lior Shamir, Tomasz Macura, Nikita Orlov, D. Mark Eckley, and Ilya G. Goldberg. 2010. Impressionism, expressionism, surrealism: Automated Recognition of Painters and Schools of Art. ACM Transactions on Applied Perception 7, 2: 1--17. Google ScholarDigital Library
- Yaoru Sun and Robert Fisher. 2003. Object-based visual attention for computer vision. Artificial Intelligence 146, 1: 77--123. Google ScholarDigital Library
- Sarit Szpiro, Yuhang Zhao, and Shiri Azenkot. 2016. Finding a store, searching for a product: a study of daily challenges of low vision people. Proceedings of the 2016 ACM International Joint Conference on Pervasive and Ubiquitous Computing -- UbiComp '16: 61--72. Google ScholarDigital Library
- Suvi Uski and A. Lampinen. 2014. Social norms and self-presentation on social network sites: Profile work in action. New Media & Society: 1--18.Google Scholar
- Marynel Vázquez and Aaron Steinfeld. 2012. Helping Visually Impaired Users Properly Aim a Camera. Proceedings of the 14th International ACM SIGACCESS Conference on Computers and Accessibility: 95--102. Google ScholarDigital Library
- Violeta Voykinska, Shiri Azenkot, Shaomei Wu, and Gilly Leshed. 2016. How Blind People Interact with Visual Content on Social Networking Services. Proceedings of the 19th ACM Conference on Computer-Supported Cooperative Work & Social Computing - CSCW '16: 1582--1593. Google ScholarDigital Library
- Violeta Voykinska, Cornell Tech, and Gilly Leshed. 2016. How Blind People Interact with Visual Content on Social Networking Services. FEBRUARY. Google ScholarDigital Library
- Nick Watson. 2014. Well, I Know this is Going to Sound Very Strange to You, but I Don't See Myself as a Disabled Person: Identity and disability. 7599, November: 508--527.Google Scholar
- Samuel White, Hanjie Ji, and Jeffrey P. Bigham. 2010. EasySnap: Real-time Audio Feedback for Blind Photography. Adjunct proceedings of the 23nd annual ACM symposium on User interface software and technology -- UIST '10: 409. Google ScholarDigital Library
- Shaomei Wu and Lada Adamic. 2014. Visually Impaired Users on an Online Social Network. 3133--3142. Google ScholarDigital Library
- Shaomei Wu, Jeffrey Wieland, Omid Farivar, and Julie Schiller. 2017. Automatic Alt-text: Computer-generated Image Descriptions for Blind Users on a Social Network Service. Cscw. Google ScholarDigital Library
- Ning Zhang, Manohar Paluri, Yaniv Taigman, Rob Fergus, and Lubomir Bourdev. 2015. Beyond Frontal Faces: Improving Person Recognition Using Multiple Cues. 4804--4813. Retrieved July 2, 2017 from http://www.cv-foundation.org/openaccess/content_cvpr_2015/html/Zhang_Beyond_Frontal_Faces_2015_CVPR_paper.htmlGoogle Scholar
- Shanyang Zhao, Sherri Grasmuck, and Jason Martin. 2008. Identity construction on Facebook: Digital empowerment in anchored relationships. Computers in Human Behavior 24, 5: 1816--1836. Google ScholarDigital Library
- Yu Zhong, Walter S. Lasecki, Erin Brady, and Jeffrey P. Bigham. 2015. RegionSpeak: Quick Comprehensive Spatial Descriptions of Complex Images for Blind Users. Proceedings of the ACM CHI'15 Conference on Human Factors in Computing Systems 1: 2353--2362. Google ScholarDigital Library
- TapTapSee -- Blind and Visually Impaired Assistive Technology -- powered by CloudSight.ai image recognition API. Retrieved March 7, 2017 from http://taptapseeapp.com/Google Scholar
- Search for pictures with Google Goggles -- Search Help. Retrieved April 2, 2017 from https://support.google.com/websearch/answer/166331?hl=enGoogle Scholar
- Alt Text Bot | AT&T NYU Connect Ability Challenge. Retrieved April 2, 2017 from https://connectability.devpost.com/submissions/37785-alt-text-botGoogle Scholar
- Legally Blind: What Does It Mean? Retrieved April 26, 2017 from http://www.allaboutvision.com/lowvision/legally-blind.htmGoogle Scholar
- TapTapSee App Review -- WonderBaby.org. Retrieved July 2, 2017 from http://www.wonderbaby.org/articles/taptapsee-app-reviewGoogle Scholar
- Google Photos adds smarter sharing, suggestions and shared libraries -- TechCrunch. Retrieved July 2, 2017 from https://techcrunch.com/2017/06/28/google-photos-adds-smarter-sharing-suggestions-and-shared-libraries/Google Scholar
- ImageNet. Retrieved April 25, 2017 from http://www.image-net.org/Google Scholar
- COCO -- Common Objects in Context. Retrieved April 25, 2017 from http://mscoco.org/Google Scholar
- VizWiz Dataset. Retrieved July 8, 2017 from http://vizwiz.org/data/#datasetGoogle Scholar
Index Terms
- The Effect of Computer-Generated Descriptions on Photo-Sharing Experiences of People with Visual Impairments
Recommendations
Improving mealtime experiences of people with visual impairments
W4A '21: Proceedings of the 18th International Web for All ConferenceA number of studies have been conducted to understand the accessibility issues that people with visual impairments experience. However, most of these are limited to navigation and object recognition tasks. In this study, we focused on providing mealtime ...
Photo Sharing in the Arab Gulf: Expressing the Collective and Autonomous Selves
CSCW '17: Proceedings of the 2017 ACM Conference on Computer Supported Cooperative Work and Social ComputingCurrent research demonstrates that when people engage in social photo sharing, they are mindful of how audiences perceive and interact with their photos. We extend this vein of inquiry to focus on photo sharing in the context of the Arab Gulf. We ...
Challenges and opportunities to improve the accessibility of YouTube for people with visual impairments as content creators
AbstractThis position paper proposes technology opportunities for supporting people with visual impairments (PVI) as content creators, rather than just content consumers. While previous studies examined accessibility issues with functions and visual ...
Comments