Catherine M. Baker
Lauren R. Milne
Richard E. Ladner
Abstract
We discuss the development of Tactile Graphics with a Voice (TGV), a system used to access label information in tactile graphics using QR codes. Blind students often rely on tactile graphics to access textbook images. Many textbook images have a large number of text labels that need to be made accessible. In order to do so, we propose TGV, which uses QR codes to replace the text, as an alternative to Braille. The codes are read with a smartphone application. We evaluated the system with a longitudinal study where 10 blind and low-vision participants completed tasks using three different modes on the smartphone application: (1) no guidance, (2) verbal guidance, and (3) finger-pointing guidance. Our results show that TGV is an effective way to access text in tactile graphics, especially for those blind users who are not fluent in Braille. We also found that preferences varied greatly across the modes, indicating that future work should support multiple modes. We expand upon the algorithms we used to implement the finger pointing, algorithms to automatically place QR codes on documents. We also discuss work we have started on creating a Google Glass version of the application.
- Frances K., Aldrich and Linda Sheppard. 2001. Tactile graphics in school education: Perspectives from pupils. British Journal of Visual Impairment, 19, 2, 69--73.Google Scholar
Cross Ref
- Catherine M. Baker, Lauren R. Milne, Jeffrey Scofield, Cynthia L. Bennett, and Richard E. Ladner. 2014. Tactile graphics with a voice: Using QR codes to access text in tactile graphics. In Proceedings of the 16th International ACM SIGACCESS Conference on Computers & Accessibility (ASSETS'14), 75--82. DOI:http://doi.org/10.1145/2661334.2661366 Google ScholarDigital Library
- Jeffrey P. Bigham, Chandrika Jayant, Andrew Miller, Brandyn White, and Tom Yeh. 2010. VizWiz::LocateIt - Enabling blind people to locate objects in their environment. In 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Workshops (CVPRW'10), 65--72. DOI:http://doi.org/10.1109/CVPRW.2010.5543821Google ScholarCross Ref
- Braille Cell Dimensions. 2009. http://www.tiresias.org/research/reports/braille_cell.htm.Google Scholar
- Ahmed Elgammal, Crystal Muang, and Dunxu Hu. 2009. Skin detection-a short tutorial. Encyclopedia of Biometrics, 1--10. Retrieved from http://pdf.aminer.org/000/312/166/finding_facial_features_using_an_hls_colour_space.pdf.Google Scholar
- Daniel Goransson. 2011. New VoiceOver Features in iOS 5. Retrieved from http://axslab.com/articles/new-voiceover-features-in-ios5.Google Scholar
- Berchie Woods Gordon-Holliday, L. E. Yunker, G. Vannatta, and F. J. Crosswhite. 1999. Advanced Mathematical Concepts: Precalculus with Applications. Glencoe/McGraw-Hill.Google Scholar
- Bill Holton. 2013. Voiceye: A breakthrough in document access. AFB AccessWorld Magazine.Google Scholar
- Chandrika Jayant, Hanjie Ji, Samuel White, and Jeffrey P. Bigham. 2011. Supporting blind photography. In Proceedings of the 13th International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS'11), 203--210. DOI:http://doi.org/10.1145/2049536.2049573 Google ScholarDigital Library
- Chandrika Jayant, Matt Renzelmann, Dana Wen, Satria Krisnandi, Richard Ladner, and Dan Comden. 2007. Automated tactile graphics translation. In Proceedings of the 9th International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS'07), 75. DOI:http://doi.org/10.1145/1296843.1296858 Google ScholarDigital Library
- Shaun K. Kane, Brian Frey, and Jacob O. Wobbrock. 2013. Access Lens: A gesture-based screen reader for real-world documents. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI'13), 347--350. DOI:http://doi.org/10.1145/2470654.2470704 Google ScholarDigital Library
- Steven Landau, Steven Holborow, and Jane Erin. 2004. The use of the talking tactile tablet for delivery of standardized tests. In Proceedings of the Annual International Technology and Persons with Disabilities Conference.Google Scholar
- Steven Landau and Joshua Miele. 2010. Talking Tactile Apps for the Pulse Pen: STEM Binder. Retrieved from https://docs.google.com/presentation/d/1Ylscpk6QKX7Y5WCW3CFnhZDJJlL4X5ki8gHdcJvBp70/present#slide=id.i0.Google Scholar
- Suranga Nanayakkara, Roy Shilkrot, Kian Peen Yeo, and Pattie Maes. 2013. EyeRing: A finger-worn input device for seamless interactions with our surroundings. In Proceedings of the 4th Augmented Human International Conference on AH'13. 13--20. DOI:http://doi.org/10.1145/2459236.2459240 Google ScholarDigital Library
- National Federation of the Blind Jernigan Institute. 2009. The Braille Literacy Crisis in America: Facing the Truth, Reversing the Trend, Empowering the Blind. Retrieved from https://www.nfb.org.Google Scholar
- Nemeth Braille. http://www.braillebug.org/nemeth_braille.asp.Google Scholar
- Son Lam Phung, Abdesselam Bouzerdoum, and Douglas Chai. 2003. Skin segmentation using color and edge information. In Proceedings of the 7th International Symposium on Signal Processing and Its Applications (ISSPA'03), 1 (July), 525--528. DOI:http://doi.org/10.1109/ISSPA.2003.1224755Google ScholarCross Ref
- Son Lam Phung, Abdesselam Bouzerdoum, and Douglas Chai. 2005. Skin segmentation using color pixel classification: Analysis and comparison. IEEE Transactions on Pattern Analysis and Machine Intelligence, 27, 1, 148--154. DOI:http://doi.org/10.1109/TPAMI.2005.17 Google ScholarDigital Library
- 2011. QR Code Minimum Size. http://www.qrstuff.com/blog/2011/11/23/qr-code-minimum-size.Google Scholar
- Audrey C. Rule, Greg P. Stefanich, Robert M. Boody, and Belinda Peiffer. 2011. Impact of adaptive materials on teachers and their students with visual impairments in secondary science and mathematics classes. International Journal of Science Education 33, January 2015, 865--887. http://doi.org/10.1080/09500693.2010.506619Google ScholarCross Ref
- Stuart Russell and Peter Norvig. 2009. Artificial Intelligence: A Modern Approach, 3rd ed. DOI:http://doi.org/10.1017/S0269888900007724 Google ScholarDigital Library
- Linda Sheppard and Frances K. Aldrich. 2001. Tactile graphics in school education: Perspectives from teachers. British Journal of Visual Impairment, 19, 3, 93--97. http://doi.org/10.1177/026461960101900303Google ScholarCross Ref
- Richard Szeliski. 2010. Computer vision: Algorithms and applications. Computer 5, 832. DOI:http://doi.org/10.1007/978-1-84882-935-0 Google ScholarDigital Library
- Ender Tekin and James M. Coughlan. 2010. A mobile phone application enabling visually impaired users to find and read product barcodes. Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), 6180 LNCS (Part 2), 290--295. DOI:http://doi.org/10.1007/978-3-642-14100-3_43Google Scholar
- Marynel Vázquez and Aaron Steinfeld. 2012. Helping visually impaired users properly aim a camera. In Proceedings of the 14th International ACM SIGACCESS Conference on Computers and Accessibility, 95--102. http://doi.org/10.1145/2384916.2384934 Google ScholarDigital Library
Index Terms
- Tactile Graphics with a Voice
Recommendations
Understanding what you feel: A Mobile Audio-Tactile System for Graphics Used at Schools with Students with Visual Impairment
CHI '20: Proceedings of the 2020 CHI Conference on Human Factors in Computing SystemsA lot of information is nowadays presented graphically. However, students with blindness do not have access to visual information. Providing an alternative text is not always the appropriate solution as exploring graphics to discover information ...
Visually Augmented Audio-Tactile Graphics for Visually Impaired People
Paper from ASSETS 2016 and Regular PapersTactile graphics play an essential role in knowledge transfer for blind people. The tactile exploration of these graphics is often challenging because of the cognitive load caused by physiological constraints and their complexity. The coupling of ...
Tactile graphics with a voice: using QR codes to access text in tactile graphics
ASSETS '14: Proceedings of the 16th international ACM SIGACCESS conference on Computers & accessibilityTextbook figures are often converted into a tactile format for access by blind students. These figures are not truly accessible unless the text within the figures is also made accessible. A common solution to access text in a tactile image is to use ...
Comments