(Computer) vision without sight

Abstract

Computer vision holds the key for the blind or visually impaired to explore the visual world.

References

1. Ackel, W. A Segway to independence. Braille Monitor, 2006.
2. Bigham, J.P., Jayant, C., Ji, H., Little, G., Miller, A., Miller, R.C., Miller, R, Tatarowicz, A., White, B., White, S. and Yeh, T. VizWiz: Nearly real-time answers to visual questions. In Proc. ACM Symposium on User Interface Software and Technology (2010).
3. Blasch, B., Wiener, W. and Welsh, R. Foundations of Orientation and Mobility. AFB Press, Second Edition, 1997.
4. Chen, X. and Yuille, A. Detecting and reading text in natural scenes. In Proc. IEEE Conference on Computer Vision and Pattern Recognition (2004).
5. Coughlan, J. and Manduchi, R. Functional assessment of a camera phone-based wayfinding system operated by blind and visually impaired users. International Journal on Artificial Intelligence Tool 18, 3 (2009), 379--397.
6. Dingler, T., Lindsay, J. and Walker, B.N. Learnability of sound cues for environmental features: Auditory icons, earcons, spearcons, and speec. In Proc. International Conference on Auditory Display, (2008).
7. Gagnon, L., Chapdelaine, C., Byrns, D., Foucher, S., Heritier, M. and Gupta, V. A computer-vision-assisted system for Videodescription scripting. In Proc. Workshop on Computer Vision Applications for the Visually Impaired (2010).
8. Gallo, O. and Manduchi, R. Reading 1-D barcodes with mobile phones using deformable templates barcodes with mobile phones using deformable templates. IEEE Transactions on Pattern Analysis and Machine Intelligence, in press.
9. Hesch, J.A. and Roumeliotis, S.I. Design and analysis of a portable indoor localization aid for the visually impaired. International Journal on Robotics Research 29, (sept. 2010), 1400--1415.
10. Hile, H., Liu, A., Borriello, G., Grzeszczuk, R., Vedantham, R. and Kosecka, J. Visual navigation for mobile devices. IEEE Multimedia 17, 2 (2010), 16--25.
11. Hile, H., Vedantham, R., Cuellar, G., Liu, A., Gelfand, N., Grzeszczuk, R. and Borriello, G. Landmark-based pedestrian navigation from collections of geotagged photos. In Proc. International Conference on Mobile and Ubiquitous Multimedia (2008).
12. Ivanchenko, V., Coughlan, J. and Shen, H. Crosswatch: A camera phone system for orienting visually impaired pedestrians at traffic intersections. In Proc. International Conference on Computers Helping People with Special Needs (2008).
13. Ivanchenko, V., Coughlan, J. and Shen, H. Real-time walk light detection with a mobile phone. In Proc. International Conference on Computers helping people with Special Needs (2010).
14. Kalia, A.A., Legge, G.E., Ogale, A. and Roy, R. Assessment of indoor route-finding technology for people who are visually impaired. Journal of Visual Impairment & Blindness 104, 3 (Mar. 2010), 135--147.
15. Krishna, S., Colbry, D., Black, J., Balasubramanian, V. and Panchanathan, S. A systematic requirements analysis and development of an assistive device to enhance the social interaction of people who are blind or visually impaired. In Proc. Workshop on Computer Vision Applications for the Visually Impaired (2008).
16. Kulyukin, V. and Kutiyanawala, A. Accessible shopping systems for blind and visually impaired individuals: design requirements and the state of the art. The Open Rehabilitation Journal 2 (2010).
17. Kutiyanawala, A. and Kulyukin, V. An eyes-free vision-based UPC and MSI barcode localization and decoding algorithm for mobile phones. In Proc. Envision Conference, (2010).
18. Ladetto, Q. and Merminod, B. Combining gyroscopes, magnetic compass and GPS for pedestrian navigation. In Proc. Int. Symposium on Kinematic Systems in Geodesy, Geomatics and Navigation (2001).
19. Liu, J. Phillips, C. and Daniilidis, K. Video-based localization without 3D mapping for the visually impaired. In Proc. Workshop on Computer Vision Applications for the Visually Impaired (2010).
20. Loomis, J.M., Golledge, R.G., Klatzky, R.L. and Marston, J.R. Assisting wayfinding in visually impaired travelers. Applied Spatial Cognition: From Research to Cognitive Technology. Lawrence Erlbaum Assoc., Mahwah, NJ, 2007, pages 179--202.
21. Manduchi, R and Kurniawan, S. Mobility-related accidents experienced by people with visual impairment. AER Journal: Research and Practice in Visual Impairment and Blindness, in press.
22. Manduchi, R., Kurniawan, S. and Bagherinia, H. Blind guidance using mobile computer vision: A usability study. In Proc. ACM SIGACCESS Conference on Computers and Accessibility (2010).
23. Marston, J.R., Loomis, J.M., Klatzky, R.L., Golledge, R.G. and Smith, E.L. Evaluation of spatial displays for navigation without sight. ACM Transactions on Applied Perception 3, 2 (2006), 110--124.
24. Mattar, M.A., Hanson, A.R. and Learned-Miller, E.G. Sign classification using local and meta-features. In Proc. Workshop on Computer Vision Applications for the Visually Impaired (2005).
25. Pradeep, V., Medioni, G. and Weiland, J. Piecewise planar modeling for step detection using stereo vision. In Proc. Workshop on Computer Vision Applications for the Visually Impaired (2008).
26. Pradeep, V., Medioni, G. and Weiland, J. Robot vision for the visually impaired. In Proc. Workshop on Applications of Computer Vision for the Visually Impaired (2010).
27. Ross, D.A. and Blasch, B.B. Wearable interfaces for orientation and wayfinding. In Proc. ACM SIGACCESS Conference on Computers and Accessibility (2000).
28. Saez, J. and Escolano, F. Stereo-based aerial obstacle detection for the visually impaired. In Proc. Workshop on Computer Vision Applications for the Visually Impaired (2008).
29. Sanketi, P., Shen, H. and Coughlan, J. Localizing blurry and low-resolution text in natural images. In Proc. IEEE Workshop on Applications of Computer Vision (2011).
30. Sudol, J., Dialameh, O., Blanchard, C. and Dorcey, T. Looktel: A comprehensive platform for computer-aided visual assistance. In Proc. Workshop on Computer Vision Applications for the Visually Impaired (2010).
31. Tekin, E. and Coughlan, J. An algorithm enabling blind users to _nd and read barcodes. In Proc. IEEE Workshop on Applications of Computer Vision (2009).
32. Tekin, E., Coughlan, J. and Shen, H. Real-time detection and reading of LED/LCD displays for visually impaired persons. In Proc. IEEE Workshop on Applications of Computer Vision (2011).
33. Tjan, B.S., Beckmann, P.J., Roy, R., Giudice, N. and Legge, G.E. Digital sign system for indoor wayfinding for the visually impaired. In Proc. Workshop on Computer Vision for the Visually Impaired (2005).
34. Walker, B.N. and Lindsay, J. Navigation performance in a virtual environment with bonephones. In Proc. International Conference on Auditory Display (2005).
35. Wang, K. and Belongie, S. Word spotting in the wild. In Proc. European Conference on Computer Vision (2010).
36. Weinman, J.J., Learned-Miller, E. and A. R. Hanson, A.R. Scene text recognition using similarity and a lexicon with sparse belief propagation. IEEE Transactions on Pattern Analysis and Machine Intelligence 31, (oct. 2009), 1733--1746.
37. Wilson, J., Walker, B.N., Lindsay, J., Cambias, C. and Dellaert, F. SWAN: System for wearable audio navigation. In Proc. IEEE International Symposium on Wearable Computers (2007).
38. Winlock, T., Christiansen, E. and Belongie, S. Toward real-time grocery detection for the visually impaired. In Proc. Workshop on Computer Vision Applications for the Visually Impaired (2010).
39. Yang, X. and Tian, Y. Robust door detection in unfamiliar environments by combining edge and corner features. In Proc. Workshop on Computer Vision Applications for the Visually Impaired (2010).
40. Yuan, D. and Manduchi, R. Dynamic environment exploration using a virtual white cane. In Proc. IEEE Conference on Computer Vision and Pattern Recognition (2005).

Index Terms

• Computing methodologies

  • Computer graphics

    • Image manipulation

    • Rendering

    • Shape modeling

  • Machine learning

• Theory of computation

  • Randomness, geometry and discrete structures

    • Computational geometry