Hernisa Kacorri
Sergio Mascetti
Hironobu Takagi
Skip Abstract Section
Abstract
Assistive applications for orientation and mobility promote independence for people with visual impairment (PVI). While typical design and evaluation of such applications involves small-sample iterative studies, we analyze large-scale longitudinal data from a geographically diverse population. Our publicly released dataset from iMove, a mobile app supporting orientation of PVI, contains millions of interactions by thousands of users over a year.
Our analysis (i) examines common functionalities, settings, assistive features, and movement modalities in iMove dataset and (ii) discovers user communities based on interaction patterns. We find that the most popular interaction mode is passive, where users receive more notifications, often verbose, while in motion and perform fewer actions. The use of built-in assistive features such as enlarged text indicate a high presence of users with residual sight. Users fall into three distinct groups: (C1) users interested in surrounding points of interest, (C2) users interacting in short bursts to inquire about current location, and (C3) users with long active sessions while in motion. iMove was designed with C3 in mind, and one strength of our contribution is providing meaningful semantics for unanticipated groups, C1 and C2. Our analysis reveals insights that can be generalized to other assistive orientation and mobility applications.
- John G. Adair. 1984. The hawthorne effect: A reconsideration of the methodological artifact. J. Appl. Psychol. 69, 2 (1984), 334.Google Scholar
Cross Ref
- Dragan Ahmetovic, Cristian Bernareggi, and Sergio Mascetti. 2011. Zebralocalizer: Identification and localization of pedestrian crossings. In Proceedings of the 13th International Conference on Human Computer Interaction with Mobile Devices and Services. ACM, 275--284. Google ScholarDigital Library
- Dragan Ahmetovic, Cole Gleason, Kris Kitani, Hironobu Takagi, and Chieko Asakawa. 2016. NavCog: Turn-by-turn smartphone navigation assistant for people with visual impairments or blindness. In Proceedings of the Web for All Conference. ACM. Google ScholarDigital Library
- Dragan Ahmetovic, Cole Gleason, Chengxiong Ruan, Kris Kitani, Hironobu Takagi, and Chieko Asakawa. 2016. NavCog: A navigational cognitive assistant for the blind. In Proceedings of the 18th International Conference on Human-Computer Interaction with Mobile Devices and Services (MobileHCI’16). ACM. Google ScholarDigital Library
- Dragan Ahmetovic, Masayuki Murata, Cole Gleason, Erin Brady, Hironobu Takagi, Kris Kitani, and Chieko Asakawa. 2017. Achieving practical and accurate indoor navigation for people with visual impairments. In Proceedings of the Web for All Conference. ACM. Google ScholarDigital Library
- D. Ahmetovic, C. Bernareggi, A. Gerino, and S. Mascetti2014. ZebraRecognizer: Efficient and precise localization of pedestrian crossings. In Proceedings of the 22nd International Conference on Pattern Recognition. IEEE. Google ScholarDigital Library
- Aries Arditi, Jeffrey D. Holtzman, and Stephen M. Kosslyn. 1988. Mental imagery and sensory experience in congenital blindness. Neuropsychologia 26, 1 (1988), 1--12.Google ScholarCross Ref
- Thomas Aynaud. 2017. Louvain Community Detection. Retrieved July 10, 2017 from https://github.com/taynaud/python-louvain.Google Scholar
- Claudio Bettini, Sergio Mascetti, X. Sean Wang, and Sushil Jajodia. 2007. Anonymity in location-based services: Towards a general framework. In Proceedings of the 2007 International Conference on Mobile Data Management. IEEE, 69--76. Google ScholarDigital Library
- Jeffrey P. Bigham, Anna C. Cavender, Jeremy T. Brudvik, Jacob O. Wobbrock, and Richard E. Ladner. 2007. WebinSitu: A comparative analysis of blind and sighted browsing behavior. In Proceedings of the 9th international ACM SIGACCESS conference on Computers and accessibility. ACM, 51--58. Google ScholarDigital Library
- Vincent D. Blondel, Jean-Loup Guillaume, Renaud Lambiotte, and Etienne Lefebvre. 2008. Fast unfolding of communities in large networks. J. Stat. Mech. Theory Exper. 2008, 10 (2008), P10008.Google ScholarCross Ref
- Matthias Böhmer, Brent Hecht, Johannes Schöning, Antonio Krüger, and Gernot Bauer. 2011. Falling asleep with angry birds, facebook and kindle: A large scale study on mobile application usage. In Proceedings of the 13th International Conference on Human Computer Interaction with Mobile Devices and Services. ACM, 47--56. Google ScholarDigital Library
- Erin L. Brady, Daisuke Sato, Chengxiong Ruan, Hironobu Takagi, and Chieko Asakawa. 2015. Exploring interface design for independent navigation by people with visual impairments. In Proceedings of the 17th International ACM SIGACCESS Conference on Computers 8 Accessibility (ASSETS’15). ACM, New York, NY, 387--388. Google ScholarDigital Library
- Marc Damashek. 1995. Gauging similarity with n-grams: Language-independent categorization of text. Science 267, 5199 (1995), 843.Google Scholar
- Scott Deerwester, Susan T. Dumais, George W. Furnas, Thomas K. Landauer, and Richard Harshman. 1990. Indexing by latent semantic analysis. J. Am. Soc. Inf. Sci. 41, 6 (1990), 391.Google ScholarCross Ref
- Himel Dev and Zhicheng Liu. 2017. Identifying frequent user tasks from application logs. In Proceedings of the 22nd International Conference on Intelligent User Interfaces. ACM, 263--273. Google ScholarDigital Library
- Christine Dickinson. 1998. Low Vision: Principles and Practice. Butterworth-Heinemann, Berwick upon Tweed, UK.Google Scholar
- Trinh Minh Tri Do, Jan Blom, and Daniel Gatica-Perez. 2011. Smartphone usage in the wild: A large-scale analysis of applications and context. In Proceedings of the 13th International Conference on Multimodal Interfaces. ACM, 353--360. Google ScholarDigital Library
- Navid Fallah, Ilias Apostolopoulos, Kostas Bekris, and Eelke Folmer. 2013. Indoor human navigation systems: A survey. Interact. Comput. 25, 1 (2013), 21--33.Google Scholar
- Nicholas A. Giudice and Gordon E. Legge. 2008. Blind navigation and the role of technology. In Engineering Handbook of Smart Technology for Aging, Disability, and Independence. 479--500.Google Scholar
- Martin Goldberg. 2015. Assisting Visually Impaired People with Mobility through Technology in the Age of Context. Ph.D. Dissertation. City University of New York.Google Scholar
- Joo Guerreiro, Dragan Ahmetovic, Kris M. Kitani, and Chieko Asakawa. 2017. Virtual navigation for blind people: Building sequential representations of the real-world. In Proceedings of the 19th International ACM SIGACCESS Conference on Computers and Accessibility. ACM. Google ScholarDigital Library
- Amy Hurst, Scott E. Hudson, Jennifer Mankoff, and Shari Trewin. 2013. Distinguishing users by pointing performance in laboratory and real-world tasks. ACM Trans. Access. Comput. 5, 2 (2013), 5. Google ScholarDigital Library
- Hideyuki Iwahashi. 1983. Toward White Wave—Story of Seiichi Miyake (in Japanese). Traffic Safety Research Center.Google Scholar
- Anil K. Jain. 2010. Data clustering: 50 years beyond K-means. Pattern Recogn. Lett. 31, 8 (2010), 651--666. Google ScholarDigital Library
- Hernisa Kacorri, Kris M. Kitani, Jeffrey P. Bigham, and Chieko Asakawa. 2017. People with visual impairment training personal object recognizers: Feasibility and challenges. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems. ACM, 5839--5849. Google ScholarDigital Library
- Hernisa Kacorri, Sergio Mascetti, Andrea Gerino, Dragan Ahmetovic, Hironobu Takagi, and Chieko Asakawa. 2016. Supporting orientation of people with visual impairment: Analysis of large scale usage data. In International ACM SIGACCESS Conference on Computers and Accessibility. ACM. Google ScholarDigital Library
- Quannan Li, Yu Zheng, Xing Xie, Yukun Chen, Wenyu Liu, and Wei-Ying Ma. 2008. Mining user similarity based on location history. In Proceedings of the 16th ACM SIGSPATIAL International Conference on Advances in Geographic Information Systems. ACM, 34. Google ScholarDigital Library
- Richard G. Long and Nicholas A. Giudice. 1997. Establishing and maintaining orientation for mobility. Foundations of Orientation and Mobility 1 (1997), 45--67.Google Scholar
- James MacQueen and others. 1967. Some methods for classification and analysis of multivariate observations. In Proceedings of the 5th Berkeley Symposium on Mathematical Statistics and Probability, Vol. 1. Oakland, CA, 281--297.Google Scholar
- Sergio Mascetti, Dragan Ahmetovic, Andrea Gerino, and Cristian Bernareggi. 2016. ZebraRecognizer: Pedestrian crossing recognition for people with visual impairment or blindness. Pattern Recognition 60 (2016), 405--419. Google ScholarDigital Library
- Sergio Mascetti, Dragan Ahmetovic, Andrea Gerino, Cristian Bernareggi, Mario Busso, and Alessandro Rizzi. 2016. Robust traffic lights detection on mobile devices for pedestrians with visual impairment. Computer Vision and Image Understanding 148 (2016), 123--135. Google ScholarDigital Library
- Sergio Mascetti, Lorenzo Picinali, Andrea Gerino, Dragan Ahmetovic, and Cristian Bernareggi. 2016. Sonification of guidance data during road crossing for people with visual impairments or blindness. International Journal of Human-Computer Studies 85 (2016), 16--26. Google ScholarDigital Library
- Florian Meier, Johannes Aigner, and David Elsweiler. 2017. Using sessions from clickstream data analysis to uncover different types of twitter behaviour. In Proceedings of the 15th International Symposium of Information Science: Everything Changes, Everything Stays the Same? Understanding Information Spaces (ISI’17). Humboldt-Universität zu Berlin.Google Scholar
- Daniel R. Montello. 2001. Spatial cognition. In International Encyclopedia of the Social and Behavioral Sciences, N. J. Smelser and B. Baltes (Eds.)Google Scholar
- Madoka Nakajima and Shinichiro Haruyama. 2013. New indoor navigation system for visually impaired people using visible light communication. EURASIP J. Wireless Commun. Netw. 2013, 1 (2013), 1--10.Google ScholarCross Ref
- Mark E. J. Newman and Michelle Girvan. 2004. Finding and evaluating community structure in networks. Phys. Rev. E 69, 2 (2004), 026113.Google ScholarCross Ref
- Bo Pang and Lillian Lee. 2008. Opinion mining and sentiment analysis. Found. Trends Inf. Retriev. 2, 1--2 (2008), 1--135. Google ScholarDigital Library
- F. Pedregosa, G. Varoquaux, A. Gramfort, V. Michel, B. Thirion, O. Grisel, M. Blondel, P. Prettenhofer, R. Weiss, V. Dubourg, J. Vanderplas, A. Passos, D. Cournapeau, M. Brucher, M. Perrot, and E. Duchesnay. 2011. Scikit-learn: Machine learning in python. Journal of Machine Learning Research 12 (2011), 2825--2830. Google ScholarDigital Library
- Torben Poulsen. 1982. Acoustic traffic signal for blind pedestrians. Appl. Acoust. 15, 5 (1982), 363--376.Google ScholarCross Ref
- N. Pressey. 1977. Mowat sensor. Focus 11, 3 (1977), 35--39.Google Scholar
- Christian Quadri, Matteo Zignani, Sabrina Gaito, and Gian Paolo Rossi. 2016. Clique-aware mobile social clouds. In Proceedings of the IFIP Networking Conference (IFIP Networking) and Workshops, 2016. IEEE, 512--517.Google ScholarCross Ref
- Lisa Ran, Sumi Helal, and Steve Moore. 2004. Drishti: An integrated indoor/outdoor blind navigation system and service. In Proceedings of the Second IEEE Annual Conference on Pervasive Computing and Communications, 2004 (PerCom’04). IEEE, 23--30. Google ScholarDigital Library
- Daniele Riboni, Claudio Bettini, Gabriele Civitarese, Zaffar Haider Janjua, and Rim Helaoui. 2016. SmartFABER: Recognizing fine-grained abnormal behaviors for early detection of mild cognitive impairment. In Artificial Intelligence in Medicine. Google ScholarDigital Library
- Victor R. Schinazi, Tyler Thrash, and Daniel-Robert Chebat. 2016. Spatial navigation by congenitally blind individuals. Wiley Interdisc. Rev.: Cogn. Sci. 7, 1 (2016), 37--58.Google ScholarCross Ref
- Lei Tang and Huan Liu. 2010. Community detection and mining in social media. Synth. Lect. Data Min. Knowl. Discov. 2, 1 (2010), 1--137. Google ScholarDigital Library
- Catherine Thinus-Blanc and Florence Gaunet. 1997. Representation of space in blind persons: Vision as a spatial sense? Psychol. Bull. 121, 1 (1997), 20.Google ScholarCross Ref
- Gang Wang, Xinyi Zhang, Shiliang Tang, Haitao Zheng, and Ben Y Zhao. 2016. Unsupervised clickstream clustering for user behavior analysis. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. Google ScholarDigital Library
- William R. Wiener, Richard L. Welsh, and Bruce B. Blasch. 2010. Foundations of Orientation and Mobility. American Foundation for the Blind.Google Scholar
- Michele A. Williams, Amy Hurst, and Shaun K. Kane. 2013. Pray before you step out: Describing personal and situational blind navigation behaviors. In Proceedings of the 15th International ACM SIGACCESS Conference on Computers and Accessibility. ACM, 28. Google ScholarDigital Library
- Yiming Yang and Jan O. Pedersen. 1997. A comparative study on feature selection in text categorization. In Proceedings of the International Conference on Machine Learing (ICML’97), Vol. 97. 412--420. Google ScholarDigital Library
- Kumar Yelamarthi, Daniel Haas, Daniel Nielsen, and Shawn Mothersell. 2010. RFID and GPS integrated navigation system for the visually impaired. In Proceedings of the 2010 53rd IEEE International Midwest Symposium on Circuits and Systems (MWSCAS’10). IEEE, 1149--1152.Google ScholarCross Ref
Index Terms
- Insights on Assistive Orientation and Mobility of People with Visual Impairment Based on Large-Scale Longitudinal Data
Recommendations
Supporting Orientation of People with Visual Impairment: Analysis of Large Scale Usage Data
ASSETS '16: Proceedings of the 18th International ACM SIGACCESS Conference on Computers and AccessibilityIn the field of assistive technology, large scale user studies are hindered by the fact that potential participants are geographically sparse and longitudinal studies are often time consuming. In this contribution, we rely on remote usage data to ...
Review on Smart Solutions for People with Visual Impairment
Computers Helping People with Special NeedsAbstractNowadays, over a billion people are estimated to be living with disabilities. The lack of support services make them overly dependent on their families and prevent them from being socially included. A good solution is to use Mobile Assistive ...
Can Route Previews Amplify Building Orientation for People with Visual Impairment?
Computers Helping People with Special NeedsAbstractBefore visiting a new location, we often look at maps to build an a priori mental representation of the environment using landmarks and points of interest. No such options are easily available for persons with visual impairment (PVIs). As a result,...
Comments