TalkingTiles: Supporting Personalization and Customization in an AAC App for Individuals with Aphasia

ABSTRACT

The development of `Post-PC' interactive surfaces, such as smartphones and tablets, and specialized support software informed by HCI research has created new opportunities for Augmentative and Alternative Communication (AAC) technologies. However, it is unclear to what degree these opportunities have been realized in practice. We conducted a field study to explore the use of one such application, TalkingTiles, by individuals with aphasia. Following a training session and one week of use, we conducted interviews with participants, their partners, and their caregivers at a local support facility. We found that TalkingTiles can be effective in supporting communication when used in concert with other communication methods, and when time can be invested in customizing the app. We discuss our findings, and implications for design with respect to customizability, simplicity, and the limitations of interactive surfaces in supporting communication.

References

1. Abdullah Al Mahmud. 2014. Considerations for Designing Technology with and for Persons with Aphasia. In Proceedings of the 26th Australian Computer-Human Interaction Conference on Designing Futures: The Future of Design (OzCHI '14). ACM, New York, NY, USA, 535--538. DOI: http://dx.doi.org/10.1145/2686612.2686698
2. Abdullah Al Mahmud and Jean-Bernard Martens. 2013. Amail: Design and evaluation of an accessible email tool for persons with aphasia. Interacting with Computers 25, 5 (2013), 351--374.
3. Meghan Allen, Joanna McGrenere, and Barbara Purves. 2008. The Field Evaluation of a Mobile Digital Image Communication Application Designed for People with Aphasia. ACM Trans. Access. Comput. 1, 1, Article 5 (May 2008), 26 pages. DOI: http://dx.doi.org/10.1145/1361203.1361208
4. David Frank Benson and Alfredo Ardila. 1996. Aphasia: A clinical perspective. Oxford University Press.
5. Jordan L. Boyd-Graber, Sonya S. Nikolova, Karyn A. Moffatt, Kenrick C. Kin, Joshua Y. Lee, Lester W. Mackey, Marilyn M. Tremaine, and Maria M. Klawe. 2006. Participatory Design with Proxies: Developing a desktop-PDA System to Support People with Aphasia. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '06). ACM, New York, NY, USA, 151--160. DOI: http://dx.doi.org/10.1145/1124772.1124797
6. Tira Cohene, Ron Baecker, and Elsa Marziali. 2005. Designing Interactive Life Story Multimedia for a Family Affected by Alzheimer's Disease: A Case Study. In CHI '05 Extended Abstracts on Human Factors in Computing Systems (CHI EA '05). ACM, New York, NY, USA, 1300--1303. DOI: http://dx.doi.org/10.1145/1056808.1056901
7. Elke Daemen, Pavan Dadlani, Jia Du, Ying Li, Pinar Erik-Paker, Jean-Bernard Martens, and Boris De Ruyter. 2007. Designing a Free Style, Indirect, and Interactive Storytelling Application for People with Aphasia. In Proceedings of the 11th IFIP TC 13 International Conference on Human-computer Interaction (INTERACT'07). Springer-Verlag, Berlin, Heidelberg, 221--234. http: //dl.acm.org/citation.cfm?id=1776994.1777022
8. Laura Flynn, Ashlyn Cumberland, and Jane Marshall. 2009. Public knowledge about aphasia: A survey with comparative data. Aphasiology 23, 3 (2009), 393--401.
9. Audrey L Holland. 1998. Why can't clinicians talk to aphasic adults? Comments on supported conversation for adults with aphasia: Methods and resources for training conversational partners. Aphasiology 12, 9 (1998), 844--847.
10. Aura Kagan. 1998. Supported conversation for adults with aphasia: Methods and resources for training conversation partners. Aphasiology 12, 9 (1998), 816--830.
11. Shaun K. Kane, Barbara Linam-Church, Kyle Althoff, and Denise McCall. 2012. What We Talk About: Designing a Context-aware Communication Tool for People with Aphasia. In Proceedings of the 14th International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS '12). ACM, New York, NY, USA, 49--56. DOI: http://dx.doi.org/10.1145/2384916.2384926
12. Tom Koppenol, Abdullah Al Mahmud, and Jean-Bernard Martens. 2010. When words fall short: helping people with aphasia to express. In Computers Helping People with Special Needs. Springer, 45--48.
13. Rajinder Koul, Melinda Corwin, and Summer Hayes. 2005. Production of graphic symbol sentences by individuals with aphasia: Efficacy of a computer-based augmentative and alternative communication intervention. Brain and language 92, 1 (2005), 58--77.
14. Stephen Lindsay, Katie Brittain, Daniel Jackson, Cassim Ladha, Karim Ladha, and Patrick Olivier. 2012. Empathy, Participatory Design and People with Dementia. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '12). ACM, New York, NY, USA, 521--530. DOI: http://dx.doi.org/10.1145/2207676.2207749
15. Felice L Loverso, Marilyn Selinger, and Thomas E Prescott. 1979. Application of verbing strategies to aphasia treatment. (1979).
16. JG Lyon, D Cariski, L Keisler, J Rosenbek, R Levine, J Kumpula, C Ryff, S Coyne, and M Blanc. 1997. Communication partners: Enhancing participation in life and communication for adults with aphasia in natural settings. Aphasiology 11, 7 (1997), 693--708.
17. Xiaojuan Ma, Jordan Boyd-Graber, Sonya Nikolova, and Perry R. Cook. 2009. Speaking Through Pictures: Images vs. Icons. In Proceedings of the 11th International ACM SIGACCESS Conference on Computers and Accessibility (Assets '09). ACM, New York, NY, USA, 163--170. DOI: http://dx.doi.org/10.1145/1639642.1639672
18. Abdullah Al Mahmud, Yvonne Limpens, and Jean-Bernard Martens. 2013. Expressing Through Digital Photographs: An Assistive Tool for Persons with Aphasia. Univers. Access Inf. Soc. 12, 3 (Aug. 2013), 309--326. DOI: http://dx.doi.org/10.1007/s10209-012-0286--8
19. Skye E McDonald, Chris Code, and Leanne Togher. 2000. Communication disorders following traumatic brain injury. Psychology press.
20. Hannah Miller, Heather Buhr, Chris Johnson, and Jerry Hoepner. 2013. AphasiaWeb: A Social Network for Individuals with Aphasia. In Proceedings of the 15th International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS '13). ACM, New York, NY, USA, Article 4, 8 pages. DOI: http://dx.doi.org/10.1145/2513383.2513439
21. Palle Møller Pedersen, Kirsten Vinter, and Tom Skyhøj Olsen. 2004. Aphasia after stroke: type, severity and prognosis. The Copenhagen aphasia study. Cerebrovascular Diseases 17 (2004), 35--43.
22. Hildred Schuell, James J Jenkins, and Edward Jimenez-Pabon. 1964. Aphasia in adults. Harper & Row.
23. Nina Simmons-Mackie, Chris Code, Elizabeth Armstrong, Lillian Stiegler, and Roberta J Elman. 2002. What is aphasia? Results of an international survey. Aphasiology 16, 8 (2002), 837--848.
24. Richard D Steele, Michael Weinrich, Robert T Wertz, Maria K Kleczewska, and Gloria S Carlson. 1989. Computer-based visual communication in aphasia. Neuropsychologia 27, 4 (1989), 409--426.
25. Iosif Moiseevich Tonkonogii. 1986. Vascular aphasia. The MIT Press.
26. Maarten Woudstra, Abdullah Al Mahmud, and Jean-Bernard Martens. 2011. A Snapshot Diary to Support Conversational Storytelling for Persons with Aphasia. In Proceedings of the 13th International Conference on Human Computer Interaction with Mobile Devices and Services (MobileHCI '11). ACM, New York, NY, USA, 641--646. DOI: http://dx.doi.org/10.1145/2037373.2037474
27. Mike Wu, Jeremy Birnholtz, Brian Richards, Ronald Baecker, and Mike Massimi. 2008. Collaborating to Remember: A Distributed Cognition Account of Families Coping with Memory Impairments. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '08). ACM, New York, NY, USA, 825--834. DOI: http://dx.doi.org/10.1145/1357054.1357186

Index Terms

• Human-centered computing

  • Human computer interaction (HCI)