Going to School on a Robot: Robot and User Interface Design Features that Matter

Abstract

Telepresence robots have recently been introduced as a way for children who are homebound due to medical conditions to attend their local schools. These robots provide an experience that is a much richer learning experience than the typical home instruction services of 4–5 hours a week. Because the robots on the market today were designed for use by adults in work settings, they do not necessarily fit children in school settings. We carried out a study of 19 homebound students, interviewing and observing them as well as interviewing their parents, teachers, administrators, and classmates. We organized our findings along the lines of the various tasks and settings the child is in, developing a learner-centered analytic framework, then teacher-, classmate-, and homebound-controller-centered analytic frameworks. Although some features of current robots fit children in school settings, we discovered a number of cases where there was a mismatch or additional features are needed. Our findings are described according to analytic frames that capture user experiences. Based on these user-centered findings, we provide recommendations for designing the robot and user interface to better fit children using robots for school and learning activities.

References

1. Ilhan Bae and Jeonghye Han. 2017. Does height affect the strictness of robot assisted teacher? In Proceedings of the Companion of the 2017 ACM/IEEE International Conference on Human-Robot Interaction. 73--74.
2. Rebecca Barr and Robert Dreeben. 2014. How schools work. In Schools and Society: A Sociological Approach to Education (5th ed.), Jeanne H. Ballantine and Joan Z. Spade (Eds.). SAGE Publications, Thousand Oaks, CA, 127.
3. Leeni Berntsson, Marie Berg, Marianne Brydolf, and Anna-Lena Hellström. 2007. Adolescents’ experiences of well-being when living with a long-term illness or disability. Scandinavian Journal of Caring Sciences 21, 4 (2007), 419--425.
4. Ann B. Brewster and Gary L. Bowen. 2004. Teacher support and the school engagement of Latino middle and high school students at risk of school failure. Child and Adolescent Social Work Journal 21, 1 (2004), 47--67.
5. Joost Broekens, Marcel Heerink, and Henk Rosendal. 2009. Assistive social robots in elderly care: A review. Gerontechnology 8, 2 (2009), 94--103.
6. Robbie Brown. 2013. A swiveling proxy that will even wear a tutu. The New York Times. Retrieved from http://www.nytimes.com/2013/06/08/education/for-homebound-students-a-robot-proxy-in-the-classroom.html.
7. Judee K. Burgoon and Michelle L. Johnson. 1998. The nature and measurement of interpersonal dominance. Communication Monographs 65, 4 (1998), 308--335.
8. James S. Catterall. 1998. Risk and resilience in student transitions to high school. American Journal of Education 106, 2 (1998), 302--333.
9. Amedeo Cesta, Gabriella Cortellessa, Andrea Orlandini, and Lorenza Tiberio. 2012. Evaluating telepresence robots in the field. In Proceedings of the International Conference on Agents and Artificial Intelligence. 433--448.
10. Robert G. Croninger and V. E. Lee. 2001. Social capital and dropping out of high school: Benefits to at-risk students of teachers’ support and guidance. Teachers College Record 103, 4 (2001), 548--581.
11. Omar Dabaghi-Pacheco. 2018. Chemo's no obstacle for this boy and his bot. Canadian Broadcasting Corporation (CBC). Retrieved from https://www.cbc.ca/news/canada/ottawa/robot-school-attendance-virtual-gloucester-verandrye-1.4543850.
12. Munjal Desai, Katherine M. Tsui, Holly A. Yanco, and Chris Uhlik. 2011. Essential features of telepresence robots. In Proceedings of the 2011 IEEE Conference Technologies for Practical Robot Applications (TePRA’11). 15--20.
13. Disability Rights California. 2012. SERR-Special Education Rights and Responsibilities: Information on the Rights of Students with Significant Health Conditions. Retrieved from https://www.disabilityrightsca.org/publications/serr-special-education-rights-and-responsibilities.
14. Sarah J. Ellis, Donna Drew, Claire E. Wakefield, Samra L. Saikal, Deborah Punch, and Richard J. Cohn. 2013. Results of a nurse-led intervention: connecting pediatric cancer patients from the hospital to the school using videoconferencing technologies. Journal of Pediatric Oncology Nursing 30, 6 (2013), 333--341.
15. Elizabeth J. Erwin and Margaret Guintini. 2000. Inclusion and classroom membership in early childhood. International Journal of Disability, Development and Education 47, 3 (2000), 237--257.
16. G. Evans-Jones, A. R. Fielder, R. B. Jones, R. Markham, and S. Stewart-Brown. 1994. Report of a Joint Working Party: Ophthalmological Services for Children. London Royal College of Ophthalmologists and British Pediatric Association, London, England.
17. Deborah Fels, Judith Waalen, Shumin Zhai, and Patrice Weiss. 2001. Telepresence under exceptional circumstances: Enriching the connection to school for sick children. In Proceedings of INTERACT. 617--624.
18. Chris Fullwood and Gwyneth Doherty-Sneddon. 2006. Effect of gazing at the camera during a video link on recall. Applied Ergonomics 37, 2 (2006), 167--175.
19. Gahgene Gweon, Donghee Hong, Sunghee Kwon, and Jeonghye Han. 2015. The influence of head size in mobile remote presence (MRP) educational robots. In Proceedings of the 2015 24th IEEE International Symposium Robot and Human Interactive Communication (RO-MAN’15). 173--178.
20. InTouch Technologies Inc. 2003. InTouch Health and Rehabilitation Institute at Santa Barbara collaborate to evaluate world's first mobile remote presence robot for healthcare. Press Release. Retrieved September, 2010 from https://intouchhealth.com/category/press-release/.
21. Steven Johnson, Irene Rae, Bilge Mutlu, and Leila Takayama. 2015. Can you see me now?: How field of view affects collaboration in robotic telepresence. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems. 2397--2406.
22. Annica Kristoffersson, Silvia Coradeschi, and Amy Loutfi. 2013. A review of mobile robotic telepresence. Advances in Human-Computer Interaction 2013 (2013), Article 902316.
23. Douglas J. Lamdin. 1996. Evidence of student attendance as an independent variable in education production functions. Journal of Educational Research 89, 3 (1996), 155--162.
24. Lyda Lannegrand-Willems and Harke A. Bosma. 2006. Identity development-in-context: The school as an important context for identity development. Identity 6, 1 (2006), 85--113.
25. Amanda Lazar, George Demiris, and Hillaire J. Thompson. 2015. Involving family members in the implementation and evaluation of technologies for dementia: A dyad case study. Journal of Gerontological Nursing 41,4 (2015), 21--26.
26. Min Kyung Lee and Leila Takayama. 2011. “Now, I have a body”: Uses and social norms for mobile remote presence in the workplace. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. 33--42.
27. Valerie E. Lee and David T. Burkham. 2003. Dropping out of high school: The role of school organization and structure. American Educational Research Journal 40, 2 (2003), 353--393.
28. Leslie S. Liu, Kori Inkpen, and Wanda Pratt. 2015. “I'm Not Like My Friends”: Understanding how children with a chronic illness use technology to maintain normalcy. In Proceedings of the 18th ACM Conference on Computer Supported Cooperative Work 8 Social Computing. 1527--1539.
29. Carman Neustaedter, Gina Venolia, Jason Procyk, and Daniel Hawkins. 2016. To Beam or not to Beam: A study of remote telepresence attendance at an academic conference. In Proceedings of the 19th ACM Conference on Computer-Supported Cooperative Work 8 Social Computing. 418--431.
30. Veronica Ahumada Newhart. 2014. Virtual inclusion via telepresence robots in the classroom. In Proceedings of the CHI’14 Extended Abstracts on Human Factors in Computing Systems. 951--956.
31. Veronica Ahumada Newhart and Judith S. Olson. 2017. My student is a robot: How schools manage telepresence experiences for students. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems. 342--347.
32. Veronica Ahumada Newhart, Mark Warschauer, and Leonard S. Sender. 2016. Virtual inclusion via telepresence robots in the classroom: An exploratory case study. International Journal of Technologies in Learning 23, 4 (2016), 9--25. Retrieved from http://escholarship.org/uc/item/9zm4h7nf.
33. Bonnie Nichols. 2003. Demographic Characteristics of Arts Attendance, 2002. National Endowment for the Arts, Washington, DC.
34. Andreas Paepcke, Bianca Soto, Leila Takayama, Frank Koenig, and Blaise Gassend. 2011. Yelling in the hall: Using sidetone to address a problem with mobile remote presence systems. In Proceedings of the 24th Annual ACM Symposium on User Interface Software and Technology. 107--116.
35. Seong Ju Park, Jeong Hye Han, Bok Hyun Kang, and Kyung Chul Shin. 2011. Teaching assistant robot, ROBOSEM, in English class and practical issues for its diffusion. In Proceedings of the Advanced Robotics and its Social Impacts. 8--11.
36. Irene Rae, Bilge Mutlu, and Leila Takayama. 2014. Bodies in motion: Mobility, presence, and task awareness in telepresence. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. 2153--2162.
37. Irene Rae and Carman Neustaedter. 2017. Robotic Telepresence at scale. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems. 313--324.
38. Irene Rae, Leila Takayama, and Bilge Mutlu. 2013. The influence of height in robot-mediated communication. In Proceedings of the 2013 8th ACM/IEEE International Conference Human-Robot Interaction (HRI’13). 1--8.
39. Irene Rae, Gina Venolia, John C. Tang, and David Molnar. 2015. A framework for understanding and designing telepresence. In Proceedings of the 18th ACM Conference on Computer Supported Cooperative Work 8 Social Computing (CSCW’15). 1552--1566.
40. Richard M. Ryan and Edward L. Deci. 2000. Self-determination theory and the facilitation of intrinsic motivation, social development, and well-being. American Psychologist 55, 1 (2000), 68--78.
41. Alessandra Sabelli, Takayuki Kanda, and Norihiro Hagita. 2011. A conversational robot in an elderly care center: An ethnographic study. In Proceedings of the 6th International Conference on Human-Robot Interaction. ACM, 37--44.
42. Sandra B. Sexson and Avi Madan-Swain. 1993. School reentry for the child with chronic illness. Journal of Learning Disabilities 26, 2 (1993), 115--125, 137.
43. David Sirkin, Gina Venolia, John Tang, George Robertson, Taemie Kim, Kori Inkpen, Mara Sedlins, Bongshin Lee, and Mike Sinclair. 2011. Motion and attention in a kinetic videoconferencing proxy. In Proceedings of the IFIP Conference on Human-Computer Interaction. 162--180.
44. Katherine M. Spowart, Anita Simmers, and David M. Tappin. 1998. Vision testing in schools: An evaluation of personnel, tests, and premises. Journal of Medical Screening 5, 3 (1998), 131--132.
45. Leila Takayama and Janet Go. 2012. Mixing metaphors in mobile remote presence. In Proceedings of the ACM 2012 Conference on Computer Supported Cooperative Work. 495--504.
46. Fumihide Tanaka, Toshimitsu Takahashi, Shizuko Matsuzoe, Nao Tazawa, and Masahiko Morita. 2013. Child-operated telepresence robot: A field trial connecting classrooms between Australia and Japan. In Proceedings of the 2013 IEEE/RSJ International Conference Intelligent Robots and Systems (IROS’13). 5896--5901.
47. Tzung-Cheng Tsai, Yeh-Liang Hsu, An-I Ma, Trevor King, and Chang-Huei Wu. 2007. Developing a telepresence robot for interpersonal communication with the elderly in a home environment. Telemedicine Journal and e-Health 13, 4 (2007), 407--424.
48. Katherine M. Tsui, Munjal Desai, Holly A. Yanco, and Chris Uhlik. 2011. Exploring use cases for telepresence robots. In Proceedings of the 6th International Conference on Human-Robot Interaction. 11--18.
49. Katherine M. Tsui, Adam Norton, David Brooks, Holly A. Yanco, and Daniel Kontak. 2011. Designing telepresence robot systems for use by people with special needs. In Proceedings of the International Symposium on Quality of Life Technologies: Intelligent Systems for Better Living.
50. Katherine M. Tsui and Holly A. Yanco. 2007. Assistive, rehabilitation, and surgical robots from the perspective of medical and healthcare professionals. In Proceedings of the AAAI Workshop on Human Implications of Human-Robot Interaction.
51. Gina Venolia, John Tang, Ruy Cervantes, Sara Bly, George Robertson, Bongshin Lee, and Kori Inkpen. 2010. Embodied social proxy: Mediating interpersonal connection in hub-and-satellite teams. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. 1049--1058.
52. Jason Yeung and Deborah I. Fels. 2005. A remote telepresence system for high school classrooms. In Proceedings of the Canadian Conference on Electrical and Computer Engineering. 1465--1468.

Index Terms

• Human-centered computing

  • Accessibility

    • Empirical studies in accessibility

  • Human computer interaction (HCI)

    • Empirical studies in HCI

    • HCI design and evaluation methods

      • User studies

  • Interaction design

    • Empirical studies in interaction design