The Ethnobot: Gathering Ethnographies in the Age of IoT

ABSTRACT

Computational systems and objects are becoming increasingly closely integrated with our daily activities. Ubiquitous and pervasive computing first identified the emerging challenges of studying technology used on-the-move and in widely varied contexts. With IoT, previously sporadic experiences are interconnected across time and space in numerous and complex ways. This increasing complexity has multiplied the challenges facing those who study human experience to inform design. This paper describes the results of a study that used a chatbot or 'Ethnobot' to gather ethnographic data, and considers the opportunities and challenges in collecting this data in the absence of a human ethnographer. This study involved 13 participants gathering information about their experiences at the Royal Highland Show. We demonstrate the effectiveness of the Ethnobot in this setting, discuss the benefits and drawbacks of chatbots as a tool for ethnographic data collection, and conclude with recommendations for the design of chatbots for this purpose.

References

1. Eric P. S. Baumer and Jed R. Brubaker. 2017. Postuserism. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (CHI '17). ACM, New York, NY, USA, 6291--6303.
2. Barry A. T. Brown, Abigail J. Sellen, and Kenton P. O'Hara. 2000. A diary study of information capture in working life. In Proceedings of the SIGCHI conference on Human Factors in Computing Systems (CHI '00). ACM, New York, NY, USA, 438--445.
3. Nazli Cila, Iskander Smit, Elisa Giaccardi, and Ben Kröse. 2017. Products as Agents: Metaphors for Designing the Products of the IoT Age. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (CHI '17). ACM, New York, NY, USA, 448--459.
4. Kenneth Mark Colby. 1974. Ten criticisms of parry. SIGART Bull. 48 (October 1974), 5--9.
5. Andy Crabtree, Steve Benford, Chris Greenhalgh, Paul Tennent, Matthew Chalmers, and Barry Brown. 2006. Supporting ethnographic studies of ubiquitous computing in the wild. In Proceedings of the 6th conference on Designing Interactive systems (DIS '06). ACM, New York, NY, USA, 60--69.
6. Andrew Crabtree, Tom Rodden, Peter Tolmie, and Graham Button. 2009. Ethnography considered harmful. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '09). ACM, New York, NY, USA, 879--888.
7. Mihaly Csikszentmihalyi, Larson, R.,&Prescott, S. 1977. The ecology of adolescent activity and experience. In Journal of Youth and Adolescence, v. 6(3), p. 281--94.
8. Mihaly Csikszentmihalyi, Kevin Rathunde, and Samuel Whalen. 1993. Talented Teenagers: The Roots of Success and Failure. New York: Cambridge University Press. ISBN 0--521--57463--3
9. Clayton Allen Davis, Onur Varol, Emilio Ferrara, Alessandro Flammini, and Filippo Menczer. 2016. BotOrNot: A System to Evaluate Social Bots. In Proceedings of the 25th International Conference Companion on World Wide Web (WWW '16 Companion). International World Wide Web Conferences Steering Committee, Republic and Canton of Geneva, Switzerland, 273--274.
10. Carl DiSalvo and Jonathan Lukens. 2011. Nonanthropocentrism and the non-human in design: Possibilities for designing new forms of engagement with and through technology. In From social butterfly to engaged citizen: urban informatics, social media, ubiquitous computing, and mobile technology to support citizen engagement, Marcus Foth, Laura Forlano, Christine Satchell and Martin Gibbs (eds.), MIT Press, 421--437.
11. Dourish, P. 2001. Where the Action Is: The Foundations of Embodied Interaction. Cambridge, MA: MIT Press. ISBN 0--262-04196-0
12. Mohd Fazil and Muhammad Abulaish. 2017. Identifying active, reactive, and inactive targets of socialbots in Twitter. In Proceedings of the International Conference on Web Intelligence (WI '17). ACM, New York, NY, USA, 573--580.
13. Michael Fischer and Monica Lam. 2016. From Books to Bots: Using Medical Literature to Create a Chat Bot. In Proceedings of the First Workshop on IoT-enabled Healthcare and Wellness Technologies and Systems (IoT of Health '16). ACM, New York, NY, USA, 23--28.
14. Fitbit. 2017. Fitbit Official Website - Make Every Beat Count. Retrieved August 22, 2017 from https://www.fitbit.com
15. Asbjørn Følstad and Petter Bae Brandtzæg. 2017. Chatbots and the new world of HCI. Interactions 24, 4 (June 2017), 38--42.
16. Linton C. Freeman, A. Kimball Romney and Sue C. Freeman. 1987. Cognitive structure and informant accuracy. American Anthropologist, 89, 2, 310--325.
17. Jon Froehlich, Mike Y. Chen, Sunny Consolvo, Beverly Harrison, and James A. Landay. 2007. MyExperience: a system for in situ tracing and capturing of user feedback on mobile phones. In Proceedings of the 5th international conference on Mobile systems, applications and services(MobiSys '07). ACM, New York, NY, USA, 57--70.
18. H., Garfinkel. 2001. Ethnomethodology's Program: Working Out Durkheim's Aphorism (ed. Rawls, A.), Lanham, Maryland: Rowman and Littlefield.
19. E., Giaccardi, C., Speed, N., Cila, M., Caldwell. 2016 'Things as Co-ethnographers: Implications of a Thing Perspective for Design and Anthropology,' in R.C. Smith et al. (eds) Design Anthropology Futures, London: Bloomsbury.
20. Jonathan Gratch, Gale M. Lucas, Aisha Aisha King, and Louis-Philippe Morency. 2014. It's only a computer: the impact of human-agent interaction in clinical interviews. In Proceedings of the 2014 international conference on Autonomous agents and multi-agent systems (AAMAS '14). International Foundation for Autonomous Agents and Multiagent Systems, Richland, SC, 85--92.
21. Christian Heath and Paul Luff. 2000. Technology in Action. Cambridge University Press, New York, NY, USA.
22. Coline Juin and David Stoikovitch. 2017. Moona: the smart product that improves sleep through head temperature. Retrieved September 12, 2017 from https://www.f6s.com/moona
23. Alice Kerly, Phil Hall, and Susan Bull. 2007. Bringing chatbots into education: Towards natural language negotiation of open learner models. Know.-Based Syst. 20, 2 (March 2007), 177--185.
24. Vera Khovanskaya, Phoebe Sengers, Melissa Mazmanian, and Charles Darrah. 2017. Reworking the Gaps between Design and Ethnography. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (CHI '17). ACM, New York, NY, USA, 5373--5385.
25. Lorenz Cuno Klopfenstein, Saverio Delpriori, Silvia Malatini, and Alessandro Bogliolo. 2017. The Rise of Bots: A Survey of Conversational Interfaces, Patterns, and Paradigms. In Proceedings of the 2017 Conference on Designing Interactive Systems (DIS '17). ACM, New York, NY, USA, 555--565.
26. Treffyn Lynch Koreshoff, Toni Robertson, and Tuck Wah Leong. 2013. Internet of things: a review of literature and products. In Proceedings of the 25th Australian Computer-Human Interaction Conference: Augmentation, Application, Innovation, Collaboration (OzCHI '13), Haifeng Shen, Ross Smith, Jeni Paay, Paul Calder, and Theodor Wyeld (Eds.). ACM, New York, NY, USA, 335--344.
27. Peter M. Krafft, Michael Macy, and Alex "Sandy" Pentland. 2017. Bots as Virtual Confederates: Design and Ethics. In Proceedings of the 2017 ACM Conference on Computer Supported Cooperative Work and Social Computing (CSCW '17). ACM, New York, NY, USA, 183--190.
28. O. Lemon, A. Bracy, A. Gruenstein, and S. Peters. A multi-modal dialogue system for human-robot conversation. In Proc. NAACL. 2001.
29. Joseph Lindley, Paul Coulton, Rachel Cooper. 2017. Why the internet of things needs object orientated ontology. 12th EAD Conference Sapienza University of Rome 12--14 April 2017
30. Kiel Long, John Vines, Selina Sutton, Phillip Brooker, Tom Feltwell, Ben Kirman, Julie Barnett, and Shaun Lawson. 2017. "Could You Define That in Bot Terms"?: Requesting, Creating and Using Bots on Reddit. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (CHI '17). ACM, New York, NY, USA, 3488--3500.
31. S. Madakam, R. Ramaswamy, and S. Tripathi. 2015 Internet of Things (IoT): A Literature Review. Journal of Computer and Communications, 3, 164--173.
32. M. F., McTear. 2002. Spoken dialogue technology: enabling the conversational user interface. CSUR, 34(1):90--169, 2002.
33. Johnathan Mell. 2015. Toward Social-Emotional Virtual Humans. In Proceedings of the 2015 International Conference on Autonomous Agents and Multiagent Systems (AAMAS '15). International Foundation for Autonomous Agents and Multiagent Systems, Richland, SC, 2015--2016
34. Hendrik Müller, Jennifer L. Gove, John S. Webb, and Aaron Cheang. 2015. Understanding and Comparing Smartphone and Tablet Use: Insights from a LargeScale Diary Study. In Proceedings of the Annual Meeting of the Australian Special Interest Group for Computer Human Interaction (OzCHI '15), Bernd Ploderer, Marcus Carter, Martin Gibbs, Wally Smith, and Frank Vetere (Eds.). ACM, New York, NY, USA, 427--436.
35. Dave Murray-Rust&Rocio von Jungenfeld. 2016. Thinking through robotic imaginaries. In: Proceedings of the 3rd Biennial Research Through Design Conference, 22--24 March 2017, Edinburgh, UK, Article 14, pp. 211--227.
36. Norman, D. A. (1981). Categorization of action slips. Psychology Review, v. 88(1), p. 1--15.
37. Kenton O'Hara and Mark Perry. 2001. Shopping anytime anywhere. In CHI '01 Extended Abstracts on Human Factors in Computing Systems (CHI EA '01). ACM, New York, NY, USA, 345--346.
38. Leysia Palen and Marilyn Salzman. 2002. Voice-mail diary studies for naturalistic data capture under mobile conditions. In Proceedings of the 2002 ACM conference on Computer supported cooperative work (CSCW '02). ACM, New York, NY, USA, 87--95.
39. Ioannis Papaioannou and Oliver Lemon. 2017. Combining Chat and Task-Based Multimodal Dialogue for More Engaging HRI: A Scalable Method Using Reinforcement Learning. In Proceedings of the Companion of the 2017 ACM/IEEE International Conference on Human-Robot Interaction(HRI '17). ACM, New York, NY, USA, 365--366.
40. Gary Pritchard, John Vines, Pam Briggs, Lisa Thomas, and Patrick Olivier. 2014. Digitally driven: how location based services impact the work practices of London bus drivers. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '14). ACM, New York, NY, USA, 36173626.
41. Larissa Pschetz, Ella Tallyn, Rory Gianni, and Chris Speed. 2017. Bitbarista: Exploring Perceptions of Data Transactions in the Internet of Things. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (CHI '17). ACM, New York, NY, USA, 2964--2975.
42. Tom Rodden, Yvonne Rogers, John Halloran, and Ian Taylor. 2003. Designing novel interactional workspaces to support face to face consultations. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '03). ACM, New York, NY, USA, 57--64.
43. Danaë Stanton Fraser, Hilary Smith, Ella Tallyn, Dave Kirk, Steve Benford, Duncan Rowland, Mark Paxton, Sara Price, and Geraldine Fitzpatrick. 2005. The SENSE project: a context-inclusive approach to studying environmental science within and across schools. In Proceedings of th 2005 conference on Computer support for collaborative learning: learning 2005: the next 10 years! (CSCL '05). International Society of the Learning Sciences 155--159.
44. Lucy Suchman. 1987. Plans and Situated Action, Cambridge CUP
45. Sysomos.com. 2009. An In-Depth Look at the Most Active Twitter User Data. Retrieved August 24, 2017 from https://sysomos.com/inside-twitter/most-activetwitter- user-data
46. Kami Vaniea, Ella Tallyn, and Chris Speed. 2017. Capturing the Connections: Unboxing Internet of Things Devices, eprint arXiv:1708.00076, 2017. Retrieved August 9, 2017 from http://arxiv.org/abs/1708.00076
47. Y., Wang. 2008. Designing chatbot interfaces for language learning: ethnographic research into affect and users' experiences (T). University of British Columbia. Retrieved August 25, 2017 from https://open.library.ubc.ca/cIRcle/collections/24/items/ 1.0066775
48. Joseph Weizenbaum. 1966. ELIZA-a computer program for the study of natural language communication between man and machine. Commun. ACM 9, 1 (January 1966), 36--45.
49. Jennifer Zamora. 2017. Rise of the Chatbots: Finding A Place for Artificial Intelligence in India and US. In Proceedings of the 22nd International Conference on Intelligent User Interfaces Companion (IUI '17 Companion). ACM, New York, NY, USA, 109--112.

Index Terms

• Human-centered computing