Marco C. Rozendaal
Boudewijn Boon
Skip Abstract Section
Abstract
In HCI there is an increasing trend to approach computing artifacts as agents. In this article, we make a case for “Objects with Intent” (OwI's) as an emerging type of agents that take advantage of the meaning of everyday things as the site for their intelligence and agency. After reviewing relevant existing research in HCI and related fields, we demonstrate how OwI's provide a new perspective on human–agent interaction. We then elaborate on how the notion of OwI's is informed by Dennett's theory of intentionality and Leontiev's Activity Theory. Thereafter, we illustrate the application of OwI's through the design case of Fizzy, a robotic ball used to stimulate hospitalized children to engage in physical play. We end by discussing the nature and merit of OwI's and reflecting more broadly on the challenges involved in designing OwI's.
- E. Aarts and R. Wichert. 2009. Ambient intelligence. In Technology Guide. Springer, Berlin, 244--249.Google Scholar
- E. Ackermann. 2005. Playthings that do things: A young kid's “Incredibles”! In Proceedings of the Interaction Design and Children (IDC’05). pp. 1--8.Google ScholarDigital Library
- J. F. Allen, D. K. Byron, M. Dzikovska, G. Ferguson, L. Galescu, and A. Stent. 2001. Toward conversational human-computer interaction. AI Magazine 22, 4 (2001), 27. Google ScholarDigital Library
- J. H. Auger. 2014. Living with robots: A speculative design approach. Journal of Human-Robot Interaction 3, 1 (2014), 20--42. Google ScholarDigital Library
- J. Bardzell and S. Bardzell. 2008. Interaction criticism: A proposal and framework for a new discipline of HCI. In Proceedings of Extended Abstracts on Human Factors in Computing Systems (CHI’08). ACM, 2463--2472.Google Scholar
- K. B. Bærentsen and J. Trettvik. 2002. An activity theory approach to affordance. In Proceedings of the 2nd Nordic Conference on Human-Computer Interaction. ACM, 51--60. Google ScholarDigital Library
- D. Berdichevsky and E. Neuenschwander. 1999. Towards an ethics of persuasive technology. Communications of the ACM 42, 5 (1999), 51--58. Google ScholarDigital Library
- H. Beyer and K. Holtzblatt. 1997. Contextual Design: Defining Customer-Centered Systems. Elsevier. Google ScholarDigital Library
- S. Bødker and P. B. Andersen. 2005. Complex mediation. Human-Computer Interaction 20, 4 (2005), 353--402. Google ScholarDigital Library
- B. Boon, M. C. Rozendaal, M. M. van den Heuvel-Eibrink, J. van der Net, and P. J. Stappers. 2016. Playscapes: A design perspective on young children's physical play. In Proceedings of the 15th International Conference on Interaction Design and Children. ACM, New York, NY, 181--189.Google Scholar
- B. Boon, M. C. Rozendaal, and P. J. Stappers. 2018. Ambiguity and open-endedness in behavioural design. In Proceedings of the DRS 2018 International Conference: Catalyst. Design Research Society, Limerick, Ireland, 2075--2085.Google Scholar
- C. Breazeal. 2003. Toward sociable robots. Robotics and Autonomous Systems 42, 3 (2003), 167--175.Google ScholarCross Ref
- R. A. Brooks. 1991. Intelligence without representation. Artificial Intelligence 47, 1--3 (1991), 139--159.Google ScholarDigital Library
- J. Cassell, T. Bickmore, L. Campbell, H. Vilhjálmsson, and H. Yan. 2000. Conversation as a System Framework: Designing Embodied Conversational Agents. Embodied Conversational Agents, 29--63. Google ScholarDigital Library
- T. Clemmensen, V. Kaptelinin, and B. Nardi. 2016. Making HCI theory work: An analysis of the use of activity theory in HCI research. Behaviour and Information Technology 35, 8 (2016), 608--627.Google ScholarDigital Library
- A. Chamberlain, A. Crabtree, T. Rodden, M. Jones, and Y. Rogers. 2012. Research in the wild: Understanding ‘in the wild' approaches to design and development. In Proceedings of the Designing Interactive Systems Conference. ACM, 795--796.Google Scholar
- N. Cila, I. Smit, E. Giaccardi, and B. Kröse. 2017. Products as agents: Metaphors for designing the products of the IoT age. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems. ACM, 448--459.Google Scholar
- T. Clemmensen, V. Kaptelinin, and B. Nardi. 2016. Making HCI theory work: An analysis of the use of activity theory in HCI research. Behaviour and Information Technology 35, 8 (2016), 608--627.Google ScholarDigital Library
- M. Cole and Y. Engeström. 1993. A cultural-historical approach to distributed cognition. In Distributed Cognitions: Psychological and Educational Considerations. Cambridge University Press, 1--46.Google Scholar
- D. J. Cook. 2009. Multi-agent smart environments. Journal of Ambient Intelligence and Smart Environments 1, 1 (2009), 51--55. Google ScholarDigital Library
- A. Crabtree, A. Chamberlain, R. E. Grinter, M. Jones, T. Rodden, and Y. Rogers. 2013. Introduction to the special issue of “The Turn to The Wild.” ACM Transactions on Computer-Human Interaction 20, 3 (2013), 13. Google ScholarDigital Library
- D. C. Dennett. 1989. The Intentional Stance. MIT Press.Google Scholar
- D. C. Dennett. 1991. Real patterns. Journal of Philosophy 88, 1 (1991), 27--51.Google ScholarCross Ref
- P. Dourish. 2004. Where the Action is: The Foundations of Embodied Interaction. MIT Press.Google Scholar
- D. El'konin. 1977. Toward the problem of stages in the mental development of the child. In Soviet Developmental Psychology, M. Cole (Ed.). Sharpe, White Plains, NY, 538--563.Google Scholar
- Y. Engeström. 1999. Activity theory and individual and social transformation. In Perspectives on Activity Theory, Y. Engeström, R. Miettinen, and R. Punamaki (Eds.). Cambridge University Press, Cambridge, England, 19--38.Google Scholar
- Y. Engeström. 2014. Learning by Expanding. Cambridge University Press.Google Scholar
- D. Fällman. 2011. The new good: Exploring the potential of philosophy of technology to contribute to human-computer interaction. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, 1051--1060. Google ScholarDigital Library
- U. Farooq and J. Grudin. 2016. Human-computer integration. Interactions 23, 6 (2016), 26--32. Google ScholarDigital Library
- A. Følstad and P. B. Brandtzæg. 2017. Chatbots and the new world of HCI. Interactions 24, 4 (2017), 38--42. Google ScholarDigital Library
- J. Forlizzi. 2008. The product ecology: Understanding social product use and supporting design culture. International Journal of Design 2, 1 (2008), 11--20.Google Scholar
- B. Friedman. 1996. Value-sensitive design. Interactions 3, 6 (1996), 16--23. Google ScholarDigital Library
- H. Hagras, V. Callaghan, M. Colley, G. Clarke, A. Pounds-Cornish, and H. Duman. 2004. Creating an ambient-intelligence environment using embedded agents. IEEE Intelligent Systems 19, 6 (2004), 12--20. Google ScholarDigital Library
- S. Hauser, D. Oogjes, R. Wakkary, and P. P. Verbeek. 2018. An annotated portfolio on doing postphenomenology through research products. In Proceedings of the 2018 on Designing Interactive Systems Conference. ACM, 459--471.Google Scholar
- M. A. Hearst, J. Allen, C. Guinn, and E. Horvitz. 1999. Mixed-initiative interaction: Trends and controversies. IEEE Intelligent Systems 14, 5 (1999), 14--23.Google ScholarDigital Library
- F. Heider and M. Simmel. 1944. An experimental study of apparent behavior. American Journal of Psychology 57, 2 (1944), 243--259.Google ScholarCross Ref
- G. Hoffman, R. Kubat, and C. Breazeal. 2008. A hybrid control system for puppeteering a live robotic stage actor. In Proceedings of the 17th IEEE International Symposium on Robot and Human Interactive Communication (RO-MAN’08). IEEE, 354--359.Google Scholar
- G. Hoffman and W. Ju. 2014. Designing robots with movement in mind. Journal of Human-Robot Interaction 3, 1 (2014), 89--122. Google ScholarDigital Library
- L. E. Holmquist. 2017. Intelligence on tap: Artificial intelligence as a new design material. Interactions 24, 4 (2017), 28--33. Google ScholarDigital Library
- E. Horvitz. 1999. Principles of mixed-initiative user interfaces. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, 159--166. Google ScholarDigital Library
- H. Ishii and B. Ulmer. 1997. Tangible bits: Towards seamless interfaces between people, bits and atoms. In Proceedings of ACM SIGCHI Conference on Human Factors in Computing Systems (CHI’97). 234--241Google Scholar
- G. Jacucci, A. Spagnolli, J. Freeman, and L. Gamberini. 2014. Symbiotic interaction: A critical definition and comparison to other human-computer paradigms. In Proceedings of International Workshop on Symbiotic Interaction. Springer, Cham, 3--20.Google Scholar
- L. E. Janlert and E. Stolterman. 1997. The character of things. Design Studies 18, 3 (1997), 297--314.Google ScholarCross Ref
- W. Ju and L. Leifer. 2008. The design of implicit interactions: Making interactive systems less obnoxious. Design Issues 24, 3 (2008), 72--84.Google ScholarCross Ref
- V. Kaptelinin and B. A. Nardi. 2006. Acting with Technology: Activity Theory and Interaction Design. MIT Press. Google ScholarDigital Library
- V. Kaptelinin and K. Kuutti. 1999. Cognitive tools reconsidered: From augmentation to mediation. In Humane Interfaces: Questions of Method and Practice in Cognitive Technology, J. P. Marsh, B. Gorayska, and J. L. Mey (Eds.). Elsevier.Google Scholar
- E. Karapanos. 2013. User experience over time. In Modeling users’ Experiences with Interactive Systems. Springer, Berlin, 57--83.Google Scholar
- L. C. Klopfenstein, S. Delpriori, S. Malatini, and A. Bogliolo. 2017. The rise of bots: A survey of conversational interfaces, patterns, and paradigms. In Proceedings of the 2017 Conference on Designing Interactive Systems. ACM, 555--565.Google Scholar
- M. Kuniavsky. 2010. Smart Things: Ubiquitous Computing User Experience Design. Elsevier. Google ScholarDigital Library
- K. Kuutti. 1996. Activity theory as a potential framework for human-computer interaction research. In Context and Consciousness: Activity Theory and Human-Computer Interaction. MIT Press, 17--44. Google ScholarDigital Library
- K. Kuutti and L. J. Bannon. 2014. The turn to practice in HCI: Towards a research agenda. In Proceedings of the 32nd Annual ACM Conference on Human Factors in Computing Systems. ACM, 3543--3552. Google ScholarDigital Library
- Latour. 2005. Reassembling the Social: An Introduction to Actor-Network-Theory. Oxford University Press, Oxford.Google Scholar
- B. Laurel. 1997. Interface agents: Metaphors with character. In Human Values and the design of Computer Technology. Center for the Study of Language and Information Stanford, 207--219. Google ScholarDigital Library
- A. N. Leontiev. 1975. Activities. Consciousness. Personality. Politizdat, Moscow.Google Scholar
- F. Levillain and E. Zibetti. 2017. Behavioral objects: The rise of the evocative machines. Journal of Human-Robot Interaction 6, 1 (2017), 4--24. Google ScholarDigital Library
- Y. K. Lim, E. Stolterman, H. Jung, and J. Donaldson. 2007. Interaction gestalt and the design of aesthetic interactions. In Proceedings of the 2007 Conference on Designing Pleasurable Products and Interfaces. ACM, 239--254. Google ScholarDigital Library
- Y. K. Lim, E. Stolterman, and J. Tenenberg. 2008. The anatomy of prototypes: Prototypes as filters, prototypes as manifestations of design ideas. ACM Transactions on Computer-Human Interaction 15, 2 (2008), 7. Google ScholarDigital Library
- B. Marenko. 2014. Neo-animism and design: A new paradigm in object theory. Design and Culture 6, 2 (2014), 219--241.Google ScholarCross Ref
- B. Marenko and P. van Allen. 2016. Animistic design: How to reimagine digital interaction between the human and the nonhuman. Digital Creativity 27, 1 (2016), 52--70.Google ScholarCross Ref
- M. F. McTear. 2000. Intelligent interface technology: From theory to reality? Interacting with Computers 12, 4 (2000), 323--336.Google ScholarCross Ref
- M. Mori, K. F. MacDorman, and N. Kageki. 2012. The uncanny valley {from the field}. IEEE Robotics 8 Automation Magazine 19, 2 (2012), 98--100.Google Scholar
- C. Nass, J. Steuer, L. Henriksen, and D. C. Dryer. 1994. Machines, social attributions, and ethopoeia: Performance assessments of computers subsequent to. International Journal of Human-Computer Studies 40, 3 (1994), 543--559.Google ScholarDigital Library
- D. Norman. 2013. The Design of Everyday Things: Revised and Expanded Edition. Basic Books, AZ.Google Scholar
- D. A. Norman. 1994. How might people interact with agents. Communications of the ACM 37, 7 (1994), 68--71. Google ScholarDigital Library
- D. A. Norman. 2014. Some observations on mental models. In Mental Models. Psychology Press, 15--22.Google Scholar
- W. Odom, J. Zimmerman, L. S. Davidoff, J. Forlizzi, A. K. Dey, and M. K. Lee. 2012. A fieldwork of the future with user enactments. In Proceedings of Designing Interactive Systems Conference (DIS’12). 338--347. DOI:http://dl.acm.org/citation.cfm?id=2318008Google Scholar
- W. T. Odom, A. J. Sellen, R. Banks, D. S. Kirk, T. Regan, M. Selby, and J. Zimmerman. 2014. Designing for slowness, anticipation and re-visitation: A long term field study of the photobox. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, 1961--1970. Google ScholarDigital Library
- H. Petroski. 1992. The Evolution of Useful Things: How Everyday Artifacts-From Forks and Pins to Paper Clips and Zippers-Came to be as They Are. Knopf, NY.Google Scholar
- J. Piaget. 1951. The Child's Conception of the World (No. 213). Rowman 8 Littlefield.Google Scholar
- J. Pierce, Y. Strengers, P. Sengers, and S. Bødker. 2013. Introduction to the special issue on practice-oriented approaches to sustainable HCI. ACM Transactions on Computer-Human Interaction 20, 4 (2013), 20. Google ScholarDigital Library
- B. Reeves and C. I. Nass. 1996. The Media Equation: How People Treat Computers, Television, and New Media like Real People and Places. Cambridge University Press. Google ScholarDigital Library
- E. Robles and M. Wiberg. 2010. Texturing the material turn in interaction design. In Proceedings of the 4th International Conference on Tangible, Embedded, and Embodied Interaction. ACM, 137--144. Google ScholarDigital Library
- Y. Rogers. 2012. HCI theory: Classical, modern, and contemporary. Synthesis Lectures on Human-Centered Informatics 5, 2 (2012), 1--129. Google ScholarCross Ref
- D. Rose. 2014. Enchanted Objects: Design, Human Desire, and the Internet of Things. Simon and Schuster.Google Scholar
- P. R. Ross and S. A. Wensveen. 2010. Designing behavior in interaction: Using aesthetic experience as a mechanism for design. International Journal of Design 4, 2 (2010), 3--13.Google Scholar
- M. C. Rozendaal. 2016. Objects with intent: A new paradigm for interaction design. Interactions 23, 3 (2016), 62--65.Google ScholarDigital Library
- S. L. Rubinshtein. 1946. Foundations of General Psychology. Academic Science, Moscow.Google Scholar
- R. M. Ryan and E. L. Deci. 2000. Self-determination theory and the facilitation of intrinsic motivation, social development, and well-being. American Psychologist 55, 1 (2000), 68.Google ScholarCross Ref
- S. Šabanović, S. Reeder, and B. Kechavarzi. 2014. Designing robots in the wild: In situ prototype evaluation for a break management robot. Journal of Human-Robot Interaction 3, 1 (2014), 70--88.Google ScholarDigital Library
- K. Salen and E. Zimmerman. 2003. Rules of Play. Game Design Fundamentals. MIT Press, Cambridge, Mass. Google ScholarDigital Library
- I. Sample and A. Hern. 2014. Scientists dispute whether computer “Eugene Goostman” passed Turing test. The Guardian. Retrieved June 2, 2019 from https://www.theguardian.com/technology/2014/jun/09/scientists-disagree-over-whether-turing-test-has-been-passed.Google Scholar
- E. Stolterman and A. Croon Fors. 2008. Critical HCI Research: A research position proposal. Design Philosophy Papers, 1 (2008).Google Scholar
- D. I. Tapia, A. Abraham, J. M. Corchado, and R. S. Alonso. 2010. Agents and ambient intelligence: Case studies. Journal of Ambient Intelligence and Humanized Computing 1, 2 (2010), 85--93.Google ScholarCross Ref
- L. Takayama. 2009. Making sense of agentic objects and teleoperation: In-the-moment and reflective perspectives. In Proceedings of the 2009 4th ACM/IEEE International Conference on Human-Robot Interaction (HRI). IEEE, 239--240. Google ScholarDigital Library
- A. S. Taylor. 2009. Machine intelligence. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, 2109--2118. Google ScholarDigital Library
- A. Vallgårda. 2014. Giving form to computational things: Developing a practice of interaction design. Personal Ubiquitous Computing 18, 3 (2014), 577--592. Google ScholarDigital Library
- P. Van Allen, J. McVeigh-Schultz, B. Brown, H. M. Kim, and D. Lara. 2013. AniThings: Animism and heterogeneous multiplicity. In Proceedings of the CHI'13 Extended Abstracts on Human Factors in Computing Systems. ACM, 2247--2256. Google ScholarDigital Library
- P.-P. Verbeek. 2011. Moralizing Technology: Understanding and Designing the Morality of Things. The University of Chicago Press, Chicago.Google Scholar
- P. P. Verbeek. 2015. Cover story beyond interaction: A short introduction to mediation theory. Interactions 22, 3 (2015), 26--31. Google ScholarDigital Library
- L. S. Vygotsky. 1978. Mind in society: The development of higher mental process. Harvard University Press, Cambridge.Google Scholar
- R. Wakkary, D. Oogjes, H. W. Lin, and S. Hauser. 2018. Philosophers living with the tilting bowl. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems. ACM, 94Google Scholar
- M. Wiberg. 2014. Methodology for materiality: Interaction design research through a material lens. Personal and Ubiquitous Computing 18, 3 (2014), 625--636.Google ScholarDigital Library
- J. Wertsch. 1981. The concept of activity in Soviet psychology: An introduction. In The Concept of Activity in Soviet Psychology, J. Wertsch (Ed.). M. E. Sharpe, Armonk, N.Y., 3--36.Google Scholar
- M. Wooldridge and N. R. Jennings. 1995. Intelligent agents: Theory and practice. The Knowledge Engineering Review 10, 2 (1995), 115--152.Google ScholarCross Ref
- V. W. Zue and J. R. Glass. 2000. Conversational interfaces: Advances and challenges. Proceedings of the IEEE 88, 8 (2000), 1166--1180.Google ScholarCross Ref
Index Terms
- Objects with Intent: Designing Everyday Things as Collaborative Partners
Recommendations
Understanding the Role of Objects in Cross-Disciplinary Collaboration
In this paper we make a case for the use of multiple theoretical perspectives—theory on boundary objects, epistemic objects, cultural historical activity theory, and objects as infrastructure—to understand the role of objects in cross-disciplinary ...
Designing mediation
ECCE '15: Proceedings of the European Conference on Cognitive Ergonomics 2015The aim of this paper is to analyze the concept of mediation in the context of current HCI research, with a special focus on the use of the concept to inform and guide the design of interactive artifacts and environments. The paper discusses the ...
Workshop on interacting with smart objects
IUI '11: Proceedings of the 16th international conference on Intelligent user interfacesThe number of smart objects in our everyday life is steadily increasing. In this workshop we discuss how the interaction with these smart objects should be designed from various perspectives.
Comments