Martijn J.L. Kors
Gabriele Ferri
Erik D. van der Spek
ABSTRACT
Persuasive games exist for a wide variety of objectives, from marketing, to healthcare and activism. Some of the more socially-aware ones cast players as members of disenfranchised minorities, such as migrants, prompting them to 'see what they see'. In parallel, a growing number of designers has recently started to leverage immersive technologies to enable the public to temporarily inhabit another person, to 'sense what they sense'. From these two converging perspectives, we hypothesize a still-uncharted space of opportunities at the crossroads of games, empathy, persuasion, and immersion. Following a Research through Design approach, we explored this space by designing A Breathtaking Journey, an embodied and multisensory mixed-reality game providing a first-person perspective of a refugee's journey. A qualitative study was conducted with a grounded theory/open coding methodology to tease out empathy-arousing characteristics, and to chart this novel game design space. As we elaborate on our analysis, we provide insights on empathic mixed-reality experiences, and conclude with offering three design opportunities: visceral engagement, reflective moments and affective appeals, to spur future research and design.
- 11 Bit Studios. 2014. This War of Mine. Retrieved from http://www.11bitstudios.com/games/16/this-war-of-mineGoogle Scholar
- Anne Adams, Peter Lunt, and Paul Cairns. 2008. A qualititative approach to HCI research. In Research Methods for Human-Computer Interaction, Paul Cairns and Anna Cox (eds.). Cambridge University Press, Cambridge, UK, 138--157.Google Scholar
- Craig A. Anderson, Akiko Shibuya, Nobuko Ihori, et al. 2010. Violent video game effects on aggression, empathy, and prosocial behavior in eastern and western countries: a meta-analytic review. Psychological bulletin 136, 2: 151--17Google Scholar
- Jamie Antonisse and Devon Johnson. 2013. Hush.Google Scholar
- Arduino. 201 Arduino Microprocessor. Retrieved from https://www.arduino.ccGoogle Scholar
- Gabo Arora, Barry Pousman, and Chris Milk. 2015. Clouds over Sidra. Vrse. Retrieved from http://with.in/watch/clouds-over-sidraGoogle Scholar
- Audio-Technica. 2014. ATH-M40x. Retrieved from http://www.audio-technica.com/cms/headphones/75b2f282c93a7651Google Scholar
- Jeffrey Bardzell and Shaowen Bardzell. 2015. Humanistic HCI. Synthesis Lectures on Human-Centered Informatics 8, 4: 1--185.Google ScholarCross Ref
- Jonathan Belman and Mary Flanagan. 2010. Designing games to foster empathy. International Journal of Cognitive Technology 15, 1: 11.Google Scholar
- Steve Benford and Gabriella Giannachi. 2011. Performing Mixed Reality. The MIT Press. Google ScholarDigital Library
- 1Steve Benford, Chris Greenhalgh, Gabriella Giannachi, Brendan Walker, Joe Marshall, and Tom Rodden. 2012. Uncomfortable Interactions. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, ACM, 2005-2014. Google ScholarDigital Library
- Mark A. Blythe, Kees Overbeeke, Andrew F. Monk, and Peter C. Wright (eds.). 2005. Funology: From Usability to Enjoyment. Springer Netherlands. Google ScholarDigital Library
- Ian Bogost. 2007. Persuasive games: The expressive power of videogames. Mit Press. Google ScholarDigital Library
- Ian Bogost. 2011. How to do things with videogames. U of Minnesota Press.Google Scholar
- Liz Owens Boltz, Danah Henriksen, and Punya Mishra. 20 Rethinking Technology & Creativity in the 21st Century: Empathy through Gaming-Perspective Taking in a Complex World. TechTrends 59, 6: 3.Google Scholar
- Virginia Braun and Victoria Clarke. 2006. Using thematic analysis in psychology. Qualitative research in psychology 3, 2: 77--101.Google Scholar
- Emily Brown and Paul Cairns. 2004. A Grounded Investigation of Game Immersion. CHI '04 Extended Abstracts on Human Factors in Computing Systems, ACM, 1297--1300. Google ScholarDigital Library
- James Brown, Kathrin Gerling, Patrick Dickinson, and Ben Kirman. 2015. Dead Fun: Uncomfortable Interactions in a Virtual Reality Game for Coffins. Proceedings of the 2015 Annual Symposium on Computer-Human Interaction in Play, ACM, 475--480. Google ScholarDigital Library
- Richard Byrne, Joe Marshall, and Florian Floyd Mueller. 2016. Designing the Vertigo Experience: Vertigo As a Design Resource for Digital Bodily Play. Proceedings of the TEI '16: Tenth International Conference on Tangible, Embedded, and Embodied Interaction, ACM, 296--303. Google ScholarDigital Library
- Karl-Erik Bystrom, Woodrow Barfield, and Claudia Hendrix. 1999. A Conceptual Model of the Sense of Presence in Virtual Environments. Presence: Teleoperators and Virtual Environments 8, 2: 241--244. Google ScholarDigital Library
- Jordan M. Carpenter and Melanie C. Green. 2012. Flying with Icarus: narrative transportation and the persuasiveness of entertainment. Psychology of entertainment media, 2nd edn. Routledge, Florence: 169--194.Google Scholar
- John W. Creswell. 2014. Research design: Qualitative, quantitative, and mixed methods approaches. Sage publications.Google Scholar
- H. Q. Dinh, N. Walker, L. F. Hodges, Chang Song, and A. Kobayashi. 1999. Evaluating the importance of multi-sensory input on memory and the sense of presence in virtual environments. Virtual Reality, 1999. Proceedings., IEEE, 222--228. Google ScholarDigital Library
- Paul Dourish. 2001. Where the Action is: The Foundations of Embodied Interaction. MIT Press, Cambridge, Massachusetts. Google ScholarDigital Library
- Epic Games. 2015. Unreal Engine 4. Retrieved from www.unrealengine.comGoogle Scholar
- J. E. Escalas and B. B. Stern. 2003. Sympathy and empathy: Emotional responses to advertising dramas. The Journal of consumer research.Google ScholarCross Ref
- Salvatore Fiore, Peter Wright, and Alistair Edwards. 2005. A Pragmatist Aesthetics Approach to the Design of a Technological Artefact. Proceedings of the 4th Decennial Conference on Critical Computing: Between Sense and Sensibility, ACM, 129--132. Google ScholarDigital Library
- Mary Flanagan. 2009. Critical Play: Radical Game Design. MIT Press. Google ScholarCross Ref
- Gonzalo Frasca. 2004. Madrid. Retrieved from http://www.newsgaming.com/games/madridGoogle Scholar
- Gonzalo Frasca. 2007. Play the message: Play, game and videogame rhetoric. Unpublished PhD dissertation. IT University of Copenhagen, Denmark.Google Scholar
- Rosemary Garris, Robert Ahlers, and James E. Driskell. 2002. Games, Motivation, and Learning: A Research and Practice Model. Simulation & gaming 33, 4: 441--467.Google Scholar
- Marientina Gotsis, Judith Piggot, Diana Hughes, and Wendy Stone. 2010. SMART-games: A Video Game Intervention for Children with Autism Spectrum Disorders. Proceedings of the 9th International Conference on Interaction Design and Children, ACM, 194--197. Google ScholarDigital Library
- D. Grigorovici. 2003. Persuasive Effects of Presence in Immersive Virtual Environments. In G. Riva, F. Davide, & W. IJsselsteijn (Eds.), Being there: Concepts, effects and measurement of presence in synthetic environments.Google Scholar
- Douglas Harper. 2002. Talking about pictures: A case for photo elicitation. Visual Studies 17, 1: 13--26.Google ScholarCross Ref
- Teresa de la Hera Conde-Pumpido. 2013. A Conceptual Model for the Study of Persuasive Games. Proceedings of DiGRA 2013.Google Scholar
- Ioanna Iacovides and Anna L. Cox. 2015. Moving Beyond Fun: Evaluating Serious Experience in Digital Games. Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems, ACM, 2245--2254. Google ScholarDigital Library
- ImpactGames. 2007. PeaceMaker. Retrieved from http://www.peacemakergame.comGoogle Scholar
- Henry Jenkins. 2004. Game design as narrative architecture. Computer 44, 3: 118--130.Google Scholar
- Dan R. Johnson. 2012. Transportation into a story increases empathy, prosocial behavior, and perceptual bias toward fearful expressions. Personality and individual differences 52, 2: 150--155.Google Scholar
- Dena M. Jones. 1997. Advertising Animal Protection. Anthrozoös 10, 4: 151--159.Google ScholarCross Ref
- Hartmut Koenitz, Gabriele Ferri, Mads Haahr, Diădem Sezen, and Tonguç Ibrahim Sezen. 2015. Interactive Digital Narrative: History, Theory and Practice. Routledge. Google ScholarDigital Library
- Sara H. Konrath, Edward H. O'Brien, and Courtney Hsing. 2011. Changes in dispositional empathy in American college students over time: a meta-analysis. Personality and social psychology review: an official journal of the Society for Personality and Social Psychology, Inc 15, 2: 180--198.Google Scholar
- Martijn Kors. 2015. Towards Design Strategies for the Persuasive Gameplay Experience. Proceedings of the 2015 Annual Symposium on Computer-Human Interaction in Play, ACM, 407--410. Google ScholarDigital Library
- Martijn Kors, Erik van der Spek, and Ben Schouten. 2015. A Foundation for the Persuasive Gameplay Experience. Proceedings of the 10th Foundations of Digital Games Conference (FDG '15).Google Scholar
- Petri Lankoski. 2007. Goals, affects, and empathy in games. Philosophy of computer games.Google Scholar
- Brenda Laurel. 1991. Computers as Theatre. Addison-Wesley. Google ScholarDigital Library
- Aaron Levisohn, Jayme Cochrane, Diane Gromala, and Jinsil Seo. 2007. The Meatbook: Tangible and Visceral Interaction. Proceedings of the 1st International Conference on Tangible and Embedded Interaction, ACM, 91--92. Google ScholarDigital Library
- Amy Shirong Lu, Tom Baranowski, Debbe Thompson, and Richard Buday. 2012. Story Immersion of Videogames for Youth Health Promotion: A Review of Literature. Games for health journal 1, 3: 199--204.Google Scholar
- Andrés Lucero, Evangelos Karapanos, Juha Arrasvuori, and Hannu Korhonen. 2014. Playful or Gameful?: creating delightful user experiences. Interactions 21, 3: 34--39. Google ScholarDigital Library
- Gregory Maio and Geoffrey Haddock. 2009. The psychology of attitudes and attitude change. Sage.Google Scholar
- Joe Marshall, Brendan Walker, Steve Benford, et al. 2011. The Gas Mask: A Probe for Exploring Fearsome Interactions. CHI '11 Extended Abstracts on Human Factors in Computing Systems, ACM, 127--136. Google ScholarDigital Library
- Tim Marsh. 2016. Slow serious games, interactions and play: Designing for positive and serious experience and reflection. Entertainment computing 14: 45--53.Google Scholar
- Tim Marsh and Brigid Costello. 2013. Lingering Serious Experience as Trigger to Raise Awareness, Encourage Reflection and Change Behavior. Persuasive Technology, Springer Berlin Heidelberg, 116--124. Google ScholarDigital Library
- John McCarthy and Peter Wright. 2004. Technology As Experience. Interactions 11, 5: 42--43. Google ScholarDigital Library
- Paul Milgram and Fumio Kishino. 1994. A taxonomy of mixed reality visual displays. IEICE transactions on information and systems 77, 12: 1321--1329.Google Scholar
- Chris Milk. 2015. How virtual reality can create the ultimate empathy machine. TED. Retrieved April 18, 2016 from https://www.ted.com/talks/chris_milk_how_virtual_reality_can_create_the_ultimate_empathy_machine?language=enGoogle Scholar
- Janet Horowitz Murray. 1997. Hamlet on the holodeck: The future of narrative in cyberspace. Simon and Schuster. Google ScholarDigital Library
- Donald A. Norman. 2005. Emotional design: Why we love (or hate) everyday things. Basic books.Google Scholar
- Oculus. 2014. Oculus Development Kit 2. Retrieved from https://www.oculus.com/en-us/dk2Google Scholar
- Daniel J. O'keefe. 2002. Persuasion: Theory and research. Sage Publications.Google Scholar
- W. Gerrod Parrott. 2001. Emotions in social psychology: Essential readings. Psychology Press.Google Scholar
- Nonny de la Peña, Peggy Weil, Joan Llobera, et al. 2010. Immersive Journalism: Immersive Virtual Reality for the First-Person Experience of News. Presence: Teleoperators and Virtual Environments 19, 4: 291--301. Google ScholarDigital Library
- Wei Peng, Mira Lee, and Carrie Heeter. 2010. The Effects of a Serious Game on Role-Taking and Willingness to Help. The Journal of communication 60, 4: 723--742.Google ScholarCross Ref
- Richard M. Perloff. 2008. The dynamics of persuasion: communication and attitudes in the twenty-first century. Lawrence Erlbaum Associates, New York.Google Scholar
- Mick Power and Tim Dalgleish. 2008. Cognition and emotion: From order to disorder (2nd ed.). Psychology Press.Google Scholar
- Stanley Presser, Jennifer M. Rothgeb, Mick P. Couper, et al. 2004. Methods for Testing and Evaluating Survey Questionnaires. John Wiley & Sons.Google Scholar
- Andrew K. Przybylski, Edward L. Deci, Edward Deci, C. Scott Rigby, and Richard M. Ryan. 2014. Competence-impeding electronic games and players' aggressive feelings, thoughts, and behaviors. Journal of personality and social psychology 106, 3: 441--457.Google ScholarCross Ref
- Susana Ruiz, Ashley York, Mike Stein, Noah Keating, and Kellee Santiago. 2006. Darfur is dying. Retrieved from http://www.darfurisdying.comGoogle Scholar
- 6Marie-Laure Ryan. 2001. Narrative As Virtual Reality: Immersion and Interactivity in Literature and Electronic Media. Johns Hopkins University Press, Baltimore, MD, USA. Google ScholarDigital Library
- Marie-Laure Ryan. 2015. Narrative as Virtual Reality 2: Revisiting Immersion and Interactivity in Literature and Electronic Media. JHU Press.Google Scholar
- B. A. M. Schouten, Menno Deen, and M. M. Bekker. 2010. Playful Identity in game design and open ended play. Proceedings of the Homo Ludens conference.Google Scholar
- P. Shaver, J. Schwartz, D. Kirson, and C. O'Connor. 1987. Emotion knowledge: further exploration of a prototype approach. Journal of personality and social psychology 52, 6: 1061--1086.Google ScholarCross Ref
- Mary Lou Shelton and Ronald W. Rogers. 1981. Fear-Arousing and Empathy-Arousing Appeals to Help: The Pathos of Persuasion. Journal of applied social psychology 11, 4: 366--378.Google ScholarCross Ref
- L. Shen. 2011. The effectiveness of empathy-versus fear-arousing antismoking PSAs. Health communication.Google Scholar
- Richard Shusterman. 2014. Somaesthetics. In The Encyclopedia of Human-Computer Interaction, 2nd Ed.Google Scholar
- Michael D. Slater and Donna Rouner. 2002. Entertainment-Education and Elaboration Likelihood: Understanding the Processing of Narrative Persuasion. Communication theory: CT: a journal of the International Communication Association 12, 2: 173--191.Google Scholar
- Toby Smethurst and Stef Craps. 2014. Playing with Trauma: Interreactivity, Empathy, and Complicity in The Walking Dead Video Game. Games and Culture. http://doi.org/10.1177/1555412014559306Google ScholarCross Ref
- Omar Sosa-Tzec, Erik Stolterman, and Martin A. Siegel. 2015. Gaza Everywhere: Exploring the Applicability of a Rhetorical Lens in HCI. Proceedings of The Fifth Decennial Aarhus Conference on Critical Alternatives, Aarhus University Press, 69--72. Google ScholarDigital Library
- Kurt D. Squire. 2005. Educating the fighter: buttonmashing, seeing, being. On The Horizon - The Strategic Planning Resource for Education Professionals 13, 2: 75--88.Google Scholar
- Luke Stark. 2015. Making Values Visceral. Aarhus Conference 2015 Workshop: "Charting the Next Decade for Value Sensitive Design".Google Scholar
- Sharon T. Steinemann, Elisa D. Mekler, and Klaus Opwis. 2015. Increasing Donating Behavior Through a Game for Change: The Role of Interactivity and Appreciation. Proceedings of the 2015 Annual Symposium on Computer-Human Interaction in Play, ACM, 319--329. Google ScholarDigital Library
- Jonathan Steuer. 1992. Defining Virtual Reality: Dimensions Determining Telepresence. The Journal of communication 42, 4: 73--93.Google ScholarCross Ref
- Tale of Tales. 2008. The Graveyard. Retrieved from http://tale-of-tales.com/TheGraveyard/index.htmlGoogle Scholar
- Tom Van Laer, Ko De Ruyter, Luca M. Visconti, and Martin Wetzels. 2014. The extended transportation-imagery model: A meta-analysis of the antecedents and consequences of consumers' narrative transportation. The Journal of consumer research 40, 5: 797--817.Google ScholarCross Ref
- T. Wiseman. 1996. A concept analysis of empathy. Journal of advanced nursing 23, 6: 1162--1167.Google ScholarCross Ref
- Pieter Wouters, Erik D. Van der Spek, and Herre Van Oostendorp. 2009. Current practices in serious game research: A review from a learning outcomes perspective. Games-based learning advancements for multi-sensory human computer interfaces: techniques and effective practices: 232--250.Google Scholar
- Yager Development. 2012. Spec Ops: The Line. Retrieved from http://www.specopstheline.comGoogle Scholar
- John Zimmerman, Jodi Forlizzi, and Shelley Evenson. 2007. Research Through Design As a Method for Interaction Design Research in HCI. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, ACM, 493--502. Google ScholarDigital Library
- Games for Change. Games for Change. Retrieved April 18, 2016 from http://www.gamesforchange.orgGoogle Scholar
- Amnesty International | Voor de mensenrechten. Amnesty International Nederland. Retrieved September 10, 2014 from https://www.amnesty.nlGoogle Scholar
- Flickr, a Yahoo company. Flickr. Retrieved October 4, 2015 from https://www.flickr.comGoogle Scholar
Index Terms
- A Breathtaking Journey. On the Design of an Empathy-Arousing Mixed-Reality Game
Recommendations
You; the Observer, Partaker or Victim. Delineating Three Perspectives to Empathic Engagement in Persuasive Games using Immersive Technologies.
CHI PLAY '18 Extended Abstracts: Proceedings of the 2018 Annual Symposium on Computer-Human Interaction in Play Companion Extended AbstractsA commonality in socially-aware persuasive games is the strategy to appeal to empathy, as a means to have players feel and understand the struggles of another. This is particularly evident in the expanding use of immersive technologies, lauded for its ...
Mixed reality in virtual world teleconferencing
VR '10: Proceedings of the 2010 IEEE Virtual Reality ConferenceIn this paper we present a Mixed Reality (MR) teleconferencing application based on Second Life (SL) and the OpenSim virtual world. Augmented Reality (AR) techniques are used for displaying virtual avatars of remote meeting participants in real physical ...
Developing an augmented reality racing game
INTETAIN '08: Proceedings of the 2nd international conference on INtelligent TEchnologies for interactive enterTAINmentAugmented reality (AR) makes it possible to create games in which virtual objects are overlaid on the real world, and real objects are tracked and used to control virtual ones. We describe the development of an AR racing game created by modifying an ...
Comments