skip to main content
10.1145/3027063.3053209acmconferencesArticle/Chapter ViewAbstractPublication PageschiConference Proceedingsconference-collections
abstract

Challenge in Digital Games: Towards Developing a Measurement Tool

Published:06 May 2017Publication History

ABSTRACT

Challenge is arguably the most important experience that players seek in digital games. However, without a measure of how challenged players feel during the act of play, it is hard to design games that are neither too easy nor too hard and, therefore, truly enjoyable. Especially in industry, challenge is dominantly assessed by means of manual play testing in ad-hoc trials. The aim of this research is to create a more systematic, complete, and reliable instrument to evaluate the level of players' experienced challenge in games in the form of a questionnaire. This paper presents the key results from an extensive literature survey which will inform further development. We survey definitions of challenge, challenge types, and their relation to player experience based on the observations of game designers. We furthermore draw from empirical findings in a diverse range of fields such as game studies, human-computer interaction (HCI) and artificial intelligence (AI).

References

  1. Sami Abuhamdeh and Mihaly Csikszentmihalyi. 2012. The importance of challenge for the enjoyment of intrinsically motivated, goal-directed activities. Personality and Social Psychology Bulletin 38, 3 (2012), 317--330. http://dx.doi.org/10.1177/0146167211427147 Google ScholarGoogle ScholarCross RefCross Ref
  2. Sami Abuhamdeh, Mihaly Csikszentmihalyi, and Baland Jalal. 2015. Enjoying the possibility of defeat: Outcome uncertainty, suspense, and intrinsic motivation. Motivation and Emotion 39, 1 (2015), 1--10. http://dx.doi.org/10.1007/s11031-014--9425--2Google ScholarGoogle ScholarCross RefCross Ref
  3. Ernest Adams. 2014. Fundamentals of game design. Pearson Education.Google ScholarGoogle Scholar
  4. Scott Bateman, Andre Doucette, Robert Xiao, Carl Gutwin, Regan L Mandryk, and Andy Cockburn. 2011. Effects of view, input device, and track width on video game driving. In Proceedings of Graphics Interface 2011. Canadian Human-Computer Communications Society, 207--214. http: //dl.acm.org/citation.cfm?id=1992917.1992952Google ScholarGoogle ScholarDigital LibraryDigital Library
  5. Philip Bontrager, Ahmed Khalifa, Andre Mendes, and Julian Togelius. 2016. Matching Games and Algorithms for General Video Game Playing. In Proceedings of the 12th International Conference on Artificial Intelligence and Interactive Digital Entertainment (AIIDE).Google ScholarGoogle Scholar
  6. Tom Cole, Paul Cairns, and Marco Gillies. 2015. Emotional and Functional Challenge in Core and Avant-garde Games. In Proceedings of the 2015 Annual Symposium on Computer-Human Interaction in Play. ACM, 121--126. http://dx.doi.org/10.1145/2793107.2793147 Google ScholarGoogle ScholarDigital LibraryDigital Library
  7. Anna Cox, Paul Cairns, Pari Shah, and Michael Carroll. 2012. Not doing but thinking: the role of challenge in the gaming experience. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, 79--88. http://dx.doi.org/10.1145/2207676.2207689 Google ScholarGoogle ScholarDigital LibraryDigital Library
  8. Mihaly Csikszentmihalyi. 1990. The psychology of optimal experience. Harper&Row, New York.Google ScholarGoogle Scholar
  9. John P Davis, Keith Steury, and Randy Pagulayan. 2005. A survey method for assessing perceptions of a game: The consumer playtest in game design. Game Studies 5, 1 (2005).Google ScholarGoogle Scholar
  10. Edward L Deci and Richard M Ryan. 2000. The" what" and" why" of goal pursuits: Human needs and the self-determination of behavior. Psychological inquiry 11, 4 (2000), 227--268. www.jstor.org/stable/1449618 Google ScholarGoogle ScholarCross RefCross Ref
  11. Difficulty. 2016. Merriam-Webster.com. Merriam-Webster.Google ScholarGoogle Scholar
  12. Laura Ermi and Frans Mäyrä. 2005. Fundamental components of the gameplay experience: Analysing immersion. Worlds in play: International perspectives on digital games research 37 (2005), 2.Google ScholarGoogle Scholar
  13. John Feil and Marc Scattergood. 2005. Beginning game level design. Thomson Course Technology.Google ScholarGoogle Scholar
  14. Fong-Ling Fu, Rong-Chang Su, and Sheng-Chin Yu. 2009. EGameFlow: A scale to measure learners enjoyment of e-learning games. Computers & Education 52, 1 (2009), 101--112. http://dx.doi.org/10.1016/j.compedu.2008.07.004 Google ScholarGoogle ScholarDigital LibraryDigital Library
  15. Shang Hwa Hsu, Ming-Hui Wen, and Muh-Cherng Wu. 2007. Exploring design features for enhancing players' challenge in strategy games. CyberPsychology & Behavior 10, 3 (2007), 393--397. http://dx.doi.org/10.1089/cpb.2006.9940 Google ScholarGoogle ScholarCross RefCross Ref
  16. Robin Hunicke, Marc LeBlanc, and Robert Zubek. 2004. MDA: A formal approach to game design and game research. In Proceedings of the AAAI Workshop on Challenges in Game AI, Vol. 4. 1.Google ScholarGoogle Scholar
  17. Wijnand IJsselsteijn, Yvonne De Kort, Karolien Poels, Audrius Jurgelionis, and Francesco Bellotti. 2007. Characterising and measuring user experiences in digital games. In International conference on advances in computer entertainment technology, Vol. 2. 27. https://doi.org/10.1093/iwc/iwt015Google ScholarGoogle ScholarCross RefCross Ref
  18. Susan A Jackson, Herbert W Marsh, and others. 1996. Development and validation of a scale to measure optimal experience: The Flow State Scale. Journal of sport and exercise psychology 18 (1996), 17--35. http://dx.doi.org/10.1123/jsep.18.1.17 Google ScholarGoogle ScholarCross RefCross Ref
  19. Charlene Jennett, Anna L Cox, Paul Cairns, Samira Dhoparee, Andrew Epps, Tim Tijs, and Alison Walton. 2008. Measuring and defining the experience of immersion in games. International journal of human-computer studies 66, 9 (2008), 641--661. http://dx.doi.org/10.1016/j.ijhcs.2008.04.004 Google ScholarGoogle ScholarDigital LibraryDigital Library
  20. Jesper Juul. 2009. Fear of failing? the many meanings of difficulty in video games. The video game theory reader 2 (2009), 237--252.Google ScholarGoogle Scholar
  21. Madison Klarkowski, Daniel Johnson, Peta Wyeth, Mitchell McEwan, Cody Phillips, and Simon Smith. 2016. Operationalising and Evaluating Sub-Optimal and Optimal Play Experiences through Challenge-Skill Manipulation. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems. ACM, 5583--5594. http://dx.doi.org/10.1145/2858036.2858563 Google ScholarGoogle ScholarDigital LibraryDigital Library
  22. Christoph Klimmt. 2003. Dimensions and determinants of the enjoyment of playing digital games: A three-level model. In Level up: Digital games research conference. 246--257.Google ScholarGoogle Scholar
  23. Christoph Klimmt, Tilo Hartmann, and Andreas Frey. 2007. Effectance and control as determinants of video game enjoyment. Cyberpsychology & behavior 10, 6 (2007), 845--848. http://dx.doi.org/10.1089/cpb.2007.9942 Google ScholarGoogle ScholarCross RefCross Ref
  24. Nicole Lazzaro. 2004. Why we play games: Four keys to more emotion without story. (2004).Google ScholarGoogle Scholar
  25. Geoffrey R Loftus and Elizabeth F Loftus. 1983. Mind at play; The psychology of video games. Basic Books, Inc.Google ScholarGoogle Scholar
  26. Thomas W Malone. 1981. Toward a theory of intrinsically motivating instruction. Cognitive science 5, 4 (1981), 333--369. http://dx.doi.org/10.1016/S0364-0213(81)80017--1Google ScholarGoogle ScholarCross RefCross Ref
  27. Thorbjørn S Nielsen, Gabriella A B Barros, Julian Togelius, and Mark J Nelson. 2015. General Video Game Evaluation Using Relative Algorithm Performance Profiles. In Proceedings of the 18th Conference on Applications of Evolutionary Computation. Springer, 369--380. http://dx.doi.org/10.1007/978--3--319--16549--3_30Google ScholarGoogle ScholarCross RefCross Ref
  28. Karolien Poels, Yvonne De Kort, and Wijnand Ijsselsteijn. 2007. It is always a lot of fun!: exploring dimensions of digital game experience using focus group methodology. In Proceedings of the 2007 conference on Future Play. ACM, 83--89. http://dx.doi.org/10.1145/1328202.1328218 Google ScholarGoogle ScholarDigital LibraryDigital Library
  29. Hua Qin, Pei-Luen Patrick Rau, and Gavriel Salvendy. 2009. Measuring player immersion in the computer game narrative. Intl. Journal of Human--Computer Interaction 25, 2 (2009), 107--133. http://dx.doi.org/10.1007/978--3--540--74873--1_60Google ScholarGoogle ScholarCross RefCross Ref
  30. Richard Rouse III. 2010. Game design: Theory and practice. Jones & Bartlett Learning.Google ScholarGoogle Scholar
  31. Richard M Ryan, C Scott Rigby, and Andrew Przybylski. 2006. The motivational pull of video games: A self-determination theory approach. Motivation and emotion 30, 4 (2006), 344--360. http://dx.doi.org/10.1007/s11031-006--9051--8Google ScholarGoogle ScholarCross RefCross Ref
  32. Katie Salen and Eric Zimmerman. 2004. Rules of play: Game design fundamentals. MIT Press.Google ScholarGoogle ScholarDigital LibraryDigital Library
  33. Jesse Schell. 2014. The Art of Game Design: A book of lenses. CRC Press. Google ScholarGoogle ScholarCross RefCross Ref
  34. John L Sherry, Kristen Lucas, Bradley S Greenberg, and Ken Lachlan. 2006. Video game uses and gratifications as predictors of use and game preference. Playing video games: Motives, responses, and consequences 24 (2006), 213--224. http: //www.allacademic.com/meta/p111471_index.htmlGoogle ScholarGoogle Scholar
  35. Ben Shneiderman. 1982. Direct manipulation: A step beyond programming languages. ACM SIGSOC Bulletin 13, 2--3 (1982), 143. http://dx.doi.org/10.1109/MC.1983.1654471 Google ScholarGoogle ScholarDigital LibraryDigital Library
  36. Penelope Sweetser and Peta Wyeth. 2005. GameFlow: a model for evaluating player enjoyment in games. Computers in Entertainment (CIE) 3, 3 (2005), 3--3. http://dx.doi.org/10.1145/1077246.1077253 Google ScholarGoogle ScholarDigital LibraryDigital Library
  37. Peter Vorderer, Tilo Hartmann, and Christoph Klimmt. 2003. Explaining the enjoyment of playing video games: the role of competition. In Proceedings of the Second International Conference on Entertainment Computing. Carnegie Mellon University, 1--9.Google ScholarGoogle ScholarDigital LibraryDigital Library

Index Terms

  1. Challenge in Digital Games: Towards Developing a Measurement Tool

    Recommendations

    Comments

    Login options

    Check if you have access through your login credentials or your institution to get full access on this article.

    Sign in
    • Published in

      cover image ACM Conferences
      CHI EA '17: Proceedings of the 2017 CHI Conference Extended Abstracts on Human Factors in Computing Systems
      May 2017
      3954 pages
      ISBN:9781450346566
      DOI:10.1145/3027063

      Copyright © 2017 Owner/Author

      Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      • Published: 6 May 2017

      Check for updates

      Qualifiers

      • abstract

      Acceptance Rates

      CHI EA '17 Paper Acceptance Rate1,000of5,000submissions,20%Overall Acceptance Rate6,164of23,696submissions,26%

      Upcoming Conference

      CHI '24
      CHI Conference on Human Factors in Computing Systems
      May 11 - 16, 2024
      Honolulu , HI , USA

    PDF Format

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader