ABSTRACT
This study sought to examine how measures of player experience used in videogame research relate to Metacritic Professional and User scores. In total, 573 participants completed an online survey, where they responded the Player Experience of Need Satisfaction (PENS) and the Game Experience Questionnaire (GEQ) in relation to their current favourite videogame. Correlations among the data indicate an overlap between the player experience constructs and the factors informing Metacritic scores. Additionally, differences emerged in the ways professionals and users appear to allocate game ratings. However, the data also provide clear evidence that Metacritic scores do not reflect the full complexity of player experience and may be misleading in some cases.
Supplemental Material
- Al Mahmud, A., et al. Designing and evaluating the tabletop game experience for senior citizens. In Proceedings of the 5th Nordic conference on Humancomputer interaction: building bridges 2008, ACM press (2008), 403--406. Google ScholarDigital Library
- Anderson, C.A., et al., Violent video game effects on aggression, empathy, and prosocial behavior in eastern and western countries: a meta-analytic review. Psychological bulletin 136, 2 (2010), 151--173.Google Scholar
- Birk, M. and R.L. Mandryk. Control your game-self: effects of controller type on enjoyment, motivation, and personality in game. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems 2013, ACM press (2013), 685--694. Google ScholarDigital Library
- Bower, B., Valuing a Video Game: Does Score Determine Value? 2009.Google Scholar
- Brockmyer, J.H., et al., The development of the Game Engagement Questionnaire: A measure of engagement in video game-playing. Journal of Experimental Social Psychology 45, 4 (2009), 624--634.Google ScholarCross Ref
- Cox, J., What Makes a Blockbuster Video Game? An Empirical Analysis of US Sales Data. Managerial and Decision Economics 35, 3 (2013), 189--198.Google Scholar
- Dauphin, B. and G. Heller, Going to other worlds: The relationships between videogaming, psychological absorption, and daydreaming styles. Cyberpsychology, Behavior, and Social Networking 13, 2 (2010), 169172.Google Scholar
- Everiss, B. Metacritic has changed the games industry. 2008, Available from: http://www.bruceongames.com/2008/06/04/metacritichas-changed-the-games-industry/.Google Scholar
- Fang, X., et al., Development of an instrument to measure enjoyment of computer game play. Intl. Journal of Human-Computer Interaction 26, 9 (2010), 868--886.Google ScholarCross Ref
- Ferguson, C.J., The good, the bad and the ugly: A meta-analytic review of positive and negative effects of violent video games. Psychiatric Quarterly 78, 4 (2007), 309--316.Google ScholarCross Ref
- Gajadhar, B., Y. De Kort, and W. Ijsselsteijn. Shared fun is doubled fun: Player enjoyment as a function of social setting. In Fun and Games 2008 (2008), 106--117. Google ScholarDigital Library
- Greenwood-Ericksen, A., S.R. Poorman, and R. Papp, On the Validity of Metacritic in Assessing Game Value. Eludamos. Journal for Computer Game Culture 7, 1 (2013), 101--127.Google Scholar
- IJsselsteijn, W.A., K. Poels, and Y.A.W. de Kort, The Game Experience Questionnaire: Development of a self-report measure to assess player experiences of digital games. Eindhoven University of Technology: Eindhoven. 2008.Google Scholar
- Jennett, C., et al., Measuring and defining the experience of immersion in games. International Journal of Human-Computer Studies 66, 9 (2008), 641--661. Google ScholarDigital Library
- Johnson, D. and J. Gardner. Personality, motivation and video games. In Proceedings of the 22nd Conference of the Computer-Human Interaction Special Interest Group of Australia on ComputerHuman Interaction 2010, ACM press (2010), 276--279. Google ScholarDigital Library
- Johnson, D., et al., Cooperative Play with Avatars and Agents: Differences in Brain Activity and the Experience of Play. Computers in Human Behavior under review, (2014).Google Scholar
- Johnson, D., et al. Personality, genre and videogame play experience. In Proceedings of the 4th International Conference on Fun and Games 2012, ACM press (2012), 117--120. Google ScholarDigital Library
- Jones, C.M., et al., Gaming well: links between videogames and flourishing mental health. Frontiers in psychology 5, (2014), 1--8.Google Scholar
- Lee, M.S. and C. Heeter, What do you mean by believable characters?: The effect of character rating and hostility on the perception of character believability. Journal of Gaming & Virtual Worlds 4, 1 (2012), 81--97.Google ScholarCross Ref
- Livingston, I., L. Nacke, and R. Mandryk, Influencing Experience: The Effects of Reading Game Reviews on Player Experience, in Entertainment Computing -- ICEC 2011, J. Anacleto, et al., Editors. Springer Berlin Heidelberg. p. 89--100, 2011. Google ScholarDigital Library
- Livingston, I.J., L.E. Nacke, and R.L. Mandryk. The impact of negative game reviews and user comments on player experience. In ACM SIGGRAPH 2011 Game Papers 2011, ACM press (2011). Google ScholarDigital Library
- McEwan, M., et al. Videogame control device impact on the play experience. In Proceedings of The 8th Australasian Conference on Interactive Entertainment: Playing the System 2012, ACM press (2012), 1--3. Google ScholarDigital Library
- Metacritic. How we create the metascore magic. 2014, Available from: http://www.metacritic.com/about-metascores.Google Scholar
- Nacke, L. and C.A. Lindley. Flow and immersion in first-person shooters: measuring the player's gameplay experience. In Proceedings of the 2008 Conference on Future Play: Research, Play, Share 2008, ACM press (2008), 81--88. Google ScholarDigital Library
- Nacke, L.E., M.N. Grimshaw, and C.A. Lindley, More than a feeling: Measurement of sonic user experience and psychophysiology in a first-person shooter game. Interacting with Computers 22, 5 (2010), 336--343. Google ScholarDigital Library
- Norman, K.L., GEQ (Game Engagement/Experience Questionnaire): A Review of Two Papers. Interacting with Computers 25, 4 (2013), 278--283.Google ScholarCross Ref
- Przybylski, A.K., C.S. Rigby, and R.M. Ryan, A motivational model of video game engagement. Review of General Psychology 14, 2 (2010), 154--166.Google ScholarCross Ref
- Przybylski, A.K., R.M. Ryan, and C.S. Rigby, The motivating role of violence in video games. Personality and Social Psychology Bulletin 35, 2 (2009), 243--259.Google ScholarCross Ref
- Przybylski, A.K., et al., The ideal self at play: the appeal of video games that let you be all you can be. Psychological Science 23, 1 (2012), 69--76.Google ScholarCross Ref
- Rigby, C.S. and R.M. Ryan, The Player Experience of Need Satisfaction (PENS) Model. Immersyve Inc. 2007.Google Scholar
- Rollings, A. and E. Adams, Andrew Rollings and Ernest Adams on game design. New Riders. 2003. Google ScholarDigital Library
- Ryan, R.M., C.S. Rigby, and A.K. Przybylski, The Motivational Pull of Video Games: A SelfDetermination Theory Approach. Motivation and Emotion 30, 4 (2006), 344--360.Google ScholarCross Ref
- Schreier, J. Metacritic Matters: How Review Scores Hurt Video Games. 2013, Available from: http://kotaku.com/metacritic-matters-how-reviewscores-hurt-video-games-472462218.Google Scholar
- Situmeang, F.B.I., M.A.A.M. Leenders, and N.M. Wijnberg, History matters: The impact of reviews and sales of earlier versions of a product on consumer and expert reviews of new editions. European Management Journal 32, 1 (2014), 73--83.Google ScholarCross Ref
- Tamborini, R., et al., Defining media enjoyment as the satisfaction of intrinsic needs. Journal of Communication 60, 4 (2010), 758--777.Google ScholarCross Ref
- Totilo, S. Low Metacritic scores cause game publishers to withhold developer royalties. 2008, Available from: http://multiplayerblog.mtv.com/2008/05/29/lowmetacritic-costs-developers/.Google Scholar
- Vella, K., D. Johnson, and L. Hides. Positively playful: when videogames lead to player wellbeing. In First International Conference on Gameful Design, Research and Applications 2013, ACM press (2013). Google ScholarDigital Library
- Wang, L.C. and M.P. Chen, The effects of game strategy and preferencematching on flow experience and programming performance in gamebased learning. Innovations in Education and Teaching International 47, 1 (2010), 39--52.Google ScholarCross Ref
- Wiebe, E.N., et al., Measuring engagement in video game-based environments: Investigation of the User Engagement Scale. Computers in Human Behavior 32, (2014), 123--132. Google ScholarDigital Library
- Wingfield, N. High scores matter to game makers, too. The Wall Street Journal, 2007.Google Scholar
Index Terms
- The edge of glory: the relationship between metacritic scores and player experience
Recommendations
Playing Alone, Playing With Others: Differences in Player Experience and Indicators of Wellbeing
CHI PLAY '15: Proceedings of the 2015 Annual Symposium on Computer-Human Interaction in PlayVideo game play is becoming an increasingly social experience, yet we have little understanding of how social and solitary modes of play differ in terms of the player experience or interact with player wellbeing. An online survey (n = 446) collected ...
The Convergence of Player Experience Questionnaires
CHI PLAY '16: Proceedings of the 2016 Annual Symposium on Computer-Human Interaction in PlayPlayer experience is an important field of digital games research to understand how games influence players. A common way to directly measure players' reported experiences is through questionnaires. However, the large number of questionnaires currently ...
GameFlow and Player Experience Measures: An Initial Comparison of Conceptual Constructs
OzCHI '19: Proceedings of the 31st Australian Conference on Human-Computer-InteractionGameFlow is a widely used model of player enjoyment, which has been applied to designing and evaluating many games and gamelike experiences since its first publication. Although GameFlow has been used as a basis for many surveys, no formal ...
Comments