WhatFutures: Designing Large-Scale Engagements on WhatsApp

ABSTRACT

WhatsApp, as the world's most popular messaging application, offers significant opportunities for improving the reach and effectiveness of engagement projects. In collaboration with the International Federation of Red Cross and Red Crescent Societies (IFRC) we designed WhatFutures, a collaborative future forecasting engagement for global youth using WhatsApp. WhatFutures was successfully deployed with 487 players across 5 countries (Kenya, Bulgaria, Finland, Australia and Hong Kong) to inform strategic change within the IFRC. Based on our analysis of the activity - including 16,100 messages, 95 multimedia artifacts, and a post-engagement survey - we present a reflection upon the design decisions underpinning WhatFutures and identify how decisions made around group structures, processes and externalization of outputs influenced engagement and data quality. We conclude with the wider implications of our findings for the design of engagements that best utilize the affordances of existing messaging applications.

References

1. Amazon. 2018. Amazon Comprehend. https://aws.amazon.com/comprehend/
2. Michael Baker, Université Lumiè re Lyon F, Richard Joiner, and David Traum. 1999. The Role of Grounding in Collaborative Learning Tasks. Collaborative learning: Cognitive and computational approaches (1999), 63.
3. J Biggs and K. F. Collis. 1982. Evaluating the Quality of Learning: The SOLO Taxonomy. 13 pages.
4. Elizabeth Bonsignore, Vicki Moulder, Carman Neustaedter, Derek Hansen, Kari Kraus, and Allison Druin. 2014. Design Tactics for Authentic Interactive Fiction: Insights from Alternate Reality Game Designers. Proceedings of the 32nd annual ACM conference on Human factors in computing systems - CHI '14 February 2016 (2014), 947--950.
5. Dan Bouhnik and Mor Deshen. 2014. WhatsApp Goes to School: Mobile Instant Messaging between Teachers and Students. Journal of Information Technology Education: Research, Vol. 13 (2014), 217--231.
6. Hanna Celina, Clement Lee, Patrick Olivier, and Ahmed Kharrufa. 2018. LearningCircle. io : Lessons Learned from Organising Courses with and without a Dedicated Platform. The Learning Circle platform : from idea to implementation .
7. Justin Cheng and Michael S Bernstein. 2014. Catalyst: Triggering Collective Action with Thresholds. Proceedings of the 17th ACM Conference on Computer Supported Cooperative Work & Social Computing (CSCW '14) (2014), 1211--1221.
8. Henry Chesbrough, Wim Vanhaverbeke, and Joel West. 2006. Open Innovation: Researching a New Paradigm. 373 pages.
9. Elizabeth G Cohen and Rachel A. Lotan. 2014. Designing groupwork: Strategies for the heterogeneous classroom. Vol. 2nd. Teachers College Press, NY. 202 pages.
10. D.L. De Vries and R.E. Slavin. 1978. Teams-Games-Tournaments (TGT): Review of Ten Classroom Experiments. Journal of Research and Development in Education,, Vol. 12(1) (1978), 28--38.
11. Sebastian Deterding, Dan Dixon, Rilla Khaled, and Lennart Nacke. 2011. From game design elements to gamefulness. Proceedings of the 15th International Academic MindTrek Conference on Envisioning Future Media Environments - MindTrek '11 (2011), 9--11. arxiv: ACM 978--1--4503-0816--8/11/09
12. Oswald Devisch, Alenka Poplin, and Simona Sofronie. 2016. The Gamification of Civic Participation: Two Experiments in Improving the Skills of Citizens to Reflect Collectively on Spatial Issues. Journal of Urban Technology, Vol. 732, June (2016), 1--22.
13. Andrea Forte, Niki Kittur, Vanessa Larco, and H Zhu. 2012. Coordination and beyond: social functions of groups in open content production. Proceedings of the ACM 2012 conference on Computer Supported Cooperative Work (2012), 417--426.
14. Rosemary Garris and Robert Ahlers. 2002. Games, Motivation, and Learning: A Research and Practice Model. Simulation and Gaming, Vol. 33, 4 (2002), 441--467.
15. James Paul Gee. 2003. What video games have to teach us about learning and literacy. Computers in Entertainment, Vol. 1, 1 (2003), 20.
16. Eric Gordon and Jessica Baldwin-Philippi. 2014. Playful civic learning: Enabling reflection and lateral trust in game-based public participation. International Journal of Communication, Vol. 8, 1 (2014), 759--786.
17. Eric Gordon, Stephen Walter, and Pablo Suarez. 2016. Engagement Games: a case for designing games to facilliate real-world action ., bibinfonumpages27 pages.
18. Hellmann's. {n. d.}. WhatsCook. http://cubo.cc/whatscook/
19. Nassim JafariNaimi and Eric M Meyers. 2015. Collective Intelligence or Group Think? Engaging Participation Patterns in World without Oil. Proceedings of the 18th ACM Conference on Computer Supported Cooperative Work & Social Computing - CSCW '15 (2015), 1872--1881.
20. N JafariNaimi, E M Meyers, and A Trumble. 2014. Designing meaningful participation: Analyzing contribution patterns in an alternate reality game. Proceedings of the International ACM SIGGROUP Conference on Supporting Group Work (2014), 306--309.
21. Jesse Schell. 2014. The Art of Game Design: A book of lenses .AK Peters/CRC Press.
22. David W. Johnson and Roger T. Johnson. 1999. Making cooperative learning work. Theory Into Practice, Vol. 38, 2 (1999), 67--73.
23. Paul Kariuki and Lizzy Oluwatoyin Ofusori. 2017. WhatsApp-Operated Stokvels Promoting Youth Entrepreneurship in Durban, South Africa. Proceedings of the 10th International Conference on Theory and Practice of Electronic Governance - ICEGOV '17 (2017), 253--259.
24. Jeffrey Y Kim, Jonathan P Allen, and Elan Lee. 2008. ALTERNATE REALITY GAMING. (cover story). Commun. ACM, Vol. 51, 2 (2008), 36--42.
25. Sunyoung Kim, Jennifer Mankoff, and Eric Paulos. 2013. Sensr. Proceedings of the 2013 conference on Computer supported cooperative work - CSCW '13 (2013), 1453.
26. Aniket Kittur. 2010. Crowdsourcing, collaboration and creativity. XRDS: Crossroads, The ACM Magazine for Students, Vol. 17, 2 (2010), 22.
27. a Kittur, J Nickerson, and M Bernstein. 2013. The Future of Crowd Work. Proc. CSCW '13 (2013), 1--17.
28. Shirlee-Ann Knight and Janice Burn. 2005. Developing a framework for assessing information quality on the World Wide Web. Informing Science Journal, Vol. 8, 3 (2005), 159 -- 172.
29. Edith Law, Andrea Wiggins, Mary L Gray, and Alex Williams. 2017. Crowdsourcing as a Tool for Research : Implications of Uncertainty. (2017), 1544--1561.
30. Haley MacLeod, Ben Jelen, Annu Prabhakar, Lora Oehlberg, Katie Siek, and Kay Connelly. 2017. Asynchronous Remote Communities (ARC) for Researching Distributed Populations. EAI Endorsed Transactions on Pervasive Health and Technology, Vol. 3, 11 (2017), 152898.
31. Haley MacLeod, Kim Oakes, Danika Geisler, Kay Connelly, and Katie Siek. 2015. Rare World: Towards Technology for Rare Diseases. Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems - CHI '15 (2015), 1145--1154.
32. Juan F Maestre, Haley Macleod, Ciabhan L Connelly, Julia C Dunbar, Jordan Beck, Katie A Siek, and Patrick C Shih. 2018. Defining Through Expansion : Conducting Asynchronous Remote Communities ( ARC ) Research with Stigmatized Groups. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems - CHI'18 (2018), 1--13.
33. Jane McGonigal. 2011. Reality is broken: Why games make us better and how they can change the world. (2011).
34. D. L. Morgan. 1997. Focus Groups as Qualitative Research. Sage Publications (1997), 32--46.
35. Lizzy Oluwatoyin Ofusori and Paul Kariuki. 2017. The Power of WhatsApp as a Communication Tool for Elections Observation and Monitoring in KwaZulu-Natal. Proceedings of the 10th International Conference on Theory and Practice of Electronic Governance - ICEGOV '17 (2017), 536--537.
36. Tamara Peyton, Alyson L. Young, and Wayne Lutters. 2013. Playing with leadership and expertise. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems - CHI '13 (2013), 715.
37. Yusuf Pisan. 2007. My guild, my people: role of guilds in massively multiplayer online games. Proceedings of the 4th Australasian conference on Interactive entertainment (2007), 20. http://portal.acm.org/citation.cfm?id=1367976
38. Annu Sible Prabhakar, Lucia Guerra-Reyes, Vanessa M. Kleinschmidt, Ben Jelen, Haley MacLeod, Kay Connelly, and Katie A. Siek. 2017. Investigating the Suitability of the Asynchronous, Remote, Community-based Method for Pregnant and New Mothers. Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems - CHI '17 (2017), 4924--4934.
39. Pybossa. 2018. Pybossa. https://pybossa.com/
40. Katharina Reinecke, Ann Arbor, and Krzysztof Z Gajos. 2015. LabintheWild : Conducting Large-Scale Online Experiments With Uncompensated Samples. Cscw (2015), 1364--1378.
41. Daniela Retelny, Sé bastien Robaszkiewicz, Alexandra To, Walter S. Lasecki, Jay Patel, Negar Rahmati, Tulsee Doshi, Melissa Valentine, and Michael S. Bernstein. 2014. Expert crowdsourcing with flash teams. In Proceedings of the 27th annual ACM symposium on User interface software and technology - UIST '14. 75--85.
42. Katie Salen. 1995. The Ecology of Games. Communication Theory, Vol. 13, 3 (1995).
43. Katie Salen and Eric Zimmerman. 2003. Rules of Play: Game Design Fundamentals. MIT Press, Vol. 2004 (2003), 688.
44. AF Seay, William J Jerome, Kevin Sang Lee, and Robert E Kraut. 2004. Project Massive: A Study of Online Gaming Communities. Extended abstracts of the 2004 conference on Human factors and computing systems - CHI '04 (2004), 1421.
45. Ethan Seltzer and Dillon Mahmoudi. 2013. Citizen Participation, Open Innovation, and Crowdsourcing: Challenges and Opportunities for Planning. Journal of Planning Literature, Vol. 28, 1 (2013), 3--18.
46. Amy Soller. 2007. Supporting Social Interaction in an Intelligent Collaborative Learning System. International Journal of Artificial Intelligence in Education, Vol. 12 (2007), 40--62.
47. Statista. {n. d.}. Most Popular Mobile Messaging Apps Worldwide. https://www.statista.com/statistics/258749/most-popular-global-mobile-messenger-apps/
48. Besiki Stvilia, Les Gasser, Michael B. Twidale, and Linda C. Smith. 2007. A framework for information quality assessment. Journal of the American Society for Information Science and TechnologyJASIST, Vol. 58, 12 (2007), 1720--1733.
49. Ajay Sura. {n. d.}. In a first, court to send summons via WhatsApp. https://timesofindia.indiatimes.com/city/chandigarh/in-a-first-court-to-send-summons-via-whatsapp/articleshow/58074835.cms
50. K Toyama. 2011. Technology as amplifier in international development. Proceedings of the 2011 iConference on - iConference '11 (2011), 75--82.
51. Zach Waggoner. 2009. My avatar, my self : identity in video role-playing games. McFarland & Company, Jefferson. 201 pages.
52. Alyson Young, Tamara Peyton, and Wayne Lutters. 2013. Understanding Situated Action in Ludic Ecologies. Proc. Intl. Conf. on Communities and Technologies (C&T) (2013), 100--109.

Index Terms

• Human-centered computing

  • Collaborative and social computing

    • Collaborative and social computing theory, concepts and paradigms

      • Collaborative content creation