skip to main content
research-article

Community Engagement Triage: Lightweight Prompts for Systematic Reviews

Published:06 December 2017Publication History
Skip Abstract Section

Abstract

Among platform designers there is still little actionable knowledge about how to foster community engagement, and new community platforms are likely to fail. Much research has documented effects that could inform better designs, however there is a lack of practical methods to review particular concerns. We design a lightweight method for systematic reviews of community engagement scenarios, based on a catalogue of 59 techniques, presented in the form of method cards, and co-developed with community engagement experts. We validate it in problem-solving workshops with organisers, and find that a full review is feasible in under 15 minutes, that it provides effective prompts and important guidance, and can successfully support process innovation. Finally, we validate it for use in summative evaluations of online communities. In a large-scale observational study of 1 million Flickr users, application of the method reveals the surprising impact of a major site redesign: it successfully increased content engagement, but at the expense of social interactions.

References

  1. Charles Abraham and Susan Michie. 2008. A taxonomy of behavior change techniques used in interventions. Health psychology, Vol. 27, 3 (2008), 379.Google ScholarGoogle Scholar
  2. Luca Maria Aiello. 2015. Group Types in Social Media. User Community Discovery, bibfieldeditorGeorgios Paliouras, Symeon Papadopoulos, Dimitrios Vogiatzis, and Yiannis Kompatsiaris (Eds.). Springer International Publishing, Chapter 5, 97--134.Google ScholarGoogle Scholar
  3. Maria Antikainen, Marko M"akip"a"a, and Mikko Ahonen. 2010. Motivating and supporting collaboration in open innovation. European Journal of Innovation Management Vol. 13, 1 (2010), 100--119.Google ScholarGoogle Scholar
  4. Jaime Arguello, Brian S Butler, Elisabeth Joyce, Robert Kraut, Kimberly S Ling, Carolyn Rosé, and Xiaoqing Wang. 2006. Talk to me: foundations for successful individual-group interactions in online communities. In Proc. SIGCHI '06. ACM, 959--968. Google ScholarGoogle ScholarDigital LibraryDigital Library
  5. Albert-László Barabási and Réka Albert. 1999. Emergence of scaling in random networks. science, Vol. 286, 5439 (1999), 509--512.Google ScholarGoogle Scholar
  6. Jonathan Bishop. 2007. Increasing participation in online communities: A framework for human-computer interaction. Computers in human behavior Vol. 23, 4 (2007), 1881--1893. Google ScholarGoogle ScholarDigital LibraryDigital Library
  7. Martin Boeker, Werner Vach, and Edith Motschall. 2013. Google Scholar as replacement for systematic literature searches. BMC medical research methodology Vol. 13, 1 (2013), 1.Google ScholarGoogle Scholar
  8. Wichor M Bramer, Dean Giustini, Bianca MR Kramer, and PF Anderson. 2013. The comparative recall of Google Scholar versus PubMed in identical searches for biomedical systematic reviews: a review of searches used in systematic reviews. Systematic reviews, Vol. 2, 1 (2013), 1.Google ScholarGoogle Scholar
  9. E Gil Clary, Mark Snyder, Robert D Ridge, John Copeland, Arthur A Stukas, Julie Haugen, and Peter Miene. 1998. Understanding and assessing the motivations of volunteers: a functional approach. Journal of personality and social psychology, Vol. 74, 6 (1998), 1516.Google ScholarGoogle ScholarCross RefCross Ref
  10. Dan Cosley, Dan Frankowski, Sara Kiesler, Loren Terveen, and John Riedl. 2005. How oversight improves member-maintained communities Proc. SIGCHI '05. ACM, 11--20. Google ScholarGoogle ScholarDigital LibraryDigital Library
  11. Nicolas Ducheneaut, Nicholas Yee, Eric Nickell, and Robert J Moore. 2007. The life and death of online gaming communities: a look at guilds in world of warcraft Proc. SIGCHI '07. ACM, 839--848. Google ScholarGoogle ScholarDigital LibraryDigital Library
  12. Andrea Forte and Cliff Lampe. 2013. Defining, understanding, and supporting open collaboration lessons from the literature. American Behavioral Scientist Vol. 57, 5 (2013), 535--547.Google ScholarGoogle ScholarCross RefCross Ref
  13. Gartner. 2012. Organizations That Integrate Communities Into Customer Support Can Realize Cost Reductions of Up to 50 Percent. (2012). http://www.gartner.com/newsroom/id/1929014Google ScholarGoogle Scholar
  14. Jean-Franccois Gehanno, Laetitia Rollin, and Stefan Darmoni. 2013. Is the coverage of Google Scholar enough to be used alone for systematic reviews. BMC medical informatics and decision making, Vol. 13, 1 (2013), 1.Google ScholarGoogle Scholar
  15. Mordechai Muki Haklay. 2016. Why is participation inequality important? European Handbook of Crowdsourced Geographic Information (2016), 35--44.Google ScholarGoogle Scholar
  16. Hahrie Han. 2014. How organizations develop activists: Civic associations and leadership in the 21st century. Oxford University Press, USA.Google ScholarGoogle Scholar
  17. Caroline Haythornthwaite. 2007. Social networks and online community. The Oxford handbook of Internet psychology (2007), 121--137.Google ScholarGoogle Scholar
  18. Quy Huy and Andrew Shipilov. 2015. The Key to Social Media Success Within Organizations. (2015). http://sloanreview.mit.edu/article/the-key-to-social-media-success-within-organizations/Google ScholarGoogle Scholar
  19. IDEO. 2003. method cards: 51 ways to inspire design. Palo Alto (2003).Google ScholarGoogle Scholar
  20. Gerjo Kok, Nell H Gottlieb, Gjalt-Jorn Y Peters, Patricia Dolan Mullen, Guy S Parcel, Robert AC Ruiter, María E Fernández, Christine Markham, and L Kay Bartholomew. 2015. A taxonomy of behaviour change methods: an intervention mapping approach. Health psychology review (2015), 1--16.Google ScholarGoogle Scholar
  21. Julia Kramer, Shanna R Daly, Seda Yilmaz, and Colleen M Seifert. 2014. A case-study analysis of design heuristics in an upper-level cross-disciplinary design course. (2014).Google ScholarGoogle Scholar
  22. Robert Kraut, Sara Kiesler, Bonka Boneva, Jonathon Cummings, Vicki Helgeson, and Anne Crawford. 2002. Internet paradox revisited. Journal of social issues Vol. 58, 1 (2002), 49--74.Google ScholarGoogle ScholarCross RefCross Ref
  23. Robert E Kraut. 2003. Applying social psychological theory to the problems of group work. HCI models, theories and frameworks: Toward a multidisciplinary science (2003), 325--356.Google ScholarGoogle Scholar
  24. Robert E Kraut, Paul Resnick, Sara Kiesler, Moira Burke, Yan Chen, Niki Kittur, Joseph Konstan, Yuqing Ren, and John Riedl. 2012. Building successful online communities: Evidence-based social design. MIT Press. Google ScholarGoogle ScholarDigital LibraryDigital Library
  25. Karel Kreijns, Paul A Kirschner, and Wim Jochems. 2003. Identifying the pitfalls for social interaction in computer-supported collaborative learning environments: a review of the research. Computers in human behavior Vol. 19, 3 (2003), 335--353.Google ScholarGoogle ScholarCross RefCross Ref
  26. Cliff Lampe, Rick Wash, Alcides Velasquez, and Elif Ozkaya. 2010. Motivations to participate in online communities. Proc. SIGCHI '10. ACM, 1927--1936. Google ScholarGoogle ScholarDigital LibraryDigital Library
  27. Roz Lasker and Elisa Weiss. 2003. Broadening participation in community problem solving: a multidisciplinary model to support collaborative practice and research. Journal of Urban Health Vol. 80, 1 (2003).Google ScholarGoogle ScholarCross RefCross Ref
  28. Charlene Li. 2015. Why No One Uses the Corporate Social Network. (2015). https://hbr.org/2015/04/why-no-one-uses-the-corporate-social-networkGoogle ScholarGoogle Scholar
  29. Chris Luebkeman. 2009. Drivers of change. Appropriate Technology Vol. 36, 4 (2009), 67.Google ScholarGoogle Scholar
  30. Lynne C Manzo and Douglas D Perkins. 2006. Finding common ground: The importance of place attachment to community participation and planning. Journal of planning literature Vol. 20, 4 (2006), 335--350.Google ScholarGoogle ScholarCross RefCross Ref
  31. Cameron Marlow. 2004. Audience, structure and authority in the weblog community International Communication Association Conference, Vol. Vol. 27.Google ScholarGoogle Scholar
  32. Susan Michie, Michelle Richardson, Marie Johnston, Charles Abraham, Jill Francis, Wendy Hardeman, Martin Eccles, James Cane, and Caroline Wood. 2013. The behavior change technique taxonomy (v1) of 93 hierarchically clustered techniques. Annals of Behavioral Medicine Vol. 46, 1 (2013).Google ScholarGoogle ScholarCross RefCross Ref
  33. Susan Michie, Maartje M van Stralen, and Robert West. 2011. The behaviour change wheel: a new method for characterising and designing behaviour change interventions. Implementation Science Vol. 6, 1 (2011), 1.Google ScholarGoogle ScholarCross RefCross Ref
  34. Michael Muller. 2012. Lurking as personal trait or situational disposition: lurking and contributing in enterprise social media. In Proc. CSCW '12. ACM. Google ScholarGoogle ScholarDigital LibraryDigital Library
  35. Michael Muller, N Sadat Shami, David R Millen, and Jonathan Feinberg. 2010. We are all lurkers: consuming behaviors among authors and readers in an enterprise file-sharing service. In Proc. GROUP '10. ACM. Google ScholarGoogle ScholarDigital LibraryDigital Library
  36. MyLife. 2013. Top 10 Failed Social Media Sites. (2013). https://www.mylife.com/blog/uncategorized/failed-social-media-sites/Google ScholarGoogle Scholar
  37. Oded Nov. 2007. What motivates Wikipedians? Commun. ACM Vol. 50, 11 (2007), 60--64. Google ScholarGoogle ScholarDigital LibraryDigital Library
  38. Jennifer Preece and Ben Shneiderman. 2009. The reader-to-leader framework: Motivating technology-mediated social participation. AIS Transactions on HCI Vol. 1, 1 (2009), 13--32.Google ScholarGoogle Scholar
  39. Paul G Schervish and John J Havens. 1997. Social participation and charitable giving: a multivariate analysis. Voluntas: International Journal of Voluntary and Nonprofit Organizations, Vol. 8, 3 (1997), 235--260.Google ScholarGoogle ScholarCross RefCross Ref
  40. P Wesley Schultz, Stuart Oskamp, and Tina Mainieri. 1995. Who recycles and when? A review of personal and situational factors. Journal of environmental psychology Vol. 15, 2 (1995), 105--121.Google ScholarGoogle ScholarCross RefCross Ref
  41. John Wilson. 2000. Volunteering. Annual review of sociology (2000), 215--240.Google ScholarGoogle Scholar
  42. Christiane Wölfel and Timothy Merritt. 2013. Method card design dimensions: a survey of card-based design tools IFIP Conference on Human-Computer Interaction. Springer, 479--486.Google ScholarGoogle Scholar
  43. Kath Wright, Su Golder, and Rocio Rodriguez-Lopez. 2014. Citation searching: a systematic review case study of multiple risk behaviour interventions. BMC medical research methodology Vol. 14, 1 (2014), 1.Google ScholarGoogle Scholar

Index Terms

  1. Community Engagement Triage: Lightweight Prompts for Systematic Reviews

        Recommendations

        Comments

        Login options

        Check if you have access through your login credentials or your institution to get full access on this article.

        Sign in

        Full Access

        • Published in

          cover image Proceedings of the ACM on Human-Computer Interaction
          Proceedings of the ACM on Human-Computer Interaction  Volume 1, Issue CSCW
          November 2017
          2095 pages
          EISSN:2573-0142
          DOI:10.1145/3171581
          Issue’s Table of Contents

          Copyright © 2017 ACM

          Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

          Publisher

          Association for Computing Machinery

          New York, NY, United States

          Publication History

          • Published: 6 December 2017
          Published in pacmhci Volume 1, Issue CSCW

          Permissions

          Request permissions about this article.

          Request Permissions

          Check for updates

          Qualifiers

          • research-article

        PDF Format

        View or Download as a PDF file.

        PDF

        eReader

        View online with eReader.

        eReader