The amount of knowledge and talent dispersed among the human race has always outstripped our capacity to harness it. Crowdsourcing corrects thatbut in doing so, it also unleashes the forces of creative destruction. From CrowdsourcingFirst identified by journalist Jeff Howe in a June 2006 Wired article, crowdsourcing describes the process by which the power of the many can be leveraged to accomplish feats that were once the province of the specialized few. Howe reveals that the crowd is more than wiseits talented, creative, and stunningly productive. Crowdsourcing activates the transformative power of todays technology, liberating the latent potential within us all. Its a perfect meritocracy, where age, gender, race, education, and job history no longer matter; the quality of work is all that counts; and every field is open to people of every imaginable background. If you can perform the service, design the product, or solve the problem, youve got the job.But crowdsourcing has also triggered a dramatic shift in the way work is organized, talent is employed, research is conducted, and products are made and marketed. As the crowd comes to supplant traditional forms of labor, pain and disruption are inevitable. Jeff Howe delves into both the positive and negative consequences of this intriguing phenomenon. Through extensive reporting from the front lines of this revolution, he employs a brilliant array of stories to look at the economic, cultural, business, and political implications of crowdsourcing. How were a bunch of part-time dabblers in finance able to help an investment company consistently beat the market? Why does Procter & Gamble repeatedly call on enthusiastic amateurs to solve scientific and technical challenges? How can companies as diverse as iStockphoto and Threadless employ just a handful of people, yet generate millions of dollars in revenue every year? The answers lie within these pages. The blueprint for crowdsourcing originated from a handful of computer programmers who showed that a community of like-minded peers could create better products than a corporate behemoth like Microsoft. Jeff Howe tracks the amazing migration of this new model of production, showing the potential of the Internet to create human networks that can divvy up and make quick work of otherwise overwhelming tasks. One of the most intriguing ideas of Crowdsourcing is that the knowledge to solve intractable problemsa cure for cancer, for instancemay already exist within the warp and weave of this infinite and, as yet, largely untapped resource. But first, Howe proposes, we need to banish preconceived notions of how such problems are solved. The very concept of crowdsourcing stands at odds with centuries of practice. Yet, for the digital natives soon to enter the workforce, the technologies and principles behind crowdsourcing are perfectly intuitive. This generation collaborates, shares, remixes, and creates with a fluency and ease the rest of us can hardly understand. Crowdsourcing, just now starting to emerge, will in a short time simply be the way things are done.
Cited By
- Yang Y, Zhao Z, Wu G, Zhuo X, Liu Q, Bai Q and Li W (2023). A Lightweight, Effective, and Efficient Model for Label Aggregation in Crowdsourcing, ACM Transactions on Knowledge Discovery from Data, 18:4, (1-27), Online publication date: 31-May-2024.
- Santos C, Baldi A, de Assis Neto F and Barcellos M (2023). Essential elements, conceptual foundations and workflow design in crowd-powered projects, Journal of Information Science, 49:6, (1546-1569), Online publication date: 1-Dec-2023.
- Luo Y Incentivizing Sequential Crowdsourcing Systems Proceedings of the 2023 International Conference on Autonomous Agents and Multiagent Systems, (2697-2699)
- Tsvetkova M, Müller S, Vuculescu O, Ham H and Sergeev R (2022). Relative Feedback Increases Disparities in Effort and Performance in Crowdsourcing Contests, Proceedings of the ACM on Human-Computer Interaction, 6:CSCW2, (1-27), Online publication date: 7-Nov-2022.
- Sarv L and Soe R Piloting Smart City Solutions in Very Small, Small and Medium-sized Municipalities. The Estonian case study. Proceedings of the 15th International Conference on Theory and Practice of Electronic Governance, (475-482)
- Huang P, Ceccagnoli M, Forman C and Wu D (2022). IT Knowledge Spillovers, Absorptive Capacity, and Productivity, Information Systems Research, 33:3, (908-934), Online publication date: 1-Sep-2022.
- Bernardino S, Santos J and Silva R (2022). Does Gender Really Matter in Crowdfunding Campaigns?, International Journal of E-Entrepreneurship and Innovation, 12:1, (1-21), Online publication date: 29-Jun-2022.
- Liu G Value Creation and Value Acquisition Under Open Innovation--Theoretical Review and Future Research Directions Digital Human Modeling and Applications in Health, Safety, Ergonomics and Risk Management. Health, Operations Management, and Design, (376-390)
- Wang M (2022). Encouraging solvers to sustain participation intention on crowdsourcing platforms: an investigation of social beliefs, Information Technology and Management, 23:1, (39-50), Online publication date: 1-Mar-2022.
- Chou S (2021). Understanding crowdsourcing adoption based on IT managers’ decision, Information Technology and Management, 22:4, (245-263), Online publication date: 1-Dec-2021.
- Glazer J, Kremer I and Perry M (2021). The Wisdom of the Crowd When Acquiring Information Is Costly, Management Science, 67:10, (6443-6456), Online publication date: 1-Oct-2021.
- Rozas D, Saldivar J and Zelickson E The platform belongs to those who work on it! Co-designing worker-centric task distribution models Proceedings of the 17th International Symposium on Open Collaboration, (1-12)
- Haug S, Rietz T and Maedche A Accelerating Deductive Coding of Qualitative Data: An Experimental Study on the Applicability of Crowdsourcing Proceedings of Mensch und Computer 2021, (432-443)
- Machado L, Melo R, de Souza C and Prikladnicki R (2021). Collaborative Behavior and Winning Challenges in Competitive Software Crowdsourcing, Proceedings of the ACM on Human-Computer Interaction, 5:GROUP, (1-25), Online publication date: 8-Jul-2021.
- Matviienko A, Heller F and Pfleging B Quantified Cycling Safety: Towards a Mobile Sensing Platform to Understand Perceived Safety of Cyclists Extended Abstracts of the 2021 CHI Conference on Human Factors in Computing Systems, (1-6)
- Seetharaman B, Pal J and Hui J (2021). Delivery Work and the Experience of Social Isolation, Proceedings of the ACM on Human-Computer Interaction, 5:CSCW1, (1-17), Online publication date: 13-Apr-2021.
- Guo C, Kim T, Susarla A and Sambamurthy V (2020). Understanding Content Contribution Behavior in a Geosegmented Mobile Virtual Community, Information Systems Research, 31:4, (1398-1420), Online publication date: 1-Dec-2020.
- Zheng H, Qi Z, Luo X, Li L and Xu B (2018). The value of backers’ word-of-mouth in crowdfunding projects filtering: an empirical investigation, Electronic Commerce Research, 20:4, (757-782), Online publication date: 1-Dec-2020.
- Geng S, Huang M and Wang Z A Swarm Enhanced Light Gradient Boosting Machine for Crowdfunding Project Outcome Prediction Machine Learning for Cyber Security, (372-382)
- Lukyanenko R, Wiggins A and Rosser H (2019). Citizen Science: An Information Quality Research Frontier, Information Systems Frontiers, 22:4, (961-983), Online publication date: 1-Aug-2020.
- Machado L, Steinmacher I, Marczak S and de Souza C How Online Forums Complement Task Documentation in Software Crowdsourcing Proceedings of the IEEE/ACM 42nd International Conference on Software Engineering Workshops, (101-108)
- Bassi H, Lee C, Misener L and Johnson A (2020). Exploring the characteristics of crowdsourcing, Journal of Information Science, 46:3, (291-312), Online publication date: 1-Jun-2020.
- Xia H and McKernan B (2020). Privacy in Crowdsourcing: a Review of the Threats and Challenges, Computer Supported Cooperative Work, 29:3, (263-301), Online publication date: 1-Jun-2020.
- Hao L, Jia B, Liu J, Huang B and Li W VCG-QCP: A Reverse Pricing Mechanism Based on VCG and Quality All-pay for Collaborative Crowdsourcing 2020 IEEE Wireless Communications and Networking Conference (WCNC), (1-6)
- Davis K, Kangassalo L, Spapé M and Ruotsalo T Brainsourcing: Crowdsourcing Recognition Tasks via Collaborative Brain-Computer Interfacing Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems, (1-14)
- de Souza C, Machado L and Melo R (2020). On Moderating Software Crowdsourcing Challenges, Proceedings of the ACM on Human-Computer Interaction, 4:GROUP, (1-22), Online publication date: 4-Jan-2020.
- Shang K, Chan F, Karungaru S, Terada K, Feng Z, Ke L and Sayama H (2020). Two-Stage Robust Optimization for the Orienteering Problem with Stochastic Weights, Complexity, 2020, Online publication date: 1-Jan-2020.
- Lin Y, Ye Y and Yang Y Crowdsourcing-based Spectrum Monitoring at A Large Geographical Scale 2019 IEEE International Symposium on Dynamic Spectrum Access Networks (DySPAN), (1-10)
- Zhang X, Chen M and Ji G Factors influencing the crowd participation in knowledge-intensive crowdsourcing Proceedings of the 4th International Conference on Crowd Science and Engineering, (186-194)
- Hantke S, Olenyi T, Hausner C, Appel T and Schuller B (2019). Large-scale Data Collection and Analysis via a Gamified Intelligent Crowdsourcing Platform, International Journal of Automation and Computing, 16:4, (427-436), Online publication date: 1-Aug-2019.
- Wilkins D, Nuseibeh B and Levine M Monetize This? Marketized-Commons Platforms, New Opportunities and Challenges for Collective Action Human-Computer Interaction. Design Practice in Contemporary Societies, (130-147)
- Tavanapour N and Bittner E Human Collaboration on Crowdsourcing Platforms – a Content Analysis HCI in Business, Government and Organizations. Information Systems and Analytics, (443-458)
- Aihara K, Bin P and Imura H On the Relationship Between Accuracy of Bus Position Estimated by Crowdsourcing and Participation Density Distributed, Ambient and Pervasive Interactions, (101-112)
- Acer U, Broeck M, Forlivesi C, Heller F and Kawsar F (2019). Scaling Crowdsourcing with Mobile Workforce, Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies, 3:2, (1-32), Online publication date: 21-Jun-2019.
- Machado L, Melo R and de Souza C The role of platform moderators in software crowdsourcing projects Proceedings of the 12th International Workshop on Cooperative and Human Aspects of Software Engineering, (119-122)
- Li Y, I. P. Rubinstein B and Cohn T Truth Inference at Scale: A Bayesian Model for Adjudicating Highly Redundant Crowd Annotations The World Wide Web Conference, (1028-1038)
- Jian L, Yang S, Ba S, Lu L and Jiang L (2019). Managing the crowds, MIS Quarterly, 43:1, (97-112), Online publication date: 1-Mar-2019.
- Nagle F (2019). Open Source Software and Firm Productivity, Management Science, 65:3, (1191-1215), Online publication date: 1-Mar-2019.
- Niu X, Qin S, Vines J, Wong R and Lu H (2019). Key Crowdsourcing Technologies for Product Design and Development, International Journal of Automation and Computing, 16:1, (1-15), Online publication date: 1-Feb-2019.
- Mayer M (2018). Examining Community Dynamics of Civic Crowdfunding Participation, Computer Supported Cooperative Work, 27:3-6, (1137-1151), Online publication date: 1-Dec-2018.
- Vaz L, Marczak S and Steinmacher I An empirical study on task documentation in software crowdsourcing Proceedings of the XXXII Brazilian Symposium on Software Engineering, (62-71)
- Zhang Y, Cui L, Huang J and Miao C CrowdMerge Proceedings of the 3rd International Conference on Crowd Science and Engineering, (1-8)
- Aihara K, Bin P, Imura H, Takasu A and Tanaka Y Collecting Bus Locations by Users: A Crowdsourcing Model to Estimate Operation Status of Bus Transit Service Distributed, Ambient and Pervasive Interactions: Understanding Humans, (171-180)
- Assis Neto F and Santos C (2018). Understanding crowdsourcing projects, Information Processing and Management: an International Journal, 54:4, (490-506), Online publication date: 1-Jul-2018.
- Hedestig U, Skog D and Söderström M Co-producing public value through IoT and social media Proceedings of the 19th Annual International Conference on Digital Government Research: Governance in the Data Age, (1-10)
- Lin B Crowdsourced software development and maintenance Proceedings of the 40th International Conference on Software Engineering: Companion Proceeedings, (492-495)
- Wang H (2018). Harnessing the crowd wisdom for software trustworthiness, ACM SIGSOFT Software Engineering Notes, 43:1, (1-6), Online publication date: 28-Mar-2018.
- Eickhoff C Cognitive Biases in Crowdsourcing Proceedings of the Eleventh ACM International Conference on Web Search and Data Mining, (162-170)
- Aitamurto T and Saldivar J (2017). Motivating Participation in Crowdsourced Policymaking, Proceedings of the ACM on Human-Computer Interaction, 1:CSCW, (1-22), Online publication date: 6-Dec-2017.
- (2017). Till data do us part, Information and Organization, 27:4, (191-210), Online publication date: 1-Dec-2017.
- Barashev A and Li G Personal Trait Predicting Work Engagement in Crowdsourcing through Achievement Goals Proceedings of the 8th International Conference on E-business, Management and Economics, (28-32)
- Diakou C, Kokkinaki A and Kleanthous S A Methodological Approach Towards Crisis Simulations: Qualifying CI-Enabled Information Systems Computational Collective Intelligence, (569-578)
- Lepola A and Kärkkäinen H Using crowdfunding for extracting feedback Proceedings of the 21st International Academic Mindtrek Conference, (194-202)
- Wang W, Guo X, Li S, Jiang Y and Zhou Z Obtaining high-quality label by distinguishing between easy and hard items in crowdsourcing Proceedings of the 26th International Joint Conference on Artificial Intelligence, (2964-2970)
- Chang Y, Chen J, Cho M, Castaldi P, Silverman E and Dy J Multiple clustering views from multiple uncertain experts Proceedings of the 34th International Conference on Machine Learning - Volume 70, (674-683)
- Hsiao I and Lin Y (2017). Enriching programming content semantics, Computers in Human Behavior, 72:C, (771-782), Online publication date: 1-Jul-2017.
- Huang G and Quinn A BlueSky Proceedings of the 2017 ACM SIGCHI Conference on Creativity and Cognition, (119-130)
- Ren R and Yan B Crowd Diversity and Performance in Wikipedia Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems, (6342-6351)
- Alkhatib A, Bernstein M and Levi M Examining Crowd Work and Gig Work Through The Historical Lens of Piecework Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems, (4599-4616)
- Ciavarrini G, Luconi V and Vecchio A (2017). Smartphone-based geolocation of Internet hosts, Computer Networks: The International Journal of Computer and Telecommunications Networking, 116:C, (22-32), Online publication date: 7-Apr-2017.
- Alabduljabbar R and Al-Dossari H Towards a classification model for tasks in crowdsourcing Proceedings of the Second International Conference on Internet of things, Data and Cloud Computing, (1-7)
- Zhang J, Sheng V, Li Q, Wu J and Wu X (2017). Consensus algorithms for biased labeling in crowdsourcing, Information Sciences: an International Journal, 382:C, (254-273), Online publication date: 1-Mar-2017.
- Nikiforov A and Singireja A Open data and crowdsourcing perspectives for smart city in the United States and Russia Proceedings of the International Conference on Electronic Governance and Open Society: Challenges in Eurasia, (171-177)
- Bansal P, Eickhoff C and Hofmann T Active Content-Based Crowdsourcing Task Selection Proceedings of the 25th ACM International on Conference on Information and Knowledge Management, (529-538)
- Aitamurto T, Chen K, Cherif A, Galli J and Santana L Civic CrowdAnalytics Proceedings of the 20th International Academic Mindtrek Conference, (86-94)
- Ertiö T, Maunula G and Blomqvist K Crowdsourcing Proceedings of the 20th International Academic Mindtrek Conference, (460-461)
- Alabduljabbar R and Al-Dossari H A Task Ontology-based Model for Quality Control in Crowdsourcing Systems Proceedings of the International Conference on Research in Adaptive and Convergent Systems, (22-28)
- Clark B, Zingale N, Logan J and Brudney J (2016). A Framework for Using Crowdsourcing in Government, International Journal of Public Administration in the Digital Age, 3:4, (57-75), Online publication date: 1-Oct-2016.
- Janssen M, Zulfa A, Klievink B and de Reuver M (2016). A Synthesised Stage Model for Collaborative Public Service Platforms, International Journal of Public Administration in the Digital Age, 3:4, (10-27), Online publication date: 1-Oct-2016.
- Rodríguez C, Daniel F and Casati F (2016). Mining and Quality Assessment of Mashup Model Patterns with the Crowd, ACM Transactions on Internet Technology, 16:3, (1-27), Online publication date: 22-Aug-2016.
- Glinos M, Dahlberg S, Tselas N and Papapetrou P FindMyDoc Proceedings of the 9th ACM International Conference on PErvasive Technologies Related to Assistive Environments, (1-4)
- Riedl C, Zanibbi R, Hearst M, Zhu S, Menietti M, Crusan J, Metelsky I and Lakhani K (2016). Detecting figures and part labels in patents, International Journal on Document Analysis and Recognition, 19:2, (155-172), Online publication date: 1-Jun-2016.
- Quirino W, Santos C, Calles J and F. F Crowdsourcing strategies for smart cities applications Proceedings of the XII Brazilian Symposium on Information Systems on Brazilian Symposium on Information Systems: Information Systems in the Cloud Computing Era - Volume 1, (510-517)
- Pournajaf L, Garcia-Ulloa D, Xiong L and Sunderam V (2016). Participant Privacy in Mobile Crowd Sensing Task Management, ACM SIGMOD Record, 44:4, (23-34), Online publication date: 9-May-2016.
- Xie H, Lui J and Towsley D (2016). Design and Analysis of Incentive and Reputation Mechanisms for Online Crowdsourcing Systems, ACM Transactions on Modeling and Performance Evaluation of Computing Systems, 1:3, (1-27), Online publication date: 7-May-2016.
- Stephens B, Chen W and Butler J (2016). Bubbling Up the Good Ideas, Journal of Computer-Mediated Communication, 21:3, (210-229), Online publication date: 1-May-2016.
- Nik-Bakht M and El-Diraby T (2016). Sus-tweet-ability, International Journal of Human-Computer Studies, 89:C, (54-72), Online publication date: 1-May-2016.
- Mourelatos E and Tzagarakis M (2016). Investigating Factors Influencing the Quality of Crowdsourced Work under Different Incentives, International Journal of Innovation in the Digital Economy, 7:2, (15-31), Online publication date: 1-Apr-2016.
- Gregori E, Importa A, Lenzini L, Luconi V, Redini N and Vecchio A (2016). Smartphone-based crowdsourcing for estimating the bottleneck capacity in wireless networks, Journal of Network and Computer Applications, 64:C, (62-75), Online publication date: 1-Apr-2016.
- Ryu S and Kim Y (2016). A typology of crowdfunding sponsors, Electronic Commerce Research and Applications, 16:C, (43-54), Online publication date: 1-Mar-2016.
- Celis L, Reddy S, Singh I and Vaya S Assignment Techniques for Crowdsourcing Sensitive Tasks Proceedings of the 19th ACM Conference on Computer-Supported Cooperative Work & Social Computing, (836-847)
- Kucherbaev P, Daniel F, Tranquillini S and Marchese M ReLauncher Proceedings of the 19th ACM Conference on Computer-Supported Cooperative Work & Social Computing, (1609-1614)
- Kazai G and Zitouni I Quality Management in Crowdsourcing using Gold Judges Behavior Proceedings of the Ninth ACM International Conference on Web Search and Data Mining, (267-276)
- Nov O, Laut J and Porfiri M (2016). Using targeted design interventions to encourage extra-role crowdsourcing behavior, Journal of the Association for Information Science and Technology, 67:2, (483-489), Online publication date: 1-Feb-2016.
- Packham S and Suleman H Crowdsourcing a Text Corpus is not a Game Proceedings of the 17th International Conference on Asia-Pacific Digital Libraries - Volume 9469, (225-234)
- Keles I, Saltenis S and Jensen C Synthesis of partial rankings of points of interest using crowdsourcing Proceedings of the 9th Workshop on Geographic Information Retrieval, (1-10)
- Kumano S, Otsuka K, Mikami D, Matsuda M and Yamato J (2015). Analyzing Interpersonal Empathy via Collective Impressions, IEEE Transactions on Affective Computing, 6:4, (324-336), Online publication date: 1-Oct-2015.
- Cvijikj I, Kadar C, Ivan B and Te Y Towards a crowdsourcing approach for crime prevention Adjunct Proceedings of the 2015 ACM International Joint Conference on Pervasive and Ubiquitous Computing and Proceedings of the 2015 ACM International Symposium on Wearable Computers, (1367-1372)
- Lin Y, Trattner C, Brusilovsky P and He D (2015). The impact of image descriptions on user tagging behavior, Journal of the Association for Information Science and Technology, 66:9, (1785-1798), Online publication date: 1-Sep-2015.
- Tranquillini S, Daniel F, Kucherbaev P and Casati F BPMN Task Instance Streaming for Efficient Micro-task Crowdsourcing Processes Proceedings of the 13th International Conference on Business Process Management - Volume 9253, (333-349)
- Aihara K, Kono S and Sugino S Spending Precious Travel Time More Wisely Proceedings of the Third International Conference on Distributed, Ambient, and Pervasive Interactions - Volume 9189, (557-567)
- Bhadra S and Hein M (2015). Correction of noisy labels via mutual consistency check, Neurocomputing, 160:C, (34-52), Online publication date: 21-Jul-2015.
- Carreño P, Gutierrez F, Ochoa S and Fortino G (2015). Supporting personal security using participatory sensing, Concurrency and Computation: Practice & Experience, 27:10, (2531-2546), Online publication date: 1-Jul-2015.
- Tranquillini S, Daniel F, Kucherbaev P and Casati F (2015). Modeling, Enacting, and Integrating Custom Crowdsourcing Processes, ACM Transactions on the Web, 9:2, (1-43), Online publication date: 26-May-2015.
- LaToza T, Chen M, Jiang L, Zhao M and van der Hoek A Borrowing from the crowd Proceedings of the 37th International Conference on Software Engineering - Volume 1, (551-562)
- Harburg E, Kim Y, Gerber E and Zhang H CrowdFound Proceedings of the 33rd Annual ACM Conference Extended Abstracts on Human Factors in Computing Systems, (1537-1542)
- Anya O Bridge the Gap! Proceedings of the 18th ACM Conference on Computer Supported Cooperative Work & Social Computing, (612-627)
- Ye H and Kankanhalli A (2015). Investigating the antecedents of organizational task crowdsourcing, Information and Management, 52:1, (98-110), Online publication date: 1-Jan-2015.
- Hara T, Springer T, Muthmann K and Schill A Towards a Reusable Infrastructure for Crowdsourcing Proceedings of the 2014 IEEE/ACM 7th International Conference on Utility and Cloud Computing, (618-623)
- Loukis E, Charalabidis Y and Androutsopoulou A A Study of Multiple Social Media Use in the European Parliament from an Innovation Perspective Proceedings of the 18th Panhellenic Conference on Informatics, (1-6)
- Xie H and Lui J (2014). Modeling crowdsourcing systems, ACM SIGMETRICS Performance Evaluation Review, 42:2, (52-54), Online publication date: 4-Sep-2014.
- Cao C, Chen L and Jagadish H From labor to trader Proceedings of the 20th ACM SIGKDD international conference on Knowledge discovery and data mining, (1067-1076)
- Ramakrishnan S and Srinivasaraghavan V Delivering software projects using captive university crowd Proceedings of the 7th International Workshop on Cooperative and Human Aspects of Software Engineering, (115-118)
- Stol K and Fitzgerald B Two's company, three's a crowd: a case study of crowdsourcing software development Proceedings of the 36th International Conference on Software Engineering, (187-198)
- Cobb C, McCarthy T, Perkins A, Bharadwaj A, Comis J, Do B and Starbird K Designing for the deluge Proceedings of the 17th ACM conference on Computer supported cooperative work & social computing, (888-899)
- Jian L and Usher N (2014). Crowd-Funded Journalism, Journal of Computer-Mediated Communication, 19:2, (155-170), Online publication date: 1-Jan-2014.
- Carreño P, Gutierrez F, Ochoa S and Fortino G Using Human-Centric Wireless Sensor Networks to Support Personal Security Proceedings of the 6th International Conference on Internet and Distributed Computing Systems - Volume 8223, (51-64)
- Kazai G, Yilmaz E, Craswell N and Tahaghoghi S User intent and assessor disagreement in web search evaluation Proceedings of the 22nd ACM international conference on Information & Knowledge Management, (699-708)
- Seidel C, Thapa B, Plattfaut R and Niehaves B Selective crowdsourcing for open process innovation in the public sector Proceedings of the 7th International Conference on Theory and Practice of Electronic Governance, (64-72)
- Mortensen J Crowdsourcing Ontology Verification Proceedings of the 12th International Semantic Web Conference - Part II, (448-455)
- Hara T, Springer T, Bombach G and Schill A Decentralised approach for a reusable crowdsourcing platform utilising standard web servers Proceedings of the 2013 ACM conference on Pervasive and ubiquitous computing adjunct publication, (1063-1074)
- Uzun A, Lehmann L, Geismar T and Küpper A Turning the OpenMobileNetwork into a live crowdsourcing platform for semantic context-aware services Proceedings of the 9th International Conference on Semantic Systems, (89-96)
- McCreadie R, Macdonald C and Ounis I News vertical search Proceedings of the 36th international ACM SIGIR conference on Research and development in information retrieval, (253-262)
- Chitnis R, Hajiaghayi M, Katz J and Mukherjee K A game-theoretic model motivated by the darpa network challenge Proceedings of the twenty-fifth annual ACM symposium on Parallelism in algorithms and architectures, (115-118)
- Poblet M, García-Cuesta E and Casanovas P Crowdsourcing Tools for Disaster Management Revised Selected Papers of the AICOL 2013 International Workshops on AI Approaches to the Complexity of Legal Systems - Volume 8929, (261-274)
- Nakatsu R and Grossman E Designing effective user interfaces for crowdsourcing Proceedings of the 15th international conference on Human Interface and the Management of Information: information and interaction design - Volume Part I, (221-229)
- Bozzon A and Galli L An introduction to human computation and games with a purpose Proceedings of the 13th international conference on Web Engineering, (514-517)
- Sabou M, Scharl A and Föls M (2013). Crowdsourced Knowledge Acquisition, International Journal on Semantic Web & Information Systems, 9:3, (14-41), Online publication date: 1-Jul-2013.
- Spiegel O, Abbassi P, Schlagwein D and Fischbach K Going it all alone in web entrepreneurship? Proceedings of the 2013 annual conference on Computers and people research, (21-32)
- Basole R, Bodner D and Rouse W (2013). Healthcare management through organizational simulation, Decision Support Systems, 55:2, (552-563), Online publication date: 1-May-2013.
- Dow S, Gerber E and Wong A A pilot study of using crowds in the classroom Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, (227-236)
- Chircop L, Radhakrishnan J, Selener L and Chiu J Markitup CHI '13 Extended Abstracts on Human Factors in Computing Systems, (2567-2572)
- Kazai G, Kamps J and Milic-Frayling N (2013). An analysis of human factors and label accuracy in crowdsourcing relevance judgments, Information Retrieval, 16:2, (138-178), Online publication date: 1-Apr-2013.
- Hansen D, Schone P, Corey D, Reid M and Gehring J Quality control mechanisms for crowdsourcing Proceedings of the 2013 conference on Computer supported cooperative work, (649-660)
- Ei Chew H, Sort B and Haddawy P Building a crowdsourcing community Proceedings of the 3rd ACM Symposium on Computing for Development, (1-2)
- Bayus B (2013). Crowdsourcing New Product Ideas over Time, Management Science, 59:1, (226-244), Online publication date: 1-Jan-2013.
- Nath S, Dayama P, Garg D, Narahari Y and Zou J Mechanism design for time critical and cost critical task execution via crowdsourcing Proceedings of the 8th international conference on Internet and Network Economics, (212-226)
- Jiang H and Matsubara S Improving Crowdsourcing Efficiency Based on Division Strategy Proceedings of the The 2012 IEEE/WIC/ACM International Joint Conferences on Web Intelligence and Intelligent Agent Technology - Volume 02, (425-429)
- Pihlajaniemi H, Luusua A, Teirilä M, Österlund T and Tanska T Experiencing participatory and communicative urban lighting through LightStories Proceedings of the Media Architecture Biennale Conference: Participation, (65-74)
- Kazai G, Craswell N, Yilmaz E and Tahaghoghi S An analysis of systematic judging errors in information retrieval Proceedings of the 21st ACM international conference on Information and knowledge management, (105-114)
- Väätäjä H, Vainio T and Sirkkunen E Location-based crowdsourcing of hyperlocal news Proceedings of the 2012 ACM International Conference on Supporting Group Work, (85-94)
- Kärkkäinen H, Jussila J and Multasuo J Can crowdsourcing really be used in B2B innovation? Proceeding of the 16th International Academic MindTrek Conference, (134-141)
- Chambers C, Sommers Z and Scaffidi C (2012). A Study of Help Requested Online by Spreadsheet Users, Journal of Organizational and End User Computing, 24:4, (41-53), Online publication date: 1-Oct-2012.
- Sabou M, Bontcheva K and Scharl A Crowdsourcing research opportunities Proceedings of the 12th International Conference on Knowledge Management and Knowledge Technologies, (1-8)
- Garg D, Bhattacharya S, Sundararajan S and Shevade S Mechanism design for cost optimal PAC learning in the presence of strategic noisy annotators Proceedings of the Twenty-Eighth Conference on Uncertainty in Artificial Intelligence, (275-285)
- Yuen M, King I and Leung K Task recommendation in crowdsourcing systems Proceedings of the First International Workshop on Crowdsourcing and Data Mining, (22-26)
- Lanza V, Tilio L, Azzato A, Casas G and Pontrandolfi P From urban labs in the city to urban labs on the web Proceedings of the 12th international conference on Computational Science and Its Applications - Volume Part II, (686-698)
- Aparicio M, Costa C and Braga A Proposing a system to support crowdsourcing Proceedings of the Workshop on Open Source and Design of Communication, (13-17)
- Bonissone P Lazy meta-learning Proceedings of the 2012 World Congress conference on Advances in Computational Intelligence, (1-23)
- Erickson L, Petrick I and Trauth E Organizational uses of the crowd Proceedings of the 50th annual conference on Computers and People Research, (155-158)
- Erickson L Leveraging the crowd as a source of innovation Proceedings of the 50th annual conference on Computers and People Research, (91-96)
- Noble J Minority voices of crowdsourcing Proceedings of the ACM 2012 conference on Computer Supported Cooperative Work Companion, (179-182)
- Jafarinaimi N Exploring the character of participation in social media Proceedings of the 2012 iConference, (72-79)
- Hamilton M, Salim F, Cheng E and Choy S (2011). Transafe, ACM SIGCAS Computers and Society, 41:2, (32-37), Online publication date: 1-Dec-2011.
- Shah S, Bao F, Lu C and Chen I CROWDSAFE Proceedings of the 19th ACM SIGSPATIAL International Conference on Advances in Geographic Information Systems, (521-524)
- Savelyev A, Xu S, Janowicz K, Mülligann C, Thatcher J and Luo W Volunteered geographic services Proceedings of the 1st ACM SIGSPATIAL International Workshop on Spatial Semantics and Ontologies, (25-31)
- Kazai G, Kamps J and Milic-Frayling N Worker types and personality traits in crowdsourcing relevance labels Proceedings of the 20th ACM international conference on Information and knowledge management, (1941-1944)
- Bigham J, Ladner R and Borodin Y The design of human-powered access technology The proceedings of the 13th international ACM SIGACCESS conference on Computers and accessibility, (3-10)
- Yetim F, Wiedenhoefer T and Rohde M Designing for motivation Proceedings of the Third international conference on Social informatics, (255-268)
- Nam T and Sayogo D Government 2.0 collects the wisdom of crowds Proceedings of the Third international conference on Social informatics, (51-58)
- Burov V, Patarakin E and Yarmakhov B Lawmaking in democracy 2.0 paradigm Proceedings of the 5th International Conference on Theory and Practice of Electronic Governance, (214-218)
- Fu Z Design for public service application based on collective intelligence in China Proceedings of the 2011 ACM symposium on The role of design in UbiComp research & practice, (3-6)
- Väätäjä H, Vainio T, Sirkkunen E and Salo K Crowdsourced news reporting Proceedings of the 13th International Conference on Human Computer Interaction with Mobile Devices and Services, (435-444)
- Kazai G, Kamps J, Koolen M and Milic-Frayling N Crowdsourcing for book search evaluation Proceedings of the 34th international ACM SIGIR conference on Research and development in Information Retrieval, (205-214)
- Sakamoto Y, Tanaka Y, Yu L and Nickerson J The crowdsourcing design space Proceedings of the 6th international conference on Foundations of augmented cognition: directing the future of adaptive systems, (346-355)
- Faste H Opening "open" innovation Proceedings of the 2011 Conference on Designing Pleasurable Products and Interfaces, (1-8)
- Fritz S, See L, McCallum I, Schill C, Perger C and Obersteiner M Building a crowd-sourcing tool for the validation of urban extent and gridded population Proceedings of the 2011 international conference on Computational science and its applications - Volume Part II, (39-50)
- Treiber M, Schall D, Dustdar S and Scherling C Tweetflows Proceedings of the 3rd International Workshop on Principles of Engineering Service-Oriented Systems, (1-7)
- Bederson B and Quinn A Web workers unite! addressing challenges of online laborers CHI '11 Extended Abstracts on Human Factors in Computing Systems, (97-106)
- Kim S, Robson C, Zimmerman T, Pierce J and Haber E Creek watch Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, (2125-2134)
- Quinn A and Bederson B Human computation Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, (1403-1412)
- Hüsig S and Kohn S (2011). "Open CAI 2.0" - Computer Aided Innovation in the era of open innovation and Web 2.0, Computers in Industry, 62:4, (407-413), Online publication date: 1-May-2011.
- Kazai G In search of quality in crowdsourcing for search engine evaluation Proceedings of the 33rd European conference on Advances in information retrieval, (165-176)
- Kazai G In Search of Quality in Crowdsourcing for Search Engine Evaluation Proceedings of the 33rd European Conference on Advances in Information Retrieval - Volume 6611, (165-176)
- Greengard S (2011). Following the crowd, Communications of the ACM, 54:2, (20-22), Online publication date: 1-Feb-2011.
- Hester V, Shaw A and Biewald L Scalable crisis relief Proceedings of the First ACM Symposium on Computing for Development, (1-7)
- Kazai G, Koolen M, Kamps J, Doucet A and Landoni M Overview of the INEX 2010 book track Proceedings of the 9th international conference on Initiative for the evaluation of XML retrieval: comparative evaluation of focused retrieval, (98-117)
- Liu Y, Lehdonvirta V, Kleppe M, Alexandrova T, Kimura H and Nakajima T A crowdsourcing based mobile image translation and knowledge sharing service Proceedings of the 9th International Conference on Mobile and Ubiquitous Multimedia, (1-9)
- Hagen P and Robertson T Social technologies Proceedings of the 11th Biennial Participatory Design Conference, (31-40)
- Alt F, Shirazi A, Schmidt A, Kramer U and Nawaz Z Location-based crowdsourcing Proceedings of the 6th Nordic Conference on Human-Computer Interaction: Extending Boundaries, (13-22)
- Goolsby R (2010). Social media as crisis platform, ACM Transactions on Intelligent Systems and Technology, 1:1, (1-11), Online publication date: 1-Oct-2010.
- Vukovic M, Kumara S and Greenshpan O Ubiquitous crowdsourcing Proceedings of the 12th ACM international conference adjunct papers on Ubiquitous computing - Adjunct, (523-526)
- Coelho T, Wesselius M and Papakonstantinou C OutRandom Proceedings of the 3rd International Conference on Fun and Games, (166-170)
- Stewart O, Lubensky D and Huerta J Crowdsourcing participation inequality Proceedings of the ACM SIGKDD Workshop on Human Computation, (30-33)
- Braet O and Spek S Crowdfunding the movies Proceedings of the 8th European Conference on Interactive TV and Video, (221-228)
- Goel S, Reeves D, Watts D and Pennock D Prediction without markets Proceedings of the 11th ACM conference on Electronic commerce, (357-366)
- Horton J and Chilton L The labor economics of paid crowdsourcing Proceedings of the 11th ACM conference on Electronic commerce, (209-218)
- Mason W and Watts D (2010). Financial incentives and the "performance of crowds", ACM SIGKDD Explorations Newsletter, 11:2, (100-108), Online publication date: 27-May-2010.
- Gibson N and Talburt J (2010). Hive, Journal of Computing Sciences in Colleges, 25:5, (72-78), Online publication date: 1-May-2010.
- Raykar V, Yu S, Zhao L, Valadez G, Florin C, Bogoni L and Moy L (2010). Learning From Crowds, The Journal of Machine Learning Research, 11, (1297-1322), Online publication date: 1-Mar-2010.
- Hagen P and Robertson T Dissolving boundaries Proceedings of the 21st Annual Conference of the Australian Computer-Human Interaction Special Interest Group: Design: Open 24/7, (129-136)
- Jamjoom H, Qu H, Buco M, Hernandez M, Saha D and Naghshineh M (2009). Crowdsourcing and service delivery, IBM Journal of Research and Development, 53:6, (925-934), Online publication date: 1-Nov-2009.
- Moreno A, de la Rosa J, Szymanski B and Barcenas J Reward System for Completing FAQs Proceedings of the 2009 conference on Artificial Intelligence Research and Development: Proceedings of the 12th International Conference of the Catalan Association for Artificial Intelligence, (361-370)
- Moreno A, de la Rosa J, Szymanski B and Barcenas J Reward System for Completing FAQs Proceedings of the 2009 conference on Artificial Intelligence Research and Development: Proceedings of the 12th International Conference of the Catalan Association for Artificial Intelligence, (361-370)
- Mason W and Watts D Financial incentives and the "performance of crowds" Proceedings of the ACM SIGKDD Workshop on Human Computation, (77-85)
- Stewart O, Huerta J and Sader M Designing crowdsourcing community for the enterprise Proceedings of the ACM SIGKDD Workshop on Human Computation, (50-53)
- Hsueh P, Melville P and Sindhwani V Data quality from crowdsourcing Proceedings of the NAACL HLT 2009 Workshop on Active Learning for Natural Language Processing, (27-35)
Index Terms
- Crowdsourcing: Why the Power of the Crowd Is Driving the Future of Business
Recommendations
Microworkers Crowdsourcing Approach, Challenges and Solutions
CrowdMM '14: Proceedings of the 2014 International ACM Workshop on Crowdsourcing for MultimediaFounded in May 2009, Microworkers.com is an international Crowdsourcing platform focusing on Microtasks. At present, more than 600,000 users from over 190 countries have already registered to our platform. This extensively diverse workforce is the key ...