Not at Home on the Range: Peer Production and the Urban/Rural Divide

ABSTRACT

Wikipedia articles about places, OpenStreetMap features, and other forms of peer-produced content have become critical sources of geographic knowledge for humans and intelligent technologies. In this paper, we explore the effectiveness of the peer production model across the rural/urban divide, a divide that has been shown to be an important factor in many online social systems. We find that in both Wikipedia and OpenStreetMap, peer-produced content about rural areas is of systematically lower quality, is less likely to have been produced by contributors who focus on the local area, and is more likely to have been generated by automated software agents (i.e. "bots"). We then codify the systemic challenges inherent to characterizing rural phenomena through peer production and discuss potential solutions.

References

1. Sisay F. Adafre and Maarten de Rijke. 2006. Finding Similar Sentences Across Multiple Languages in Wikipedia. 62--69.
2. Luc Anselin. 2005. Exploring Spatial Data with GeoDa: A Workbook. Center for Spatially Integrated Social Science.
3. Judd Antin, Ed H. Chi, James Howison, Sharoda Paul, Aaron Shaw, and Jude Yew. 2011. Apples to Oranges?: Comparing Across Studies of Open Collaboration/Peer Production. Proceedings of the 7th International Symposium on Wikis and Open Collaboration, ACM, 227--228. http://doi.org/10.1145/2038558.2038610
4. Gavin Bailey, Bernie Hogan, Mark Graham, and Ahmed Medhat Mohammed. 2012. Interactive Mapping of Wikipedia's Geographies: Visualizing Variation in Participation and Representation. WikiSym '12: 8th International Symposium on Wikis and Open Collaboration.
5. Roger Bivand, Micah Altman, Luc Anselin, et al. 2015. spdep: Spatial Dependence: Weighting Schemes, Statistics and Models. Retrieved September 25, 2015 from https://cran.rproject.org/web/packages/spdep/index.html
6. Philip Bump. 2014. There really are two Americas. An urban one and a rural one. The Washington Post. Retrieved September 23, 2015 from http://www.washingtonpost.com/news/thefix/wp/2014/10/21/there-really-are-two-americas-aurban-one-and-a-rural-one/
7. Jessica L. Collins and Barry Wellman. 2010. Small Town in the Internet Society: Chapleau Is No Longer an Island. American Behavioral Scientist 53, 9: 1344--1366. http://doi.org/10.1177/0002764210361689
8. Melanie Eckle. Quality Assessment of Remote Mapping in OpenStreetMap for Disaster Management Purposes. Retrieved September 24, 2015 from http://iscram2015.uia.no/wpcontent/uploads/2015/05/5--1.pdf
9. Sarah Elwood, Michael F. Goodchild, and Daniel Z. Sui. 2012. Researching Volunteered Geographic Information: Spatial Data, Geographic Research, and New Social Practice. Annals of the Association of American Geographers 102, 3: 571--590. http://doi.org/10.1080/00045608.2011.595657
10. Maike Erdmann, Kotaro Nakayama, Takahiro Hara, and Shojiro Nishio. 2008. An Approach for Extracting Bilingual Terminology from Wikipedia. In Database Systems for Advanced Applications, Jayant R. Haritsa, Ramamohanarao Kotagiri and Vikram Pudi (eds.). Springer Berlin Heidelberg, 380--392. Retrieved May 4, 2014 from http://link.springer.com/chapter/10.1007/978--3--54078568--2_28
11. M. Erdmann, K. Nakayama, T. Hara, and S. Nishio. 2008. A bilingual dictionary extracted from the Wikipedia link structure. Database Systems for Advanced Applications, 686--689.
12. Killian Fox. 2012. OpenStreetMap: "It's the Wikipedia of maps". The Guardian. Retrieved May 13, 2015 from http://www.theguardian.com/theobserver/2012/feb/18/ openstreetmap-world-map-radicals
13. Evgeniy Gabrilovich and Shaul Markovitch. 2006. Overcoming the brittleness bottleneck using wikipedia: enhancing text categorization with encyclopedic knowledge. AAAI '06: The Twenty-First National Conference on Artificial Intelligence, AAAI Press, 1301--1306. Retrieved February 16, 2012 from http://dl.acm.org/citation.cfm?id=1597348.1597395
14. Evgeniy Gabrilovich and Shaul Markovitch. 2007. Computing Semantic Relatedness using Wikipediabased Explicit Semantic Analysis. IJCAI '07: Twentieth Joint Conference for Artificial Intelligence.
15. R. Stuart Geiger. 2014. Bots, bespoke, code and the materiality of software platforms. Information, Communication & Society 17, 3: 342--356. http://doi.org/10.1080/1369118X.2013.873069
16. R. Stuart Geiger and Aaron Halfaker. 2013. When the Levee Breaks: Without Bots, What Happens to Wikipedia's Quality Control Processes' Proceedings of the 9th International Symposium on Open Collaboration, ACM, 6:1--6:6. http://doi.org/10.1145/2491055.2491061
17. Eric Gilbert, Karrie Karahalios, and Christian Sandvig. 2008. The network in the garden: an empirical analysis of social media in rural life. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, ACM, 1603--1612. http://doi.org/10.1145/1357054.1357304
18. Mark Graham, Scott A. Hale, and Monica Stephens. 2011. Geographies of the World's Knowledge. Convoco! Edition, London, England.
19. Mark Graham, Ralph K. Straumann, and Bernie Hogan. 2015. Digital Divisions of Labor and Informational Magnetism: Mapping Participation in Wikipedia. Annals of the Association of American Geographers 0, 0: 1--21. http://doi.org/10.1080/00045608.2015.1072791
20. Mark Graham, Matthew Zook, and Andrew Boulton. 2013. Augmented reality in urban places: contested content and the duplicity of code. Transactions of the Institute of British Geographers 38, 3: 464--479. http://doi.org/10.1111/j.1475--5661.2012.00539.x
21. Shane Greenstein and Feng Zhu. Is Wikipedia Biased? American Economic Review 102, 3: 343--348.
22. Mordechai (Muki) Haklay, Sofia Basiouka, Vyron Antoniou, and Aamer Ather. 2010. How Many Volunteers Does it Take to Map an Area Well? The Validity of Linus? Law to Volunteered Geographic Information. The Cartographic Journal 47, 4: 315--322. http://doi.org/10.1179/000870410X12911304958827
23. Muki Haklay. 2012. Nobody wants to do council estates? -- digital divide, spatial justice and outliers. AAG '12: 2012 Annual Meeting of the Association of American Geographers. Retrieved from http://www.slideshare.net/mukih/nobody-wants-to-docouncil-estates-digital-divide-spatial-justice-andoutliers?ref=http://povesham.wordpress.com/
24. Aaron Halfaker, Aniket Kittur, Robert Kraut, and John Riedl. 2009. A Jury of Your Peers: Quality, Experience and Ownership in Wikipedia. Proceedings of the 5th International Symposium on Wikis and Open Collaboration, ACM, 15:1--15:10. http://doi.org/10.1145/1641309.1641332
25. Aaron Halfaker and John Riedl. 2012. Bots and Cyborgs: Wikipedia's Immune System. Computer 45, 79--82.
26. Darren Hardy, James Frew, and Michael F. Goodchild. 2012. Volunteered geographic information production as a spatial process. International Journal of Geographical Information Science: 1--22. http://doi.org/10.1080/13658816.2011.629618
27. Brent Hecht. 2013. The Mining and Application of Diverse Cultural Perspectives in User-Generated Content.
28. Brent Hecht and Darren Gergle. 2009. Measuring SelfFocus Bias in Community-Maintained Knowledge Repositories. Communities and Technologies 2009: 4th International Conference on Communities and Technologies, 11--19.
29. Brent Hecht and Darren Gergle. 2010. On The "Localness" of User-Generated Content. CSCW '10: 2010 ACM Conference on Computer Supported Cooperative Work, 229--232.
30. Brent Hecht and Darren Gergle. 2011. A Beginner's Guide to Geographic Virtual Communities Research. In Handbook of Research on Methods and Techniques for Studying Virtual Communities: Paradigms and Phenomena. IGI Global, 333--347.
31. Brent Hecht and Shashi Shekhar. 2014. Spatial Computing Massive Open Online Course (MOOC). Coursera. Retrieved from https://www.coursera.org/course/spatialcomputing
32. Brent Hecht and Monica Stephens. 2014. A Tale of Cities: Urban Biases in Volunteered Geographic Information. ICWSM '14: Eight International AAAI Conference on Weblogs and Social Media.
33. Nathan Ingraham. 2012. Apple using TomTom and OpenStreetMap data in iOS 6 Maps app. The Verge. Retrieved September 11, 2012 from http://www.theverge.com/2012/6/11/3078987/appletomtom-openstreemap-ios-6-maps-app
34. DD Ingram and SF Franco. 2012. Rural Classification Scheme for Counties. National Center for Health Statistics. Retrieved from http://www.cdc.gov/nchs/data_access/urban_rural.htm #documentation
35. Brian C. Keegan and Jed R. Brubaker. 2015. "Is" to "Was": Coordination and Commemoration in Posthumous Activity on Wikipedia Biographies. Proceedings of the 18th ACM Conference on Computer Supported Cooperative Work & Social Computing, ACM, 533--546. http://doi.org/10.1145/2675133.2675238
36. Aniket Kittur and Robert E. Kraut. 2008. Harnessing the wisdom of crowds in wikipedia: quality through coordination. Proceedings of the 2008 ACM conference on Computer supported cooperative work, ACM, 37--46. http://doi.org/10.1145/1460563.1460572
37. Ronald R Kline. 2002. Consumers in the country: technology and social change in rural america. Johns Hopkins Univ Press, Baltimore.
38. S.K. Lam, A. Uduwage, Z. Dong, et al. 2011. WP:Clubhouse? An Exploration of Wikipedia's Gender Imbalance. WikiSym '11: 7th International Symposium on Wikis and Open Collaboration, 1--10.
39. Michael D. Lieberman and J. Lin. 2009. You Are Where You Edit: Locating Wikipedia Users Through Edit Histories. ICWSM '09: 3rd Int'l AAAI Conference on Weblogs and Social Media.
40. Andrew Lih. 2009. The Wikipedia Revolution: How a Bunch of Nobodies Created the World's Greatest Encyclopedia. Hyperion.
41. Linna Li, Michael F. Goodchild, and Bo Xu. 2013. Spatial, temporal, and socioeconomic patterns in the use of Twitter and Flickr. Cartography and Geographic Information Science 40, 2: 61--77. http://doi.org/10.1080/15230406.2013.777139
42. Magnus Manske. 2015. Reasonator - Meta. Retrieved September 25, 2015 from https://meta.wikimedia.org/wiki/Reasonator
43. Afra Mashhadi, Giovanni Quattrone, and Licia Capra. 2013. Putting ubiquitous crowd-sourcing into context. CSCW '13: 2013 ACM Conference on Computer Supported Cooperative Work, 611--622.
44. Olena Medelyan, David Milne, Catherine Legg, and Ian H. Witten. 2009. Mining meaning from Wikipedia. International Journal of Human-Computer Studies 67, 9: 716--754. http://doi.org/10.1016/j.ijhcs.2009.05.004
45. Amanda Menking and Ingrid Erickson. 2015. The Heart Work of Wikipedia: Gendered, Emotional Labor in the World's Largest Online Encyclopedia. Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems, ACM, 207--210. http://doi.org/10.1145/2702123.2702514
46. David Milne and Ian H Witten. 2008. Learning to link with wikipedia. CIKM '08: 17th ACM Conference on Information and Knowledge Management, ACM, 509--518. http://doi.org/10.1145/1458082.1458150
47. David Milne and Ian H Witten. 2008. An Effective, Low-Cost Measure of Semantic Relatedness Obtained from Wikipedia Links. WIKIAI '08: First AAAI Workshop on Wikipedia and Artificial Intelligence.
48. National Administration of Surveying, Mapping and Geoinformation. 2002. Surveying and Mapping Law of the People's Republic of China. Retrieved September 25, 2015 from http://en.nasg.gov.cn/article/Lawsandregulations/2013 12/20131200005471.shtml
49. Ulrike Pfeil, Panayiotis Zaphiris, and Chee Siang Ang. 2006. Cultural Differences in Collaborative Authoring of Wikipedia. Journal of Computer-Mediated Communication 12, 1: 88--113.
50. Ingmar Poese, Steve Uhlig, Mohamed Ali Kaafar, Benoit Donnet, and Bamba Gueye. 2011. IP geolocation databases: Unreliable? SIGCOMM 41, 2.
51. Giovanni Quattrone, Licia Capra, and Pasquale De Meo. 2015. There's No Such Thing as the Perfect Map: Quantifying Bias in Spatial Crowd-sourcing Datasets. CSCW '15.
52. Giovanni Quattrone, Afra Mashhadi, Daniele Quercia, C. Smith, and Licia Capra. 2014. Modelling Growth of Urban Crowd-Sourced Information.
53. G. Quattrone, Afra Mashhadi, and Licia Capra. 2014. Mind the Map: The Impact of Culture and Economic Affluence on Crowd- Mapping Behaviours. CSCW '14.
54. Eric S. Raymond. 2001. The Cathedral & the Bazaar: Musings on Linux and Open Source by an Accidental Revolutionary. O'Reilly Media, Beijing?; Cambridge, Mass.
55. Joseph Reagle and Lauren Rhue. 2011. Gender Bias in Wikipedia and Britannica. International Journal of Communication 5: 1138--1158.
56. Shilad Sen, Toby Jia-Jun Li, WikiBrain Team, and Brent Hecht. 2014. WikiBrain: Democratizing Computation on Wikipedia. Proceedings of The International Symposium on Open Collaboration, ACM, 27:1--27:10. http://doi.org/10.1145/2641580.2641615
57. Shilad W. Sen, Heather Ford, David R. Musicant, Mark Graham, Oliver S.B. Keyes, and Brent Hecht. 2015. Barriers to the Localness of Volunteered Geographic Information. Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems, ACM, 197--206. http://doi.org/10.1145/2702123.2702170
58. C.E. Shannon. 1948. A mathematical theory of communication. Bell System Technical Journal, The 27, 3: 379--423. http://doi.org/10.1002/j.15387305.1948.tb01338.x
59. Terry Sicular, Yue Ximing, Björn Gustafsson, and Li Shi. 2007. The Urban-Rural Income Gap and Inequality in China. Review of Income and Wealth 53, 1: 93--126. http://doi.org/10.1111/j.14754991.2007.00219.x
60. Monica Stephens. 2013. Gender and the GeoWeb: divisions in the production of user-generated cartographic information. GeoJournal: 1--16. http://doi.org/10.1007/s10708-013--9492-z
61. Besiki Stvilia, Michael B. Twidale, Linda C. Smith, and Les Gasser. 2008. Information quality work organization in wikipedia. Journal of the American Society for Information Science and Technology 59, 6: 983--1001. http://doi.org/10.1002/asi.20813
62. US Census Bureau. 2010 Census Urban and Rural Classification and Urban Area Criteria. Retrieved September 11, 2013 from http://www.census.gov/geo/reference/ua/urban-rural2010.html
63. Claudia Wagner, David Garcia, Mohsen Jadidi, and Markus Strohmaier. 2015. It's a Man's Wikipedia? Assessing Gender Inequality in an Online Encyclopedia. Ninth International AAAI Conference on Web and Social Media. Retrieved September 21, 2015 from http://www.aaai.org/ocs/index.php/ICWSM/ICWSM15 /paper/view/10585
64. Morten Warncke-Wang, Vlad Ayukaev, Brent Hecht, and Loren Terveen. 2015. The Success and Failure of Quality Improvement Projects in Peer Production Communities.
65. Morten Warncke-Wang, Dan Cosley, and John Riedl. 2013. Tell Me More: An Actionable Quality Model for Wikipedia. Proceedings of the 9th International Symposium on Open Collaboration, ACM, 8:1--8:10. http://doi.org/10.1145/2491055.2491063
66. Morten Warncke-Wang, Vivek Ranjan, Loren Terveen, and Brent Hecht. 2015. Misalignment Between Supply and Demand of Quality Content in Peer Production Communities. ICWSM 2015: Ninth International AAAI Conference on Web and Social Media.
67. Richard Weait. 2010. Wolfram Alpha is using OpenStreetMap data. OpenStreetMap Blog. Retrieved from https://blog.openstreetmap.org/2010/06/16/wolframalpha-is-using-openstreetmap-data/
68. Wikimedia Foundation. WikiWomen's Collaborative Meta. Retrieved September 25, 2015 from https://meta.wikimedia.org/wiki/WikiWomen%27s_Co llaborative
69. Benjamin P. Wing and Jason Baldridge. 2011. Simple Supervised Document Geolocation with Geodesic Grids. ACL '11: Proceedings of the 49th Annual Meeting of the Association for Computational Linguistics, 955--964.
70. Jiang Yang, Meredith Ringel Morris, Jaime Teevan, Lada A. Adamic, and Mark S. Ackerman. 2011. Culture Matters: A Survey Study of Social Q&A Behavior. ICWSM '11: 5th International AAAI Conference on Weblogs and Social Media.
71. Dennis Zielstra, Hartwig H. Hochmair, and Pascal Neis. 2013. Assessing the Effect of Data Imports on the Completeness of OpenStreetMap -- A United States Case Study. Transactions in GIS 17, 3: 315--334. http://doi.org/10.1111/tgis.12037
72. Dennis Zielstra, Hartwig Hochmair, Pascal Neis, and Francesco Tonini. 2014. Areal Delineation of Home Regions from Contribution and Editing Patterns in OpenStreetMap. ISPRS International Journal of GeoInformation 3, 4: 1211--1233. http://doi.org/10.3390/ijgi3041211
73. Dennis Zielstra and Alexander Zipf. 2010. A comparative study of proprietary geodata and volunteered geographic information for Germany. 13th AGILE international conference on geographic information science. Retrieved May 23, 2015 from http://agile2010.dsi.uminho.pt/pen/shortpapers_pdf/14 2_doc.pdf
74. 2012. foursquare is joining the OpenStreetMap movement! Say hi to pretty new maps! foursquare blog. Retrieved September 15, 2012 from http://blog.foursquare.com/2012/02/29/foursquare-isjoining-the-openstreetmap-movement-say-hi-to-prettynew-maps/
75. 2015. Template:Grading scheme. Wikipedia, the free encyclopedia. Retrieved September 23, 2015 from https://en.wikipedia.org/w/index.php?title=Template:G rading_scheme&oldid=654786473
76. 2015. Wikipedia:Pokémon test. Wikipedia, the free encyclopedia. Retrieved September 25, 2015 from https://en.wikipedia.org/w/index.php?title=Wikipedia: Pok%C3%A9mon_test&oldid=677970811
77. USDA Economic Research Service - Population & Migration. Retrieved September 25, 2015 from http://www.ers.usda.gov/topics/rural-economypopulation/population-migration.aspx

Index Terms

• Human-centered computing