FiDO: A Community-based Web Browsing Agent and CDN for Challenged Network Environments

Abstract

Homes located on tribal lands, particularly in rural areas of the United States, continue to lack access to broadband Internet and cellular connectivity [19]. Inspired by previous observations of community content similarity in tribal networks, we propose FiDO, a community-based Web browsing and content delivery system that takes advantage of user mobility, opportunistic connectivity, and collaborative filtering to provide relevant Web content to members of disconnected households via opportunistic contact with cellular base stations during a daily commute. We evaluate FiDO using trace-driven simulations with network usage data collected from a tribal-operated ISP that serves the Coeur d’Alene Indian Reservation in Western Idaho. By collecting data about household Web preferences and applying a collaborative filtering technique based on the Web usage patterns of the surrounding reservation community, we are able to opportunistically browse the Web on behalf of members of disconnected households, providing an average of 69.4 Web pages (all content from a specific URL, e.g., “http://gis.cdatribe-nsn.gov/LandBuyBack/”) crawled from 73% of their top 10 most visited Web domains (e.g., “cdatribe-nsn.gov” or “cnn.com/”) per day. Moreover, this content is able to be fetched and pushed to users even when the opportunistic data rate is limited to an average of only 0.99 Mbps (σ = 0.24 Mbps) and the daily opportunistic connection time is an average of 45.9 minutes (σ = 2.3 minutes). Additionally, we demonstrate a hybrid “search and browse” approach that allocates a percentage of opportunistic resources to the download of user-specified content. By dedicating only 10% of opportunistic windows of connectivity to the download of social media content, 51% of households were able to receive all of their daily expected social media content in addition to an average of 55.3 Web pages browsed on their behalf from an average of 4 different Web domains. Critically, we demonstrate the feasibility of a collaborative and community-based Web browsing model that extends access to Web content across the last mile(s) using existing infrastructure and rural patterns of mobility.

References

1. V. Alia. The New Media Nation: Indigenous Peoples and Global Communication, volume 2. Berghahn Books, 2010.
2. R. Armstrong, D. Freitag, T. Joachims, and T. Mitchell. WebWatcher: A Learning Apprentice for the World Wide Web. In Proceedings of the AAAI Spring Symposium on Information Gathering from Heterogenous, Distributed Environments, pages 59--66, Palo Alto, CA, USA, March 1995.
3. R. Armstrong, D. Freitag, T. Joachims, and T. Mitchell. WebWatcher: A Learning Apprentice for the World Wide Web. In AAAI Spring Symposium, pages 6--12, Mar. 1995.
4. A. Balasubramanian, Y. Zhou, W. Croft, B. Levine, and A. Venkataramani. Web Search from a Bus. In Proceedings of the Second ACM Workshop on Challenged Networks, pages 59--66, Montreal, Quebec, Canada, September 2007.
5. E. Brewer, M. Demmer, M. Ho, R. Honicky, J. Pal, M. Plauche, and S. Surana. The Challenges of Technology Research for Developing Regions. IEEE Pervasive Computing, 5(2):15--23, 2006.
6. A. Broder, R. Kumar, F. Maghoul, P. Raghavan, S. Rajagopalan, R. Stata, A. Tomkins, and J. Wiener. Graph Structure in the Web. Computer Networks, 33(1):309--320, 2000.
7. P. Carpenter, K. Gibson, C. Kakekaspan, and S. OâĂŹDonnell. How Women in Remote and Rural First Nation Communities are Using Information and Communication Technologies (ICT). Journal of Rural and Community Development, 8(2), 2014.
8. J. Carr. State Traffic and Speed Laws. http://www.mit.edu/~jfc/laws.html#types, April 2015.
9. J. Chen, L. Subramanian, and J. Li. RuralCafe: Web Search in the Rural Developing World. In ACM WWW 2009, pages 411--420, Madrid, Spain, Apr. 2009.
10. L. Chen and K. Sycara. WebMate: A Personal Agent for Browsing and Searching. In Proceedings of the 18th International Conference on Autonomous Agents, pages 132--139, Minneapolis, MN, USA, July 1998.
11. L. Chen and K. Sycara. WebMate: A Personal Agent for Browsing and Searching. In AAMAS 1998, pages 132--139, Minneapolis, MN, USA, July 1998.
12. M. D. Clark. To Tweet Our Own Cause: A Mixed-methods Study of the Online Phenomenon “Black Twitter”. The University of North Carolina at Chapel Hill, 2014.
13. A. Clauset, C. R. Shalizi, and M. E. Newman. Power-law Distributions in Empirical Data. SIAM Review, 51(4):661--703, 2009.
14. Department of Transportation. Bureau of Transportation Statistics. https://www.rita.dot.gov/bts/sites/rita.dot.gov.bts/files/publications/national_transportation_statistics/html/table_01_36.html, May 2016.
15. H. S. Dhillon and J. G. Andrews. Downlink Rate Distribution in Heterogeneous Cellular Networks Under Generalized Cell Selection. IEEE Wireless Communications Letters, 3(1):42--45, 2014.
16. M. E. Duarte. Network Sovereignty: Understanding the Implications of Tribal Broadband Networks. PhD thesis, University of Washington, 2013.
17. R. Fagin, R. Kumar, and D. Sivakumar. Comparing Top k Lists. Journal on Discrete Mathematics, 17(1):134--160, 2003.
18. K. Fall. A Delay-Tolerant Network Architecture for Challenged Internets. In ACM SIGCOMM 2003, pages 27--34, Berlin, Germany, Aug. 2003.
19. Federal Communications Commission. Native Nations. https://www.fcc.gov/general/native-nations, Sept. 2016.
20. K. Gibson, M. Kakekaspan, G. Kakekaspan, S. O’Donnell, B. Walmark, and B. Beaton. A History of Everyday Communication by Community Members of Fort Severn First Nation: From Hand Deliveries to Virtual Pokes. In Proceedings of the 2012 iConference, pages 105--111, 2012.
21. E. Gilbert, K. Karahalios, and C. Sandvig. The Network in the Garden: An Empirical Analysis of Social Media in Rural Life. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, CHI ’08, April, isbn = 978-1-60558-011-1, address = Florence, Italy, pages = 1603--1612 2008.
22. S. Guo, M. H. Falaki, E. A. Oliver, S. Ur Rahman, A. Seth, M. A. Zaharia, and S. Keshav. Very Low-cost Internet Access Using KioskNet. SIGCOMM Computer Communication Review, 37(5):95--100, Oct. 2007.
23. K. Heimerl and E. Brewer. The Village Base Station. In ACM DEV 2010, pages 131--140, San Francisco, CA, USA, June 2010.
24. K. Heimerl, S. Hasan, K. Ali, E. Brewer, and T. Parikh. Local, Sustainable, Small-scale Cellular Networks. In ICTD 2013, pages 2--12, Cape Town, South Africa, Dec. 2013.
25. HTTP Archive. Average Bytes per Page by Content Type. http://httparchive.org/interesting.php?a=All8l=Apr%201%202017, April 2017.
26. International Telecommunications Union. Facts and Figures. http://www.itu.int/en/ITU-D/Statistics/Documents/facts/ICTFactsFigures2016.pdf, June 2016.
27. S. Isaacman, R. Becker, R. Cáceres, M. Martonosi, J. Rowland, A. Varshavsky, and W. Willinger. Human Mobility Modeling at Metropolitan Scales. In Proceedings of the 10th International Conference on Mobile Systems, Applications, and Services, MobiSys ’12, pages 239--252, Low Wood Bay, Lake District, UK, June 2012.
28. S. Jain, K. Fall, and R. Patra. Routing in a Delay Tolerant Network, volume 34. 2004.
29. D. Johnson, E. Belding, and G. Van Stam. Network Traffic Locality in a Rural African Village. In ICTD 2012, pages 268--277, Atlanta, GA, USA, Mar. 2012.
30. D. Johnson, V. Pejovic, E. Belding, and G. van Stam. VillageShare: Facilitating Content Generation and Sharing in Rural Networks. In ACM DEV 2012, pages 61--70, Atlanta, GA, USA, Mar. 2012.
31. T. T. Keegan, P. Mato, S. Ruru, et al. Using Twitter in an Indigenous Language: An Analysis of Te Reo Maori Tweets. AlterNative: An International Journal of Indigenous Peoples, 11(1):59, 2015.
32. H. Lieberman. Letizia: An Agent that Assists Web Browsing. In Proceedings of the 1995 International Joint Conference on Artificial Intelligence, pages 924--929, Montreal, Quebec, Canada, August 1995.
33. T. Matthews, K. Liao, A. Turner, M. Berkovich, R. Reeder, and S. Consolvo. She’ll just grab any device that’s closer: A study of everyday device 8 account sharing in households. In CHI 2016, pages 5921--5932, San Jose, CA, USA, September 2016.
34. R. Meusel, S. Vigna, O. Lehmberg, and C. Bizer. Graph Structure in the Web—Revisited: A Trick of the Heavy Tail. In Proceedings of the 23rd international conference on World Wide Web, pages 427--432, Seoul, South Korea, May 2014.
35. H. Molyneaux, S. O’Donnell, C. Kakekaspan, B. Walmark, P. Budka, and K. Gibson. Social Media in Remote First Nation Communities. Canadian Journal of Communication, 39(2), 2014.
36. National Telecommunications and Information Administration. Exploring the Digital Nation: Embracing the Mobile Internet, October 2014.
37. Open Signal Map. Compare Mobile Networks Near You. https://opensignal.com/, March 2017.
38. J. Ott and D. Kutscher. A Disconnection-tolerant Transport for Drive-thru Internet Environments. In Proceedings of the 24th Annual Joint Conference of the IEEE Computer and Communications Societies, volume 3, pages 1849--1862, Miami, FL, USA, March 2005.
39. M. Pazzani. A Framework for Collaborative, Content-based and Demographic Filtering. Artificial Intelligence Review, 13(5-6):393--408, 1999.
40. M. Pazzani, J. Muramatsu, and D. Billsus. Syskill 8 Webert: Identifying Interesting Web Sites. In Proceedings of the 13th National Conference on Artificial Intelligence, pages 54--61, Portland, OR, USA, August 1996.
41. A. Pentland, R. Fletcher, and A. Hasson. DakNet: Rethinking Connectivity in Developing Nations. Computer, 37(1):78--83, 2004.
42. M. Pitkänen and J. Ott. Enabling Opportunistic Storage for Mobile DTNs. Pervasive and Mobile Computing, 4(5):579--594, 2004.
43. S. C. Rushing and D. Stephens. Use of Media Technologies by Native American Teens and Young Adults in the Pacific Northwest: Exploring Their Utility for Designing Culturally Appropriate Technology-based Health Interventions. The Journal of Primary Prevention, 32(3):135, 2011.
44. J. Schafer, D. Frankowski, J. Herlocker, and S. Sen. Collaborative Filtering Recommender Systems. In The Adaptive Web, pages 291--324. Springer, 2007.
45. P. Schmitt, R. Raghavendra, and E. Belding. Internet Media Upload Caching for Poorly-connected Regions. In ACM DEV 2015, pages 41--49, London, UK, Dec. 2015.
46. A. Seth, D. Kroeker, M. Zaharia, S. Guo, and S. Keshav. Low-cost Communication for Rural Internet Kiosks Using Mechanical Backhaul. In ACM MobiCom 2006, pages 334--345, Los Angeles, CA, USA, Sept. 2006.
47. A. Smith. U.S. Smartphone Use in 2015. http://www.pewinternet.org/2015/04/01/us-smartphone-use-in-2015/, April 2015.
48. Southern California Tribal Chairmen’s Association. Tribal Digital Village. https://sctdv.net/, January 2017.
49. The Bro Project. Bro Network Security Monitor. https://www.bro.org/, Sept. 2016.
50. TraceAnon. http://www.wand.net.nz/trac/libtrace/wiki/TraceAnon, July 2010.
51. C. A. Trujillo, A. Barrios, S. M. Camacho, and J. A. Rosa. Low Socioeconomic Class and Consumer Complexity Expectations for New Product Technology. Journal of Business Research, 63(6):538--547, 2010.
52. United States Census Bureau. American Fact Finder. http://factfinder.census.gov, 2014.
53. T. Unwin. ICT4D: Information and Communication Technology for Development. Cambridge University Press, 2009.
54. M. Vigil, E. Belding, and R. M. Repurposing FM: Radio Nowhere to OSNs Everywhere. In Proceedings of the 19th ACM Conference on Computer-Supported Cooperative Work 8 Social Computing, pages 1260--1272, San Francisco, CA, USA, February 2016.
55. M. Vigil, E. Belding, and M. Rantanen. Repurposing FM: Radio Nowhere to OSNs Everywhere. In Proceedings of the 19th ACM Conference on Computer-Supported Cooperative Work 8 Social Computing, pages 1260--1272, San Francisco, CA, USA, 2016.
56. M. Vigil, M. Rantanen, and E. Belding. A Fist Look at Tribal Web Traffic. In Proceedings of the 24th International Conference on World Wide Web, pages 1155--1165, Florence, Italy, May 2015.
57. M. Vigil-Hayes, M. Duarte, N. D. Parkhurst, and E. Belding. #indigenous: Tracking the Connective Actions of Native American Advocates on Twitter. In Proceedings of the 2017 ACM Conference on Computer Supported Cooperative Work and Social Computing, pages 1387--1399, Portland, OR, USA, 2017.
58. J. Waitoa, R. Scheyvens, T. R. Warren, et al. E-whanaungatanga: The Role of Social Media in Maori Political Empowerment. AlterNative: An International Journal of Indigenous Peoples, 11(1):45, 2015.
59. W. Zhao, M. Ammar, and E. Zegura. A Message Ferrying Approach for Data Delivery in Sparse Mobile Ad Hoc Networks. In ACM MobiHoc 2004, pages 187--198, Roppongi, Japan, May 2004.
60. M. Zheleva, A. Paul, D. Johnson, and E. Belding. Kwiizya: Local Cellular Network Services in Remote Areas. In ACM MobiSys 2013, pages 417--430, Taipei, Taiwan, June 2013.

Index Terms

• Networks

  • Network types

    • Mobile networks