Allison McDonald
ABSTRACT
We report the first wide-scale measurement study of server-side geographic restriction, or geoblocking, a phenomenon in which server operators intentionally deny access to users from particular countries or regions. Many sites practice geoblocking due to legal requirements or other business reasons, but excessive blocking can needlessly deny valuable content and services to entire national populations.
To help researchers and policymakers understand this phenomenon, we develop a semi-automated system to detect instances where whole websites were rendered inaccessible due to geoblocking. By focusing on detecting geoblocking capabilities offered by large CDNs and cloud providers, we can reliably distinguish the practice from dynamic anti-abuse mechanisms and network-based censorship. We apply our techniques to test for geoblocking across the Alexa Top 10K sites from thousands of vantage points in 177 countries. We then expand our measurement to a sample of CDN customers in the Alexa Top 1M.
We find that geoblocking occurs across a broad set of countries and sites. We observe geoblocking in nearly all countries we study, with Iran, Syria, Sudan, Cuba, and Russia experiencing the highest rates. These countries experience particularly high rates of geoblocking for finance and banking sites, likely as a result of U.S. economic sanctions. We also verify our measurements with data provided by Cloudflare, and find our observations to be accurate.
- Akamai. Akamai pragma header. https://community.akamai.com/customers/s/article/Akamai-Pragma-Header?language=en_US.Google Scholar
- Kona DDoS Defender. https://www.akamai.com/us/en/resources/cdn-ddos.jsp.Google Scholar
- amp/aw. EU parliament bans geoblocking, exempts Netflix and other streaming services, Feb 2018. http://www.dw.com/en/eu-parliament-bans-geoblocking-exempts-netflix-and-other-streaming-services/a-42475135.Google Scholar
- Anonymous. Towards a comprehensive picture of the Great Firewall's DNS censorship. In 4th USENIX Workshop on Free and Open Communications on the Internet (FOCI), 2014.Google Scholar
- S. Aryan, H. Aryan, and J. A. Halderman. Internet censorship in Iran: A first look. In 3rd USENIX Workshop on Free and Open Communications on the Internet (FOCI), 2013.Google Scholar
- Austrlian House Standing Committee on Infrastructure and Communications. At what cost? IT pricing and the Australia tax, July 2013. https://www.aph.gov.au/Parliamentary_Business/Committees/House_of_Representatives_Committees?url=ic/ittpricing/report.htm.Google Scholar
- BBC News. GDPR: US news sites unavailable to EU users under new rules, May 2018. https://www.bbc.com/news/world-europe-44248448.Google Scholar
- T. Bray. An HTTP status code to report legal obstacles. RFC 7725, Feb. 2016.Google Scholar
- BuiltWith. Akamai usage statistics. https://trends.builtwith.com/cdn/Akamai.Google Scholar
- A. Chaabane, T. Chen, M. Cunche, E. D. Cristofaro, A. Friedman, and M. A. Kaafar. Censorship in the wild: Analyzing Internet filtering in Syria. In 14th ACM Internet Measurement Conference (IMC), 2014. Google ScholarDigital Library
- T. Chung, D. Choffnes, and A. Mislove. Tunneling for transparency: A large-scale analysis of end-to-end violations in the Internet. In 16th ACM Internet Measurement Conference (IMC), 2016. Google ScholarDigital Library
- Citizen Lab. Block test list. https://github.com/citizenlab/test-lists.Google Scholar
- R. Clayton, S. J. Murdoch, and R. N. M. Watson. Ignoring the Great Firewall of China. In Privacy Enhancing Technologies Symposium (PETS). Springer, 2006. Google ScholarDigital Library
- Cloudflare. https://www.cloudflare.com.Google Scholar
- Cloudflare. How do I control IP access to my site?, Aug. 2018. https://support.cloudflare.com/hc/en-us/articles/217074967-How-do-I-control-IP-access-to-my-site-.Google Scholar
- Council of European Union. Council regulation (EU) no A8--0172/2017, 2017.Google Scholar
- A. Dainotti, C. Squarcella, E. Aben, K. C. Claffy, M. Chiesa, M. Russo, and A. Pescapé. Analysis of country-wide Internet outages caused by censorship. In 11th ACM Internet Measurement Conference (IMC), 2011. Google ScholarDigital Library
- J. Dalek, B. Haselton, H. Noman, A. Senft, M. Crete-Nishihata, P. Gill, and R. J. Deibert. A method for identifying and confirming the use of URL filtering products for censorship. In 14th ACM Internet Measurement Conference (IMC), 2014. Google ScholarDigital Library
- U.S. Department of the Treasury. Office of Foreign Assets Control (OFAC). https://www.treasury.gov/about/organizational-structure/offices/Pages/Office-of-Foreign-Assets-Control.aspx.Google Scholar
- Z. Durumeric, D. Adrian, A. Mirian, M. Bailey, and J. A. Halderman. A search engine backed by Internet-wide scanning. In 22nd ACM Conference on Computer and Communications Security (CCS), pages 542--553, 2015. Google ScholarDigital Library
- Facebook. Content restrictions based on local law, 2017. https://transparency.facebook.com/content-restrictions.Google Scholar
- R. Fielding and J. Reschke. Hypertext transfer protocol (HTTP/1.1): Semantics and content. RFC 7231, June 2014.Google Scholar
- A. Filastò and J. Appelbaum. OONI: Open Observatory of Network Interference. In 2nd USENIX Workshop on Free and Open Communications on the Internet (FOCI), 2012.Google Scholar
- Freedom House. Freedom on the net 2016, November 2016.Google Scholar
- Google. Countries or regions with restricted access. https://support.google.com/a/answer/2891389.Google Scholar
- Google. Google appengine faq. htttps://cloud.google.com/appengine/kb/#staticip.Google Scholar
- GreatFire.org. https://en.greatfire.org.Google Scholar
- Hola unblocker. https://hola.org.Google Scholar
- S. Huang, F. Cuadrado, and S. Uhlig. Middleboxes in the Internet: a HTTP perspective. In Network Traffic Measurement and Analysis Conference (TMA), pages 1--9. IEEE, 2017.Google ScholarCross Ref
- M. Ikram, N. Vallina-Rodriguez, S. Seneviratne, M. A. Kaafar, and V. Paxson. An analysis of the privacy and security risks of android vpn permission-enabled apps. In 16th ACM Internet Measurement Conference (IMC), pages 349--364, 2016. Google ScholarDigital Library
- International Monetary Fund. World economic outlook database. http://www.imf.org/external/pubs/ft/weo/2014/02/weodata/index.aspx.Google Scholar
- B.Jones, T.-W. Lee, N. Feamster, and P. Gill. Automated detection and fingerprinting of censorship block pages. In 14th ACM Internet Measurement Conference (IMC), 2014. Google ScholarDigital Library
- S. Khattak, T. Elahi, L. Simon, C. M. Swanson, S. J. Murdoch, and I. Goldberg. SOK: Making sense of censorship resistance systems. Proceedings on Privacy Enhancing Technologies, (4):37--61, 2016.Google ScholarCross Ref
- S. Khattak, M. Javed, S. A. Khayam, Z. A. Uzmi, and V. Paxson. A look at the consequences of Internet censorship through an ISP lens. In 14th ACM Internet Measurement Conference (IMC), pages 271--284, 2014. Google ScholarDigital Library
- G. Lowe, P. Winters, and M. L. Marcus. The great DNS wall of China. MS, New York University, 21, 2007.Google Scholar
- Luminati. https://luminati.io.Google Scholar
- Z. Nabi. The anatomy of Web censorship in Pakistan. In 1st USENIX Workshop on Free and Open Communications on the Internet (FOCI), 2013.Google Scholar
- New York Times. Google, seeking a return to china, is said to be building a censored search engine, Aug. 2018. https://www.nytimes.com/2018/08/01/technology/china-google-censored-search-engine.html.Google Scholar
- OpenNet Initiative. Survey of government Internet filtering practices indicates increasing internet censorship, May 2007. https://cyber.harvard.edu/newsroom/first_global_filtering_survey_released.Google Scholar
- J. C. Park and J. R. Crandall. Empirical study of a national-scale distributed intrusion detection system: Backbone-level filtering of HTML responses in china. In International Conference on Distributed Computing Systems (ICDCS), pages 315--326. IEEE, 2010. Google ScholarDigital Library
- P. Pearce, R. Ensafi, F. Li, N. Feamster, and V. Paxson. Augur: Internet-wide detection of connectivity disruptions. In 38th IEEE Symposium on Security and Privacy, May 2017.Google ScholarCross Ref
- F. Pedregosa, G. Varoquaux, A. Gramfort, V. Michel, B. Thirion, O. Grisel, M. Blondel, P. Prettenhofer, R. Weiss, V. Dubourg, J. Vanderplas, A. Passos, D. Cournapeau, M. Brucher, M. Perrot, and E. Duchesnay. Scikit-learn: Machine Learning in Python. Journal of Machine Learning Research, 12:2825--2830, 2011. Google ScholarDigital Library
- R. Singh, R. Nithyanand, S. Afroz, P. Pearce, M. C. Tschantz, P. Gill, and V. Paxson. Characterizing the nature and dynamics of tor exit blocking. In 26th USENIX Security Symposium, pages 325--341, 2017. Google ScholarDigital Library
- The Spamhaus Project. https://www.spamhaus.org/statistics/countries.Google Scholar
- M. Trimble. Geoblocking, technical standards and the law. In Scholarly Works, chapter 947. 2016. http://scholars.law.unlv.edu/facpub/947.Google Scholar
- M. C. Tschantz, S. Afroz, S. Sajid, S. A. Qazi, M. Javed, and V. Paxson. A bestiary of blocking: The motivations and modes behind website unavailability. In 8th USENIX Workshop on Free and Open Communications on the Internet (FOCI 18), Baltimore, MD, 2018. USENIX Association.Google Scholar
- Z. Wallace. How to block entire countries from accessing your website. SitePoint, Apr. 2015. https://www.sitepoint.com/how-to-block-entire-countries-from-accessing-website/.Google Scholar
- M. Xynou, A. Filastò, and S. Basso. Measuring internet censorship in cuba's parknets. https://ooni.torproject.org/post/cuba-internet-censorship-2017/, 2017.Google Scholar
- J. Zittrain and B. Edelman. Internet filtering in China. IEEE Internet Computing, 7(2):70--77, 2003. Google ScholarDigital Library
Recommendations
An analysis of global research funding from subject field and funding agencies perspectives in the G9 countries
This study analyzed journal articles published by authors from the G9 countries (Canada, China, France, Germany, Italy, Japan, Russia, the United Kingdom, and the United States) to identify the distribution of research funding and funding agencies in ...
RETRACTED ARTICLE: Educational reforms and internationalization of universities: evidence from major regions of the world
Internationalization of universities has become a worldwide phenomenon as global economic integration continues to make its way forcefully into the higher education. The objective of the study is to develop a model for internationalization of ...
Comments