Himabindu Pucha
ABSTRACT
An important stage of wide-area systems and networking research is to prototype a system to understand its performance when deployed in the real Internet. A key requirement of prototyping is that results obtained from the prototype experiments be representative of the behavior if the system were deployed over nodes connected to commercial ISPs. Recently, distributed testbeds such as PlanetLab and RON have become increasingly popular for performing wide-area experimentation. However, such testbeds typically consist of a significant fraction of nodes with connectivity to research and education networks which potentially hinder their usability in prototyping systems.In this paper, we investigate the impact of testbeds with connectivity to research and education networks on the applications and network services so that such testbeds can be leveraged for evaluation and prototyping. Specifically, we investigate when the representativeness of wide-area experiments deployed on such testbeds is affected by studying the routing paths that applications use over such testbeds. We then investigate how the representativeness of wide-area experiments is affected by studying the performance properties of such paths. We further measure the impact of using such testbeds on application performance via application case studies. Finally, we propose a technique that uses the currently available testbeds but reduces their bias by exposing applications evaluated to network conditions more reflective of the conditions in the commercial Internet.
- D. G. Andersen, H. Balakrishnan, M. F. Kaashoek, and R. Morris. Resilient Overlay Networks. In Proc. of ACM SOSP, 2001. Google Scholar
Digital Library
- S. Banerjee, B. Bhattacharjee, and C. Kommareddy. Scalable Application Layer Multicast. In Proc. of ACM SIGCOMM, 2002. Google ScholarDigital Library
- S. Banerjee, T. G. Griffin, and M. Pias. The Interdomain Connectivity of PlanetLab Nodes. In Proc. of PAM, 2004.Google ScholarCross Ref
- A. Bavier, N. Feamster, M. Huang, J. Rexford, and L. Peterson. In VINI Veritas: Realistic and Controlled Network Experimentation. In Proc. of SIGCOMM, 2006. Google ScholarDigital Library
- C. Bron and J. Kerbosch. Algorithm 457: Finding All Cliques of an Undirected Graph. Commun. ACM, 16(9), 1973. Google ScholarDigital Library
- C. Dovrolis, P. Ramanathan, and D. Moore. What Do Packet Dispersion Techniques Measure? In Proc. of IEEE Infocom, 2001.Google ScholarCross Ref
- K. P. Gummadi, H. Madhyastha, S. D. Gribble, H. M. Levy, and D. J. Wetherall. Improving the Reliability of Internet Paths with One-hop Source Routing. In Proc. of OSDI, 2004. Google ScholarDigital Library
- N. Hu, L. E. Li, Z. M. Mao, P. Steenkiste, and J. Wang. Locating internet bottlenecks: algorithms, measurements, and implications. In Proc. of SIGCOMM, 2004. Google ScholarDigital Library
- Y. hua Chu, S. G. Rao, and H. Zhang. A Case for End System Multicast. In Proc. of ACM SIGMETRICS, 2000. Google ScholarDigital Library
- R. Mahajan, N. Spring, D. Wetherall, and T. Anderson. User-level internet path diagnosis. In Proc. of SOSP, 2003. Google ScholarDigital Library
- T. S. E. Ng and H. Zhang. Predicting Internet Network Distance with Coordinates-Based Approaches. In Proceedings of IEEE INFOCOM, June 2002.Google ScholarCross Ref
- U. of Oregon Route Views Archive Project. http://www.routeviews.org.Google Scholar
- K. Park, V. S. Pai, L. Peterson, and Z. Wang. CoDNS: Improving DNS Performance and Reliability via Cooperative Lookups. In Proc. of OSDI, 2004. Google ScholarDigital Library
- V. Paxson. Strategies for sound internet measurement. In Proc. of IMC, 2004. Google ScholarDigital Library
- L. Peterson, T. Anderson, D. Culler, and T. Roscoe. A Blueprint for Introducing Disruptive Technology Into the Internet. In Proc. of ACM HotNets, 2002.Google Scholar
- PlanetLab. http://www.planet-lab.org.Google Scholar
- S. Rhea, B. Godfrey, B. Karp, J. Kubiatowicz, S. Ratnasamy, S. Shenker, I. Stoica, and H. Yu. OpenDHT: A Public DHT Service and Its Uses. In Proc. of SIGCOMM, 2005. Google ScholarDigital Library
- RipeNCC: Routing Information Service Raw Data. http://abcoude.ripe.net/ris/rawdata/.Google Scholar
- RON. http://nms.csail.mit.edu/ron/sites/.Google Scholar
- A. Rowstron and P. Druschel. Pastry: Scalable, Distributed Object Location and Routing for Large-Scale Peer-to-peer Systems. In Proc. of ACMIFIPUSENIX Middleware, November 2001. Google ScholarDigital Library
- A. Rowstron and P. Druschel. Storage management and caching in PAST, a large-scale, persistent peer-to-peer storage utility. In Proc. of SOSP, 2001. Google ScholarDigital Library
- J. Sommers, P. Barford, N. Duffield, and A. Ron. Improving accuracy in end-to-end packet loss measurement. In Proc. of SIGCOMM, 2005. Google ScholarDigital Library
- N. Spring, R. Mahajan, and T. Anderson. Quantifying the causes of internet path inflation. In Proc. of SIGCOMM, 2003.Google Scholar
- J. Strauss, D. Katabi, and F. Kaashoek. A measurement study of available bandwidth estimation tools. In Proc. of IMC, 2003. Google ScholarDigital Library
- L. Subramanian, I. Stoica, H. Balakrishnan, and R. Katz. OverQoS: An Overlay Based Architecture for Enhancing Internet QoS. In Proc. of USENIX NSDI, 2004. Google ScholarDigital Library
- L. Wang, K. Park, R. Pang, V. S. Pai, and L. Peterson. Reliability and security in the codeen content distribution network. In Proc. of USENIX ATC, 2004. Google ScholarDigital Library
- B. White, J. Lepreau, L. Stoller, R. Ricci, S. Guruprasad, M. Newbold, M. Hibler, C. Barb, and A. Joglekar. An Integrated Experimental Environment for Distributed Systems and Networks. In Proc. of OSDI, 2002. Google ScholarDigital Library
- P. Yalagandula, P. Sharma, S. Banerjee, S.-J.Lee, and S. Basu. S3: A Scalable Sensing Service for Monitoring Large Networked Systems. In Proc. of the Workshop on Internet Network Management, 2006. Google ScholarDigital Library
- R. Zhang and Y. C. Hu. Assisted Peer-to-Peer Search with Partial Indexing. In Proc. of IEEE INFOCOM, 2005.Google Scholar
- GNP Homepage. http://www.cs.rice.edu/ Eugeneng/research/gnp/.Google Scholar
- Iperf. http://dast.nlanr.net/Projects/Iperf/.Google Scholar
- PlanetLab IPerf. http://www.planet-lab.org/logs/iperf/.Google Scholar
- S3: Scalable Sensing Service. http://networking.hpl.hp.com/s-cube/.Google Scholar
- The P2PSim Project. http://pdos.csail.mit.edu/p2psim/.Google Scholar
- The Gnutella protocol specification, 2000. http://dss.clip2.com/GnutellaProtocol04.pdf.Google Scholar
Index Terms
- On the impact of research network based testbeds on wide-area experiments
Recommendations
User Experiences on Network Testbeds
CSET '21: Proceedings of the 14th Cyber Security Experimentation and Test WorkshopNetwork testbeds are used by researchers to evaluate their research products in a controlled setting. Teachers and students also use network testbeds in classes to facilitate active learning in authentic settings. However, testbeds have scarce human ...
Testbeds Support for Reproducible Research
Reproducibility '17: Proceedings of the Reproducibility WorkshopIn the context of experimental research, testbeds play an important role in enabling reproducibility of experiments, by providing a set of services that help experiments with setting up the experimental environment, and collecting data about it. This ...
A taxonomy and evaluation for developing 802.11-based wireless mesh network testbeds
The definition of wireless mesh networks (WMNs) has been used in the literature to connote and epitomize the ideal, ubiquitous, pervasive, and autonomic networking technology. An increasing interest has been emerging on the development of 802.11-based ...
Comments