An active measurement system for shared environments

ABSTRACT

Testbeds composed of end hosts deployed across the Internet enable researchers to simultaneously conduct a wide variety of experiments. Active measurement studies of Internet path properties that require precisely crafted probe streams can be problematic in these environments. The reason is that load on the host systems from concurrently executing experiments (as is typical in PlanetLab) can significantly alter probe stream timings. In this paper we measure and characterize how packet streams from our local PlanetLab nodes are affected by experimental concurrency. We find that the effects can be extreme. We then set up a simple PlanetLab deployment in a laboratory testbed to evaluate these effects in a controlled fashion. We find that even relatively low load levels can cause serious problems in probe streams. Based on these results, we develop a novel system called <scp>MAD</scp> that can operate as a Linux kernel module or as a stand-alone daemon to support real-time scheduling of probe streams. <scp>MAD</scp> coordinates probe packet emission for all active measurement experiments on a node. We demonstrate the capabilities of <scp>MAD</scp>, showing that it performs effectively even under very high levels of multiplexing and host system load.

References

1. EverLab: Next Generation PlanetLab Network. http://www.everlab.org.
2. KURT: Kansas University Real-time Linux. http://www.ittc.ku.edu/kurt/.
3. MyPLC - A complete Planetlab Central (PLC) portable installation. http://www.planet-lab.org/doc/myplc.
4. OneLab. http://www.fp6-ist-onelab.eu/.
5. A new approach to kernel timers. http://lwn.net/Articles/152436/, September 2005.
6. Linux kernel gains new real-time support. http://www.linuxdevices.com/news/NS9566944929.html, October 2006.
7. NSF CISE, GENI - Global Environment for Network Innovations. http://www.geni.net, 2007.
8. G. Almes, S. Kalidindi, and M. Zekauskas. A one-way delay metric for IPPM.IETF RFC 2679, September 1999.
9. G. Almes, S. Kalidindi, and M. Zekauskas. A one way packet loss metric for IPPM.IETF RFC 2680, September 1999.
10. D. Andersen, H. Balakrishnan, F. Kaashoek, and R. Morris. Resilient overlay networks. In Proceedings of ACM Symposium on Operating Systems Principles, Banff, Alberta, Canada, 2001.
11. M. Aron and P. Druschel. Soft Timers: Efficient Microsecond Software Timer Support for Network Processing. ACM Transactions on Computer Systems, August 2000.
12. S. Banerjee, T. Griffin, and M. Pias. The interdomain connectivity of PlanetLab nodes. In Proceedings of Passive and Active Measurement Workshop, Antibes Juan-les-Pins, France, April 2004.
13. P. Barham, B. Dragovic, K. Fraser, S. Hand, T. Harris, A. Ho, R. Heugebauer, I. Pratt, and A. Warfield. Xen and the Art of Virtualization. In Proceedings of ACM Symposium on Operating Systems Principles, October 2003.
14. A. Bavier, M. Bowman, B. Chun, D. Culler, S. Karlin, S. Muir, L. Peterson, T. Roscoe, T. Spalink, and M. Wawrzoniak. Operating System Support for Planetary-Scale Network Services. In USENIX Symposium on Networked Systems Design and Implementation, March 2004.
15. B. Bershad, S. Savage, P. Pardyak, E. Sirer, M. Fiuczynski, D. Becker, S. Eggers, and C. Chambers. Extensibility, safety and performance in the SPIN operating system. In Proceedings of ACM Symposium on Operating Systems Principles, Copper Mountain Resort, CO, December 1995.
16. J. Bolot. End-to-end packet delay and loss behavior in the internet. In Proceedings of ACM SIGCOMM, San Francisco, CA, September 1993.
17. R. Carter and M. Crovella. Measuring bottleneck link speed in packet-switched networks. Performance Evaluation Review, 27-28:297--318, October 1996.
18. National Research Council, editor. Looking Over the Fences at Networks: A Neighbor's View of Networking Research. National Academy Press, 2001.
19. D. Engler and M. Kaashoek. Exokernel: an operating system architecture for application-level resource management. In Proceedings of ACM Symposium on Operating Systems Principles, Copper Mountain Resort, CO, December 1995.
20. V. Jacobson. Congestion avoidance and control. In Proceedings of ACM SIGCOMM, Stanford, CA, 1988.
21. M. Jain and C. Dovrolis. End-to-end available bandwidth: Measurement methodology, dynamics, and relation to TCP throughput. In Proceedings of ACM SIGCOMM, Pittsburgh, PA, August 2002.
22. S. Kalidindi and M. Zekauskas. Surveyor: An Infrastructure for Internet Performance Measurements. In Proceedings of INET '99, 1999.
23. R. Kapoor, L.-J. Chen, L. Lao, M. Gerla, and M. Y. Sanadidi. CapProbe: a simple and accurate capacity estimation technique. In Proceedings of ACM SIGCOMM, Portland, OR, August 2004.
24. K. Lai and M. Baker. Measuring link bandwidths using a deterministic model of packet delay. In Proceedings of ACM SIGCOMM, Stockholm, Sweden, 2000 2000.
25. J. Liu and M. Crovella. Using loss pairs to discover network properties. In Proceedings of ACM Internet Measurement Workshop, San Francisco, CA, October 2001.
26. K. Park and V. Pai. CoMon - A Monitoring Infrastructure for PlanetLab. http://comon.cs.princeton.edu/.
27. A. Pásztor and D. Veitch. A precision infrastructure for active probing. In Proceedings of Passive and Active Measurement Workshop, Amsterdam, Netherlands, 2001.
28. A. Pásztor and D. Veitch. PC-based Precision Timing without GPS. In Proceedings of ACM SIGMETRICS, Marina Del Rey, CA, June 2002.
29. V. Paxson, A. Adams, and M. Mathis. Experiences with NIMI. In Proceedings of Passive and Active Measurement Workshop, 2000.
30. L. Peterson, S. Shenker, and J. Turner. Overcoming the Internet Impasse through Virtualization. In Proceedings of ACM SIGCOMM HotNets-III, 2004.
31. H. Pucha, Y. C. Hu, and Z. M. Mao. On the Impact of Research Network based Testbeds on Wide-Area Experiments. In Proceedings of ACM Internet Measurement Conference, Rio de Janeiro, Brazil, October 2006.
32. V. Ribeiro, R. Riedi, R. Baraniuk, J. Navratil, and L. Cottrell. pathChirp: Efficent Available Bandwidth Estimation for Network Paths. In Proceedings of Passive and Active Measurement Workshop, April 2003.
33. M. Rosenblum and T. Garfinkel. Virtual Machine Monitors: Current Technology and Future Trends. IEEE Computer, May 2005.
34. J. H. Saltzer, D. P. Reed, and D. D. Clark. End-to-end arguments in system design. ACM Transactions on Computer Systems, 2(4):277--288, November 1984.
35. E. Sarmiento. Securing FreeBSD using Jail. Sys Admin, 10(5):31--37, May 2001.
36. S. Soltesz, H. Pötzl, M. Fiuczynski, A. Bavier, and L. Peterson. Container-based Operating System Virtualization: A Scalable, High-performance Alternative to Hypervisors. In Proceedings of EuroSYS, 2007.
37. J. Sommers and P. Barford. Self-configuring network traffic generation. In Proceedings of ACM Internet Measurement Conference, Taormina, Sicily, Italy, October 2004.
38. J. Sommers, P. Barford, N. Duffield, and A. Ron. Improving Accuracy in End-to-end Packet Loss Measurement. In Proceedings of ACM SIGCOMM, Philadelphia, PA, August 2005.
39. J. Sommers, P. Barford, N. Duffield, and A. Ron. A Framework for Multi-objective SLA Compliance Monitoring. In Proceedings of IEEE INFOCOM (minisymposium), Anchorage, AK, May 2007.
40. J. Sommers, P. Barford, N. Duffield, and A. Ron. Accurate and Efficient SLA Compliance Monitoring. In To appear, Proceedings of ACM SIGCOMM, Kyoto, Japan, August 2007.
41. J. Sommers, P. Barford, and W. Willinger. A proposed framework for calibration of available bandwidth estimation tools. In Proceedings of IEEE Symposium on Computer and Communication, Pula, Sardinia, Italy, June 2006.
42. N. Spring, L. Peterson, A. Bavier, and V. Pai. Using PlanetLab for Network Research: Myths, Realities, and Best Practices. In Proceedings of the Second USENIX Workshop on Real, Large Distributed Systems (WORLDS '05), San Francisco, CA, December 2005.
43. N. Spring, D. Wetherall, and T. Anderson. Scriptroute: A Public Internet Measurement Facility. In Proceedings of USENIX Symposium on Internet Technologies and Systems (USITS), 2003.
44. J. Strauss, D. Katabi, and F. Kaashoek. A measurement study of available bandwidth estimation tools. In Proceedings of ACM Internet Measurement Conference, Miami, FL, October 2003.
45. Y. Zhang, R. West, and X. Qi. A virtual deadline scheduler for window-constrained service guarantees. In Proceedings of the 25th IEEE Real-time Systems Symposium (RTSS), December 2004.

Index Terms

• General and reference

  • Cross-computing tools and techniques

    • Measurement

    • Metrics

• Networks

  • Network protocols

    • Transport protocols

  • Network services

    • Network management

    • Network monitoring

  • Network types

    • Public Internet