skip to main content
10.1145/2486092.2486103acmconferencesArticle/Chapter ViewAbstractPublication PagespadsConference Proceedingsconference-collections
research-article

Leveraging symbiotic relationship between simulation and emulation for scalable network experimentation

Published:19 May 2013Publication History

ABSTRACT

A testbed capable of representing detailed operations of complex applications under diverse large-scale network conditions can be extremely helpful for investigating potential system design and implementation problems, and studying application performance issues, such as scalability and robustness, even before the applications are deployed in a real environment. We introduce a novel method that combines high-performance large-scale network simulation and high-fidelity network emulation, and thereby enables real instances of network applications and protocols to run in real operating environments, and be tested under large-scale simulated network settings. In our approach, network simulation and emulation form a symbiotic relationship, through which they are synchronized for an accurate representation of the large-scale traffic behavior. We introduce a model downscaling method, along with an efficient queuing model and a traffic reproduction technique, which can significantly reduce the synchronization overhead and improve computational efficiency, while maintaining the accuracy of the system. We validate our approach with extensive experiments via simulation and with a real-system prototype.

References

  1. J. Ahrenholz, C. Danilov, T. Henderson, and J. Kim. CORE: A real-time network emulator. MILCOM'08, pages 1--7.Google ScholarGoogle Scholar
  2. C. Barakat, P. Thiran, G. Iannaccone, C. Diot, and P. Owezarski. A flow-based model for Internet backbone traffic. IMW'02, pages 35--47. Google ScholarGoogle ScholarDigital LibraryDigital Library
  3. P. Barford and L. Landweber. Bench-style network research in an Internet instance laboratory. SIGCOMM Comput. Commun. Rev., 33(3):21--26, 2003. Google ScholarGoogle ScholarDigital LibraryDigital Library
  4. L. Breslau, D. Estrin, K. Fall, S. Floyd, J. Heidemann, A. Helmy, P. Huang, S. McCanne, K. Varadhan, Y. Xu, and H. Yu. Advances in network simulation. IEEE Computer, 33(5):59--67, 2000. Google ScholarGoogle ScholarDigital LibraryDigital Library
  5. CAIDA Anonymized Internet Traces 2011 Dataset. http://www.caida.org/data/passive/passive_2011_dataset.xml.Google ScholarGoogle Scholar
  6. X. Chang. Network simulations with OPNET. WSC'99, pages 307--314. Google ScholarGoogle ScholarDigital LibraryDigital Library
  7. M. A. Erazo, Y. Li, and J. Liu. SVEET! A scalable virtualized evaluation environment for TCP. TRIDENTCOM'09, pages 1--10.Google ScholarGoogle Scholar
  8. D. Eun and N. Shroff. Simplification of network analysis in large-bandwidth systems. INFOCOM'03.Google ScholarGoogle Scholar
  9. K. Fall. Network emulation in the Vint/NS simulator. ISCC'99, pages 244--250. Google ScholarGoogle ScholarDigital LibraryDigital Library
  10. C. Fraleigh, S. Moon, B. Lyles, C. Cotton, M. Khan, D. Moll, R. Rockell, T. Seely, and S. C. Diot. Packet-level traffic measurements from the Sprint IP backbone. Netwrk. Mag. of Global Internetwkg., 17(6):6--16, 2003. Google ScholarGoogle ScholarDigital LibraryDigital Library
  11. C. Fraleigh, F. Tobagi, and C. Diot. Provisioning IP backbone networks to support latency sensitive traffic. INFOCOM'03.Google ScholarGoogle Scholar
  12. R. Fujimoto, D. Lunceford, E. Page, and A. M. Uhrmacher. Grand challenges for modeling and simulation. Technical Report 350, Schloss Dagstuhl, 2002.Google ScholarGoogle Scholar
  13. Y. Gu. ROSENET: A remote server-based network emulation system. PhD thesis, Georgia Institute of Technology, 2007. Google ScholarGoogle ScholarDigital LibraryDigital Library
  14. M. Handley, E. Kohler, A. Ghosh, O. Hodson, and P. Radoslavov. Designing extensible IP router software. NSDI'05, pages 189--202. Google ScholarGoogle ScholarDigital LibraryDigital Library
  15. M. Liljenstam, J. Liu, D. Nicol, Y. Yuan, G. Yan, and C. Grier. RINSE: the real-time immersive network simulation environment for network security exercises. PADS'05, pages 119--128. Google ScholarGoogle ScholarDigital LibraryDigital Library
  16. J. Liu. A primer for real-time simulation of large-scale networks. ANSS'08, pages 85--94. Google ScholarGoogle ScholarDigital LibraryDigital Library
  17. J. Liu, Y. Li, N. V. Vorst, S. Mann, and K. Hellman. A real-time network simulation infrastructure based on OpenVPN. Journal of Systems and Software, 82(3):473--485, 2009. Google ScholarGoogle ScholarDigital LibraryDigital Library
  18. X. Liu, H. Xia, and A. A. Chien. Network emulation tools for modeling grid behavior. CCGrid'03.Google ScholarGoogle Scholar
  19. D. M. Nicol, D. Jin, and Y. Zheng. S3F: the scalable simulation framework revisited. WSC'11, pages 3288--3299. Google ScholarGoogle ScholarDigital LibraryDigital Library
  20. Open vSwitch. http://openvswitch.org/.Google ScholarGoogle Scholar
  21. F. Papadopoulos, K. Psounis, and R. Govindan. Performance preserving topological downscaling of Internet-like networks. IEEE J. Sel. Areas Commun., 24(12):2313--2326, 2006. Google ScholarGoogle ScholarCross RefCross Ref
  22. K. Papagiannaki, S. Moon, C. Fraleigh, P. Thiran, F. Tobagi, and C. Diot. Analysis of measured single-hop delay from an operational backbone network. INFOCOM'02.Google ScholarGoogle Scholar
  23. L. Peterson, T. Anderson, D. Culler, and T. Roscoe. A blueprint for introducing disruptive technology into the Internet. HotNets-I, 2002.Google ScholarGoogle ScholarDigital LibraryDigital Library
  24. PRIME. https://www.primessf.net/prime/.Google ScholarGoogle Scholar
  25. ProtoGENI. http://www.protogeni.net/.Google ScholarGoogle Scholar
  26. L. Rizzo. Dummynet: a simple approach to the evaulation of network protocols. SIGCOMM Comput. Commun. Rev., 27(1):31--41, 1997. Google ScholarGoogle ScholarDigital LibraryDigital Library
  27. P. Sanaga, J. Duerig, R. Ricci, and J. Lepreau. Modeling and emulation of Internet paths. NSDI'09, pages 199--212. Google ScholarGoogle ScholarDigital LibraryDigital Library
  28. R. Simmonds, R. Bradford, and B. Unger. Applying parallel discrete event simulation to network emulation. PADS'00, pages 15--22. Google ScholarGoogle ScholarDigital LibraryDigital Library
  29. B. K. Szymanski, A. Saifee, A. Sastry, Y. Liu, and K. Madnani. Genesis: a system for large-scale parallel network simulation. PADS'02, pages 89--96. Google ScholarGoogle ScholarDigital LibraryDigital Library
  30. A. Vahdat, K. Yocum, K. Walsh, P. Mahadevan, D. Kostic, J. Chase, and D. Becker. Scalability and accuracy in a large-scale network emulator. SIGOPS Oper. Syst. Rev., 36(SI):271--284, 2002. Google ScholarGoogle ScholarDigital LibraryDigital Library
  31. N. Van Vorst, M. Erazo, and J. Liu. PrimoGENI: Integrating real-time network simulation and emulation in GENI. PADS'11, pages 1--9. Google ScholarGoogle ScholarDigital LibraryDigital Library
  32. N. Van Vorst, T. Li, and J. Liu. How low can you go? Spherical routing for scalable network simulations. MASCOTS'11, pages 259--268. Google ScholarGoogle ScholarDigital LibraryDigital Library
  33. B. White, J. Lepreau, L. Stoller, R. Ricci, S. Guruprasad, M. Newbold, M. Hibler, C. Barb, and A. Joglekar. An integrated experimental environment for distributed systems and networks. OSDI'02, pages 255--270. Google ScholarGoogle ScholarDigital LibraryDigital Library
  34. T. Ye, S. Kalyanaraman, D. Harrison, B. Sikdar, B. Mo, H. Tahilramani, K. Vastola, and B. Szymanski. Network management and control using collaborative on-line simulation. ICC'01.Google ScholarGoogle Scholar
  35. Y. Zhang and N. Duffield. On the constancy of Internet path properties. IMW'01, pages 197--211. Google ScholarGoogle ScholarDigital LibraryDigital Library
  36. J. Zhou, Z. Ji, M. Takai, and R. Bagrodia. MAYA: integrating hybrid network modeling to the physical world. TOMACS, 14(2):149--169, 2004. Google ScholarGoogle ScholarDigital LibraryDigital Library

Index Terms

  1. Leveraging symbiotic relationship between simulation and emulation for scalable network experimentation

    Recommendations

    Comments

    Login options

    Check if you have access through your login credentials or your institution to get full access on this article.

    Sign in
    • Published in

      cover image ACM Conferences
      SIGSIM PADS '13: Proceedings of the 1st ACM SIGSIM Conference on Principles of Advanced Discrete Simulation
      May 2013
      426 pages
      ISBN:9781450319201
      DOI:10.1145/2486092

      Copyright © 2013 ACM

      Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      • Published: 19 May 2013

      Permissions

      Request permissions about this article.

      Request Permissions

      Check for updates

      Qualifiers

      • research-article

      Acceptance Rates

      SIGSIM PADS '13 Paper Acceptance Rate29of75submissions,39%Overall Acceptance Rate398of779submissions,51%

    PDF Format

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader