skip to main content
research-article

Symbiotic Network Simulation and Emulation

Published:29 June 2015Publication History
Skip Abstract Section

Abstract

A testbed capable of representing detailed operations of complex applications under diverse network conditions is invaluable for understanding the design and performance of new protocols and applications before their real deployment. We introduce a novel method that combines high-performance large-scale network simulation and high-fidelity network emulation, and thus enables real instances of network applications and protocols to run in real operating environments and be tested under simulated network settings. Using our approach, network simulation and emulation can form a symbiotic relationship, through which they are synchronized for an accurate representation of the network-scale traffic behavior. We introduce a model downscaling method along with an efficient queuing model and a traffic reproduction technique, which can significantly reduce the synchronization overhead and improve accuracy. We validate our approach with extensive experiments via simulation and with a real-system implementation. We also present a case study using our approach to evaluate a multipath data transport protocol.

References

  1. Jeff Ahrenholz, Claudiu Danilov, Thomas R. Henderson, and Jae H. Kim. 2008. CORE: A real-time network emulator. In Proceedings of the IEEE Military Communications Conference (MILCOM'08). 1--7.Google ScholarGoogle Scholar
  2. Chadi Barakat, Patrick Thiran, Gianluca Iannaccone, Christophe Diot, and Philippe Owezarski. 2002. A flow-based model for Internet backbone traffic. In Proceedings of the 2nd ACM SIGCOMM Workshop on Internet Measurement (IMW'02). 35--47. Google ScholarGoogle ScholarDigital LibraryDigital Library
  3. Paul Barford and Larry Landweber. 2003. Bench-style network research in an Internet instance laboratory. ACM SIGCOMM Computer Communication Review 33, 3, 21--26. Google ScholarGoogle ScholarDigital LibraryDigital Library
  4. Lee Breslau, Deborah Estrin, Kevin Fall, Sally Floyd, John Heidemann, Ahmed Helmy, Polly Huang, Steven McCanne, Kannan Varadhan, Ya Xu, and Haobo Yu. 2000. Advances in network simulation. IEEE Computer 33, 5, 59--67. Google ScholarGoogle ScholarDigital LibraryDigital Library
  5. CAIDA. 2011. The CAIDA Anonymized Internet Traces 2011 Dataset. Retrieved May 28, 2015, from http://www.caida.org/data/passive/passive_2011_dataset.xml.Google ScholarGoogle Scholar
  6. Mark Carson and Darrin Santay. 2003. NIST Net: A Linux-based network emulation tool. SIGCOMM Computer Communication Review 33, 3, 111--126. Google ScholarGoogle ScholarDigital LibraryDigital Library
  7. Xinjie Chang. 1999. Network simulations with OPNET. In Proceedings of the 1999 Winter Simulation Conference, Vol. 1. 307--314. Google ScholarGoogle ScholarDigital LibraryDigital Library
  8. DDDAS. 2014. Dynamic Data-Driven Application Systems Info Cybernetics. Retrieved May 28, 2015, from http://www.dddas.org/.Google ScholarGoogle Scholar
  9. Miguel A. Erazo, Yue Li, and Jason Liu. 2009. SVEET! A scalable virtualized evaluation environment for TCP. In Proceedings of the 5th International Conference on Testbeds and Research Infrastructures for the Development of Networks and Communities and Workshops (TRIDENTCOM'09). 1--10.Google ScholarGoogle ScholarCross RefCross Ref
  10. Do Young Eun and Ness B. Shroff. 2003. Simplification of network analysis in large-bandwidth systems. In Proceedings of the 22nd Annual Joint Conference of the IEEE Computer and Communications Societies (INFOCOM'03).Google ScholarGoogle Scholar
  11. Kevin Fall. 1999. Network emulation in the Vint/NS simulator. In Proceedings of the 4th IEEE Symposium on Computers and Communications. 244--250. Google ScholarGoogle ScholarDigital LibraryDigital Library
  12. Chuck Fraleigh, Sue Moon, Bryan Lyles, Chase Cotton, Mujahid Khan, Deb Moll, Rob Rockell, Ted Seely, and Christophe Diot. 2003a. Packet-level traffic measurements from the Sprint IP backbone. IEEE Network 17, 6, 6--16. Google ScholarGoogle ScholarDigital LibraryDigital Library
  13. Chuck Fraleigh, Fouad Tobagi, and Christophe Diot. 2003b. Provisioning IP backbone networks to support latency sensitive traffic. In Proceedings of the 22nd Annual Joint Conference of the IEEE Computer and Communications Societies (INFOCOM'03).Google ScholarGoogle ScholarCross RefCross Ref
  14. Richard Fujimoto, Dell Lunceford, Ernest Page, and Adelinde M. Uhrmacher. 2002. Grand Challenges for Modeling and Simulation. Technical Report 350. Schloss Dagstuhl.Google ScholarGoogle Scholar
  15. Yan Gu. 2007. ROSENET: A Remote Server-Based Network Emulation System. Ph.D. Dissertation. Georgia Institute of Technology. Google ScholarGoogle ScholarDigital LibraryDigital Library
  16. Huaizhong Han, Srinivas Shakkottai, Christopher V. Hollot, Rayadurgam Srikant, and Don Towsley. 2006. Multi-path TCP: A joint congestion control and routing scheme to exploit path diversity in the Internet. IEEE/ACM Transactions on Networking 14, 6, 1260--1271. Google ScholarGoogle ScholarDigital LibraryDigital Library
  17. Mark Handley, Eddie Kohler, Atanu Ghosh, Orion Hodson, and Pavlin Radoslavov. 2005. Designing extensible IP router software. In Proceedings of the 2nd Symposium on Networked Systems Design and Implementation (NSDI'05). 189--202. Google ScholarGoogle ScholarDigital LibraryDigital Library
  18. Dong Jin and David M. Nicol. 2010. Fast simulation of background traffic through fair queueing networks. In Proceedings of the Winter Simulation Conference. 2935--2946. Google ScholarGoogle ScholarDigital LibraryDigital Library
  19. Eddie Kohler, Robert Morris, Benjie Chen, John Jannotti, and M. Frans Kaashoek. 2000. The Click modular router. ACM Transactions on Computer Systems 18, 8, 263--297. Google ScholarGoogle ScholarDigital LibraryDigital Library
  20. Michael Liljenstam, Jason Liu, David M. Nicol, Yougu Yuan, Guanhua Yan, and Chris Grier. 2005. RINSE: The real-time interactive network simulation environment for network security exercises. In Proceedings of the 19th Workshop on Parallel and Distributed Simulation (PADS'05). 119--128. Google ScholarGoogle ScholarDigital LibraryDigital Library
  21. Jason Liu. 2008. A primer for real-time simulation of large-scale networks. In Proceedings of the 41st Annual Simulation Symposium (ANSS'08). 85--94. Google ScholarGoogle ScholarDigital LibraryDigital Library
  22. Jason Liu. 2013. Real-time scheduling of logical processes for parallel discrete-event simulation. In Proceedings of the Winter Simulation Conference. 2959--2971. Google ScholarGoogle ScholarDigital LibraryDigital Library
  23. Jason Liu, Yue Li, Nathanael Van Vorst, Scott Mann, and Keith Hellman. 2009. A real-time network simulation infrastructure based on OpenVPN. Journal of Systems and Software 82, 3, 473--485. Google ScholarGoogle ScholarDigital LibraryDigital Library
  24. Xin Liu, Huaxia Xia, and Andrew A. Chien. 2003. Network emulation tools for modeling grid behavior. In Proceedings of the 3rd IEEE/ACM International Symposium on Cluster Computing and the Grid (CCGrid 03).Google ScholarGoogle Scholar
  25. David M. Nicol, Dong Jin, and Yuhao Zheng. 2011. S3F: The scalable simulation framework revisited. In Proceedings of the Winter Simulation Conference. 3288--3299. Google ScholarGoogle ScholarDigital LibraryDigital Library
  26. Open vSwitch. 2013. An Open Virtual Switch. Retrieved May 28, 2015, from http://openvswitch.org/.Google ScholarGoogle Scholar
  27. Fragkiskos Papadopoulos, Konstantinos Psounis, and Ramesh Govindan. 2006. Performance preserving topological downscaling of Internet-like networks. IEEE Journal on Selected Areas in Communications 24, 12, 2313--2326. Google ScholarGoogle ScholarCross RefCross Ref
  28. Konstantinos Papagiannaki, Sue Moon, Chuck Fraleigh, Patrick Thiran, Fouad Tobagi, and Christophe Diot. 2002. Analysis of measured single-hop delay from an operational backbone network. In Proceedings of the 21st Annual Joint Conference of the IEEE Computer and Communications Society (INFOCOM'02).Google ScholarGoogle ScholarCross RefCross Ref
  29. Larry Peterson, Tom Anderson, David Culler, and Timothy Roscoe. 2002. A blueprint for introducing disruptive technology into the Internet. In Proceedings of the 1st Workshop on Hot Topics in Networking (HotNets-I'02).Google ScholarGoogle Scholar
  30. PRIME. 2013. Parallel Real-Time Immersive Network Modeling Environment. Retrieved May 28, 2015, from https://www.primessf.net/prime/.Google ScholarGoogle Scholar
  31. ProtoGENI. 2013. ProtoGENI. Retrieved May 28, 2015, from http://www.protogeni.net/.Google ScholarGoogle Scholar
  32. Costin Raiciu, Damon Wischik, and Mark Handley. 2009. Practical Congestion Control for Multipath Transport Protocols. Technical Report. University College of London.Google ScholarGoogle Scholar
  33. Luigi Rizzo. 1997. Dummynet: A simple approach to the evaluation of network protocols. ACM SIGCOMM Computer Communication Review 27, 1, 31--41. Google ScholarGoogle ScholarDigital LibraryDigital Library
  34. Pramod Sanaga, Jonathon Duerig, Robert Ricci, and Jay Lepreau. 2009. Modeling and emulation of Internet paths. In Proceedings of the 6th Conference on Networked Systems Design and Implementation (NSDI'09). 199--212. Google ScholarGoogle ScholarDigital LibraryDigital Library
  35. Rob Simmonds, Russell Bradford, and Brian Unger. 2000. Applying parallel discrete event simulation to network emulation. In Proceedings of the 14th Workshop on Parallel and Distributed Simulation (PADS'00). 15--22. Google ScholarGoogle ScholarDigital LibraryDigital Library
  36. Boleslaw K. Szymanski, Adnan Saifee, Anand Sastry, Yu Liu, and Kiran Madnani. 2002. Genesis: A system for large-scale parallel network simulation. In Proceedings of the 16th Workshop on Parallel and Distributed Simulation (PADS'02). 89--96. Google ScholarGoogle ScholarDigital LibraryDigital Library
  37. Amin Vahdat, Ken Yocum, Kevin Walsh, Priya Mahadevan, Dejan Kostić, Jeff Chase, and David Becker. 2002. Scalability and accuracy in a large-scale network emulator. ACM SIGOPS Operating Systems Review 36, SI, 271--284. Google ScholarGoogle ScholarDigital LibraryDigital Library
  38. Nathanael Van Vorst, Miguel Erazo, and Jason Liu. 2011a. PrimoGENI: Integrating real-time network simulation and emulation in GENI. In Proceedings of the 2011 IEEE Workshop on Principles of Advanced and Distributed Simulation (PADS'11). 1--9. Google ScholarGoogle ScholarDigital LibraryDigital Library
  39. Nathanael Van Vorst, Ting Li, and Jason Liu. 2011b. How low can you go? Spherical routing for scalable network simulations. In Proceedings of the 19th IEEE Annual International Symposium on Modelling, Analysis, and Simulation of Computer and Telecommunication Systems (MASCOTS'11). 259--268. Google ScholarGoogle ScholarDigital LibraryDigital Library
  40. Brian White, Jay Lepreau, Leigh Stoller, Robert Ricci, Shashi Guruprasad, Mac Newbold, Mike Hibler, Chad Barb, and Abhijeet Joglekar. 2002. An integrated experimental environment for distributed systems and networks. In Proceedings of the 5th Symposium on Operating Systems Design and Implementation (OSDI'02). 255--270. Google ScholarGoogle ScholarDigital LibraryDigital Library
  41. Tao Ye, Shivkumar Kalyanaraman, David Harrison, Biplab Sikdar, Bin Mo, Hema Tahilramani, Ken Vastola, and Boleslaw Szymanski. 2001. Network management and control using collaborative on-line simulation. In Proceedings of the IEEE International Conference on Communications (ICC'01).Google ScholarGoogle ScholarCross RefCross Ref
  42. Yin Zhang and Nick Duffield. 2001. On the constancy of Internet path properties. In Proceedings of the 1st ACM SIGCOMM Workshop on Internet Measurement (IMW'01). 197--211. Google ScholarGoogle ScholarDigital LibraryDigital Library
  43. Junlan Zhou, Zhengrong Ji, Mineo Takai, and Rajive Bagrodia. 2004. MAYA: Integrating hybrid network modeling to the physical world. ACM Transactions on Modeling and Computer Simulation 14, 2, 149--169. Google ScholarGoogle ScholarDigital LibraryDigital Library

Index Terms

  1. Symbiotic Network Simulation and Emulation

    Recommendations

    Comments

    Login options

    Check if you have access through your login credentials or your institution to get full access on this article.

    Sign in

    Full Access

    • Published in

      cover image ACM Transactions on Modeling and Computer Simulation
      ACM Transactions on Modeling and Computer Simulation  Volume 26, Issue 1
      Special Issue on PADS
      December 2015
      210 pages
      ISSN:1049-3301
      EISSN:1558-1195
      DOI:10.1145/2798338
      Issue’s Table of Contents

      Copyright © 2015 ACM

      Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      • Published: 29 June 2015
      • Accepted: 1 January 2015
      • Revised: 1 December 2014
      • Received: 1 January 2014
      Published in tomacs Volume 26, Issue 1

      Permissions

      Request permissions about this article.

      Request Permissions

      Check for updates

      Qualifiers

      • research-article
      • Research
      • Refereed

    PDF Format

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader