Abstract
A testbed capable of representing detailed operations of complex applications under diverse network conditions is invaluable for understanding the design and performance of new protocols and applications before their real deployment. We introduce a novel method that combines high-performance large-scale network simulation and high-fidelity network emulation, and thus enables real instances of network applications and protocols to run in real operating environments and be tested under simulated network settings. Using our approach, network simulation and emulation can form a symbiotic relationship, through which they are synchronized for an accurate representation of the network-scale traffic behavior. We introduce a model downscaling method along with an efficient queuing model and a traffic reproduction technique, which can significantly reduce the synchronization overhead and improve accuracy. We validate our approach with extensive experiments via simulation and with a real-system implementation. We also present a case study using our approach to evaluate a multipath data transport protocol.
- Jeff Ahrenholz, Claudiu Danilov, Thomas R. Henderson, and Jae H. Kim. 2008. CORE: A real-time network emulator. In Proceedings of the IEEE Military Communications Conference (MILCOM'08). 1--7.Google Scholar
- Chadi Barakat, Patrick Thiran, Gianluca Iannaccone, Christophe Diot, and Philippe Owezarski. 2002. A flow-based model for Internet backbone traffic. In Proceedings of the 2nd ACM SIGCOMM Workshop on Internet Measurement (IMW'02). 35--47. Google ScholarDigital Library
- Paul Barford and Larry Landweber. 2003. Bench-style network research in an Internet instance laboratory. ACM SIGCOMM Computer Communication Review 33, 3, 21--26. Google ScholarDigital Library
- Lee Breslau, Deborah Estrin, Kevin Fall, Sally Floyd, John Heidemann, Ahmed Helmy, Polly Huang, Steven McCanne, Kannan Varadhan, Ya Xu, and Haobo Yu. 2000. Advances in network simulation. IEEE Computer 33, 5, 59--67. Google ScholarDigital Library
- CAIDA. 2011. The CAIDA Anonymized Internet Traces 2011 Dataset. Retrieved May 28, 2015, from http://www.caida.org/data/passive/passive_2011_dataset.xml.Google Scholar
- Mark Carson and Darrin Santay. 2003. NIST Net: A Linux-based network emulation tool. SIGCOMM Computer Communication Review 33, 3, 111--126. Google ScholarDigital Library
- Xinjie Chang. 1999. Network simulations with OPNET. In Proceedings of the 1999 Winter Simulation Conference, Vol. 1. 307--314. Google ScholarDigital Library
- DDDAS. 2014. Dynamic Data-Driven Application Systems Info Cybernetics. Retrieved May 28, 2015, from http://www.dddas.org/.Google Scholar
- Miguel A. Erazo, Yue Li, and Jason Liu. 2009. SVEET! A scalable virtualized evaluation environment for TCP. In Proceedings of the 5th International Conference on Testbeds and Research Infrastructures for the Development of Networks and Communities and Workshops (TRIDENTCOM'09). 1--10.Google ScholarCross Ref
- Do Young Eun and Ness B. Shroff. 2003. Simplification of network analysis in large-bandwidth systems. In Proceedings of the 22nd Annual Joint Conference of the IEEE Computer and Communications Societies (INFOCOM'03).Google Scholar
- Kevin Fall. 1999. Network emulation in the Vint/NS simulator. In Proceedings of the 4th IEEE Symposium on Computers and Communications. 244--250. Google ScholarDigital Library
- Chuck Fraleigh, Sue Moon, Bryan Lyles, Chase Cotton, Mujahid Khan, Deb Moll, Rob Rockell, Ted Seely, and Christophe Diot. 2003a. Packet-level traffic measurements from the Sprint IP backbone. IEEE Network 17, 6, 6--16. Google ScholarDigital Library
- Chuck Fraleigh, Fouad Tobagi, and Christophe Diot. 2003b. Provisioning IP backbone networks to support latency sensitive traffic. In Proceedings of the 22nd Annual Joint Conference of the IEEE Computer and Communications Societies (INFOCOM'03).Google ScholarCross Ref
- Richard Fujimoto, Dell Lunceford, Ernest Page, and Adelinde M. Uhrmacher. 2002. Grand Challenges for Modeling and Simulation. Technical Report 350. Schloss Dagstuhl.Google Scholar
- Yan Gu. 2007. ROSENET: A Remote Server-Based Network Emulation System. Ph.D. Dissertation. Georgia Institute of Technology. Google ScholarDigital Library
- Huaizhong Han, Srinivas Shakkottai, Christopher V. Hollot, Rayadurgam Srikant, and Don Towsley. 2006. Multi-path TCP: A joint congestion control and routing scheme to exploit path diversity in the Internet. IEEE/ACM Transactions on Networking 14, 6, 1260--1271. Google ScholarDigital Library
- Mark Handley, Eddie Kohler, Atanu Ghosh, Orion Hodson, and Pavlin Radoslavov. 2005. Designing extensible IP router software. In Proceedings of the 2nd Symposium on Networked Systems Design and Implementation (NSDI'05). 189--202. Google ScholarDigital Library
- Dong Jin and David M. Nicol. 2010. Fast simulation of background traffic through fair queueing networks. In Proceedings of the Winter Simulation Conference. 2935--2946. Google ScholarDigital Library
- Eddie Kohler, Robert Morris, Benjie Chen, John Jannotti, and M. Frans Kaashoek. 2000. The Click modular router. ACM Transactions on Computer Systems 18, 8, 263--297. Google ScholarDigital Library
- Michael Liljenstam, Jason Liu, David M. Nicol, Yougu Yuan, Guanhua Yan, and Chris Grier. 2005. RINSE: The real-time interactive network simulation environment for network security exercises. In Proceedings of the 19th Workshop on Parallel and Distributed Simulation (PADS'05). 119--128. Google ScholarDigital Library
- Jason Liu. 2008. A primer for real-time simulation of large-scale networks. In Proceedings of the 41st Annual Simulation Symposium (ANSS'08). 85--94. Google ScholarDigital Library
- Jason Liu. 2013. Real-time scheduling of logical processes for parallel discrete-event simulation. In Proceedings of the Winter Simulation Conference. 2959--2971. Google ScholarDigital Library
- Jason Liu, Yue Li, Nathanael Van Vorst, Scott Mann, and Keith Hellman. 2009. A real-time network simulation infrastructure based on OpenVPN. Journal of Systems and Software 82, 3, 473--485. Google ScholarDigital Library
- Xin Liu, Huaxia Xia, and Andrew A. Chien. 2003. Network emulation tools for modeling grid behavior. In Proceedings of the 3rd IEEE/ACM International Symposium on Cluster Computing and the Grid (CCGrid 03).Google Scholar
- David M. Nicol, Dong Jin, and Yuhao Zheng. 2011. S3F: The scalable simulation framework revisited. In Proceedings of the Winter Simulation Conference. 3288--3299. Google ScholarDigital Library
- Open vSwitch. 2013. An Open Virtual Switch. Retrieved May 28, 2015, from http://openvswitch.org/.Google Scholar
- Fragkiskos Papadopoulos, Konstantinos Psounis, and Ramesh Govindan. 2006. Performance preserving topological downscaling of Internet-like networks. IEEE Journal on Selected Areas in Communications 24, 12, 2313--2326. Google ScholarCross Ref
- Konstantinos Papagiannaki, Sue Moon, Chuck Fraleigh, Patrick Thiran, Fouad Tobagi, and Christophe Diot. 2002. Analysis of measured single-hop delay from an operational backbone network. In Proceedings of the 21st Annual Joint Conference of the IEEE Computer and Communications Society (INFOCOM'02).Google ScholarCross Ref
- Larry Peterson, Tom Anderson, David Culler, and Timothy Roscoe. 2002. A blueprint for introducing disruptive technology into the Internet. In Proceedings of the 1st Workshop on Hot Topics in Networking (HotNets-I'02).Google Scholar
- PRIME. 2013. Parallel Real-Time Immersive Network Modeling Environment. Retrieved May 28, 2015, from https://www.primessf.net/prime/.Google Scholar
- ProtoGENI. 2013. ProtoGENI. Retrieved May 28, 2015, from http://www.protogeni.net/.Google Scholar
- Costin Raiciu, Damon Wischik, and Mark Handley. 2009. Practical Congestion Control for Multipath Transport Protocols. Technical Report. University College of London.Google Scholar
- Luigi Rizzo. 1997. Dummynet: A simple approach to the evaluation of network protocols. ACM SIGCOMM Computer Communication Review 27, 1, 31--41. Google ScholarDigital Library
- Pramod Sanaga, Jonathon Duerig, Robert Ricci, and Jay Lepreau. 2009. Modeling and emulation of Internet paths. In Proceedings of the 6th Conference on Networked Systems Design and Implementation (NSDI'09). 199--212. Google ScholarDigital Library
- Rob Simmonds, Russell Bradford, and Brian Unger. 2000. Applying parallel discrete event simulation to network emulation. In Proceedings of the 14th Workshop on Parallel and Distributed Simulation (PADS'00). 15--22. Google ScholarDigital Library
- Boleslaw K. Szymanski, Adnan Saifee, Anand Sastry, Yu Liu, and Kiran Madnani. 2002. Genesis: A system for large-scale parallel network simulation. In Proceedings of the 16th Workshop on Parallel and Distributed Simulation (PADS'02). 89--96. Google ScholarDigital Library
- Amin Vahdat, Ken Yocum, Kevin Walsh, Priya Mahadevan, Dejan Kostić, Jeff Chase, and David Becker. 2002. Scalability and accuracy in a large-scale network emulator. ACM SIGOPS Operating Systems Review 36, SI, 271--284. Google ScholarDigital Library
- Nathanael Van Vorst, Miguel Erazo, and Jason Liu. 2011a. PrimoGENI: Integrating real-time network simulation and emulation in GENI. In Proceedings of the 2011 IEEE Workshop on Principles of Advanced and Distributed Simulation (PADS'11). 1--9. Google ScholarDigital Library
- Nathanael Van Vorst, Ting Li, and Jason Liu. 2011b. How low can you go? Spherical routing for scalable network simulations. In Proceedings of the 19th IEEE Annual International Symposium on Modelling, Analysis, and Simulation of Computer and Telecommunication Systems (MASCOTS'11). 259--268. Google ScholarDigital Library
- Brian White, Jay Lepreau, Leigh Stoller, Robert Ricci, Shashi Guruprasad, Mac Newbold, Mike Hibler, Chad Barb, and Abhijeet Joglekar. 2002. An integrated experimental environment for distributed systems and networks. In Proceedings of the 5th Symposium on Operating Systems Design and Implementation (OSDI'02). 255--270. Google ScholarDigital Library
- Tao Ye, Shivkumar Kalyanaraman, David Harrison, Biplab Sikdar, Bin Mo, Hema Tahilramani, Ken Vastola, and Boleslaw Szymanski. 2001. Network management and control using collaborative on-line simulation. In Proceedings of the IEEE International Conference on Communications (ICC'01).Google ScholarCross Ref
- Yin Zhang and Nick Duffield. 2001. On the constancy of Internet path properties. In Proceedings of the 1st ACM SIGCOMM Workshop on Internet Measurement (IMW'01). 197--211. Google ScholarDigital Library
- Junlan Zhou, Zhengrong Ji, Mineo Takai, and Rajive Bagrodia. 2004. MAYA: Integrating hybrid network modeling to the physical world. ACM Transactions on Modeling and Computer Simulation 14, 2, 149--169. Google ScholarDigital Library
Index Terms
- Symbiotic Network Simulation and Emulation
Recommendations
Leveraging symbiotic relationship between simulation and emulation for scalable network experimentation
SIGSIM PADS '13: Proceedings of the 1st ACM SIGSIM Conference on Principles of Advanced Discrete SimulationA testbed capable of representing detailed operations of complex applications under diverse large-scale network conditions can be extremely helpful for investigating potential system design and implementation problems, and studying application ...
Toward Scalable Emulation of Future Internet Applications with Simulation Symbiosis
DS-RT 2015: Proceedings of the 19th International Symposium on Distributed Simulation and Real Time ApplicationsMininet is a popular container-based emulation environment built on Linux for testing OpenFlow applications. Using Mininet, one can compose an experimental network using a set of virtual hosts and virtual switches with flexibility. However, it is well ...
Adaptive Model Update Algorithms for Remote Network Emulation
PADS '08: Proceedings of the 22nd Workshop on Principles of Advanced and Distributed SimulationRemote network emulation is an approach that utilizes a remote parallel simulator to improve the scale and accuracy of network emulation for general users with no local access to high performance computing facilities. The remote network emulation ...
Comments