A multi-domain SDN for dynamic layer-2 path service

ABSTRACT

This paper describes our experience in deploying a multidomain Software-Defined Network (SDN) that supports dynamic Layer-2 (L2) path service, and offers insights gained from this experience. SDN controllers, capable of handling requests for advance-reservation and provisioning of rate-guaranteed L2 paths, were deployed in each domain. The experience demonstrated that this architecture can support global-scale multi-domain dynamic L2 path service. However, to reach this scale, better tools are required for diagnostics of end-to-end L2 connectivity, and better error-reporting functionality is needed from the SDN controllers. As a use case for rate-guaranteed L2 path service, we experimented with high-speed large dataset transfers. We found that a combination of Circuit TCP (CTCP), in which the sending rate is held fixed, and a token bucket filter based rate shaper at the sending host, is best to achieve almost 0-loss, high-throughput transfers across L2 paths. Detailed studies were conducted to understand the impact of the rate-shaper and CTCP parameters to find the best settings.

References

1. N. S. V. Rao, W. Wing, S. Carter, and Q. Wu, "Ultrascience net: network testbed for large-scale science applications," Communications Magazine, IEEE, vol. 43, pp. S12--S17, Nov 2005.
2. D. Katramatos, D. Yu, B. Gibbard, and S. McKee, "The TeraPaths testbed: Exploring end-to-end network QoS," in Testbeds and Research Infrastructure for the Development of Networks and Communities, 2007. TridentCom 2007. 3rd International Conference on, pp. 1--7, May 2007.
3. A. Bobyshev, M. Crawford, P. DeMar, V. Grigaliunas, M. Grigoriev, A. Moibenko, D. Petravick, and R. Rechenmacher, "Lambda station: On-demand flow based routing for data intensive grid applications over multitopology networks," in Broadband Communications, Networks and Systems, 2006. BROADNETS 2006. 3rd International Conference on, pp. 1--9, Oct 2006.
4. X. Zheng, M. Veeraraghavan, N. S. V. Rao, Q. Wu, and M. Zhu, "CHEETAH: Circuit-switched High-speed End-to-End Transport ArcHitecture testbed," Communications Magazine, IEEE, vol. 43, pp. s11--s17, Aug 2005.
5. X. Yang, C. Tracy, J. Sobieski, and T. Lehman, "GMPLS-based dynamic provisioning and traffic engineering of high-capacity ethernet circuits in hybrid optical/packet networks," in INFOCOM 2006. 25th IEEE International Conference on Computer Communications. Proceedings, pp. 1--5, April 2006.
6. "On-Demand Secure Circuits and Advance Reservation System (OSCARS)." http://www.es.net/OSCARS/docs/index.html.
7. "Open Exchange Software Suite (OESS)." http://globalnoc.iu.edu/sdn/oess.html.
8. J. Zurawski, R. Ball, A. Barczyk, M. Binkley, J. Boote, E. Boyd, A. Brown, R. Brown, T. Lehman, S. McKee, B. Meekhof, A. Mughal, H. Newman, S. Rozsa, P. Sheldon, A. Tackett, R. Voicu, S. Wolf, and X. Yang, "The DYNES instrument: A description and overview," Journal of Physics: Conference Series, vol. 396, no. 4, p. 042065, 2012.
9. E. Dart, L. Rotman, B. Tierney, M. Hester, and J. Zurawski, "The science DMZ: A network design pattern for data-intensive science," in Proceedings of the International Conference on High Performance Computing, Networking, Storage and Analysis, SC '13, (New York, NY, USA), pp. 85:1--85:10, ACM, 2013.
10. "NSF Global Environment for Network Innovations (GENI) project." http://www.geni.net/.
11. Z. Yan, M. Veeraraghavan, C. Tracy, and C. Guok, "On how to provision Quality of Service (QoS) for large dataset transfers," in Proceedings of the Sixth International Conference on Communication Theory, Reliability, and Quality of Service (CTRQ), Apr. 21-26, 2013.
12. Open Grid Forum (OFG) Network Service Interface Working Group (NSI-WG), "Inter-Domain Controller Protocol (IDCP) Specification." Oct. 24, 2010, http://www.ggf.org/documents/GFD.170.pdf.
13. G. Roberts, T. Kudoh, I. Monga, J. Sobieski, J. MacAuley, and C. Guok, "NSI Connection Service v2.0," 2014. OGF GFD.212.
14. M. McGinley, H. Bhuiyan, T. Li, and M. Veeraraghavan, "An in-depth cross-layer experimental study of transport protocols over circuits," in Computer Communications and Networks (ICCCN), 2010 Proceedings of 19th International Conference on, pp. 1--6, Aug 2010.
15. S. Jain, A. Kumar, S. Mandal, J. Ong, L. Poutievski, A. Singh, S. Venkata, J. Wanderer, J. Zhou, M. Zhu, J. Zolla, U. Hölzle, S. Stuart, and A. Vahdat, "B4: Experience with a globally-deployed software defined WAN," in Proceedings of the ACM SIGCOMM 2013 Conference on SIGCOMM, SIGCOMM '13, (New York, NY, USA), pp. 3--14, ACM, 2013.
16. C.-Y. Hong, S. Kandula, R. Mahajan, M. Zhang, V. Gill, M. Nanduri, and R. Wattenhofer, "Achieving high utilization with software-driven WAN," in Proceedings of the ACM SIGCOMM 2013 Conference on SIGCOMM, SIGCOMM '13, (New York, NY, USA), pp. 15--26, ACM, 2013.
17. "GENI Network Stitching." http://groups.geni.net/geni/wiki/GeniNetworkStitching.
18. "Internet2 Advanced Layer 2 Services (AL2S)." http://www.internet2.edu.
19. "perfSONAR-PS." http://psps.perfsonar.net/.
20. "OpenFlow Discovery Protocol and Link Layer Discovery Protocol." http://groups.geni.net/geni/wiki/.
21. "GRNOC routerproxy." http://routerproxy.grnoc.iu.edu/.
22. ESnet, "ESnet Fasterdata Knowledge Base." http://fasterdata.es.net/.
23. B. Hubert, "Linux Advanced Routing & Traffic Control." http://www.lartc.org/manpages/tc.pdf.
24. "Brocade ICX 6610 Switches Frequently Asked Questions." http://www.brocade.com/content/brocade/en/backend-content/pdf-page.html?/content/dam/common/documents/content-types/faqs/icx-6610-switch-faq.pdf.

Index Terms

• Computer systems organization

  • Dependable and fault-tolerant systems and networks

• General and reference

  • Cross-computing tools and techniques

    • Performance

• Information systems

  • Data management systems

    • Database management system engines

• Networks

  • Network architectures

  • Network performance evaluation