Oscar Hellström
ABSTRACT
With the increased use of network enabled applications and server hosted software systems, scalability with respect to network connectivity is becoming an increasingly important subject. The programming language Erlang has previously been shown to be a suitable choice for creating highly available, scalable and robust telecoms systems. In this exploratory study we want to investigate how to optimise an Erlang system for maximum TCP/IP connectivity in terms of operating system, tuning of the operating system TCP stack and tuning of the Erlang Runtime System. The study shows how a series of benchmarks are used to evaluate the impact of these factors and how to evaluate the best settings for deploying and configuring an Erlang application. We conclude that the choice of operating system and the use of kernel poll both have a major impact on the scalability of the benchmarked systems.
- epoll scalability web page. http://lse.sourceforge. net/epoll/index.html, Nov. 2002.Google Scholar
- poll(7d) driver for fast poll on many file descriptors. Online manual: http://docs.sun.com/app/docs/doc/816-5177/6mbbc4g9q?a=view, Sept. 2005.Google Scholar
- Erlang/OTP product information. http://www.erlang.se/productinfo/index.shtml, Feb. 2006.Google Scholar
- Release notes for Erlang R11B-2. http://www.erlang.org/download/otp_src_R11B-2.readme, Nov. 2006.Google Scholar
- Tsung. http://tsung.erlang-projects.org/, Dec. 2006.Google Scholar
- ejabberd distributed fault-tolerant Jabber/XMPP server in Erlang. http://ejabberd.jabber.ru/, Feb. 2007.Google Scholar
- Erlang/OTP R11B Documentation. http://www. erlang.org/doc/doc-5.5.4/doc/, 2007.Google Scholar
- The FreeBSD project. http://www.freebsd.org/, 2007.Google Scholar
- The Linux kernel archives. http://www.sun.com/software/solaris/, 2007.Google Scholar
- The NetBSD project. http://www.netbsd.org/, 2007.Google Scholar
- openSUSE. http://www.opensuse.org/, 2007.Google Scholar
- Solaris 10 operating system. http://www.sun.com/software/solaris/, 2007.Google Scholar
- Yaws. http://yaws.hyber.org/, 2007.Google Scholar
- J. Armstrong. The development of Erlang. In ICFP '97: Proceedings ofthe second ACM SIGPLAN international conference on Functional programming, pages 196--203, New York, NY, USA, 1997. ACM Press. Google ScholarDigital Library
- R. Benson. The event completion framework for the Solaris operating system. http://developers.sun.com/solaris/articles/event_completion. html, July 2004.Google Scholar
- E. Biagioni. A structured TCP in standard ML. In SIGCOMM '94: Proceedings of the conference on Communications architectures, protocols and applications, pages 36--45, New York, NY, USA, 1994. ACM Press. Google ScholarDigital Library
- F. Cesarini, L. Larsson, and M. Slaski. From http to html: Erlang/otp experiences in web based service applications. In ERLANG '06: Proceedings of the 2006 ACM SIGPLAN workshop on Erlang, pages 52--57, New York, NY, USA, 2006. ACM Press. Google ScholarDigital Library
- A. Erramilli, O. Narayan, A. Neidhardt, and I. Saniee. Performance impacts of multi-scaling in wide-area TCP/IP traffic. In Proceedings of the 2000 IEEE Computer and Communications Societies Conference on Computer Communications (INFOCOM-00), pages 352--359, Los Alamitos, Mar. 26-30 2000. IEEE.Google ScholarCross Ref
- S. L. Fritchie. A study of erlang ETS table implementations and performance. In B. Däcker and T. Arts, editors, Proceedings of the 2003 ACM SIGPLAN Workshop on Erlang, Uppsala, Sweden, August 29, 2003, pages 43--55. ACM, 2003. Google ScholarDigital Library
- V. Jacobson, R. Braden, and D. Borman. RFC 1323: TCP extensions for high performance, May 1992. Obsoletes RFC1072, RFC1185. Status: PROPOSED STANDARD. Google ScholarDigital Library
- F. v. Leitner. Benchmarking BSD and Linux. http: //bulk.fefe.de/scalability/, Oct. 2003.Google Scholar
- W. E. Leland, M. S. Taqqu, W. Willinger, and D. V. Wilson. On the self-similar nature of ethernet traffic (extended version). IEEE/ACM Trans. Netw., 2(1):1--15, 1994. Google ScholarDigital Library
- J. Lemon. Kqueue: Ageneric and scalable event notification system for freebsd. In Proceedings of the FREENIX Track. 2001 USENIX Annual Technical Conference, pages 141--153, Berkeley, CA, USA, 2001. USENIX Assoc. Google ScholarDigital Library
- D. Libenzi. /dev/epoll home page. http://www.xmailserver.org/linux-patches/nio-improve.html, 2002.Google Scholar
- J. Liedtke, N. Islam, T. Jaeger, V. Panteleenko, and Y. Park. Irreproducible benchmarks might be sometimes useful. In EW 8: Proceedings of the 8th ACM SIGOPS European workshop on Support for composing distributed applications, pages 242--246, New York, NY, USA, 1998. ACM Press. Google ScholarDigital Library
- P. Mohagheghi and R. Conradi. An empirical investigation of software reuse benefits in a large telecom producet. Technical report, The Norwegian University of Science and Technology, Computer and Information Science, 2001.Google Scholar
- N. Niclausse, Z. Liu, and C. Jalpa-Villanueva. Traffic model and performance evaluation of web servers. Performance Evaluation, 46(2-3):77--100, Oct. 2001. Google ScholarDigital Library
- J. H. Nyström, P. W. Trinder, and D. J. King. Are highlevel languages suitable for robust telecoms software? In Proceedings of Computer Safety, Reliability, and Security. 24th International Conference, SAFECOMP 2005., pages 275--288, Berlin, Germany, Sept. 2005. Springer-Verlag. Google ScholarDigital Library
- J. París, V. M. Gulías, and A. Valderruten. A high performance erlang Tcp/Ip stack. In K. F. Sagonas and J. Armstrong, editors, Proceedings of the 2005 ACM SIGPLAN Workshop on Erlang, Tallinn, Estonia, September 26-28, 2005, pages 52--61. ACM, 2005. Google ScholarDigital Library
- V. Paxson and S. Floyd. Wide-area traffic: The failure of poisson modeling. IEEE/ACM Trans. Netw., 3(3):226--244, June 1995. Google ScholarDigital Library
- P. Saint-Andre. RFC 3920: Extensible Message and Presence Protocol (XMPP): Core, Oct. 2004. Status: PROPOSED STANDARD.Google Scholar
- P. Saint-Andre. RFC 3921: Extensible Messaging and Presence Protocol (XMPP): Instant Messaging and Presence, Oct. 2004. Status: PROPOSED STANDARD.Google Scholar
- J. Wechta, A. Eberlein, and F. Halsall. Impact of topology and choice of tcp window size on the performance of switched LANs. Computer Communications, 22(10):995--965, June 1999.Google ScholarDigital Library
Index Terms
- Optimising TCP/IP connectivity
Recommendations
A case for context-aware TCP/IP
This paper discusses the design and evaluation of CATNIP, a Context-Aware Transport/Network Internet Protocol for the Web. This integrated protocol uses application-layer knowledge (i.e., Web document size) to provide explicit context information to the ...
TCP tunnels: avoiding congestion collapse
LCN '00: Proceedings of the 25th Annual IEEE Conference on Local Computer NetworksThis paper examines the attributes of TCP tunnels which are TCP circuits that carry IP packets and benefit from the congestion control mechanism of TCP/IP. The deployment of TCP tunnels reduces the many flows situation on the Internet to that of a few ...
A detailed performance analysis of UDP/IP, TCP/IP, and M-VIA network protocols using Linux/SimOS
This paper presents a performance study of UDP/IP, TCP/IP, and M-VIA using Linux/SimOS. Linux/SimOS is a Linux operating system port to a complete machine simulator SimOS. A complete machine simulator includes all the system components, such as CPU, ...
Comments