The Eucalyptus Open-Source Cloud-Computing System

ABSTRACT

Cloud computing systems fundamentally provide access to large pools of data and computational resources through a variety of interfaces similar in spirit to existing grid and HPC resource management and programming systems. These types of systems offer a new programming target for scalable application developers and have gained popularity over the past few years. However, most cloud computing systems in operation today are proprietary, rely upon infrastructure that is invisible to the research community, or are not explicitly designed to be instrumented and modified by systems researchers. In this work, we present Eucalyptus -- an open-source software framework for cloud computing that implements what is commonly referred to as Infrastructure as a Service (IaaS); systems that give users the ability to run and control entire virtual machine instances deployed across a variety physical resources. We outline the basic principles of the Eucalyptus design, detail important operational aspects of the system, and discuss architectural trade-offs that we have made in order to allow Eucalyptus to be portable, modular and simple to use on infrastructure commonly found within academic settings. Finally, we provide evidence that Eucalyptus enables users familiar with existing Grid and HPC systems to explore new cloud computing functionality while maintaining access to existing, familiar application development software and Grid middle-ware.

References

1. 3Tera home page. http://www.3tera.com/.
2. K. Adams and O. Agesen. A comparison of software and hardware techniques for x86 virtualization. In ASPLOS-XII: Proceedings of the 12th international conference on Architectural support for programming languages and operating systems, pages 2-13, New York, NY, USA, 2006. ACM.
3. Advanced Micro Devices, AMD Inc. AMD Virtualization Codenamed "Pacifica" Technology, Secure Virtual Machine Architecture Reference Manual. May 2005.
4. Amazon Web Services home page. http://aws. amazon.com/.
5. P. Barham, B. Dragovic, K. Fraser, S. Hand, T. Harris, A. Ho, R. Neugebauer, I. Pratt, and A. Warfield. Xen and the art of virtualization. In SOSP '03: Proceedings of the nineteenth ACM symposium on Operating systems principles , pages 164-177, New York, NY, USA, 2003. ACM.
6. F. Bellard. QEMU, a Fast and Portable Dynamic Translator. Proceedings of the USENIX Annual Technical Conference, FREENIX Track, pages 41-46, 2005.
7. F. Berman, G. Fox, and T. Hey. Grid Computing: Making the Global Infrastructure a Reality. Wiley and Sons, 2003.
8. F. Chang, J. Dean, S. Ghemawat, W. Hsieh, D. Wallach, M. Burrows, T. Chandra, A. Fikes, and R. Gruber. Bigtable: A Distributed Storage System for Structured Data. Proceedings of 7th Symposium on Operating System Design and Implementation (OSDI), page 205218, 2006.
9. J. Chase, D. Irwin, L. Grit, J. Moore, and S. Sprenkle. Dynamic virtual clusters in a grid site manager. High Performance Distributed Computing, 2003. Proceedings. 12th IEEE International Symposium on, pages 90-100, 2003.
10. J. Dean and S. Ghemawat. MapReduce: Simplified Data Processing on Large Clusters. Proceedings of 6th Symposium on Operating System Design and Implementation (OSDI), pages 137-150, 2004.
11. G. DeCandia, D. Hastorun, M. Jampani, G. Kakulapati, A. Lakshman, A. Pilchin, S. Sivasubramanian, P. Vosshall, and W. Vogels. Dynamo: amazon's highly available key-value store. Proceedings of twenty-first ACM SIGOPS symposium on Operating systems principles, pages 205- 220, 2007.
12. Enomalism elastic computing infrastructure. http:// www.enomaly.com.
13. Eucalyptus Public Cloud (EPC). http: //eucalyptus.cs.ucsb.edu/wiki/ EucalyptusPublicCloud/.
14. I. Foster and C. Kesselman. Globus: A metacomputing infrastructure toolkit. International Journal of Supercomputer Applications, 1997.
15. I. Foster and C. Kesselman, editors. The Grid - Blueprint for a New Computing Infrastructure. Morgan Kaufmann, 1998.
16. I. Foster, C. Kesselman, J. Nick, and S. Tuecke. The physiology of the grid: An open grid services architecture for distributed systems integration, 2002.
17. I. Foster, C. Kesselman, and S. Tuecke. The anatomy of the grid: Enabling scalable virtual organizations. Int. J. High Perform. Comput. Appl., 15(3):200-222, 2001.
18. D. Gannon. Programming the grid: Distributed software components, 2002.
19. Google - http://www.google.com/.
20. D. Greschler and T. Mangan. Networking lessons in delivering 'software as a service': part i. Int. J. Netw. Manag., 12(5):317-321, 2002.
21. D. Greschler and T. Mangan. Networking lessons in delivering 'software as a service': part ii. Int. J. Netw. Manag., 12(6):339-345, 2002.
22. R. Hiremane. Intel Virtualization Technology for Directed I/O (Intel VT-d). Technology@Intel Magazine, 4(10), May 2007.
23. W. Huang, M. Koop, Q. Gao, and D. Panda. Virtual machine aware communication libraries for high performance computing. In Proceedings of Supercomputing 2007.
24. W. Huang, J. Liu, B. Abali, and D. K. Panda. A case for high performance computing with virtual machines. In ICS '06: Proceedings of the 20th annual international conference on Supercomputing, pages 125-134, New York, NY, USA, 2006. ACM.
25. Hyper-v home page - http://www.microsoft. com/hyperv.
26. Intel. Enhanced Virtualization on Intel Architecture-based Servers. Intel Solutions White Paper, March 2005.
27. K. Keahey, I. Foster, T. Freeman, and X. Zhang. Virtual workspaces: Achieving quality of service and quality of life in the grid. Sci. Program., 13(4):265-275, 2005.
28. M. Krasnyansky. VTun-Virtual Tunnels over TCP/IP networks, 2003.
29. P. Laplante, J. Zhang, and J. Voas. What's in a name? distinguishing between saas and soa. IT Professional, 10(3):46-50, May-June 2008.
30. M. McNett, D. Gupta, A. Vahdat, and G. M. Voelker. Usher: An Extensible Framework for Managing Clusters of Virtual Machines. In Proceedings of the 21st Large Installation System Administration Conference (LISA), November 2007.
31. A. Menon, A. Cox, and W. Zwaenepoel. Optimizing Network Virtualization in Xen. Proc. USENIX Annual Technical Conference (USENIX 2006), pages 15-28, 2006.
32. M. F. Mergen, V. Uhlig, O. Krieger, and J. Xenidis. Virtualization for high-performance computing. SIGOPS Oper. Syst. Rev., 40(2):8-11, 2006.
33. NSF TeraGrid Project. http://www.teragrid. org/.
34. J. P. Ostriker and M. L. Norman. Cosmology of the early universe viewed through the new infrastructure. Commun. ACM, 40(11):84-94, 1997.
35. oVirt home page. http://ovirt.org/.
36. Amazon simple storage service api (2006-03-01) - http://docs.amazonwebservices.com/ AmazonS3/2006-03-01/.
37. Salesforce Customer Relationships Management (CRM) system. http://www.salesforce.com/.
38. T. Tannenbaum and M. Litzkow. The condor distributed processing system. Dr. Dobbs Journal, February 1995.
39. Virtual Grid Application Development Software project. http://vgrads.rice.edu/.
40. Vmware home page - http://www.vmware.com.
41. L. Youseff, K. Seymour, H. You, J. Dongarra, and R. Wolski. The impact of paravirtualized memory hierarchy on linear algebra computational kernels and software. In HPDC, pages 141-152. ACM, 2008.

Index Terms

• General and reference

  • Cross-computing tools and techniques

    • Performance

• Software and its engineering

  • Software organization and properties

    • Contextual software domains

      • Operating systems

    • Extra-functional properties

      • Software performance

    • Software system structures

      • Distributed systems organizing principles