Anshul Gandhi
Mor Harchol-Balter
Charles Lefurgy
Abstract
Server farms today consume more than 1.5% of the total electricity in the U.S. at a cost of nearly $4.5 billion. Given the rising cost of energy, many industries are now seeking solutions for how to best make use of their available power. An important question which arises in this context is how to distribute available power among servers in a server farm so as to get maximum performance.
By giving more power to a server, one can get higher server frequency (speed). Hence it is commonly believed that, for a given power budget, performance can be maximized by operating servers at their highest power levels. However, it is also conceivable that one might prefer to run servers at their lowest power levels, which allows more servers to be turned on for a given power budget. To fully understand the effect of power allocation on performance in a server farm with a fixed power budget, we introduce a queueing theoretic model, which allows us to predict the optimal power allocation in a variety of scenarios. Results are verified via extensive experiments on an IBM BladeCenter.
We find that the optimal power allocation varies for different scenarios. In particular, it is not always optimal to run servers at their maximum power levels. There are scenarios where it might be optimal to run servers at their lowest power levels or at some intermediate power levels. Our analysis shows that the optimal power allocation is non-obvious and depends on many factors such as the power-to-frequency relationship in the processors, the arrival rate of jobs, the maximum server frequency, the lowest attainable server frequency and the server farm configuration. Furthermore, our theoretical model allows us to explore more general settings than we can implement, including arbitrarily large server farms and different power-to-frequency curves. Importantly, we show that the optimal power allocation can significantly improve server farm performance, by a factor of typically 1.4 and as much as a factor of 5 in some cases.
- Lesswatts.org: Race to idle. http://www.lesswatts.org/projects/applications-power-management/race-to-idle.php.Google Scholar
- Intel: Nehalem. http://intel.wingateweb.com/US08/published/sessions/NGMS001/SF08_NGMS001_100t.pdf.Google Scholar
- U.S. Environmental Protection Agency. Epa report on server and data center energy efficiency. 2007.Google Scholar
- National Electrical Contractors Association. Data centers -- meeting today's demand. 2007.Google Scholar
- Jeffrey S. Chase, Darrell C. Anderson, Prachi N. Thakar, and Amin M. Vahdat. Managing energy and server resources in hosting centers. In Proceedings of the Eighteenth ACM Symposium on Operating Systems Principles (SOSP), pages 103--116, 2001. Google ScholarDigital Library
- Intel Corp. Intel Core2 Duo Mobile Processor Datasheet: Table 20. http://download.intel.com/design/mobile/datashts/32012001.pdf, 2008.Google Scholar
- M. Elnozahy, M. Kistler, and R. Rajamony. Energy conservation policies for web servers. In USITS, 2003. Google ScholarDigital Library
- Xiaobo Fan, Wolf-Dietrich Weber, and Luiz Andre Barroso. Power provisioning for a warehouse-sized computer. pages 13--23, 2007. Google ScholarDigital Library
- Wes Felter, Karthick Rajamani, Tom Keller, and Cosmin Rusu. A performance-conserving approach for reducing peak power consumption in server systems. In ICS '05: Proceedings of the 19th annual International Conference on Supercomputing, pages 293--302, New York, NY, USA, 2005. ACM. Google ScholarDigital Library
- Mark E. Femal and Vincent W. Freeh. Boosting Data Center Performance Through Non-Uniform Power Allocation. In ICAC '05: Proceedings of the Second International Conference on Automatic Computing, pages 250--261, Washington, DC, 2005. Google ScholarDigital Library
- M.S. Floyd, S. Ghiasi, T.W. Keller, K. Rajamani, F.L. Rawson, J.C. Rubio, and M. S. Ware. System Power Management Support in the IBM POWER6 Microprocessor. IBM Journal of Research and Development, 51:733--746, 2007. Google ScholarDigital Library
- Anshul Gandhi, Mor Harcol-Balter, Rajarshi Das, and Charles Lefurgy. Optimal power allocation in server farms. Technical Report CMU-CS-09-113, 2009.Google ScholarDigital Library
- Intel Corp. Intel Math Kernel Library 10.0 -- LINPACK. http://www.intel.com/cd/software/products/asmo-na/eng/266857.htm.Google Scholar
- Raj Jain. phThe Art of Computer Systems Performance Analysis: techniques for experimental design, measurement, simulation, and modeling. pages 563--567. Wiley, 1991.Google Scholar
- Radim Kolar. Web bench. http://home.tiscali.cz:8080/cz210552/webbench.html.Google Scholar
- Kleinrock L. Queueing Systems, Volume 2. Wiley-Interscience, New York, 1976.Google Scholar
- Charles Lefurgy, Xiaorui Wang, and Malcolm Ware. Power capping: a prelude to power shifting. Cluster Computing, November 2007. Google ScholarDigital Library
- J.D. McCalpin. Stream: Sustainable memory bandwidth in high performance computers. http://www.cs.virginia.edu/stream/.Google Scholar
- David Mosberger and Tai Jin. httperf--A Tool for Measuring Web Server Performance. ACM Sigmetrics: Performance Evaluation Review, 26:31--37, 1998. Google ScholarDigital Library
- Vivek Pandey, W. Jiang, Y. Zhou, and R. Bianchini. DMA-Aware Memory Energy Management. HPCA '06: The 12th International Symposium on High-Performance Computer Architecture, pages 133--144, 11-15 Feb. 2006.Google Scholar
- Ramya Raghavendra, Parthasarathy Ranganathan, Vanish Talwar, Zhikui Wang, and Xiaoyun Zhu. No "Power" Struggles: Coordinated Multi-Level Power Management for the Data Center. In ASPLOS XIII: Proceedings of the 13th international conference on Architectural support for programming languages and operating systems, pages 48--59, 2008. Google ScholarDigital Library
- K. Rajamani, H. Hanson, J.C. Rubio, S. Ghiasi, and F.L. Rawson. Online power and performance estimation for dynamic power management. Research Report RC-24007, July 2006.Google Scholar
- Salvatore Sanfilippo. WBox HTTP testing tool (Version 4). http://www.hping.org/wbox/, 2007.Google Scholar
- X Wang and M Chen. Cluster-level Feedback Power Control for Performance Optimization. 14th IEEE International Symposium on High-Performance Computer Architecture (HPCA 2008), February 2008.Google Scholar
- Zhikui Wang, Xiaoyun Zhu, Cliff McCarthy, Partha Ranganathan, and Vanish Talwar. Feedback Control Algorithms for Power Management of Servers. In Third International Workshop on Feedback Control Implementation and Design in Computing Systems and Networks (FeBid), Annapolis, MD, June 2008.Google Scholar
Index Terms
- Optimal power allocation in server farms
Recommendations
Optimal power allocation in server farms
SIGMETRICS '09: Proceedings of the eleventh international joint conference on Measurement and modeling of computer systemsServer farms today consume more than 1.5% of the total electricity in the U.S. at a cost of nearly $4.5 billion. Given the rising cost of energy, many industries are now seeking solutions for how to best make use of their available power. An important ...
Joint optimization of idle and cooling power in data centers while maintaining response time
ASPLOS '10Server power and cooling power amount to a significant fraction of modern data centers' recurring costs. While data centers provision enough servers to guarantee response times under the maximum loading, data centers operate under much less loading most ...
Joint optimization of idle and cooling power in data centers while maintaining response time
ASPLOS '10Server power and cooling power amount to a significant fraction of modern data centers' recurring costs. While data centers provision enough servers to guarantee response times under the maximum loading, data centers operate under much less loading most ...
Comments