Storm surge simulation and load balancing in Azure cloud

ABSTRACT

Cloud computing platforms are drawing increasing attention of the scientific research communities. By providing a framework to lease computation resources, cloud computing enables the scientists to carry out large-scale experiments in a cost-effective fashion without incurring high setup and maintenance costs of a large compute system. In this paper, we study the implementation and scalability issues in deploying a particular class of computational science applications. Using Platform-as-a-Service (PAAS) of Windows Azure cloud, we implement a high-throughput Storm-Surge Simulation in both a middleware framework for deploying jobs (in cloud and grid environment) and a MapReduce framework---a data parallel programming model for processing large data sets. We present the detailed techniques to balance the simulation loads while parallelizing the application across a large number of nodes.

References

1. NOAA SLOSH display program. http://slosh.nws.noaa.gov/sloshPub/#sloshDsp.
2. K. Chandrasekar, M. Pathirage, S. Wijeratne, C. Mattocks, and B. Plale. Middleware alternatives for storm surge predictions in windows azure. In Proc. 3rd workshop on Scientific Cloud Computing Date, Science-Cloud '12, pages 3--12, 2012.
3. D. de Oliveira, E. Ogasawara, F. Baião, and M. Mattoso. Scicumulus: A lightweight cloud middleware to explore many task computing paradigm in scientific workflows. In Proc. IEEE 3rd Int. Conf. on Cloud Computing, CLOUD '10, pages 378--385, Washington, DC, USA, 2010. IEEE Computer Society.
4. B. Glahn, A. Taylor, N. Kurkowski, and W. Shaffer. The role of the slosh model in national weather service storm surge forecasting. National Weather Digest, 33(1):3--14, 2009.
5. T. Gunarathne, T.-L. Wu, J. Qiu, and G. Fox. Cloud computing paradigms for pleasingly parallel biomedical applications. In Proc. 19th ACM Int. Symposium on High Performance Distributed Computing, HPDC '10, pages 460--469, New York, NY, USA, 2010. ACM.
6. T. Gunarathnea, J. Qiu, and G. Fox. Iterative mapreduce for azure cloud. In Proc. Cloud Computing and Its Applications, CCA, CCA '11, 2011.
7. S. Jha, D. S. Katz, A. Luckow, A. Merzky, and K. Stamou. Understanding scientific applications for cloud environments. In R. Buyya, J. Broberg, and A. M. Goscinski, editors, Cloud Computing: Principles and Paradigms, page 664, March 2011.
8. C. A. Lee. A perspective on scientific cloud computing. In Proc. 19th ACM Int. Symposium on High Performance Distributed Computing, HPDC '10, pages 451--459, 2010.
9. J. Li, M. Humphrey, D. A. Agarwal, K. R. Jackson, C. van Ingen, and Y. Ryu. eScience in the cloud: A modis satellite data reprojection and reduction pipeline in the windows azure platform. In IPDPS, pages 1--10, 2010.
10. W. Lu, J. Jackson, and R. Barga. AzureBlast: a case study of developing science applications on the cloud. In Proc. 19th ACM Int. Symposium on High Performance Distributed Computing, HPDC '10, pages 413--420, 2010.
11. W. Lu, J. Jackson, J. Ekanayake, R. S. Barga, and N. Araujo. Performing large science experiments on azure: Pitfalls and solutions. In CloudCom, pages 209--217, 2010.
12. P. Mehrotra, J. Djomehri, S. Heistand, R. Hood, H. Jin, A. Lazanoff, S. Saini, and R. Biswas. Performance evaluation of amazon EC2 for NASA HPC applications. In Proceedings of the 3rd workshop on Scientific Cloud Computing Date, pages 41--50, New York, NY, USA, 2012.
13. C. Moretti, A. Thrasher, L. Yu, M. Olson, S. J. Emrich, and D. Thain. A framework for scalable genome assembly on clusters, clouds, and grids. IEEE Trans. Parallel Distributed Systems, 23(12):2189--2197, 2012.
14. S. Pandey, D. Karunamoorthy, and R. Buyya. Workflow engine for clouds. In Cloud Computing, Principles and Paradigms, Wiley Series on Parallel and Distributed Computing, pages 321--344, 2011.
15. R. Simpson and H. Saffir. Tropical cyclone destructive potential by integrated kinetic energy. Bull. Amer. Meteor. Soc., 88:1799--1800, 2007.
16. E. C. Withana and B. Plale. Sigiri: uniform resource abstraction for grids and clouds. Concurrency and Computation: Practice and Experience, 24(18):1532--0626, Dec 2012.