Semi-automatic extraction of software skeletons for benchmarking large-scale parallel applications

ABSTRACT

The design of high-performance computing architectures requires performance analysis of large-scale parallel applications to derive various parameters concerning hardware design and software development. The process of performance analysis and benchmarking an application can be done in several ways with varying degrees of fidelity. One of the most cost-effective ways is to do a coarse-grained study of large-scale parallel applications through the use of program skeletons. The concept of a "program skeleton" that we discuss in this paper is an abstracted program that is derived from a larger program where source code that is determined to be irrelevant is removed for the purposes of the skeleton. In this work, we develop a semi-automatic approach for extracting program skeletons based on compiler program analysis. We demonstrate correctness of our skeleton extraction process by comparing details from communication traces, as well as show the performance speedup of using skeletons by running simulations in the SST/macro simulator.

References

1. V. S. Adve, R. Bagrodia, E. Deelman, and R. Sakellariou. Compiler-optimized simulation of large-scale applications on high performance architectures. Journal of Parallel and Distributed Computing, 62(3):393--426, March 2002.
2. D. H. Bailey, E. Barszcz, J. T. Barton, D. S. Browning, R. L. Carter, L. Dagum, R. A. Fatoohi, P. O. Frederickson, T. A. Lasinski, R. S. Schreiber, H. D. Simon, V. Venkatakrishnan, and S. K. Weeratunga. The NAS parallel benchmarks-summary and preliminary results. In Proceedings of the 1991 ACM/IEEE conference on Supercomputing, Supercomputing '91, pages 158--165, New York, NY, USA, 1991. ACM.
3. J. Dongarra, T. Hey, and E. Strohmaier. PARKBENCH: Methodology, Relations and Results. In H. M. Liddell, A. Colbrook, L. O. Hertzberger, and P. M. A. Sloot, editors, HPCN Europe, volume 1067 of Lecture Notes in Computer Science, pages 770--777. Springer, 1996.
4. C. L. Janssen, H. Adalsteinsson, S. Cranford, J. P. Kenny, A. Pinar, D. A. Evensky, and J. Mayo. A simulator for large-scale parallel architectures. International Journal of Parallel and Distributed Systems, 1(2):57--73, 2010.
5. Lawrence Livermore National Laboratory. ROSE Compiler. http://www.roseCompiler.org.
6. R. Preissl, M. Schulz, D. Kranzlmüller, B. R. de Supinski, and D. J. Quinlan. Using MPI Communication Patterns to Guide Source Code Transformations. In Proceedings of the 8th International Conference on Computational Science (ICCS), pages 253--260. Springer-Verlag, 2008.
7. Sandia National Laboratories. HPCCG. http://bec.syr.edu/hpccg.html.
8. Sandia National Laboratories. The Structural Simulation Toolkit. http://sst.sandia.gov/.
9. J. Shalf, D. Quinlan, and C. Janssen. Rethinking hardware-software codesign for exascale systems. IEEE Computer, 44(11):22--30, Nov. 2011.
10. J. Subhlok and Q. Xu. Automatic construction of coordinated performance skeletons. In Proceedings of the 2008 IEEE International Symposium on Parallel and Distributed Processing (IPDPS), pages 1--5, April 2008.

Index Terms

• General and reference

  • Cross-computing tools and techniques

    • Performance

• Social and professional topics

  • Professional topics

    • Management of computing and information systems

      • Software management

        • Software selection and adaptation

• Software and its engineering

  • Software creation and management

    • Designing software

  • Software organization and properties

    • Extra-functional properties

      • Software performance