Automatic generation of test-beds for pre-deployment QoS evaluation of web services

ABSTRACT

This paper presents Puppet (Pick UP Performance Evaluation Test-bed), an approach for the automatic generation of test-beds to empirically evaluate different QoS features of a Web Service under development. Specifically, the generation exploits the information about the coordinating scenario, the service description and the specification of the agreements that the roles will abide. The approach is supported by a proof-of-concept tool to validate the feasibility of the idea.

References

1. G. Alonso, F. Casati, H. Kuno, and V. Machiraju. Web Services--Concepts, Architectures and Applications. Springer--Verlag, 2004.
2. Apache Software Foundation. Axis User's Guide. http://ws.apache.org/axis/java/user-guide.html.
3. A. Bertolino, A. Bonivento, G. De Angelis, and A. Sangiovanni Vincentelli. Modeling and Early Performance Estimation for Network Processor Applications. In Proc. of the 9th International Conference on Model Driven Engineering Languages and Systems (MoDELS/UML 2006). Springer--Verlag, 2006. to appear.
4. A. Bertolino and R. Mirandola. Software Performance Engineering of Component--Based Systems. In Proc. of the 4th International Workshop on Software and Performance (WOSP 2004), pages 238--242. ACM Press, 2004.
5. G. Denaro, A. Polini, and W. Emmerich. Early Performance Testing of Distributed Software Applications. In Proc. of the 4th International Workshop on Software and Performance (WOSP 2004), pages 94--103. ACM Press, 2004.
6. D. Draheim, J. Grundy, J. Hosking, C. Lutteroth, and G. Weber. Realistic Load Testing ofWeb Applications. In Proc. of the Conference on Software Maintenance and Reengineering (CSMR 2006), pages 57--70. IEEE Computer Society, 2006.
7. Global Grid Forum. Web Services Agreement Specification (WS--Agreement), version 2005/09 edition, September 2005.
8. J. Grundy, J. Hosking, L. Li, and N. Liu. Performance Engineering of Service Compositions. In Proc. of the 2006 International Workshop on Service--Oriented Software Engineering (SOSE 2006), pages 26--32. ACM Press, 2006.
9. C. E. Hrischuk, J. A. Rolia, and C. M. Woodside. Automatic Generation of a Software Performance Model Using an Object-Oriented Prototype. In Patrick W. Dowd and Erol Gelenbe, editors, Proc. of the 3rd International Workshop on Modeling, Analysis, and Simulation On Computer and Telecommunication Systems (MASCOTS 1995), pages 399--409. IEEE Computer Society, 1995.
10. Y. Liu and I. Gorton. Accuracy of Performance Prediction for EJB Applications: A Statistical Analysis. In Proc. of Software Engineering and Middleware (SEM 2004), volume LNCS 3437, pages 185--198. Springer, 2004.
11. H. Ludwig. WS-Agreement Concepts and Use -- Agreement-Based Service-Oriented Architectures. Technical report, IBM, May 2006.
12. H. Ludwig, A. Dan, and R. Kearney. Cremona: An architecture and library for creation and monitoring of ws-agreents. In Proc. of Service-Oriented Computing - ICSOC 2004, Second International Conference, pages 65--74. ACM, 2004.
13. C. U. Smith and L. Williams. Performance Solutions: A practical Guide To Creating Responsive, Scalable Software. Addison--Wesley, 2001.

Index Terms

• Software and its engineering

  • Software creation and management

    • Designing software

      • Software implementation planning

        • Software design techniques

    • Software development process management

    • Software verification and validation

      • Software defect analysis

        • Software testing and debugging