Evaluation of modeling techniques for agent-based systems

ABSTRACT

To develop agent- based systems, one needs a methodology that supports the development process as common in other disciplines. In recent years, several such methodologies and modeling techniques have been suggested. An important question is, to what extent do the existing methodologies address the developers' needs. In this paper we attempt to answer this question. In particular, we discuss suitability of agent modeling techniques to agent- based systems development. In evaluating existing modeling techniques, we address criteria from software engineering as well as characteristics of agent- based systems. Our evaluation shows that some aspects of modeling techniques for agent- based systems may benefit from further enhancements. As we show, these aspects include distribution, concurrency, testing and communication richness. We also find space for (relatively small) improvements in aspects such as the refining of the models throughout the development process and the coverage and consistency checking of the suggested models.

References

1. 1.M. A. Ardis, J. A. Chaves, L. J. Jagadeesan, P. Mataga, C. Puchol, M. G. Staskauskas and J. Von Olnhausen, A Framework for Evaluating Specification Methods for Reactive Systems, Experience Report, Proc. of 17th Intl. Conf. on Software Engineering, 1995.]]
2. 2.B. Bauer, J.P. Muller, and J. Odell, Agent UML: A Formalism for Specifying Multiagent Software Systems: P. Ciancarinin and M.J. Wooldridge (eds.) Agent-Oriented Software Engineering, LNCS 1957, Springer, 2000, pp. 91-103.]]
3. 3.F. M. T. Brazier, B. Dunin-Keplicz, N. R. Jennings and J. Treur, DESIRE: Modelling Multi-Agent Systems in a Compositional Formal Framework. Intl. Journal of Cooperative Information Systems, vol. 6, Formal Methods in Cooperative Information Systems: Multi-Agent Systems, (M. Huhns and M. Singh, eds.), 1997, pp. 67-94.]]
4. 4.F. M. T. Brazier, B. Dunin-Keplicz, J. Treur and L. C. Verbrugge, Modeling Internal Dynamic Behaviour of BDI agents. In: J.-J. Ch. Meyer and P.Y. Schobbes (eds.), Formal Models of Agents, LNAI 1760, Springer, 1999, pp. 36-56.]]
5. 5.F. M. T. Brazier., C. M. Jonker, J. Treur and N.J.E. Wijngaards, Compositional Design of a Generic Design Agent. In: G. Luger, L. Interrante (eds.), Proc. of AAAI Workshop on AI and Manufacturing: State of the Art and State of Practice. AAAI Press, 1998, pp. 30-39.]]
6. 6.C. A. Iglesias, M. Garijo, and J. C. Gonzalez. A survey of agent-oriented methodologies. In J. P. Muller, M. P.Singh, and A. S. Roa, (eds.), Intelligent Agent V, Proc. of ATAL-98, LNAI 1555, Springer, 1999,pp. 317-330.]]
7. 7.N. R. Jennings and M. Wooldridge, Agent-Oriented Software Engineering, Handbook of Agent Technology (ed. J. Bradshaw) AAAI/MIT Press, 2000 (to appear).]]
8. 8.N. R. Jennings, P. Faratin, M. J. Johnson, P. O'Brien, M. E. Wiegand: Using Intelligent Agents to Manage Business Processes, Proc. of PAAM96, London, UK, 1996, 345-360]]
9. 9.N. R. Jennings, On Agent-Based Software Engineering, Artificial Intelligence, 117 (2), 2000 , 277-296.]]
10. 10.N. R. Jennings, P. Faratin, T. J. Norman, P. O'Brien and B. Odgers, Autonomous Agents for Business Process Management, Int. Journal of Applied AI 14 (2), 2000, 145-189.]]
11. 11.N. R. Jennings, P. Faratin, T. J. Norman, P. O'Brien, B. Odgers and J. L. Alty, Implementing a Business Process Management System using ADEPT: A Real-World Case Study, Intl. Journal of Applied AI 14 (5), 2000, 421-465.]]
12. 12.S. Katz, Draft of Formal Specification Method Book, http://www.cs.technion.ac.il/~cs236368/, 2000.]]
13. 13.C. M. Jonker, M. Klusch, and J. Treur, Design of Collaborative Information Agents. In: M. Klusch, and L. Kerschberg (eds.), Cooperative Information Agents IV, Proc. of CIA 2000. LANI 1860, Springer, 2000, pp. 262-283.]]
14. 14.M. Luck and M. d'Inverno, Structuring a Z Specification to Provide a Formal Framework for Autonomous Agent Systems, Proc. of ZUM'95, J. Bowen and M. Hinchey (eds.), LNCS, 967, 47-62, Springer, 1995.]]
15. 15.M. Mulder, J. Treur and M.Fisher, Agent Modelling in MetateM and DESIRE. In: M. P. Singh, A. S. Rao, M. J. Wooldridge (eds.), Intelligent Agents IV, Proc. of ATAL'97. LNAI 1365, Springer, 1998, pp. 193-207.]]
16. 16.T. J. Norman, N. R. Jennings, P. Faratin and E. H. Mamdani: Designing and implementing a multi-agent architecture for business process management, in Intelligent Agents III (eds. J. P. Mueller, M. J. Wooldridge and N. R. Jennings) LNAI 1193, Springer, 1996, 261-275.]]
17. 17.O. Shehory, Architectural Properties of Multi-Agent Systems, Technical Report CMU-RI-TR-98-28, The Robotics Institute, Carnegie Mellon University, 1998.]]
18. 18.O. Shehory and A. Sturm, Evaluating Agent-Based System Modeling Techniques, Technical Report TR-ISE/IE-003-2000, Faculty of Industrial Engineering and Management Technion - Israel Institute of Technology, 2000.]]
19. 19.M. Wooldridge, N. R. Jennings, and D. Kinny, A Methodology for Agent-Oriented Analysis and Design Proc. of Agents-99, Seattle, WA, 1999, 69-76.]]
20. 20.M. Wooldridge, N. R. Jennings, and D. Kinny, The Gaia Methodology for Agent-Oriented Analysis and Design, Journal of Autonomous Agents and MAS 3 (3), 2000, 285-312.]]

Index Terms

• Computing methodologies

  • Artificial intelligence

    • Distributed artificial intelligence

  • Modeling and simulation

    • Model development and analysis

      • Model verification and validation

    • Simulation evaluation