Experiments on pattern-based ontology design

ABSTRACT

This paper addresses the evaluation of pattern-based ontology design through experiments. An initial method for reuse of content ontology design patterns (Content ODPs) was used by the participants during the experiments. Hypotheses considered include the usefulness of Content ODPs for ontology developers, and we additionally study in what respects they are useful and what open issues remain. The main positive conclusions when using Content ODPs include: ontology developers perceived them as useful, ontology quality is improved, coverage of the task increases, usability is improved, and common modelling mistakes can be avoided.

References

1. A. Ampatzoglou and A. Chatzigeorgiou. Evaluation of object-oriented design patterns in game development. Information and Software Technology, 49(5), 2007.
2. R. Arndt, R. Troncy, S. Staab, L. Hardman, and M. Vacura. COMM: designing a well-founded multimedia ontology for the web. In The Semantic Web: ISWC 2007 + ASWC 2007, volume 4825 of LNCS, pages 30--43. Springer, Berlin Heidelberg, 2008.
3. K. Beck, J. O. Coplien, J. Crocker, L. Dominick, G. Meszaros, F. Paulisch, and J. Vlissides. Industrial experience with design patterns. In ICSE-18, Conference Proceedings. IEEE Press, Los Alamitos, 1996.
4. E. Blomqvist. Semi-automatic Ontology Construction based on Patterns. PhD thesis, Linköping University, Department of Computer and Information Science at the Institute of Technology, 2009.
5. E. S. Chung, J. I. Hong, J. Lin, M. K. Prabaker, J. A. Landay, and A. L. Liu. Development and evaluation of emerging design patterns for ubiquitous computing. In Proceedings of the 2004 Conference on Designing interactive Systems: Processes, Practices, Methods, and Techniques. ACM Press, New York, 2004.
6. A. Dearden, J. Finlay, L. Allgar, and B. McManus. Evaluating pattern languages in participatory design. In CHI '02 Extended Abstracts on Human Factors in Computing Systems. ACM Press, New York, 2002.
7. M. Dzbor et al. D5.6.2 Experimentation with parts of NeOn methodology. Technical report, NeOn Project, 2009.
8. A. Gangemi. Ontology Design Patterns for Semantic Web Content. In M. Musen et al. (eds.): Proceedings of the Fourth International Semantic Web Conference, Galway, Ireland, 2005. Springer.
9. A. Gangemi, C. Catenacci, M. Ciaramita, and J. Lehmann. Modelling ontology evaluation and validation. In Proceedings of ESWC 2006, pages 140--154, 2006.
10. A. Gangemi and V. Presutti. Ontology design patterns. In Handbook on Ontologies, 2nd Ed., International Handbooks on Information Systems. Springer, 2009.
11. M. Gruninger and M. S. Fox. The role of competency questions in enterprise engineering. In Proceedings of the IFIP WG5.7 Workshop on Benchmarking--Theory and Practice, 1994.
12. P. Kotze, K. Renaud, A. Dearden, K. Koukouletsos, and B. Khazaei. Patterns, anti-patterns and guidelines--effective aids to teaching HCI principles? In Inventivity: Teaching theory, design and innovation in HCI--Proceedings of HCIEd2006, 2006.
13. G. Masuda, N. Sakamoto, and K. Ushijima. Evaluation and analysis of applying design patterns. In Proc. of the International Workshop on the Principles of Software Evolution, 1999.
14. G. Papamargaritis and A. Sutclie. Applying the domain theory to design for reuse. BT Technology Journal, 22(2):104--115, 2004.
15. L. Prechelt, B. Unger-Lamprecht, M. Philippsen, and W. F. Tichy. Two controlled experiments assessing the usefulness of design pattern documentation in program maintenance. IEEE Trans. on Software Engineering, 26(6), 2002.
16. V. Presutti and A. Gangemi. Content ontology design patterns as practical building blocks for web ontologies. In Proceedings of the 27th International Conference on Conceptual Modeling--ER2008, pages 128--141, 2008.
17. V. Presutti et al. D2.5.1: A library of ontology design patterns: reusable solutions for collaborative design of networked ontologies. Technical report, The NeOn Pro ject, 2008.
18. N. R. Shadbolt, K. O'Hara, and L. Crow. The experimental evaluation of knowledge acquisition techniques and methods: History, problems and new directions. International Journal of Human-Computer Studies, 51(4):729--755, 1999.
19. M. C. Suárez-Figueroa et al. D5.4.2: Revision and extension of the neon methodology for building contextualized ontology networks. Technical report, The NeOn Project, 2009.

Index Terms

• Computing methodologies

  • Artificial intelligence

    • Knowledge representation and reasoning

• Theory of computation

  • Logic