MOWL: An ontology representation language for web-based multimedia applications

Abstract

Several multimedia applications need to reason with concepts and their media properties in specific domain contexts. Media properties of concepts exhibit some unique characteristics that cannot be dealt with conceptual modeling schemes followed in the existing ontology representation and reasoning schemes. We have proposed a new perceptual modeling technique for reasoning with media properties observed in multimedia instances and the latent concepts. Our knowledge representation scheme uses a causal model of the world where concepts manifest in media properties with uncertainties. We introduce a probabilistic reasoning scheme for belief propagation across domain concepts through observation of media properties. In order to support the perceptual modeling and reasoning paradigm, we propose a new ontology language, Multimedia Web Ontology Language (MOWL). Our primary contribution in this article is to establish the need for the new ontology language and to introduce the semantics of its novel language constructs. We establish the generality of our approach with two disperate knowledge-intensive applications involving reasoning with media properties of concepts.

References

1. Arndt, R., Troncy, R., Staab, S., Hardman, L., and Vacura, M. 2007. COMM: designing a well-founded multimedia ontology for the web. In Proceedings of the 6th International Semantic Web Conference (ISWC'07/ASWC'07). Springer-Verlag, Berlin, 30--43.
2. Bai, L., Lao, S., Jones, G. J. F., and Smeaton, A. F. 2007. Video semantic content analysis based on ontology. In Proceedings of the International Machine Vision and Image Processing Conference (IMVIP'07). IEEE Computer Society, Los Alamitos, CA, 117--124.
3. Bertini, M., Bimbo, A. D., Serra, G., Torniai, C., Cucchiara, R., Grana, C., and Vezzani, R. 2009. Dynamic pictorially enriched ontologies for digital video libraries. Multimedia 16, 2, 42--51.
4. Busa-Fekete, R., Szarvas, Gy., Éltetö, T., and Kégl, B. 2012. An apple-to-apple comparison of Learning-to-rank algorithms in terms of normalized discounted cumulative gain. In Proceedings of the ECAI-12 Workshop, Preference Learning: Problems and Applications in AI (ECAI-12). IEEE Computer Society.
5. Chaudhury, S. and Ghosh, H. 2004. Distributed and reactive query planning in RMAGIC: An agent based multimedia retrieval system. IEEE Trans. Knowle. Data Eng. 16, 9, 1082--1095.
6. Dasiopoulou, S., Kompatsiaris, I., and Strintzis, M. G. 2010. Investigating fuzzy DLs-based reasoning in semantic image analysis. Multimed. Tools Appl. 49, 1, 167--194.
7. Ding, Z. and Peng, Y. 2004. A probabilistic extension to ontology language OWL. In Proceedings of the 37th Hawaii International Conference on System Sciences.
8. Doerr, M. 2012. The CIDOC conceptual reference module: An ontological approach to semantic interoperability of metadata. AI Mag. 24, 3.
9. Foley, J. D., van Dam, A., Feiner, S. K., and Hughes, J. F. 1982. Computer Graphics: Principles and Practice.
10. Gangemi, A., Guarino, N., Masolo, C., Oltramari, A., and Schneider, L. 2002. Sweetening ontologies with DOLCE. In Proceedings of the 13th International Conference on Knowledge Engineering and Knowledge Management. Ontologies and the Semantic Web (EKAW'02), Springer-Verlag. 166--181.
11. Garcia, R. and Celma, O. 2005. Semantic integration and retrieval of multimedia metadata. In Proceedings of the 5th Knowledge Markup and Semantic Annotation Workshop (SemAnnot'05).
12. Ghosh, H., Chaudhury, S., Kashyap, K., and Maiti, B. 2007. Ontology specification and integration for multimedia applications. In Ontologies: A Handbok of Principles, Concepts, and Applications in Information Systems. Springer.
13. Hunter, J. 2003. Enhancing the semantic interoperability of multimedia through a core ontology. IEEE Trans. Circ. Syst. Video Tech. 13, 1, 49--58.
14. Jiang, S., Huang, T., and Gao, W. 2004. An ontology based approach to retrieve digitized art images. In Proceedings of the IEEE International Conference on Web Intelligence. 131--137.
15. Kangassalo, H. 1991. Conceptual level user interfaces to data bases and information systems. In Advances in Information Modelling and Knowledge Bases. H. Jaakkola, H. Kangassalo, and S. Ohsuga, Eds., IOS Press, 66--90.
16. Kentner, B. 1979. Color Me a Season: A Complete Guide to Finding Your Best Colors and How to Use Them. Ken Kra Publishers.
17. Liu, S., Feng, J., Song, Z., Zhang, T., Lu, H., Xu, C., and Yan, S. 2012. Hi, magic closet, tell me what to wear! In Proceedings of the 20th ACM International Conference on Multimedia (MM'12). ACM, New York, 619--628.
18. Mallik, A., Chaudhury, S., and Ghosh, H. 2011. Nrityakosha: Preserving the intangible heritage of Indian classical dance. ACM J. Comput. Cultur. Herit. 4, 3, 11.
19. Motik, B., Patel-Schneider, P. F., and Parsia, B. 2012. OWL 2 Web ontology language: Structural specification and function-style syntax. http://www.w3.org/TR/owl2-syntax/.
20. Nikolopoulos, S., Paradopoulos, G., Kompatsiaris, I., and Patras, I. 2011. Evidence-driven image interpretation by combining implicit and explicit knpwledge in Bayesian Network. IEEE Trans. Syst. Man Cybernet. -- Part B 41, 5, 1366--1381.
21. Papadias, D. and Delis, V. M. 2001. Approximate spatio-temporal retrieval. ACM Trans. Inf. Syst. 19, 1, 53--96.
22. Patel-Schneider, P. F. and Horrocks, I. 2004. OWL web ontology language: Semantics and abstract syntax: section 2. abstract syntax. http://www.w3.org/TR/owl-semantics/syntax.html.
23. Pradhan, M., Henrion, M., Provan, G., Favero, B. D., and Huang, K. 1996. The sensitivity of belief networks to imprecise probabilities: an experimental investigation. Artif. Intell. 85, 363--397.
24. Rafatirad, S., Gupta, A., and Jain, R. 2009. Event composition operators: ECO. In Proceedings of the 1st ACM International Workshop on Events in Multimedia (EiMM'09). ACM, New York, 65--72.
25. Randell, D., Witkowski, M., and Shanahan, M. 2001. From images to bodies: Modelling and exploiting spatial occlusion and motion parallax. In Proceedings of the 17th International Joint Conference on Artificial Intelligence (IJCAI'01). Vol. 1 Morgan Kaufmann Publishers Inc., San Francisco, CA, 57--63.
26. Saathoff, C. and Scherp, A. 2010. Unlocking the semantics of multimedia presentations in the web with the multimedia metadata ontology. In Proceedings of the 19th International Conference on World Wide Web (WWW'10). ACM, New York, 831--840.
27. Salembier, P. and Smith, J. R. 2001. MPEG-7 multimedia description schemes. IEEE Trans. Circ. Syst. Video Tech. 11, 6, 748--759.
28. Scherp, A., Franz, T., Saathoff, C., and Staab, S. 2009. F--a model of events based on the foundational ontology dolce+DnS ultralight. In Proceedings of the 5th International Conference on Knowledge Capture (K-CAP'09). ACM, New York, 137--144.
29. Schneider, L. 2003. Designing foundational ontologies - The object-centered high-level reference ontology OCHRE as a case study. In Proceedings of the 22nd International Conference on Conceptual Modeling. Springer, 91--104.
30. Shaw, R., Troncy, R., and Hardman, L. 2009. LODE: Linking Open Descriptions of Events. In Proceedings of the 4th Asian Conference on the Semantic Web (ASWC'09). Springer-Verlag, Berlin, 153--167.
31. Tsinaraki, C., Polydoros, P., and Christodoulakis, S. 2007. Interoperability support between MPEG-7/21 and OWL in DS-MIRF. IEEE Trans. Knowl. Data Eng. 19, 2, 219--232.
32. Vogiatzis, D., Pierrakos, D., Paliouras, G., Jenkyn-Jones, S., and Possen, B. J. H. H. A. 2012. Expert and community based style advice. Expert Syst. Appli.: An Internat. J. 39, 12, 10647--10655.
33. Wattamwar, S. S. and Ghosh, H. 2008. Spatio-temporal query for multimedia databases. In Proceeding of the 2nd ACM Workshop on Multimedia Semantics, International Multimedia Conference, 48--55.

Index Terms

• Computing methodologies

  • Artificial intelligence

    • Knowledge representation and reasoning

• Information systems

  • Information systems applications

    • Multimedia information systems

• Theory of computation

  • Logic

  • Models of computation

    • Computability