Dynamic adapter generation for data integration middleware

ABSTRACT

Relatively mature integration technologies are available that make application integration tractable from an engineering perspective. However, integrating multiple heterogeneous data sources into applications is still a time-consuming, costly and error-prone engineering task, because existing integration technologies are based on static integration architectures. Such architectures tightly couple a data source to the data integration infrastructure. This paper describes the architecture and evolving prototype implementation of the Data Concierge, which provides a dynamic solution to integrate heterogeneous data sources. The core architecture and mechanisms in the Data Concierge can be used for dynamically attaching to a previously unidentified source of information, without the need for a pre-existing adapter component. In this paper, an ontology based API description mechanism supported by the Data Concierge is described, along with the architecture and prototype tools for describing the metadata necessary to facilitate dynamic integration. The use of an ontology and associated state machine to generate API calls to access data sources is illustrated using an FTP data source.

References

1. Linthicum, D. Enterprise Application Integration, Addison-Wesley, 1999.
2. Schantz, R. E., and Schmidt, D. C. Middleware for Distributed Systems Evolving the Common Structure for Network-centric Applications, Encyclopedia of Software Engineering, Wiley & Sons, 2001.
3. Tripathi, A. Challenges Designing Next-Generation Middleware Systems. COMMUNICATIONS OF THE ACM, 45, 6 (2002), 39--42.
4. Kon, F., Costa, F., Blair, G., and Campbell, R. H. The Case for Reflective Middleware. COMMUNICATIONS OF THE ACM, 45, 6 (2002), 33--38.
5. Fung, K. H., Low, G., and Ray, P. K. Embracing Dynamic Evolution in Distributed Systems, IEEE Software, 21, 2 (2004), 49--55.
6. Gorton, I., Almquist, J., Dorow, K., Gong P., and Thurman, D. An Architecture for Dynamic Data Source Integration. HAWAII INTERNATIONAL CONFERENCE ON SYSTEM SCIENCES (HICSS-38), Hawaii, 2005, p.276C.
7. Sugumaran, V., and Storey, V. C. Ontology for conveptual modeling: their creation, use, and management. Data & Knowledge Engineering, 42, 3 (2002), 251--371.
8. Neches, R., Fikes, R. E., Finin, T., Gruber, T. R., Senator, T., and Swartout, W. R. Enabling Technology for Knowledge Sharing, AI Magazine, 12, 3 (1991), 36--56.
9. DePrince jr, W., and Hofmeister, C. Usage Policies for Components. In Proceedings of the 6th ICSE Workshop on Component-Based Software Engineering, 2003.
10. Hudak, P. Modular Domain Specific Languages and Tools. In Proceedings of the 5th International conference on Software Reuse (ICSR), Victoria, Canada, 1998, 134--142.
11. Introduction to Unimod. Available at http://unimod.sourceforge.net/
12. Shalyto, A. A., and Tukkel, N. I. SWITCH Technology: An Automated Approach to Developing Software for Reactive Systems. Programming and Computer Software, 27, 5 (2001), 260--276.
13. Nodine, M., Ngu, A. H. H., Cassandra, A., and Bohrer, W. G. Scalable Semantic Brokering over Dynamic Heterogeneous Data Sources in InfoSleuth. IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 15, 5 (2003), 1082--1098.
14. Michalowski, M., Ambite, J. L., Thakkar, S., and Tuchinda, R. Retrieving and Semantically Integrating Heterogeneous Data from the Web. IEEE INTELLIGENT SYSTEMS, 19, 3 (2004), 72--79.
15. Ghanem, M., Giannadakis, N., Rowe, A., and Guo, Y. DYNAMIC INFORMATION INTEGRATION FOR E-SCIENCE. UK e-Science All-hands Conference, Sheffield, UK, 2002.
16. Genesereth, M. R., Keller, A., and Duschka, O. M. Infomaster: An Information Integration System. In Proc. ACM SIGMOD International Conference on Management of Data, 26, 2 (1997), 539--542.
17. Bouguettaya, A., Benatallah, B., Hendra, L., Ouzzani, M., and Beard, J. Supporting Dynamic Interactions among Web-Based Information Sources. IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 12, 5 (2000), 779--801.