Roy Meissner
ABSTRACT
One approach to continuously achieve a certain data quality level is to use an integration pipeline that continuously checks and monitors the quality of a data set according to defined metrics. This approach is inspired by Continuous Integration pipelines, that have been introduced in the area of software development and DevOps to perform continuous source code checks. By investigating in possible tools to use and discussing the specific requirements for RDF data sets, an integration pipeline is derived that joins current approaches of the areas of software-development and semantic-web as well as reuses existing tools. As these tools have not been built explicitly for CI usage, we evaluate their usability and propose possible workarounds and improvements. Furthermore, a real-world usage scenario is discussed, outlining the benefit of the usage of such a pipeline.
- N. Arndt, N. Radtke, and M. Martin. Distributed collaboration on rdf datasets using git: Towards the quit store. In 12th International Conference on Semantic Systems Proceedings, Sept. 2016. Google Scholar
Digital Library
- W. Beek, L. Rietveld, H. Bazoobandi, J. Wielemaker, and S. Schlobach. Lod laundromat: A uniform way of publishing other people's dirty data. In Proceedings of the International Semantic Web Conference (ISWC), 2014. Google ScholarDigital Library
- S. Cirulli. Continuous integration for xml and rdf data. XML LONDON, pages 52--60, 2015.Google ScholarCross Ref
- J. Debattista, S. Londono, C. Lange, and S. Auer. Luzzu - a framework for linked data quality assessment. Dec. 2015.Google Scholar
- P. M. Duvall, S. Matyas, and A. Glover. Continuous Integration. Addison-Wesley, Feb. 2008.Google Scholar
- M. Fowler. Continuous integration. http://martinfowler.com/articles/continuousIntegration.html, May 2006. Access date: 2016-06-30.Google Scholar
- A. Hogan, A. Harth, A. Passant, S. Decker, and A. Polleres. Weaving the pedantic web. 3rd International Workshop on Linked Data on the Web (LDOW2010) in conjunction with 19th International World Wide Web Conference, 2010.Google Scholar
- D. Kontokostas, P. Westphal, S. Auer, S. Hellmann, J. Lehmann, and R. Cornelissen. Databugger: A test-driven framework for debugging the web of data. In Proceedings of the Companion Publication of the 23rd International Conference on World Wide Web Companion, Apr. 2014. Google ScholarDigital Library
- A. Nareike, N. Arndt, N. Radtke, S. Nuck, L. Seige, and T. Riechert. AMSL: Managing electronic resources for libraries based on semantic web. In Proceedings of the INFORMATIK 2014: Big Data --Komplexität meistern, volume P-232 of GI-Edition---Lecture Notes in Informatics, pages 1017--1026. Gesellschaft für Informatik e.V., Sept. 2014. © 2014 Gesellschaft für Informatik.Google Scholar
- V. Pecanac. Top 8 continuous integration tools. http://www.code-maze.com/top-8-continuous-integration-tools/, Feb. 2016. Access date: 2016-07-01.Google Scholar
- N. Petersen, L. Halilaj, C. Lange, and S. Auer. Vocol: An agile methodology and environment for collaborative vocabulary development. Feb. 2015.Google Scholar
- M. Poveda-Villalón, A. Gómez-Pérez, and M. C. Súarez-Figueroa. Oops!(ontology pitfall scanner!): An on-line tool for ontology evaluation. International Journal on Semantic Web and Information Systems (IJSWIS), 10(2):7--34, 2014. Google ScholarDigital Library
- A. Zaveri, A. Rula, A. Maurino, R. Pietrobon, J. Lehmann, and S. Auer. Quality assessment for linked data:a survey. Semantic Web Journal, 7(1):63--93, Mar. 2015.Google ScholarCross Ref
Recommendations
Managing Quality Assurance Challenges of DevOps through Analytics
ICSCA '19: Proceedings of the 2019 8th International Conference on Software and Computer ApplicationsDevOps is an intermarriage between developmental practices and operational modalities. The methodology employs the practices of continuous integration and delivery and places the deployment pipeline as the main requirement to automate, deliver and ...
Adoption Issues in DevOps from the Perspective of Continuous Delivery Pipeline
ICSCA '19: Proceedings of the 2019 8th International Conference on Software and Computer ApplicationsDevOps and Continuous Delivery (CD) are the terms that are always related to each other in Software Delivery and Operation Process area. DevOps introduces a significant agile perspective to deliver the software product in short cycle time that will ...
Understanding DevOps critical success factors and organizational practices
IWSiB '22: Proceedings of the 5th International Workshop on Software-intensive Business: Towards Sustainable Software BusinessDevOps is a combination of practices and a company culture which aims minimize the barriers between the operation and development teams in the organization. As its adoption and use in the industry has been growing, different kinds of research are trying ...
Comments