skip to main content
research-article

Spectrum-Based Fault Localization in Model Transformations

Published:17 September 2018Publication History
Skip Abstract Section

Abstract

Model transformations play a cornerstone role in Model-Driven Engineering (MDE), as they provide the essential mechanisms for manipulating and transforming models. The correctness of software built using MDE techniques greatly relies on the correctness of model transformations. However, it is challenging and error prone to debug them, and the situation gets more critical as the size and complexity of model transformations grow, where manual debugging is no longer possible.

Spectrum-Based Fault Localization (SBFL) uses the results of test cases and their corresponding code coverage information to estimate the likelihood of each program component (e.g., statements) of being faulty. In this article we present an approach to apply SBFL for locating the faulty rules in model transformations. We evaluate the feasibility and accuracy of the approach by comparing the effectiveness of 18 different state-of-the-art SBFL techniques at locating faults in model transformations. Evaluation results revealed that the best techniques, namely Kulcynski2, Mountford, Ochiai, and Zoltar, lead the debugger to inspect a maximum of three rules to locate the bug in around 74% of the cases. Furthermore, we compare our approach with a static approach for fault localization in model transformations, observing a clear superiority of the proposed SBFL-based method.

References

  1. Rui Abreu, Alberto Gonzalez-Sanchez, and Arjan J. C. van Gemund. 2010. Exploiting count spectra for Bayesian fault localization. In Proceedings of the 6th International Conference on Predictive Models in Software Engineering (PROMISE’10). ACM, Article 12, 10 pages. Google ScholarGoogle ScholarDigital LibraryDigital Library
  2. Rui Abreu, Peter Zoeteweij, and Arjan J. C. van Gemund. 2009. Spectrum-based multiple fault localization. In Proceedings of IEEE/ACM International Conference on Automated Software Engineering (ASE ’09). IEEE Computer Society, Los Alamitos, CA, 88--99. Google ScholarGoogle ScholarDigital LibraryDigital Library
  3. Rui Abreu, Peter Zoeteweij, Rob Golsteijn, and Arjan J. C. van Gemund. 2009. A practical evaluation of spectrum-based fault localization. J. Syst. Softw. 82, 11 (2009), 1780--1792. Google ScholarGoogle ScholarDigital LibraryDigital Library
  4. R. Abreu, P. Zoeteweij, and A. J. C. van Gemund. 2007. On the accuracy of spectrum-based fault localization. In Proceedings of the Testing: Academic and Industrial Conference Practice and Research Techniques-MUTATION (TAICPART-MUTATION'07). IEEE Computer Society, Washington, DC, USA, 89--98. Google ScholarGoogle ScholarDigital LibraryDigital Library
  5. Shaukat Ali, Muhammad Zohaib Iqbal, and Andrea Arcuri. 2014. Improved heuristics for solving OCL constraints using search algorithms. In Proceedings of the 2014 Annual Conference on Genetic and Evolutionary Computation (GECCO’14). ACM, New York, NY, 1231--1238. Google ScholarGoogle ScholarDigital LibraryDigital Library
  6. S. Ali, M. Zohaib Iqbal, A. Arcuri, and L. C. Briand. 2013. Generating test data from OCL constraints with search techniques. IEEE Trans. Softw. Eng. 39, 10 (2013), 1376--1402. Google ScholarGoogle ScholarDigital LibraryDigital Library
  7. Jesús Manuel Almendros-Jiménez and Antonio Becerra-Terón. 2016. Automatic generation of ecore models for testing ATL transformations. In Proceedings of the 6th International Conference on Model and Data Engineering (MEDI’16). LNCS, Vol. 9893. Springer, 16--30.Google ScholarGoogle ScholarCross RefCross Ref
  8. Kyriakos Anastasakis, Behzad Bordbar, Geri Georg, and Indrakshi Ray. 2008. On challenges of model transformation from UML to alloy. Softw. Syst. Model. 9, 1 (2008).Google ScholarGoogle Scholar
  9. Vincent Aranega, Jean-Marie Mottu, Anne Etien, Thomas Degueule, Benoit Baudry, and Jean-Luc Dekeyser. 2015. Towards an automation of the mutation analysis dedicated to model transformation. Softw. Test. Verif. Reliabil. 25, 5--7 (2015), 653--683. Google ScholarGoogle ScholarDigital LibraryDigital Library
  10. Thorsten Arendt, Enrico Biermann, Stefan Jurack, Christian Krause, and Gabriele Taentzer. 2010. Henshin: Advanced concepts and tools for in-place EMF model transformations. In Proceedings of ACM/IEEE 21st International Conference on Model Driven Engineering Languages and Systems (MODELS’10), Vol. 6394. 121--135. Google ScholarGoogle ScholarDigital LibraryDigital Library
  11. Fatmah Yousef Assiri and James M. Bieman. 2017. Fault localization for automated program repair: Effectiveness, performance, repair correctness. Softw. Qual. J. 25, 1 (2017), 171--199. Google ScholarGoogle ScholarDigital LibraryDigital Library
  12. ATL. 2006. ATL Zoo. Retrieved from http://www.eclipse.org/atl/atlTransformations.Google ScholarGoogle Scholar
  13. E. T. Barr, M. Harman, P. McMinn, M. Shahbaz, and S. Yoo. 2015. The oracle problem in software testing: A survey. IEEE Trans. Softw. Eng. 41, 5 (May 2015), 507--525.Google ScholarGoogle ScholarDigital LibraryDigital Library
  14. Benoit Baudry, Trung Dinh-Trong, Jean-Marie Mottu, Devon Simmonds, Robert France, Sudipto Ghosh, Franck Fleurey, and Yves Le Traon. 2006. Model transformation testing challenges. In Proceedings of the ECMDA Workshop on Integration of Model Driven Development and Model Driven Testing. http://www.cs.colostate.edu/ france/publications/TransTestinGoogle ScholarGoogle Scholar
  15. Amine Benelallam, Abel Gómez, Massimo Tisi, and Jordi Cabot. 2015. Distributed model-to-model transformation with ATL on MapReduce. In Proceedings of the 2015 ACM SIGPLAN International Conference on Software Language Engineering (SLE’15). ACM, New York, NY, 37--48. Google ScholarGoogle ScholarDigital LibraryDigital Library
  16. Marco Brambilla, Jordi Cabot, and Manuel Wimmer. 2012. Model-Driven Software Engineering in Practice. Morgan&Claypool. Google ScholarGoogle ScholarDigital LibraryDigital Library
  17. Erwan Brottier, Franck Fleurey, Jim Steel, Benoit Baudry, and Yves Le Traon. 2006. Metamodel-based test generation for model transformations: An algorithm and a tool. In Proceedings of Annual IEEE International Symposium on Software Reliability Engineering (ISSRE’06). 85--94. Google ScholarGoogle ScholarDigital LibraryDigital Library
  18. L. Burgueño, J. Troya, M. Wimmer, and A. Vallecillo. 2015. Static fault localization in model transformations. IEEE Trans. Softw. Eng. 41, 5 (May 2015), 490--506.Google ScholarGoogle ScholarDigital LibraryDigital Library
  19. Loli Burgueño, Manuel Wimmer, Javier Troya, and Antonio Vallecillo. 2013. TractsTool: Testing MTs based on contracts. In Invited Talks, Demonstration Session, Poster Session, and ACM Student Research Competition (MODELS’13). CEUR.Google ScholarGoogle Scholar
  20. Daniel Calegari, Carlos Luna, Nora Szasz, and Alvaro Tasistro. 2010. A type-theoretic framework for certified model transformations. In Proceedings of Brazilian Symposium on Formal Methods (SBMF’10). 112--127. Google ScholarGoogle ScholarDigital LibraryDigital Library
  21. Eric Cariou, Raphaël Marvie, Lionel Seinturier, and Laurence Duchien. 2004. OCL for the specification of model transformation contracts. In Proceedings of the OCL and Model Driven Engineering Workshop. http://web.univ-pau.fr/ ecariou/papers/workshop-ocl-mde-uml2004-pape.Google ScholarGoogle Scholar
  22. Zheng Cheng, Rosemary Monahan, and James F. Power. 2015. A Sound Execution Semantics for ATL via Translation Validation. Springer International Publishing, Cham, 133--148. Google ScholarGoogle ScholarDigital LibraryDigital Library
  23. Zheng Cheng and Massimo Tisi. 2017. A Deductive Approach for Fault Localization in ATL Model Transformations. Springer, Berlin, 300--317. Google ScholarGoogle ScholarDigital LibraryDigital Library
  24. Antonio Cicchetti, Davide Di Ruscio, Romina Eramo, and Alfonso Pierantonio. 2011. JTL: A bidirectional and change propagating transformation language. In Software Language Engineering. LNCS, Vol. 6563. Springer, 183--202. Google ScholarGoogle ScholarDigital LibraryDigital Library
  25. Cauê Clasen, Marcos Didonet Del Fabro, and Massimo Tisi. 2012. Transforming very large models in the cloud: A research roadmap. In Proceedings of the 1st International Workshop on Model-Driven Engineering on and for the Cloud. Springer, Copenhagen, Denmark. https://hal.inria.fr/hal-00711524Google ScholarGoogle Scholar
  26. Manuel Clavel, Francisco Durán, Steven Eker, Patrick Lincoln, Narciso Martí-Oliet, José Meseguer, and Carolyn Talcott. 2007. All About Maude—A High-Performance Logical Framework. LNCS, Vol. 4350. Springer.Google ScholarGoogle Scholar
  27. György Csertán, Gábor Huszerl, István Majzik, Zsigmond Pap, András Pataricza, and Dániel Varró. 2002. VIATRA—visual automated transformations for formal verification and validation of UML models. In Proceedings of the 17th International Conference on Automated Software Engineering (ASE’02). IEEE/ACM, 267--270. Google ScholarGoogle ScholarDigital LibraryDigital Library
  28. Krzysztof Czarnecki and Simon Helsen. 2006. Feature-based survey of model transformation approaches. IBM Syst. J. 45, 3 (2006), 621--646. Google ScholarGoogle ScholarDigital LibraryDigital Library
  29. Alberto Rodrigues da Silva. 2015. Model-driven engineering: A survey supported by the unified conceptual model. Comput. Lang. Syst. Struct. 43 (2015), 139--155. Google ScholarGoogle ScholarDigital LibraryDigital Library
  30. Juan de Lara and Hans Vangheluwe. 2002. AToM3: A tool for multi-formalism and meta-modelling. In Proceedings of the 5th International Conference on Fundamental Approaches to Software Engineering (FASE’02). LNCS, Vol. 2306. Springer, 174--188. Google ScholarGoogle ScholarDigital LibraryDigital Library
  31. Joaquín Derrac, Salvador García, Daniel Molina, and Francisco Herrera. 2011. A practical tutorial on the use of nonparametric statistical tests as a methodology for comparing evolutionary and swarm intelligence algorithms. Swarm Evol. Comput. 1, 1 (2011), 3--18.Google ScholarGoogle ScholarCross RefCross Ref
  32. Francisco Durán, Steffen Zschaler, and Javier Troya. 2013. On the reusable specification of non-functional properties in DSLs. In Proceedings of the 5th International Conference on Software Language Engineering (SLE’12). Revised Selected Papers (LNCS). Springer, 332--351.Google ScholarGoogle ScholarCross RefCross Ref
  33. Jean-Rémy Falleri, Marianne Huchard, and Clémentine Nebut. 2006. Towards a traceability framework for model transformations in Kermeta. In Proceedings of the European Conference on Model Driven Architecture—Traceability Workshop (ECMDA-TW’06). 31--40. https://hal-lirmm.ccsd.cnrs.fr/lirmm-00102855Google ScholarGoogle Scholar
  34. M. Fleck, J. Troya, M. Kessentini, M. Wimmer, and B. Alkhazi. 2017. Model transformation modularization as a many-objective optimization problem. IEEE Trans. Softw. Eng. 43, 11 (2017), 1009--1032.Google ScholarGoogle ScholarDigital LibraryDigital Library
  35. Martin Fleck, Javier Troya, and Manuel Wimmer. 2015. Marrying search-based optimization and model transformation technology. In Proceedings of First North American Search Based Software Engineering Symposium (NasBASE'15). 1--16.Google ScholarGoogle Scholar
  36. Martin Fleck, Javier Troya, and Manuel Wimmer. 2016. Search-based model transformations. J. Softw. Evol. Process 28, 12 (2016), 1081--1117. Google ScholarGoogle ScholarDigital LibraryDigital Library
  37. Martin Fleck, Javier Troya, and Manuel Wimmer. 2016. Search-based model transformations with MOMoT. In Proceedings of Theory and Practice of Model Transformations (ICMT’16). Springer, 79--87. Google ScholarGoogle ScholarDigital LibraryDigital Library
  38. Franck Fleurey, Benoit Baudry, Pierre-Alain Muller, and Yves Le Traon. 2009. Qualifying input test data for model transformations. Softw. Syst. Model. 8, 2 (2009), 185--203.Google ScholarGoogle ScholarCross RefCross Ref
  39. Franck Fleurey, Benoit Baudry, Pierre-Alain Muller, and Yves Le Traon. 2009. Qualifying input test data for model transformations. Softw. Syst. Model. 8, 2 (2009), 185--203.Google ScholarGoogle ScholarCross RefCross Ref
  40. Milton Friedman. 1940. A comparison of alternative tests of significance for the problem of m rankings. Ann. Math. Stat. 11, 1 (1940), 86--92. http://www.jstor.org/stable/2235971Google ScholarGoogle ScholarCross RefCross Ref
  41. Pau Giner and Vicente Pelechano. 2009. Test-driven development of model transformations. In Proceedings of ACM/IEEE 21st International Conference on Model Driven Engineering Languages and Systems (MODELS’09). LNCS, Vol. 5795. Springer, 748--752. Google ScholarGoogle ScholarDigital LibraryDigital Library
  42. Martin Gogolla and Antonio Vallecillo. 2011. Tractable Model Transformation Testing. Springer, Berlin, 221--235.Google ScholarGoogle Scholar
  43. C. Gong, Z. Zheng, W. Li, and P. Hao. 2012. Effects of class imbalance in test suites: An empirical study of spectrum-based fault localization. In Proceedings of the IEEE 36th Annual Computer Software and Applications Conference Workshops. 470--475. Google ScholarGoogle ScholarDigital LibraryDigital Library
  44. Carlos A. González and Jordi Cabot. 2012. ATLTest: A White-Box Test Generation Approach for ATL Transformations. Springer, 449--464.Google ScholarGoogle Scholar
  45. Joel Greenyer and Ekkart Kindler. 2010. Comparing relational model transformation technologies: Implementing query/view/transformation with triple graph grammars. Softw. Syst. Model. 9, 1 (2010), 21--46.Google ScholarGoogle ScholarCross RefCross Ref
  46. Esther Guerra. 2012. Specification-driven test generation for model transformations. In Theory and Practice of Model Transformations, Zhenjiang Hu and Juan de Lara (Eds.). Springer, Berlin, 40--55. Google ScholarGoogle ScholarDigital LibraryDigital Library
  47. Esther Guerra, Juan de Lara, Manuel Wimmer, Gerti Kappel, Angelika Kusel, Werner Retschitzegger, Johannes Schönböck, and Wieland Schwinger. 2013. Automated verification of model transformations based on visual contracts. Automat, Softw, Eng, 20, 1 (2013), 5--46. Google ScholarGoogle ScholarDigital LibraryDigital Library
  48. Esther Guerra and Mathias Soeken. 2015. Specification-driven model transformation testing. Softw, Syst, Model, 14, 2 (2015), 623--644. Google ScholarGoogle ScholarDigital LibraryDigital Library
  49. M. Hamill and K. Goseva-Popstojanova. 2009. Common trends in software fault and failure data. IEEE Trans, Softw, Eng, 35, 4 (2009), 484--496. Google ScholarGoogle ScholarDigital LibraryDigital Library
  50. Mary Jean Harrold, Gregg Rothermel, Kent Sayre, Rui Wu, and Liu Yi. 2000. An empirical investigation of the relationship between spectra differences and regression faults. Softw, Test, Verif, Reliabil, 10, 3 (2000), 171--194.Google ScholarGoogle Scholar
  51. Xiao He, Xing Chen, Sibo Cai, Ying Zhang, and Gang Huang. 2018. Testing bidirectional model transformation using metamorphic testing. Information and Software Technology (2018).Google ScholarGoogle Scholar
  52. Myles Hollander, Douglas A. Wolfe, and Eric Chicken. 2013. Nonparametric Statistical Methods. John Wiley 8 Sons.Google ScholarGoogle Scholar
  53. Sture Holm. 1979. A simple sequentially rejective multiple test procedure. Scand. J. Statist. 6, 2 (1979), 65--70. SJSADGGoogle ScholarGoogle Scholar
  54. INRIA. 2005. ATL Transformation Example: BibTeXML to DocBook. Retrieved from https://www.eclipse.org/atl/atlTransformations/BibTeXML2DocBook/ExampleBibTeXML2DocBook{v00.01}.pdf.Google ScholarGoogle Scholar
  55. Tom Janssen, Rui Abreu, and Arjan J. C. van Gemund. 2009. Zoltar: A spectrum-based fault localization tool. In Proceedings of the 2009 ESEC/FSE Workshop on Software Integration and Evolution @ Runtime (SINTER’09). ACM, New York, NY, 23--30. Google ScholarGoogle ScholarDigital LibraryDigital Library
  56. Jean-Marc Jézéquel, Olivier Barais, and Franck Fleurey. 2011. Model driven language engineering with Kermeta. In Generative and Transformational Techniques in Software Engineering III. LNCS, Vol. 6491. Springer, 201--221. Google ScholarGoogle ScholarDigital LibraryDigital Library
  57. Yue Jia and Mark Harman. 2009. Higher order mutation testing. Inf. Softw. Technol. 51, 10 (2009), 1379--1393. Google ScholarGoogle ScholarDigital LibraryDigital Library
  58. Yue Jia and Mark Harman. 2011. An analysis and survey of the development of mutation testing. IEEE Trans. Softw. Eng. 37, 5 (2011), 649--678. Google ScholarGoogle ScholarDigital LibraryDigital Library
  59. James A. Jones and Mary Jean Harrold. 2005. Empirical evaluation of the tarantula automatic fault-localization technique. In Proceedings of the 20th IEEE/ACM International Conference on Automated Software Engineering (ASE’05). ACM, New York, NY, 273--282. Google ScholarGoogle ScholarDigital LibraryDigital Library
  60. Frédéric Jouault. 2005. Loosely coupled traceability for ATL. In Workshop Proceedings of European Conference on Model Driven Architecture—Traceability Workshop (ECMDA’05).Google ScholarGoogle Scholar
  61. Frédéric Jouault, Freddy Allilaire, Jean Bézivin, and Ivan Kurtev. 2008. ATL: A model transformation tool. Sci. Comput. Program. 72, 1-2 (2008), 31--39. Google ScholarGoogle ScholarDigital LibraryDigital Library
  62. Frédéric Jouault, Freddy Allilaire, Jean Bézivin, Ivan Kurtev, and Patrick Valduriez. 2006. ATL: A QVT-like transformation language. In Companion to the 21st ACM SIGPLAN Symposium on Object-oriented Programming Systems, Languages, and Applications (OOPSLA’06). ACM, 719--720. Google ScholarGoogle ScholarDigital LibraryDigital Library
  63. Frédéric Jouault, Jean Bézivin, Charles Consel, Ivan Kurtev, and Fabien Latry. 2006. Building DSLs with AMMA/ATL, a case study on SPL and CPL telephony languages. In Proceedings of the ECOOP Workshop on Domain-Specific Program Development. Nantes, France. https://hal.inria.fr/inria-00353580Google ScholarGoogle Scholar
  64. Begashaw Gezu Kirsie. 2010. Guideline and Evaluation of Model Transformation Engineering Approaches. Master’s thesis. KTH Industrial Engineering and Management, Sweden.Google ScholarGoogle Scholar
  65. Dimitrios S. Kolovos, Louis M. Rose, Nicholas Matragkas, Richard F. Paige, Esther Guerra, Jesús Sánchez Cuadrado, Juan De Lara, István Ráth, Dániel Varró, Massimo Tisi, and Jordi Cabot. 2013. A research roadmap towards achieving scalability in model driven engineering. In Proceedings of the Workshop on Scalability in Model Driven Engineering (BigMDE’13). ACM, New York, NY, Article 2, 10 pages. Google ScholarGoogle ScholarDigital LibraryDigital Library
  66. Thomas Kühne. 2006. Matters of (meta-) modeling. Softw. Syst. Model. 5, 4 (2006), 369--385.Google ScholarGoogle ScholarCross RefCross Ref
  67. H. J. Lee, L. Naish, and K. Ramamohanarao. 2010. Effective software bug localization using spectral frequency weighting function. In Proceedings of the IEEE 34th Annual Computer Software and Applications Conference. 218--227. Google ScholarGoogle ScholarDigital LibraryDigital Library
  68. Chao Liu, Long Fei, Xifeng Yan, Jiawei Han, and Samuel P. Midkiff. 2006. Statistical debugging: A hypothesis testing-based approach. IEEE Trans. Softw. Eng. 32, 10 (Oct. 2006), 831--848. Google ScholarGoogle ScholarDigital LibraryDigital Library
  69. Lucia, F. Thung, D. Lo, and L. Jiang. 2012. Are faults localizable? In Proceedings of the 2012 9th IEEE Working Conference on Mining Software Repositories (MSR’12). 74--77. Google ScholarGoogle ScholarDigital LibraryDigital Library
  70. Lucia Lucia, David Lo, Lingxiao Jiang, Ferdian Thung, and Aditya Budi. 2014. Extended comprehensive study of association measures for fault localization. J. Softw. Evol. Process 26, 2 (2014), 172--219. Google ScholarGoogle ScholarDigital LibraryDigital Library
  71. Levi Lúcio, Moussa Amrani, Jürgen Dingel, Leen Lambers, Rick Salay, Gehan Selim, Eugene Syriani, and Manuel Wimmer. 2016. Model transformation intents and their properties. Softw. Syst. Model. 15, 3 (2016), 647--684. Google ScholarGoogle ScholarDigital LibraryDigital Library
  72. Jochen Ludewig. 2003. Models in software engineering -- an introduction. Softw. Syst. Model. 2, 1 (2003), 5--14.Google ScholarGoogle ScholarCross RefCross Ref
  73. Xiaoguang Mao, Yan Lei, Ziying Dai, Yuhua Qi, and Chengsong Wang. 2014. Slice-based statistical fault localization. J. Syst. Softw. 89 (Mar. 2014), 51--62.Google ScholarGoogle Scholar
  74. A. E. Maxwell and A. E. G. Pilliner. 1968. Deriving coefficients of reliability and agreement for ratings. Br. J. Math. Statist. Psych. 21, 1 (1968), 105--116.Google ScholarGoogle ScholarCross RefCross Ref
  75. S. J. Mellor, K. Scott, A. Uhl, D. Weise, and R. M. Soley. 2004. MDA Distilled: Principles of Model-driven Architecture. Vol. 88. Addison-Wesley. Google ScholarGoogle ScholarDigital LibraryDigital Library
  76. Antonio Moreno-Delgado, Francisco Durán, Steffen Zschaler, and Javier Troya. 2014. Modular DSLs for flexible analysis: An e-motions reimplementation of palladio. In Proceedings of the 10th European Conference on Modelling Foundations and Applications (ECMFA’14). LNCS. Springer, 132--147. Google ScholarGoogle ScholarDigital LibraryDigital Library
  77. Jean-Marie Mottu, Benoit Baudry, and Yves Le Traon. 2006. Mutation Analysis Testing for Model Transformations. Springer, Berlin,, 376--390. Google ScholarGoogle ScholarDigital LibraryDigital Library
  78. Lee Naish, Hua Jie Lee, and Kotagiri Ramamohanarao. 2011. A model for spectra-based software diagnosis. ACM Trans. Softw. Eng. Methodol. 20, 3, Article 11 (Aug. 2011), 32 pages. Google ScholarGoogle ScholarDigital LibraryDigital Library
  79. L. Naish, Neelofar, and K. Ramamohanarao. 2015. Multiple bug spectral fault localization using genetic programming. In Proceedings of the 2015 24th Australasian Software Engineering Conference. 11--17. Google ScholarGoogle ScholarDigital LibraryDigital Library
  80. Bentley James Oakes, Javier Troya, Levi Lúcio, and Manuel Wimmer. 2018. Full contract verification for ATL using symbolic execution. J. Softw. Syst. Model. 17, 3 (2018), 815--849. Google ScholarGoogle ScholarDigital LibraryDigital Library
  81. Elmahdi Omar, Sudipto Ghosh, and Darrell Whitley. 2017. Subtle higher order mutants. Inf. Softw. Technol. 81 (2017), 3--18. Google ScholarGoogle ScholarDigital LibraryDigital Library
  82. Magnus Persson, Martin Törngren, Ahsan Qamar, Jonas Westman, Matthias Biehl, Stavros Tripakis, Hans Vangheluwe, and Joachim Denil. 2013. A characterization of integrated multi-view modeling in the context of embedded and cyber-physical systems. In Proceedings of the 11th ACM International Conference on Embedded Software (EMSOFT’13). IEEE Press, Los Alamitos, CA, Article 10, 10 pages. http://dl.acm.org/citation.cfm?id=2555754.2555764 Google ScholarGoogle ScholarDigital LibraryDigital Library
  83. Iman Poernomo and Jeffrey Terrell. 2010. Correct-by-construction model transformations from partially ordered specifications in Coq. In Proceedings of International Conference on Formal Engineering Methods (ICFEM’10). 56--73. Google ScholarGoogle ScholarDigital LibraryDigital Library
  84. Eclipse Modeling Project. 2015. Atlas Transformation Language—ATL. Retrieved from http://eclipse.org/atl.Google ScholarGoogle Scholar
  85. Yuhua Qi, Xiaoguang Mao, Yan Lei, and Chengsong Wang. 2013. Using automated program repair for evaluating the effectiveness of fault localization techniques. In Proceedings of the 2013 International Symposium on Software Testing and Analysis (ISSTA’13). ACM, New York, NY, 191--201. Google ScholarGoogle ScholarDigital LibraryDigital Library
  86. Jose E. Rivera, Francisco Duran, and Antonio Vallecillo. 2009. A graphical approach for modeling time-dependent behavior of DSLs. In Proceedings of the IEEE Symposium on Visual Languages and Human-Centric Computing (VL/HCC’09). IEEE, 51--55. Google ScholarGoogle ScholarDigital LibraryDigital Library
  87. Louis M. Rose, Markus Herrmannsdoerfer, Steffen Mazanek, Pieter Van Gorp, Sebastian Buchwald, Tassilo Horn, Elina Kalnina, Andreas Koch, Kevin Lano, Bernhard Schätz, and Manuel Wimmer. 2014. Graph and model transformation tools for model migration. Softw. Syst. Model. 13, 1 (2014), 323--359. Google ScholarGoogle ScholarDigital LibraryDigital Library
  88. K. Rustan and M. Leino. 2008. This Is Boogie 2. Technical Report. Manuscript KRML 178.Google ScholarGoogle Scholar
  89. Jesús Sánchez-Cuadrado and Jesús García-Molina. 2009. Modularization of model transformations through a phasing mechanism. Softw. Syst. Model. 8, 3 (Jul 2009), 325--345.Google ScholarGoogle Scholar
  90. Jesús Sánchez-Cuadrado, Esther Guerra, and Juan de Lara. 2018. Quick fixing ATL transformations with speculative analysis. Softw. Syst. Model. 17, 3 (2018), 779--813. Google ScholarGoogle ScholarDigital LibraryDigital Library
  91. Jesús Sánchez-Cuadrado, Esther Guerra, and Juan de Lara. 2017. Static analysis of model transformations. IEEE Trans. Softw. Eng. 43, 9 (2017), 868--897.Google ScholarGoogle ScholarDigital LibraryDigital Library
  92. J. Sánchez-Cuadrado, E. Guerra, J. de Lara, R. Clarisó, and J. Cabot. 2017. Translating target to source constraints in model-to-model transformations. In Proceedings of the ACM/IEEE 20th International Conference on Model Driven Engineering Languages and Systems (MODELS’17). 12--22.Google ScholarGoogle Scholar
  93. S. Segura, G. Fraser, A. Sanchez, and A. Ruiz-Cortes. 2016. A survey on metamorphic testing. IEEE Trans. Softw. Eng. 42, 9 (2016), 805--824.Google ScholarGoogle ScholarCross RefCross Ref
  94. Gehan M. K. Selim, Shige Wang, James R. Cordy, and Juergen Dingel. 2012. Model Transformations for Migrating Legacy Models: An Industrial Case Study. Springer, Berlin, 90--101.Google ScholarGoogle Scholar
  95. Sagar Sen, Benoit Baudry, and Jean-Marie Mottu. 2009. Automatic model generation strategies for model transformation testing. In Proceedings of the International Conference on Manufacturing Technologies (ICMT’09). LNCS, Vol. 5563. Springer, 148--164. Google ScholarGoogle ScholarDigital LibraryDigital Library
  96. Shane Sendall and Wojtek Kozaczynski. 2003. Model transformation: The heart and soul of model-driven software development. IEEE Softw. 20, 5 (2003), 42--45. Google ScholarGoogle ScholarDigital LibraryDigital Library
  97. Gabriele Taentzer. 2003. AGG: A graph transformation environment for modeling and validation of software. In Proceedings of the 2nd Workshop on Applications of Graph Transformations with Industrial Relevance (AGTIVE’03). LNCS, Vol. 3062. Springer, 446--453.Google ScholarGoogle Scholar
  98. Javier Troya, Alexander Bergmayr, Loli Burgueno, and Manuel Wimmer. 2015. Towards systematic mutations for and with ATL model transformations. In Proceedings of the IEEE 8th International Conference on Software Testing, Verification and Validation Workshops (ICSTW’15). 1--10.Google ScholarGoogle ScholarCross RefCross Ref
  99. Javier Troya, Sergio Segura, José Antonio Parejo, and Antonio Ruiz-Cortes. 2017. An approach for debugging model transformations applying spectrum-based fault localization. In XXII Jornadas de Ingeniería del Software y Bases de Datos (JISBD’17). https://biblioteca.sistedes.es/submissions/uploaded-files/JISBD_2017_paper_32.pdf.Google ScholarGoogle Scholar
  100. Javier Troya, Sergio Segura, José Antonio Parejo, and Antonio Ruiz-Cortés. 2017. Spectrum-Based Fault Localization in Model Transformations. Retrieved from https://gestionproyectos.us.es/projects/itim/wiki. Google ScholarGoogle ScholarDigital LibraryDigital Library
  101. Javier Troya, Sergio Segura, and Antonio Ruiz-Cortés. 2018. Automated inference of likely metamorphic relations for model transformations. J. Syst. Softw. 136 (2018), 188--208. Google ScholarGoogle ScholarDigital LibraryDigital Library
  102. Javier Troya and Antonio Vallecillo. 2011. A rewriting logic semantics for ATL. J. Obj. Technol. 10, 5 (2011), 1--29.Google ScholarGoogle ScholarCross RefCross Ref
  103. Javier Troya and Antonio Vallecillo. 2014. Specification and simulation of queuing network models using domain-specific languages. Comput. Stand. Intef. 36, 5 (2014), 863--879. Google ScholarGoogle ScholarDigital LibraryDigital Library
  104. Antonio Vallecillo and Martin Gogolla. 2012. Typing model transformations using tracts. In Proceedings of the 5th International Conference on Theory and Practice of Model Transformations (ICMT’12). Springer, 56--71. Google ScholarGoogle ScholarDigital LibraryDigital Library
  105. András Vargha and Harold D. Delaney. 2000. A critique and improvement of the CL common language effect size statistics of McGraw and Wong. J. Educ. Behav. Stat. 25, 2 (2000), 101--132.Google ScholarGoogle Scholar
  106. D. Wagelaar. 2014. Using ATL/EMFTVM for import/export of medical data. In Proceedings of the 2nd Software Development Automation Conference.Google ScholarGoogle Scholar
  107. Leonard Muellner Norman Walsh. 1999. DocBook: The Definitive Guide. O’Reilly 8 Associates. http://www.docbook.org/tdg/Google ScholarGoogle Scholar
  108. Jos Warmer and Anneke Kleppe. 2003. The Object Constraint Language: Getting Your Models Ready for MDA. Addison-Wesley. Google ScholarGoogle ScholarDigital LibraryDigital Library
  109. Manuel Wimmer and Loli Burgueño. 2013. Testing M2T/T2M transformations. In Proceedings of the International Conference on Model Driven Engineering Languages and Systems (MODELS’13). Springer, 203--219. Google ScholarGoogle ScholarDigital LibraryDigital Library
  110. Manuel Wimmer, Gerti Kappel, Johannes Schönböck, Angelika Kusel, Werner Retschitzegger, and Wieland Schwinger. 2009. A Petri Net based debugging environment for QVT relations. In Proceedings of the IEEE/ACM International Conference on Automated Software Engineering (ASE’09). IEEE, 3--14. Google ScholarGoogle ScholarDigital LibraryDigital Library
  111. Manuel Wimmer, Salvador Martínez, Frédéric Jouault, and Jordi Cabot. 2012. A catalogue of refactorings for model-to-model transformations. J. Obj. Technol. 11, 2 (Aug. 2012), 2:1--40.Google ScholarGoogle ScholarCross RefCross Ref
  112. Claes Wohlin, Per Runeson, Martin Höst, Magnus C. Ohlsson, and Björn Regnell. 2012. Experimentation in Software Engineering. Springer. Google ScholarGoogle ScholarCross RefCross Ref
  113. W. E. Wong, V. Debroy, R. Gao, and Y. Li. 2014. The DStar method for effective software fault localization. IEEE Trans. Reliabil. 63, 1 (Mar. 2014), 290--308.Google ScholarGoogle ScholarCross RefCross Ref
  114. W. E. Wong, V. Debroy, Y. Li, and R. Gao. 2012. Software fault localization using DStar (D<sup>*</sup>). In Proceedings of the IEEE 6th International Conference on Software Security and Reliability. 21--30. Google ScholarGoogle ScholarDigital LibraryDigital Library
  115. W. Eric Wong, Ruizhi Gao, Yihao Li, Rui Abreu, and Franz Wotawa. 2016. A survey on software fault localization. IEEE Trans. Softw. Eng. 42, 8 (2016), 707--740. Google ScholarGoogle ScholarDigital LibraryDigital Library
  116. Xiaoyuan Xie. 2012. On the Analysis of Spectrum-based Fault Localization. Ph.D. Dissertation. Faculty of Information and Communication Technologies, Swinburne University of Technology, Australia.Google ScholarGoogle Scholar
  117. Xiaoyuan Xie, Tsong Yueh Chen, Fei-Ching Kuo, and Baowen Xu. 2013. A theoretical analysis of the risk evaluation formulas for spectrum-based fault localization. ACM Trans. Softw. Eng. Methodol. 22, 4, Article 31 (Oct. 2013), 40 pages. Google ScholarGoogle ScholarDigital LibraryDigital Library
  118. X. Xue and A. S. Namin. 2013. How significant is the effect of fault interactions on coverage-based fault localizations? In Proceedings of the 2013 ACM/IEEE International Symposium on Empirical Software Engineering and Measurement. 113--122.Google ScholarGoogle Scholar
  119. Shin Yoo. 2012. Evolving human competitive spectra-based fault localisation techniques. In Search Based Software Engineering, Gordon Fraser and Jerffeson Teixeira de Souza (Eds.). Springer, Berlin, 244--258. Google ScholarGoogle ScholarDigital LibraryDigital Library
  120. Yanbing Yu, James A. Jones, and Mary Jean Harrold. 2008. An empirical study of the effects of test-suite reduction on fault localization. In Proceedings of the 30th International Conference on Software Engineering (ICSE’08). ACM, New York, NY, 201--210. Google ScholarGoogle ScholarDigital LibraryDigital Library
  121. Xiangyu Zhang, Sriraman Tallam, Neelam Gupta, and Rajiv Gupta. 2007. Towards locating execution omission errors. In Proceedings of the 28th ACM SIGPLAN Conference on Programming Language Design and Implementation (PLDI’07). ACM, 415--424. Google ScholarGoogle ScholarDigital LibraryDigital Library
  122. Zhenyu Zhang, W. K. Chan, T. H. Tse, Peifeng Hu, and Xinming Wang. 2009. Is non-parametric hypothesis testing model robust for statistical fault localization? Inf. Softw. Technol. 51, 11 (2009), 1573--1585. Google ScholarGoogle ScholarDigital LibraryDigital Library
  123. Álvaro Jiménez, Juan M. Vara, Verónica A. Bollati, and Esperanza Marcos. 2015. MeTAGeM-trace: Improving trace generation in model transformation by leveraging the role of transformation models. Sci. Comput. Program. 98 (2015), 3--27. Google ScholarGoogle ScholarDigital LibraryDigital Library

Index Terms

  1. Spectrum-Based Fault Localization in Model Transformations

            Recommendations

            Comments

            Login options

            Check if you have access through your login credentials or your institution to get full access on this article.

            Sign in

            Full Access

            • Published in

              cover image ACM Transactions on Software Engineering and Methodology
              ACM Transactions on Software Engineering and Methodology  Volume 27, Issue 3
              July 2018
              210 pages
              ISSN:1049-331X
              EISSN:1557-7392
              DOI:10.1145/3276753
              Issue’s Table of Contents

              Copyright © 2018 ACM

              Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

              Publisher

              Association for Computing Machinery

              New York, NY, United States

              Publication History

              • Published: 17 September 2018
              • Accepted: 1 July 2018
              • Revised: 1 May 2018
              • Received: 1 October 2017
              Published in tosem Volume 27, Issue 3

              Permissions

              Request permissions about this article.

              Request Permissions

              Check for updates

              Qualifiers

              • research-article
              • Research
              • Refereed

            PDF Format

            View or Download as a PDF file.

            PDF

            eReader

            View online with eReader.

            eReader