Rafaqut Kazmi
Skip Abstract Section
Abstract
Regression test case selection techniques attempt to increase the testing effectiveness based on the measurement capabilities, such as cost, coverage, and fault detection. This systematic literature review presents state-of-the-art research in effective regression test case selection techniques. We examined 47 empirical studies published between 2007 and 2015. The selected studies are categorized according to the selection procedure, empirical study design, and adequacy criteria with respect to their effectiveness measurement capability and methods used to measure the validity of these results.
The results showed that mining and learning-based regression test case selection was reported in 39% of the studies, unit level testing was reported in 18% of the studies, and object-oriented environment (Java) was used in 26% of the studies. Structural faults, the most common target, was used in 55% of the studies. Overall, only 39% of the studies conducted followed experimental guidelines and are reproducible.
There are 7 different cost measures, 13 different coverage types, and 5 fault-detection metrics reported in these studies. It is also observed that 70% of the studies being analyzed used cost as the effectiveness measure compared to 31% that used fault-detection capability and 16% that used coverage.
- J. Anderson, S. Salem, and H. Do. 2014. Improving the effectiveness of test suite through mining historical data. In Proceedings of the 11th Working Conference on Mining Software Repositories. ACM, 142--151. Google Scholar
Digital Library
- J. H. Andrews, L. C. Briand, Y. Labiche, and A. S. Namin. 2006. Using mutation analysis for assessing and comparing testing coverage criteria. IEEE Trans. Software Eng. 32, 608--624. Google ScholarDigital Library
- M. A. Askarunisa, M. L. Shanmugapriya, and D. N. Ramaraj. 2010. Cost and coverage metrics for measuring the effectiveness of test case prioritization techniques. INFOCOMP J. Comput. Sci. 9, 43--52.Google Scholar
- A. Assis Lobo De Oliveira, C. Gonyalves Camilo-Junior, and A. M. Vincenzi. 2013. A coevolutionary algorithm to automatic test case selection and mutant in mutation testing. In Proceedings of the IEEE Congress on Evolutionary Computation (CEC’13). IEEE, 829--836.Google Scholar
- B. Beizer. 1995. Black-Box Testing: Techniques for Functional Testing of Software and Systems, John Wiley 8 Sons, Inc. Google ScholarDigital Library
- D. Binkley. 1995. Reducing the cost of regression testing by semantics guided test case selection. In Proceedings of the International Conference on Software Maintenance. IEEE, 251--260. Google ScholarDigital Library
- S. Biswas, R. Mall, M. Satpathy, and S. Sukumaran. 2011a. Regression test selection techniques: A survey. Informat.: Int. J. Comput. Informat. 35, 289--321.Google Scholar
- S. Biswas, R. Mall, M. Satpathy, and S. Sukumaran. 2011b. Regression test selection techniques: A survey. Informatica 35.Google Scholar
- P. Brereton, B. A. Kitchenham, D. Budgen, M. Turner, and M. Khalil. 2007. Lessons from applying the systematic literature review process within the software engineering domain. J. Syst. Software 80, 571--583. Google ScholarDigital Library
- X. Cai and M. R. Lyu. 2005. The effect of code coverage on fault detection under different testing profiles. ACM SIGSOFT Software Eng. Notes 30, 1--7. Google ScholarDigital Library
- E. G. Cartaxo, P. D. Machado, and F. G. O. Neto. 2011. On the use of a similarity function for test case selection in the context of model-based testing. Software Test. Verificat. Reliabil. 21, 75--100. Google ScholarDigital Library
- S. Chen, Z. Chen, Z. Zhao, B. Xu, and Y. Feng. 2011a. Using semi-supervised clustering to improve regression test selection techniques. In Proceedings of the IEEE 4th International Conference on Software Testing, Verification and Validation (ICST’11). IEEE, 1--10. Google ScholarDigital Library
- Z. Chen, Y. Duan, Z. Zhao, B. Xu, and J. Qian. 2011b. Using program slicing to improve the efficiency and effectiveness of cluster test selection. Int. J. Software Eng. Knowl. Eng. 21, 759--777.Google ScholarCross Ref
- P. K. Chittimalli and M. J. Harrold. 2009. Recomputing coverage information to assist regression testing. IEEE Trans. Software Eng. 35, 452--469. Google ScholarDigital Library
- H. Cibulski and A. Yehudai. 2011. Regression test selection techniques for test-driven development. In Proceedings of the 4th International Conference on Software Testing, Verification and Validation Workshops (ICSTW’11). IEEE, 115--124. Google ScholarDigital Library
- C. A. C. Coello, D. A. Van Veldhuizen, and G. B. Lamont. 2002. Evolutionary Algorithms for Solving Multi-Objective Problems. Springer. Google ScholarDigital Library
- L. S. De Souza, P. B. De Miranda, R. B. Prudencio, and F. De Barros. 2011. A multi-objective particle swarm optimization for test case selection based on functional requirements coverage and execution effort. In Proceedings of the23rd IEEE International Conference on Tools with Artificial Intelligence (ICTAI’11). IEEE, 245--252. Google ScholarDigital Library
- L. S. De Souza, R. B. Prudencio, and D. A. Barros. 2014a. A hybrid binary multi-objective particle swarm optimization with local search for test case selection. In Proceedings of the 2014 Brazilian Conference on Intelligent Systems (BRACIS’14), 2014a. IEEE, 414--419. Google ScholarDigital Library
- L. S. De Souza, R. B. Prudencio, and F. D. Barros. 2014b. A comparison study of binary multi-objective particle swarm optimization approaches for test case selection. In Proceedings of the 2014 IEEE Congress on Evolutionary Computation (CEC’14). IEEE, 2164--2171.Google Scholar
- L. S. De Souza, R. B. Prudêncio, F. D. A. Barros, and E. H. D. S. Aranha. 2013. Search based constrained test case selection using execution effort. Expert Syst. Appl. 40, 4887--4896. Google ScholarDigital Library
- K. Deb. 2001. Multi-Objective Optimization Using Evolutionary Algorithms, John Wiley 8 Sons. Google ScholarDigital Library
- M. E. Delamaro and J. Offutt. 2014. Assessing the influence of multiple test case selection on mutation experiments. In Proceedings of the 2014 IEEE 7th International Conference on Software Testing, Verification and Validation Workshops (ICSTW’14). IEEE, 171--175. Google ScholarDigital Library
- H. Do and G. Rothermel. 2006. An empirical study of regression testing techniques incorporating context and lifetime factors and improved cost-benefit models. In Proceedings of the 14th ACM SIGSOFT International Symposium on Foundations of Software Engineering. ACM, 141--151. Google ScholarDigital Library
- T. Dyba, B. A. Kitchenham, and M. Jorgensen. 2005. Evidence-based software engineering for practitioners. IEEE Software, 22, 58--65. Google ScholarDigital Library
- I. Eee. 1990. Standard G lossary of softwareengineering terminology. IEEE Software Eng. Stand. Cll ect. IEEE, 610.12--190.Google Scholar
- W. S. A. El-Hamid, S. S. El-Etriby, and M. M. Hadhoud. 2010. Regression test selection technique for multi-programming language. In Proceedings of the 7th International Conference on Informatics and Systems (INFOS’10). IEEE, 1--5.Google Scholar
- S. Elbaum, P. Kallakuri, A. Malishevsky, G. Rothermel, and S. Kanduri. 2003. Understanding the effects of changes on the cost-effectiveness of regression testing techniques. Software Test. Verificat. Reliabil. 13, 65--83.Google ScholarCross Ref
- S. Elbaum, A. Malishevsky, and G. Rothermel. 2001. Incorporating varying test costs and fault severities into test case prioritization. In Proceedings of the 23rd International Conference on Software Engineering. IEEE Computer Society, 329--338. Google ScholarDigital Library
- S. Elbaum, A. G. Malishevsky, and G. Rothermel. 2002. Test case prioritization: A family of empirical studies. IEEE Trans. Software Eng. 28, 159--182. Google ScholarDigital Library
- E. Engström, P. Runeson, and M. Skoglund. 2010. A systematic review on regression test selection techniques. Informat. Software Technol. 52, 14--30. Google ScholarDigital Library
- E. Engström, M. Skoglund, and P. Runeson. 2008. Empirical evaluations of regression test selection techniques: A systematic review. In Proceedings of the 2nd ACM-IEEE International Symposium on Empirical Software Engineering and Measurement. ACM, 22--31. Google ScholarDigital Library
- K. F. Fischer. 1977. A test case selection method for the validation of software maintenance modifications. Proceedings of COMPSAC, 1977. 421--426.Google Scholar
- E. Fourneret, J. Cantenot, F. Bouquet, B. Legeard, and J. Botella. 2014. Setgam: Generalized technique for regression testing based on UML/OCL models. In Proceedings of the 8th International Conference on Software Security and Reliability (SERE’14), 2014. IEEE, 147--156. Google ScholarDigital Library
- M. Gligoric, L. Eloussi, and D. Marinov. 2015. Practical regression test selection with dynamic file dependencies. In Proceedings of the 2015 International Symposium on Software Testing and Analysis. ACM, 211--222. Google ScholarDigital Library
- M. Gligoric, A. Groce, C. Zhang, R. Sharma, M. A. Alipour, and D. Marinov. 2014. Guidelines for coverage-based comparisons of non-adequate test suites. Space 6, 1, 142.Google Scholar
- J. E. González, N. Juristo, and S. Vegas. 2014. A systematic mapping study on testing technique experiments: has the situation changed since 2000? In Proceedings of the 8th ACM/IEEE International Symposium on Empirical Software Engineering and Measurement, 2014. ACM, 3. Google ScholarDigital Library
- T. L. Graves, M. J. Harrold, J. M. Kim, A. Porter, and G. Rothermel. 2001. An empirical study of regression test selection techniques. ACM Trans. Software Eng. Methodol (TOSEM) 10, 184--208. Google ScholarDigital Library
- F. Haftmann, D. Kossmann, and E. Lo. 2007. A framework for efficient regression tests on database applications. VLDB J.: Int. J. Very Large Data Bases 16, 145--164. Google ScholarDigital Library
- M. Harman and N. Alshahwan. 2008. Automated session data repair for web application regression testing. In Proceedings of the 1st International Conference on Software Testing, Verification, and Validation. IEEE, 298--307. Google ScholarDigital Library
- H. Hemmati, A. Arcuri, and L. Briand. 2010a. Reducing the cost of model-based testing through test case diversity. In Testing Software and Systems. Springer. Google ScholarDigital Library
- H. Hemmati, A. Arcuri, and L. Briand. 2011. Empirical investigation of the effects of test suite properties on similarity-based test case selection. In Proceedings of the IEEE 4th International Conference on Software Testing, Verification and Validation (ICST’11). IEEE, 327--336. Google ScholarDigital Library
- H. Hemmati and L. Briand. 2010. An industrial investigation of similarity measures for model-based test case selection. In Proceedings of the IEEE 21st International Symposium on Software Reliability Engineering (ISSRE’10) IEEE, 141--150. Google ScholarDigital Library
- H. Hemmati, L. Briand, A. Arcuri, and S. Ali. 2010b. An enhanced test case selection approach for model-based testing: An industrial case study. In Proceedings of the 18th ACM SIGSOFT International Symposium on Foundations of Software Engineering. ACM, 267--276. Google ScholarDigital Library
- K. Hla, Y. Choi, and J. S. Park. 2008. Applying particle swarm optimization to prioritizing test cases for embedded real time software retesting. In Proceedings of the IEEE 8th International Conference on Computer and Information Technology Workshops. IEEE, 527--532. Google ScholarDigital Library
- S. Huang, Y. Chen, J. Zhu, Z. J. Li, and H. F. Tan. 2009. An optimized change-driven regression testing selection strategy for binary Java applications. In Proceedings of the 2009 ACM Symposium on Applied Computing. ACM, 558--565. Google ScholarDigital Library
- S. Huang, Z. J. Li, J. Zhu, Y. Xiao, and W. Wang. 2011. A novel approach to regression test selection for J2EE applications. In Proceedings of the 27th IEEE International Conference on Software Maintenance (ICSM’11). IEEE, 13--22. Google ScholarDigital Library
- IEEE-STD-610. 12-1990. 1990. IEEE standard glossary of software engineering terminology (IEEE Std 610.12-1990). IEEE Computer Society, Los Alamitos. CA.Google Scholar
- S. A. Infrastructure. 2016. SIR. Retrieved from http://sir.unl.edu/portal/index.php.Google Scholar
- L. Inozemtseva and R. Holmes. 2014. Coverage is not strongly correlated with test suite effectiveness. In Proceedings of the 36th International Conference on Software Engineering. ACM, 435--445. Google ScholarDigital Library
- M. Z. Z. Iqbal, Z. Malik, and M. Riebisch. 2010. A model-based regression testing approach for evolving software systems with flexible tool support. In Proceedings of the 17th IEEE International Conference and Workshops on Engineering of Computer Based Systems (ECBS’10). IEEE, 41--49. Google ScholarDigital Library
- L. Jiang and Z. Su. 2007. Context-aware statistical debugging: from bug predictors to faulty control flow paths. In Proceedings of the 22nd IEEE/ACM International Conference on Automated Software Engineering. ACM, 184--193. Google ScholarDigital Library
- D. S. Johnson. 2002. A theoretician's guide to the experimental analysis of algorithms. Data Structures, Near Neighbor Searches, and Methodology: Fifth and Sixth DIMACS Implementation Challenges, 59, 215--250.Google Scholar
- B. Kitchenham. 2004. Procedures for performing systematic reviews. Keele University, Keele, UK. 33, 1--26.Google Scholar
- B. A. Kitchenham, T. Dyba, and M. Jorgensen. 2004. Evidence-based software engineering. In Proceedings of the 26th International Conference on Software Engineering. IEEE Computer Society, 273--281. Google ScholarDigital Library
- B. A. Kitchenham, S. L. Pfleeger, L. M. Pickard, P. W. Jones, D. C. Hoaglin, K. El Emam, and J. Rosenberg. 2002. Preliminary guidelines for empirical research in software engineering. IEEE Trans. Software Eng. 28, 721--734. Google ScholarDigital Library
- M. Kumar, A. Sharma, and R. Kumar. 2013. Fuzzy entropy-based framework for multi-faceted test case classification and selection: An empirical study. IET Software 8, 103--112.Google ScholarCross Ref
- M. Kumar, A. Sharma, and R. Kumar. 2015. An empirical evaluation of a three-tier conduit framework for multifaceted test case classification and selection using fuzzy-ant colony optimisation approach. Software: Pract. Exp. 45, 949--971. Google ScholarDigital Library
- D. C. Kung, C. H. Liu, and P. Hsia. 2000. An object-oriented web test model for testing web applications. In Proceedings of the 1st Asia-Pacific Conference on Quality Software. IEEE, 111--120. Google ScholarDigital Library
- H. K. Leung and L. White. 1989. Insights into regression testing [software testing]. In Proceedings of the 1989 Conference on Software Maintenance. IEEE, 60--69.Google Scholar
- H. K. Leung and L. White. 1991. A cost model to compare regression test strategies. In Proceedings of the 1991 Conference on Software Maintenance. IEEE, 201--208.Google Scholar
- W. E. Lewis. 2008. Software Testing and Continuous Quality Improvement, CRC Press, Boca Raton, FL. Google ScholarDigital Library
- W. E. Lewis. 2016. Software Testing and Continuous Quality Improvement, CRC Press, Boca Raton, FL. Google ScholarDigital Library
- B. Li, D. Qiu, H. Leung, and D. Wang. 2012. Automatic test case selection for regression testing of composite service based on extensible BPEL flow graph. J. Syst. Software 85, 1300--1324. Google ScholarDigital Library
- Y. D. Lin, C. H. Chou, Y. C. Lai, T. Y. Huang, S. Chung, J. T. Hung, and F. C. Lin. 2012. Test coverage optimization for large code problems. J. Syst. Software 85, 16--27. Google ScholarDigital Library
- N. Mansour, H. Takkoush, and A. Nehme. 2011. UML-based regression testing for OO software. J. Software Maint. Evol.: Res. Pract. 23, 51--68. Google ScholarDigital Library
- A. Memon, A. Nagarajan, and Q. Xie. 2005. Automating regression testing for evolving GUI software. J. Software Maint. Evol.: Res. Pract. 17, 27--64. Google ScholarDigital Library
- A. M. Memon. 2008. Automatically repairing event sequence-based GUI test suites for regression testing. ACM Transactions on Software Engineering and Methodology (TOSEM) 18, 4. Google ScholarDigital Library
- A. M. Memon and M. L. Soffa. 2003. Regression testing of GUIs. ACM SIGSOFT Software Engineering Notes 28, 118--127. Google ScholarDigital Library
- S. Mirarab, S. Akhlaghi, and L. Tahvildari. 2012a. Size-constrained regression test case selection using multicriteria optimization. IEEE Trans. Software Eng. 38, 936--956. Google ScholarDigital Library
- S. Mirarab, S. Akhlaghi, and L. Tahvildari. 2012b. Size-constrained regression test case selection using multicriteria optimization. IEEE Trans. Software Eng. 38, 936--956. Google ScholarDigital Library
- J. D. Musa. 1993. Operational profiles in software-reliability engineering. IEEE Software 10, 14--32. Google ScholarDigital Library
- R. Nagar, A. Kumar, S. Kumar, and A. S. Baghel. 2014. Implementing test case selection and reduction techniques using meta-heuristics. In Proceedings of the 5th International Conference on Confluence The Next Generation Information Technology Summit (Confluence’14). IEEE, 837--842.Google Scholar
- A. S. Namin and J. H. Andrews. 2009. The influence of size and coverage on test suite effectiveness. Proceedings of the 18th International Symposium on Software Testing and Analysis. ACM, 57--68. Google ScholarDigital Library
- A. Nanda, S. Mani, S. Sinha, M. J. Harrold, and A. Orso. 2011. Regression testing in the presence of non-code changes. In Proceedings of the IEEE 4th International Conference on Software Testing, Verification and Validation (ICST’11). IEEE, 21--30. Google ScholarDigital Library
- D. D. Nardo, N. Alshahwan, L. Briand, and Y. Labiche. 2015. Coverage-based regression test case selection, minimization and prioritization: A case study on an industrial system. Software Test. Verificat. Reliabil. 25, 371--396. Google ScholarDigital Library
- A. Orso and G. Rothermel. 2014. Software testing: A research travelogue (2000--2014). In Proceedings on the Future of Software Engineering. ACM, 117--132. Google ScholarDigital Library
- A. Orso, N. Shi, and M. J. Harrold. 2004. Scaling regression testing to large software systems. ACM SIGSOFT Software Engineering Notes, 2004. ACM, 241--251. Google ScholarDigital Library
- T. J. Ostrand, E. J. Weyuker, and R. M. Bell. 2005. Predicting the location and number of faults in large software systems. IEEE Trans. Software Eng. 31, 340--355. Google ScholarDigital Library
- Y. Pang, X. Xue, and A. S. Namin. 2013. Identifying effective test cases through k-means clustering for enhancing regression testing. In Proceedings of the 12th International Conference on Machine Learning and Applications (ICMLA’13). IEEE, 78--83. Google ScholarDigital Library
- A. Panichella, R. Oliveto, M. D. Penta, and A. De Lucia. 2015. Improving multi-objective test case selection by injecting diversity in genetic algorithms. IEEE Trans. Software Eng. 41, 358--383.Google ScholarDigital Library
- A. Pasala, Y. Lew Yaw Fung, F. Akladios, G. Appala Raju, and R. P. Gorthi. 2008. Selection of regression test suite to validate software applications upon deployment of upgrades. In Proceedings of the 19th Australian Conference on Software Engineering (ASWEC’08). IEEE, 130--138. Google ScholarDigital Library
- S. Poulding, P. Emberson, I. Bate, and J. Clark. 2007. An efficient experimental methodology for configuring search-based design algorithms. In Proceedings of the 10th IEEE High Assurance Systems Engineering Symposium (HASE’07). IEEE, 53--62. Google ScholarDigital Library
- X. Qu, M. B. Cohen, and G. Rothermel. 2008. Configuration-aware regression testing: an empirical study of sampling and prioritization. In Proceedings of the 2008 International Symposium on Software Testing and Analysis. ACM, 75--86. Google ScholarDigital Library
- N. Rachatasumrit and M. Kim. 2012. An empirical investigation into the impact of refactoring on regression testing. In Proceedings of the 28th IEEE International Conference on Software Maintenance (ICSM’12). IEEE, 357--366. Google ScholarDigital Library
- D. Roest, A. Mesbah, and A. Van Deursen. 2010. Regression testing ajax applications: Coping with dynamism. In Proceedings of the 3rd International Conference on Software Testing, Verification and Validation (ICST’10). IEEE, 127--136. Google ScholarDigital Library
- E. Rogstad, L. Briand, and R. Torkar. 2013. Test case selection for black-box regression testing of database applications. Informat. Software Technol. 55, 1781--1795. Google ScholarDigital Library
- D. S. Rosenblum and E. J. Weyuker. 1997. Using coverage information to predict the cost-effectiveness of regression testing strategies. IEEE Trans. Software Engineering 23, 146--156. Google ScholarDigital Library
- G. Rothermel. 1996. Efficient, Effective Regression Testing Using Safe Test Selection Techniques. Clemson University.Google Scholar
- G. Rothermel and M. J. Harrold. 1994. A framework for evaluating regression test selection techniques. In Proceedings of the 16th International Conference on Software Engineering (ICSE-16). IEEE, 201--210. Google ScholarDigital Library
- G. Rothermel and M. J. Harrold. 1996. Analyzing regression test selection techniques. IEEE Trans. Software Eng. 22, 529--551. Google ScholarDigital Library
- G. Rothermel, M. J. Harrold, J. Ostrin, and C. Hong. 1998. An empirical study of the effects of minimization on the fault detection capabilities of test suites. In Proceedings of the 1998 Proceedings of the International Conference on Software Maintenance. IEEE, 34--43. Google ScholarDigital Library
- G. Rothermel, R. H. Untch, C. Chu, and M. J. Harrold. 2001. Prioritizing test cases for regression testing. IEEE Trans. Software Engineering, 27, 929--948. Google ScholarDigital Library
- P. Sapna and H. Mohanty. 2010. Clustering test cases to achieve effective test selection. Proceedings of the 1st Amrita ACM-W Celebration on Women in Computing in India, 2010. ACM, 15. Google ScholarDigital Library
- W. Schütz. 1994. Fundamental issues in testing distributed real-time systems. Real-Time Syst. 7, 129--157. Google ScholarDigital Library
- W. R. Shadish, T. D. Cook, and D. T. Campbell. 2002. Experimental and Quasi-Experimental Designs for Generalized Causal Inference. Wadsworth Cengage Learning.Google Scholar
- A. Shi, T. Yung, A. Gyori, and D. Marinov. 2015. Comparing and combining test-suite reduction and regression test selection. In Proceedings of the 2015 10th Joint Meeting on Foundations of Software Engineering. ACM, 237--247. Google ScholarDigital Library
- Y. Singh, A. Kaur, and B. Suri. 2010. A hybrid approach for regression testing in interprocedural program. JIPS, 6, 21--32.Google ScholarCross Ref
- C. Tao, B. Li, X. Sun, and C. Zhang. 2010a. An approach to regression test selection based on hierarchical slicing technique. In Proceedings of the IEEE 34th Annual Computer Software and Applications Conference Workshops (COMPSACW’10). IEEE, 347--352. Google ScholarDigital Library
- C. Tao, B. Li, X. Sun, and Y. Zhou. 2010b. A hierarchical model for regression test selection and cost analysis of Java programs. In Proceedings of the 17th Asia Pacific Software Engineering Conference (APSEC’10). IEEE, 290--299. Google ScholarDigital Library
- W. T. Tsai, X. Zhou, R. A. Paul, Y. Chen, and X. Bai. 2009. A coverage relationship model for test case selection and ranking for multi-version software. In High Assurance Services Computing. Springer.Google Scholar
- R. Victor. 2003. Iterative and incremental development: A brief history. IEEE Computer Society, 47--56. Google ScholarDigital Library
- L. White. 1989. Insights IntoRegressionTesting. In Proceedings of the Conference on Software Maintenance. IEEE Computer Society Press, 60--69.Google Scholar
- L. White and B. Robinson. 2004. Industrial real-time regression testing and analysis using firewalls. Proceedings on the 20th IEEE International Conference on Software Maintenance, 2004. IEEE, 18--27. Google ScholarDigital Library
- C. Wohlin, P. Runeson, M. Höst, M. C. Ohlsson, B. Regnell, and A. Wesslén. 2012. Experimentation in Software Engineering, Springer Science 8 Business Media. Google ScholarDigital Library
- W. E. Wong, J. R. Horgan, A. P. Mathur, and A. Pasquini. 1997. Test set size minimization and fault detection effectiveness: A case study in a space application. In Proceedings on the 21st Annual International Computer Software and Applications Conference (COMPSAC’97). IEEE, 522--528. Google ScholarDigital Library
- G. Xu and A. Rountev. 2007. Regression test selection for AspectJ software. In Proceedings of the 29th International Conference on Software Engineering (ICSE’07). IEEE, 65--74. Google ScholarDigital Library
- L. Xu, B. Xu, Z. Chen, J. Jiang, and H. Chen. 2003. Regression testing for web applications based on slicing. In Proceedings on the 27th Annual International Computer Software and Applications Conference (COMPSAC’03). IEEE, 652--656. Google ScholarDigital Library
- Z. Xu, K. Gao, T. M. Khoshgoftaar, and N. Seliya. 2014. System regression test planning with a fuzzy expert system. Informat. Sci. 259, 532--543. Google ScholarDigital Library
- Z. Xu, Y. Liu, and K. Gao. 2013. A novel fuzzy classification to enhance software regression testing. In Proceedings of the IEEE Symposium on Computational Intelligence and Data Mining (CIDM’13). IEEE, 53--58.Google Scholar
- R. K. Yin. 2003. Case study research design and methods third edition. Applied Social Research Methods Series, 5.Google Scholar
- S. Yoo and M. Harman. 2007. Pareto efficient multi-objective test case selection. In Proceedings of the 2007 International Symposium on Software Testing and Analysis. ACM, 140--150. Google ScholarDigital Library
- S. Yoo and M. Harman. 2012. Regression testing minimization, selection and prioritization: A survey. Software Test. Verificat. Reliabil. 22, 67--120. Google ScholarDigital Library
- L. Yu, L. Xu, and W. T. Tsai. 2010. Time-constrained test selection for regression testing. Advanced Data Mining and Applications. Springer. Google ScholarDigital Library
- T. Yu, X. Qu, M. Acharya, and G. Rothermel. 2013. Oracle-based regression test selection. In Proceedings of the IEEE 6th International Conference on Software Testing, Verification and Validation (ICST’13). IEEE, 292--301. Google ScholarDigital Library
- L. Zhang, S. S. Hou, C. Guo, T. Xie, and H. Mei. 2009. Time-aware test-case prioritization using integer linear programming. In Proceedings of the 18th International Symposium on Software Testing and Analysis. ACM, 213--224. Google ScholarDigital Library
- J. Zheng, L. Williams, B. Robinson, and K. Smiley. 2007. Regression test selection for black-box dynamic link library components. In Proceedings of the 2nd International Workshop on Incorporating COTS Software Into Software Systems: Tools and Techniques. IEEE Computer Society, 9. Google ScholarDigital Library
Index Terms
- Effective Regression Test Case Selection: A Systematic Literature Review
Recommendations
Coverage Specification for Test Case Intent Preservation in Regression Suites
ICSTW '13: Proceedings of the 2013 IEEE Sixth International Conference on Software Testing, Verification and Validation WorkshopsRegression testing ensures that previous faults do not recur. When a fault is reported and fixed, the testing team augments the test suite with a new test case that exercises the fault in the original program. Typically the new test case covers patterns ...
Test Case Prioritization for Continuous Regression Testing: An Industrial Case Study
ICSM '13: Proceedings of the 2013 IEEE International Conference on Software MaintenanceRegression testing in continuous integration environment is bounded by tight time constraints. To satisfy time constraints and achieve testing goals, test cases must be efficiently ordered in execution. Prioritization techniques are commonly used to ...
Evaluating non-adequate test-case reduction
ASE '16: Proceedings of the 31st IEEE/ACM International Conference on Automated Software EngineeringGiven two test cases, one larger and one smaller, the smaller test case is preferred for many purposes. A smaller test case usually runs faster, is easier to understand, and is more convenient for debugging. However, smaller test cases also tend to ...
Comments