skip to main content
Skip header Section
The Art of Software TestingJune 2004
Publisher:
  • John Wiley & Sons, Inc.
  • 111 River Street
  • Hoboken
  • NJ
  • United States
ISBN:978-0-471-46912-4
Published:01 June 2004
Skip Bibliometrics Section
Bibliometrics
Abstract

No abstract available.

Cited By

  1. Dubslaff C, Weis K, Baier C and Apel S (2024). Feature causality, Journal of Systems and Software, 209:C, Online publication date: 1-Mar-2024.
  2. ACM
    Clark A, Foster M, Prifling B, Walkinshaw N, Hierons R, Schmidt V and Turner R (2023). Testing Causality in Scientific Modelling Software, ACM Transactions on Software Engineering and Methodology, 33:1, (1-42), Online publication date: 31-Jan-2024.
  3. Pira E, Rafe V and Esfandyari S (2024). A three-phase approach to improve the functionality of t-way strategy, Soft Computing - A Fusion of Foundations, Methodologies and Applications, 28:1, (415-435), Online publication date: 1-Jan-2024.
  4. Nayak G, Barisal S and Ray M (2023). CGWO: An Improved Grey Wolf Optimization Technique for Test Case Prioritization, Programming and Computing Software, 49:8, (942-953), Online publication date: 1-Dec-2023.
  5. Abo-eleneen A, Palliyali A and Catal C (2024). The role of Reinforcement Learning in software testing, Information and Software Technology, 164:C, Online publication date: 1-Dec-2023.
  6. Hu Y, Jiang H and Hu Z (2023). Measuring code maintainability with deep neural networks, Frontiers of Computer Science: Selected Publications from Chinese Universities, 17:6, Online publication date: 1-Dec-2023.
  7. ACM
    Hossain S, Filieri A, Dwyer M, Elbaum S and Visser W Neural-Based Test Oracle Generation: A Large-Scale Evaluation and Lessons Learned Proceedings of the 31st ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering, (120-132)
  8. ACM
    Castro R, Oliveira F, Rodrigues J, Tiago L, Sousa C and Chaves L Enhancing Issue Management through the Employment of Inspection Technique: An Experience Report in The Industry Proceedings of the XXII Brazilian Symposium on Software Quality, (208-217)
  9. ACM
    Lancetti W, Endo A, Ferrari F and Durelli V Ticket to Ride: A Journey Through the Most In-Demand Soft Skills for QA Professionals in Brazil Proceedings of the XXII Brazilian Symposium on Software Quality, (128-137)
  10. ACM
    Mori A, Paiva A and Souza S An Approach to Regression Testing Selection based on Code Changes and Smells Proceedings of the 8th Brazilian Symposium on Systematic and Automated Software Testing, (25-34)
  11. ACM
    Soares A, Vilela J, Peixoto M, Santos D and Silva C Perceptions of Practitioners on Security-Related Software Testing in a Mobile Software Development Company Proceedings of the XIX Brazilian Symposium on Information Systems, (348-355)
  12. Heiding F, Katsikeas S and Lagerström R (2023). Research communities in cyber security vulnerability assessments, Computer Science Review, 48:C, Online publication date: 1-May-2023.
  13. Abdeen W, Chen X and Unterkalmsteiner M (2023). An approach for performance requirements verification and test environments generation, Requirements Engineering, 28:1, (117-144), Online publication date: 1-Mar-2023.
  14. ACM
    Hejderup J On the Use of Tests for Software Supply Chain Threats Proceedings of the 2022 ACM Workshop on Software Supply Chain Offensive Research and Ecosystem Defenses, (47-49)
  15. ACM
    Sousa É, Rodrigues A, Teixeira N, Santos I, Francisco M, Andrade R and Vasconcelos D From past to future: An experience using data mining to guide tests. Proceedings of the XXI Brazilian Symposium on Software Quality, (1-10)
  16. ACM
    Damasceno H, Bezerra C, Coutinho E and Machado I Analyzing Test Smells Refactoring from a Developers Perspective Proceedings of the XXI Brazilian Symposium on Software Quality, (1-10)
  17. ACM
    Hu Q, Guo Y, Cordy M, Xie X, Ma L, Papadakis M and Le Traon Y (2022). An Empirical Study on Data Distribution-Aware Test Selection for Deep Learning Enhancement, ACM Transactions on Software Engineering and Methodology, 31:4, (1-30), Online publication date: 31-Oct-2022.
  18. ACM
    Choma Neto J, Chagas R, Mori A, Vilela R, Colanzi T and Souza S A Strategy to Support the Infeasible Test Requirements Identification Proceedings of the 7th Brazilian Symposium on Systematic and Automated Software Testing, (29-38)
  19. ACM
    Hutchinson B, Rostamzadeh N, Greer C, Heller K and Prabhakaran V Evaluation Gaps in Machine Learning Practice Proceedings of the 2022 ACM Conference on Fairness, Accountability, and Transparency, (1859-1876)
  20. ACM
    Han R, Gatla O, Zheng M, Cao J, Zhang D, Dai D, Chen Y and Cook J (2022). A Study of Failure Recovery and Logging of High-Performance Parallel File Systems, ACM Transactions on Storage, 18:2, (1-44), Online publication date: 31-May-2022.
  21. Brito M, Souza S and Souza P (2022). Integration testing for robotic systems, Software Quality Journal, 30:1, (3-35), Online publication date: 1-Mar-2022.
  22. Ardimento P, Aversano L, Bernardi M, Cimitile M and Iammarino M (2022). Just-in-time software defect prediction using deep temporal convolutional networks, Neural Computing and Applications, 34:5, (3981-4001), Online publication date: 1-Mar-2022.
  23. Pelánek R and Effenberger T (2022). Improving Learning Environments: Avoiding Stupidity Perspective, IEEE Transactions on Learning Technologies, 15:1, (64-77), Online publication date: 1-Feb-2022.
  24. Tomassi D and Rubio-González C On the real-world effectiveness of static bug detectors at finding null pointer exceptions Proceedings of the 36th IEEE/ACM International Conference on Automated Software Engineering, (292-303)
  25. Anjum M and Ryan C (2021). Seeding Grammars in Grammatical Evolution to Improve Search-Based Software Testing, SN Computer Science, 2:4, Online publication date: 1-Jul-2021.
  26. Pimentel J, Murta L, Braganholo V and Freire J (2021). Understanding and improving the quality and reproducibility of Jupyter notebooks, Empirical Software Engineering, 26:4, Online publication date: 1-Jul-2021.
  27. Marsso L, Mateescu R and Serwe W Automated Transition Coverage in Behavioural Conformance Testing Testing Software and Systems, (219-235)
  28. Polo M, Pedreira O, S. Places Á and García Rodríguez de Guzmán I (2020). Automated generation of oracled test cases with regular expressions and combinatorial techniques, Journal of Software: Evolution and Process, 32:12, Online publication date: 3-Dec-2020.
  29. ACM
    Melo S, Moreira V, Paschoal L and Souza S Testing Education Proceedings of the XXXIV Brazilian Symposium on Software Engineering, (554-563)
  30. ACM
    Santos I, Coutinho E and Souza S Software testing ecosystems insights and research opportunities Proceedings of the XXXIV Brazilian Symposium on Software Engineering, (421-426)
  31. ACM
    Herculano W, Mongiovi M and Alves E Manually Written or Generated Tests? Proceedings of the XXXIV Brazilian Symposium on Software Engineering, (273-282)
  32. Şerban C, Niculescu V and Vescan A Attaining competences in software quality oriented design based on cyclic learning 2020 IEEE Frontiers in Education Conference (FIE), (1-9)
  33. ACM
    Lopes V, Norberto M, R. S. D, Kassab M, da Silva Soares A, Oliveira R and Neto V A Systematic Mapping Study on Software Testing for Systems-of-Systems Proceedings of the 5th Brazilian Symposium on Systematic and Automated Software Testing, (88-97)
  34. ACM
    Girardon G, Costa V, Machado R, Bernardino M, Legramante G, Basso F, de Macedo Rodrigues E and Neto A Testing as a service (TaaS) Proceedings of the 35th Annual ACM Symposium on Applied Computing, (1989-1996)
  35. ACM
    Souza M, Villanes I, Dias-Neto A and Endo A On the Exploratory Testing of Mobile Apps Proceedings of the IV Brazilian Symposium on Systematic and Automated Software Testing, (42-51)
  36. ACM
    Fu Z and Su Z Effective floating-point analysis via weak-distance minimization Proceedings of the 40th ACM SIGPLAN Conference on Programming Language Design and Implementation, (439-452)
  37. Yang Y, Zhou Y, Sun H, Su Z, Zuo Z, Xu L and Xu B Hunting for bugs in code coverage tools via randomized differential testing Proceedings of the 41st International Conference on Software Engineering, (488-499)
  38. Hatton L and van Genuchten M (2019). Computational Reproducibility, IEEE Software, 36:2, (137-144), Online publication date: 1-Mar-2019.
  39. Al-Hajjaji M, Thüm T, Lochau M, Meinicke J and Saake G (2019). Effective product-line testing using similarity-based product prioritization, Software and Systems Modeling (SoSyM), 18:1, (499-521), Online publication date: 1-Feb-2019.
  40. ACM
    Francalino W, Callado A and Jucá P Defining and Implementing a Test Automation Strategy in an IT Company Proceedings of the Euro American Conference on Telematics and Information Systems, (1-5)
  41. ACM
    Spadini D Practices and tools for better software testing Proceedings of the 2018 26th ACM Joint Meeting on European Software Engineering Conference and Symposium on the Foundations of Software Engineering, (928-931)
  42. Merayo M, Hierons R and Núñez M (2018). Passive testing with asynchronous communications and timestamps, Distributed Computing, 31:5, (327-342), Online publication date: 1-Oct-2018.
  43. ACM
    Vassallo C, Proksch S, Zemp T and Gall H Un-break my build Proceedings of the 26th Conference on Program Comprehension, (41-51)
  44. ACM
    Spadini D, Aniche M, Storey M, Bruntink M and Bacchelli A When testing meets code review Proceedings of the 40th International Conference on Software Engineering, (677-687)
  45. ACM
    Marcozzi M, Bardin S, Kosmatov N, Papadakis M, Prevosto V and Correnson L Time to clean your test objectives Proceedings of the 40th International Conference on Software Engineering, (456-467)
  46. ACM
    Sinaga A, Hutajulu O, Hutahaean R and Hutagaol I Path Coverage Information for Adaptive Random Testing Proceedings of the 2017 International Conference on Information Technology, (248-252)
  47. Hierons R and Nez M (2017). Implementation relations and probabilistic schedulers in the distributed test architecture, Journal of Systems and Software, 132:C, (319-335), Online publication date: 1-Oct-2017.
  48. ACM
    Fu Z and Su Z (2017). Achieving high coverage for floating-point code via unconstrained programming, ACM SIGPLAN Notices, 52:6, (306-319), Online publication date: 14-Sep-2017.
  49. ACM
    Campos J, Fayollas C, Gonçalves M, Martinie C, Navarre D, Palanque P and Pinto M (2017). A More Intelligent Test Case Generation Approach through Task Models Manipulation, Proceedings of the ACM on Human-Computer Interaction, 1:EICS, (1-20), Online publication date: 30-Jun-2017.
  50. ACM
    Fu Z and Su Z Achieving high coverage for floating-point code via unconstrained programming Proceedings of the 38th ACM SIGPLAN Conference on Programming Language Design and Implementation, (306-319)
  51. ACM
    Ponzio P, Aguirre N, Frias M and Visser W Field-exhaustive testing Proceedings of the 2016 24th ACM SIGSOFT International Symposium on Foundations of Software Engineering, (908-919)
  52. Machado B, Camilo-Junior C, Rodrigues C and Quijano E SBSTFrame: a framework to search-based software testing 2016 IEEE International Conference on Systems, Man, and Cybernetics (SMC), (004106-004111)
  53. ACM
    Oliveira A, Souza P and Souza S ValiErlang Proceedings of the 1st Brazilian Symposium on Systematic and Automated Software Testing, (1-10)
  54. ACM
    Domingues A, Rodrigues E and Bernardino M AutoFun Proceedings of the 1st Brazilian Symposium on Systematic and Automated Software Testing, (1-10)
  55. ACM
    Almeida L, Cirilo E and Barbosa E SS-BDD Proceedings of the 1st Brazilian Symposium on Systematic and Automated Software Testing, (1-10)
  56. ACM
    Padmanaban R, Thirumaran M, Suganya K and Priya R AOSE Methodologies and Comparison of Object Oriented and Agent Oriented Software Testing Proceedings of the International Conference on Informatics and Analytics, (1-16)
  57. Wu H (2016). An SMT-based Approach for Generating Coverage Oriented Metamodel Instances, International Journal of Information System Modeling and Design, 7:3, (23-50), Online publication date: 1-Jul-2016.
  58. Liu H and Chen T (2016). Randomized Quasi-Random Testing, IEEE Transactions on Computers, 65:6, (1896-1909), Online publication date: 1-Jun-2016.
  59. ACM
    Gómez O, Vegas S and Juristo N Impact of CS programs on the quality of test cases generation Proceedings of the 38th International Conference on Software Engineering Companion, (374-383)
  60. ACM
    Hussain S, Khan A and Bennin K Empirical investigation of fault predictors in context of class membership probability estimation Proceedings of the 31st Annual ACM Symposium on Applied Computing, (1550-1553)
  61. ACM
    Bernardino M, Rodrigues E and Zorzo A Performance testing modeling Proceedings of the 31st Annual ACM Symposium on Applied Computing, (1660-1665)
  62. ACM
    Pachulski Camara B and Graciotto Silva M A Strategy to Combine Test-Driven Development and Test Criteria to Improve Learning of Programming Skills Proceedings of the 47th ACM Technical Symposium on Computing Science Education, (443-448)
  63. ACM
    Liu H, Spichkova M, Schmidt H, Sellis T and Duckham M Spatio-Temporal Architecture-Based Framework for Testing Services in the Cloud Proceedings of the ASWEC 2015 24th Australasian Software Engineering Conference, (18-22)
  64. Caizares P, Nez A, Nez M and Pardo J (2015). A Methodology for Designing Energy-aware Systems for Computational Science, Procedia Computer Science, 51:C, (2804-2808), Online publication date: 1-Sep-2015.
  65. ACM
    Melo S, Souza S, Silva R and Souza P Concurrent software testing in practice: a catalog of tools Proceedings of the 6th International Workshop on Automating Test Case Design, Selection and Evaluation, (31-40)
  66. Balera J and Santiago Júnior V T-Tuple Reallocation Proceedings, Part IV, of the 15th International Conference on Computational Science and Its Applications -- ICCSA 2015 - Volume 9158, (503-517)
  67. Caglayan B, Tosun Misirli A, Bener A and Miranskyy A (2015). Predicting defective modules in different test phases, Software Quality Journal, 23:2, (205-227), Online publication date: 1-Jun-2015.
  68. Tamai T Software engineering view of a large-scale system failure and the following lawsuit Proceedings of the Second International Workshop on Software Engineering Research and Industrial Practice, (18-24)
  69. Hauptmann B, Juergens E and Woinke V Generating refactoring proposals to remove clones from automated system tests Proceedings of the 2015 IEEE 23rd International Conference on Program Comprehension, (115-124)
  70. ACM
    Sun H, Zheng Y, Bulej L, Villazón A, Qi Z, Tůma P and Binder W A programming model and framework for comprehensive dynamic analysis on Android Proceedings of the 14th International Conference on Modularity, (133-145)
  71. ACM
    Bokil P, Krishnan P and Venkatesh R (2015). Achieving Effective Test Suites for Reactive Systems using Specification Mining and Test Suite Reduction Techniques, ACM SIGSOFT Software Engineering Notes, 40:1, (1-8), Online publication date: 6-Feb-2015.
  72. Salaün G and Ye L Debugging Process Algebra Specifications Proceedings of the 16th International Conference on Verification, Model Checking, and Abstract Interpretation - Volume 8931, (245-262)
  73. ACM
    Clough P Evaluation Proceedings of the 6th Annual Meeting of the Forum for Information Retrieval Evaluation, (1-9)
  74. ACM
    Clarke P, Davis D, King T, Pava J and Jones E (2014). Integrating Testing into Software Engineering Courses Supported by a Collaborative Learning Environment, ACM Transactions on Computing Education, 14:3, (1-33), Online publication date: 3-Nov-2014.
  75. ACM
    Rodrigues E, Saad R, Oliveira F, Costa L, Bernardino M and Zorzo A Evaluating capture and replay and model-based performance testing tools Proceedings of the 8th ACM/IEEE International Symposium on Empirical Software Engineering and Measurement, (1-8)
  76. ACM
    Kasurinen J and Smolander K What do game developers test in their products? Proceedings of the 8th ACM/IEEE International Symposium on Empirical Software Engineering and Measurement, (1-10)
  77. ACM
    Segura S, Sánchez A and Ruiz-Cortés A Automated variability analysis and testing of an E-commerce site. Proceedings of the 29th ACM/IEEE International Conference on Automated Software Engineering, (139-150)
  78. ACM
    Liu H, Yusuf I, Schmidt H and Chen T Metamorphic fault tolerance: an automated and systematic methodology for fault tolerance in the absence of test oracle Companion Proceedings of the 36th International Conference on Software Engineering, (420-423)
  79. ACM
    Yu T, Srisa-an W and Rothermel G SimRT: an automated framework to support regression testing for data races Proceedings of the 36th International Conference on Software Engineering, (48-59)
  80. Elberzhager F, Münch J, Rombach D and Freimut B (2014). Integrating inspection and test processes based on context‐specific assumptions, Journal of Software: Evolution and Process, 26:4, (371-385), Online publication date: 15-Apr-2014.
  81. ACM
    Krutz D, Malachowsky S and Reichlmayr T Using a real world project in a software testing course Proceedings of the 45th ACM technical symposium on Computer science education, (49-54)
  82. Yang W, Chen Z, Gao Z, Zou Y and Xu X (2014). GUI testing assisted by human knowledge, Journal of Systems and Software, 89:C, (76-86), Online publication date: 1-Mar-2014.
  83. Sarma M (2014). Mutation analysis approach to develop reliable object-oriented software, Advances in Software Engineering, 2014, (6-6), Online publication date: 1-Jan-2014.
  84. ACM
    Sarkar A and Bell T Teaching black-box testing to high school students Proceedings of the 8th Workshop in Primary and Secondary Computing Education, (75-78)
  85. Gutiérrez C, García-Magariño I, Serrano E and Botía J (2013). Robust design of multi-agent system interactions, Engineering Applications of Artificial Intelligence, 26:9, (2093-2104), Online publication date: 1-Oct-2013.
  86. Khamis M and Nagi K (2013). Designing multi-agent unit tests using systematic test design patterns-(extended version), Engineering Applications of Artificial Intelligence, 26:9, (2128-2142), Online publication date: 1-Oct-2013.
  87. Brucker A and Wolff B (2013). On theorem prover-based testing, Formal Aspects of Computing, 25:5, (683-721), Online publication date: 1-Sep-2013.
  88. ACM
    Varshney S and Mehrotra M (2013). Search based software test data generation for structural testing, ACM SIGSOFT Software Engineering Notes, 38:4, (1-6), Online publication date: 12-Jul-2013.
  89. Thummalapenta S, Lakshmi K, Sinha S, Sinha N and Chandra S Guided test generation for web applications Proceedings of the 2013 International Conference on Software Engineering, (162-171)
  90. ACM
    Anisetti M, Ardagna C, Damiani E and Saonara F (2013). A test-based security certification scheme for web services, ACM Transactions on the Web, 7:2, (1-41), Online publication date: 1-May-2013.
  91. Boyle M, Samaha A, Rodewald A and Hoffmann A (2013). Review, Computers in Human Behavior, 29:3, (1023-1027), Online publication date: 1-May-2013.
  92. Lemos O, Ferrari F, Eler M, Maldonado J and Masiero P (2013). Evaluation studies of software testing research in Brazil and in the world, Journal of Systems and Software, 86:4, (951-969), Online publication date: 1-Apr-2013.
  93. Nakagawa E, Antonino P, Becker M, Maldonado J, Storf H, Villela K and Rombach D (2013). Relevance and perspectives of AAL in Brazil, Journal of Systems and Software, 86:4, (985-996), Online publication date: 1-Apr-2013.
  94. Nagy R, Schneider G and Timofeitchik A Automatic testing of real-time graphics systems Proceedings of the 19th international conference on Tools and Algorithms for the Construction and Analysis of Systems, (463-477)
  95. ACM
    Costa J and Monteiro J (2013). Coverage-directed observability-based validation for embedded software, ACM Transactions on Design Automation of Electronic Systems, 18:2, (1-20), Online publication date: 1-Mar-2013.
  96. Serrano E and Botia J (2013). Validating ambient intelligence based ubiquitous computing systems by means of artificial societies, Information Sciences: an International Journal, 222, (3-24), Online publication date: 1-Feb-2013.
  97. ACM
    Caglayan B and Bener A (2012). Issue ownership activity in two large software projects, ACM SIGSOFT Software Engineering Notes, 37:6, (1-7), Online publication date: 27-Nov-2012.
  98. González C and Cabot J ATLTest Proceedings of the 15th international conference on Model Driven Engineering Languages and Systems, (449-464)
  99. ACM
    Heider W, Rabiser R, Grünbacher P and Lettner D Using regression testing to analyze the impact of changes to variability models on products Proceedings of the 16th International Software Product Line Conference - Volume 1, (196-205)
  100. Gutiérrez J, Aragón G, Mejías M, Domínguez Mayo F and Ruiz Cutilla C Automatic test case generation from functional requirements in NDT Proceedings of the 12th international conference on Current Trends in Web Engineering, (176-185)
  101. Hierons R and Núñez M (2012). Using schedulers to test probabilistic distributed systems, Formal Aspects of Computing, 24:4-6, (679-699), Online publication date: 1-Jul-2012.
  102. Winkler D, Schmidt M, Ramler R and Biffl S Improving unfamiliar code with unit tests Proceedings of the 13th international conference on Product-Focused Software Process Improvement, (290-304)
  103. Poon P, Chen T and Tse T Choices, choices Proceedings of the 17th Ada-Europe international conference on Reliable Software Technologies, (162-176)
  104. Lemos O, Ferrari F, Silveira F and Garcia A Development of auxiliary functions: should you be agile? an empirical assessment of pair programming and test-first programming Proceedings of the 34th International Conference on Software Engineering, (529-539)
  105. Bengolea V, Aguirre N, Marinov D and Frias M Using coverage criteria on RepOK to reduce bounded-exhaustive test suites Proceedings of the 6th international conference on Tests and Proofs, (19-34)
  106. Sharma B, Girdhar I, Taneja M, Basia P, Vadla S and Srivastava P Software coverage Proceedings of the Second international conference on Swarm, Evolutionary, and Memetic Computing - Volume Part I, (618-625)
  107. ACM
    Kats L, Vermaas R and Visser E Integrated language definition testing Proceedings of the 2011 ACM international conference on Object oriented programming systems languages and applications, (139-154)
  108. ACM
    Kats L, Vermaas R and Visser E (2011). Integrated language definition testing, ACM SIGPLAN Notices, 46:10, (139-154), Online publication date: 18-Oct-2011.
  109. Neider D Small strategies for safety games Proceedings of the 9th international conference on Automated technology for verification and analysis, (306-320)
  110. Araújo E, Redlich L, Lago V, Moreno M and Soares L Conformance Test Suite for the Ginga-NCL Proceedings of the 17th Brazilian Symposium on Multimedia and the Web on Brazilian Symposium on Multimedia and the Web - Volume 1, (9-17)
  111. Leucker M Teaching runtime verification Proceedings of the Second international conference on Runtime verification, (34-48)
  112. Schlick R, Herzner W and Jöbstl E Fault-based generation of test cases from UML-Models Proceedings of the 30th international conference on Computer safety, reliability, and security, (270-283)
  113. Oliveira L and Nakagawa E A service-oriented reference architecture for software testing tools Proceedings of the 5th European conference on Software architecture, (405-421)
  114. Uetsuki K, Matsuodani T and Tsuda K Software logical structure verification method by modeling implemented specification Proceedings of the 15th international conference on Knowledge-based and intelligent information and engineering systems - Volume Part III, (336-345)
  115. ACM
    Cafeo B, Noppen J, Ferrari F, Chitchyan R and Rashid A Inferring test results for dynamic software product lines Proceedings of the 19th ACM SIGSOFT symposium and the 13th European conference on Foundations of software engineering, (500-503)
  116. ACM
    Nie C and Leung H (2011). The Minimal Failure-Causing Schema of Combinatorial Testing, ACM Transactions on Software Engineering and Methodology, 20:4, (1-38), Online publication date: 1-Sep-2011.
  117. Singhal V and Aggarwal P Using coverage to deploy formal verification in a simulation world Proceedings of the 23rd international conference on Computer aided verification, (44-49)
  118. ACM
    Buzdalov M Generation of tests for programming challenge tasks using evolution algorithms Proceedings of the 13th annual conference companion on Genetic and evolutionary computation, (763-766)
  119. Lemos O and Masiero P (2011). A pointcut-based coverage analysis approach for aspect-oriented programs, Information Sciences: an International Journal, 181:13, (2721-2746), Online publication date: 1-Jul-2011.
  120. Coelho R, von Staa A, Kulesza U, Rashid A and Lucena C (2011). Unveiling and taming liabilities of aspects in the presence of exceptions, Information Sciences: an International Journal, 181:13, (2700-2720), Online publication date: 1-Jul-2011.
  121. Shahamiri S, Kadir W, Ibrahim S and Hashim S (2011). An automated framework for software test oracle, Information and Software Technology, 53:7, (774-788), Online publication date: 1-Jul-2011.
  122. Yang L, Dang Z and Fischer T (2011). Information gain of black-box testing, Formal Aspects of Computing, 23:4, (513-539), Online publication date: 1-Jul-2011.
  123. Molinero C, Núñez M and Hierons R Experimental comparison of different techniques to generate adaptive sequences Proceedings of the 11th international conference on Artificial neural networks conference on Advances in computational intelligence - Volume Part II, (404-411)
  124. Derderian K, Merayo M, Hierons R and Núñez M A case study on the use of genetic algorithms to generate test cases for temporal systems Proceedings of the 11th international conference on Artificial neural networks conference on Advances in computational intelligence - Volume Part II, (396-403)
  125. ACM
    Ramesh S and Gadkari A Rigorous model-based design & verification flow for in-vehicle software Proceedings of the 48th Design Automation Conference, (13-16)
  126. Lazzarini Lemos O, Bajracharya S, Ossher J, Masiero P and Lopes C (2011). A test-driven approach to code search and its application to the reuse of auxiliary functionality, Information and Software Technology, 53:4, (294-306), Online publication date: 1-Apr-2011.
  127. ACM
    Ramadoss B, Prema P and Balasundaram S Improving test coverage using merged classification tree Proceedings of the International Conference & Workshop on Emerging Trends in Technology, (752-757)
  128. Schieferdecker I Test automation with TTCN-3 - state of the art and a future perspective Proceedings of the 22nd IFIP WG 6.1 international conference on Testing software and systems, (1-14)
  129. ACM
    Clarke P, Allen A, King T, Jones E and Natesan P Using a web-based repository to integrate testing tools into programming courses Proceedings of the ACM international conference companion on Object oriented programming systems languages and applications companion, (193-200)
  130. Lussenburg V, van der Storm T, Vinju J and Warmer J Mod4J Proceedings of the 13th international conference on Model driven engineering languages and systems: Part II, (346-360)
  131. ACM
    Holzer A, Schallhart C, Tautschnig M and Veith H How did you specify your test suite Proceedings of the 25th IEEE/ACM International Conference on Automated Software Engineering, (407-416)
  132. ACM
    Kim S and Baik J An effective fault aware test case prioritization by incorporating a fault localization technique Proceedings of the 2010 ACM-IEEE International Symposium on Empirical Software Engineering and Measurement, (1-10)
  133. ACM
    Caglayan B, Tosun A, Miranskyy A, Bener A and Ruffolo N Usage of multiple prediction models based on defect categories Proceedings of the 6th International Conference on Predictive Models in Software Engineering, (1-9)
  134. Tschumitschew K, Klawonn F, Obermöller N and Lawrenz W Visualisation of test coverage for conformance tests of low level communication protocols Proceedings of the 14th international conference on Knowledge-based and intelligent information and engineering systems: Part II, (244-252)
  135. Heidegger P and Thiemann P Contract-driven testing of javascript code Proceedings of the 48th international conference on Objects, models, components, patterns, (154-172)
  136. ACM
    Wischermann D and Schröder-Preikschat W Separating testing concerns by means of models Proceedings of the 1st Workshop on Testing Object-Oriented Systems, (1-7)
  137. ACM
    Strasser A, Mayr H and Naderhirn T Harmonizing the test support for object-oriented legacy systems using state-of-the-art test tools Proceedings of the 1st Workshop on Testing Object-Oriented Systems, (1-7)
  138. ACM
    Dimov A, Chandran S and Punnekkat S How do we collect data for software reliability estimation? Proceedings of the 11th International Conference on Computer Systems and Technologies and Workshop for PhD Students in Computing on International Conference on Computer Systems and Technologies, (155-160)
  139. ACM
    Stehle E, Lynch K, Shevertalov M, Rorres C and Mancoridis S On the use of computational geometry to detect software faults at runtime Proceedings of the 7th international conference on Autonomic computing, (109-118)
  140. Miller T, Padgham L and Thangarajah J Test coverage criteria for agent interaction testing Proceedings of the 11th international conference on Agent-oriented software engineering, (91-105)
  141. ACM
    Metzger A, Sammodi O, Pohl K and Rzepka M Towards pro-active adaptation with confidence Proceedings of the 2010 ICSE Workshop on Software Engineering for Adaptive and Self-Managing Systems, (20-28)
  142. Marinho M, Maciel P, Sousa E, Maciel T and Andrade E Performance evaluation of test process based on stochastic models Proceedings of the 2010 Spring Simulation Multiconference, (1-6)
  143. Garcia J Methodology supporting architecture validations (MAVS) Proceedings of the 2010 Spring Simulation Multiconference, (1-9)
  144. Kang E, Jackson E and Schulte W An approach for effective design space exploration Proceedings of the 16th Monterey conference on Foundations of computer software: modeling, development, and verification of adaptive systems, (33-54)
  145. Zhou R, Wei Z, Tang S and Kim J Study on application of .NET reflection in automated testing Proceedings of the 12th international conference on Advanced communication technology, (797-800)
  146. Maia C, do Carmo R, de Freitas F, de Campos G and de Souza J (2010). Automated test case prioritization with reactive GRASP, Advances in Software Engineering, 2010, (1-13), Online publication date: 1-Jan-2010.
  147. Sawyer J and Brann D How to test your models more effectively Winter Simulation Conference, (968-978)
  148. Chen Y and Zhong Y Experimental study on GA-based path-oriented test data generation using branch distance Proceedings of the 3rd international conference on Intelligent information technology application, (216-219)
  149. Weiglhofer M, Fraser G and Wotawa F (2009). Using coverage to automate and improve test purpose based testing, Information and Software Technology, 51:11, (1601-1617), Online publication date: 1-Nov-2009.
  150. Cabac L, Dörges T, Duvigneau M and Moldt D Requirements and tools for the debugging of multi-agent systems Proceedings of the 7th German conference on Multiagent system technologies, (238-247)
  151. Chen T, Kuo F and Liu H (2009). Adaptive random testing based on distribution metrics, Journal of Systems and Software, 82:9, (1419-1433), Online publication date: 1-Sep-2009.
  152. Pretre V, Kermadec A, Bouquet F, Lang C and Dadeau F (2009). Automated UML models merging for web services testing, International Journal of Web and Grid Services, 5:2, (107-129), Online publication date: 1-Aug-2009.
  153. Lemos O, Franchin I and Masiero P (2009). Integration testing of Object-Oriented and Aspect-Oriented programs, Science of Computer Programming, 74:10, (861-878), Online publication date: 1-Aug-2009.
  154. Silveira P and Melo A Exploring XML Perturbation Techniques for Web Services Testing Proceedings of the 9th International Conference on Web Engineering, (355-369)
  155. Chen T, Kuo F, Liu H and Wang S Conformance Testing of Network Simulators Based on Metamorphic Testing Technique Proceedings of the Joint 11th IFIP WG 6.1 International Conference FMOODS '09 and 29th IFIP WG 6.1 International Conference FORTE '09 on Formal Techniques for Distributed Systems, (243-248)
  156. Takahashi M (2009). A technique for retrospective computer validation of drug manufacturing software, International Journal of Computer Applications in Technology, 35:2/3/4, (139-149), Online publication date: 1-Jun-2009.
  157. Zhang Z, Thangarajah J and Padgham L Automated testing for intelligent agent systems Proceedings of the 10th international conference on Agent-oriented software engineering, (66-79)
  158. Zhang Z, Thangarajah J and Padgham L Model based testing for agent systems Proceedings of The 8th International Conference on Autonomous Agents and Multiagent Systems - Volume 2, (1333-1334)
  159. Flores A and Polo M (2009). Testing-based Process for Evaluating Component Replaceability, Electronic Notes in Theoretical Computer Science (ENTCS), 236, (101-115), Online publication date: 1-Apr-2009.
  160. ACM
    Kimm H, Shin S, Ham H and Sung C Failure management development for integrated automotive safety-critical software systems Proceedings of the 2009 ACM symposium on Applied Computing, (517-521)
  161. Liu H and Kuan Tan H (2009). Covering code behavior on input validation in functional testing, Information and Software Technology, 51:2, (546-553), Online publication date: 1-Feb-2009.
  162. Sarma M and Mall R (2009). Automatic generation of test specifications for coverage of system state transitions, Information and Software Technology, 51:2, (418-432), Online publication date: 1-Feb-2009.
  163. ACM
    Pacheco C, Lahiri S and Ball T Finding errors in .net with feedback-directed random testing Proceedings of the 2008 international symposium on Software testing and analysis, (87-96)
  164. Schieferdecker I, Grabowski J, Vassiliou-Gioles T and Din G The test technology TTCN-3 Formal methods and testing, (292-319)
  165. Lee M and Foreman G Continuous testing for enterprise portal technology refresh Proceedings of the 11th IASTED International Conference on Software Engineering and Applications, (397-402)
  166. Nir D, Tyszberowicz S and Yehudai A Locating regression bugs Proceedings of the 3rd international Haifa verification conference on Hardware and software: verification and testing, (218-234)
  167. Tu S, Condamoor S, Mather T, Hall R, Jones N and Musen M Document-Oriented Views of Guideline Knowledge Bases Proceedings of the 11th conference on Artificial Intelligence in Medicine, (431-440)
  168. Arnicane V Use of non-IT testers in software development Proceedings of the 8th international conference on Product-Focused Software Process Improvement, (175-187)
  169. Merayo M, Núñez M and Rodríguez I Formal specification of multi-agent systems by using EUSMs Proceedings of the 2007 international conference on Fundamentals of software engineering, (318-333)
  170. Wende Kong , Ying Shi and Smidts C Early Software Reliability Prediction Using Cause-effect Graphing Analysis Proceedings of the 2007 Annual Reliability and Maintainability Symposium, (173-178)
  171. Börcsök J and Schaefer S Methodologies of safety-related software development Proceedings of the 6th WSEAS international conference on Applied computer science, (131-136)
  172. ACM
    Pohl K and Metzger A (2006). Software product line testing, Communications of the ACM, 49:12, (78-81), Online publication date: 1-Dec-2006.
  173. Briones L, Brinksma E and Stoelinga M A semantic framework for test coverage Proceedings of the 4th international conference on Automated Technology for Verification and Analysis, (399-414)
  174. Gomez-Sanz J The construction of multi-agent systems as an engineering discipline Proceedings of the 7th international conference on Engineering societies in the agents world VII, (25-37)
  175. ACM
    Lemos O, Ferrari F, Masiero P and Lopes C Testing aspect-oriented programming Pointcut Descriptors Proceedings of the 2nd workshop on Testing aspect-oriented programs, (33-38)
  176. Chi H, Jones E, Evans D and Brown M Generating test data for specification-based tests via quasirandom sequences Proceedings of the 6th international conference on Computational Science - Volume Part IV, (773-780)
  177. Sârbu C, Johansson A, Fraikin F and Suri N Improving robustness testing of COTS OS extensions Proceedings of the Third international conference on Service Availability, (120-139)
  178. Shehory O A self-healing approach to designing and deploying complex, distributed and concurrent software systems Proceedings of the 4th international conference on Programming multi-agent systems, (3-13)
  179. ACM
    Downey J Systems architect and systems analyst Proceedings of the 2006 ACM SIGMIS CPR conference on computer personnel research: Forty four years of computer personnel research: achievements, challenges & the future, (213-220)
  180. Meyer B Dependable software Dependable Systems, (1-33)
  181. Oriat C Jartege Proceedings of the First international conference on Quality of Software Architectures and Software Quality, and Proceedings of the Second International conference on Software Quality, (242-256)
  182. Chan F, Tang W and Chen T Software Testing Education and Training in Hong Kong Proceedings of the Fifth International Conference on Quality Software, (313-316)
  183. Baresi L, Fraternali P, Tisi M and Morasca S Towards model-driven testing of a web application generator Proceedings of the 5th international conference on Web Engineering, (75-86)
  184. ACM
    Schilling A, Madeira K, Donegan P, Sousa K, Furtado E and Furtado V (2005). An integrated method for designing user interfaces based on tests, ACM SIGSOFT Software Engineering Notes, 30:4, (1-5), Online publication date: 1-Jul-2005.
  185. ACM
    Schilling A, Madeira K, Donegan P, Sousa K, Furtado E and Furtado V An integrated method for designing user interfaces based on tests Proceedings of the 1st international workshop on Advances in model-based testing, (1-5)
  186. Bombieri N, Fummi F and Pravadelli G Functional Verification of Networked Embedded Systems Proceedings of the 6th International Symposium on Quality of Electronic Design, (321-326)
  187. Wegener J and Mueller F (2001). A Comparison of Static Analysis and Evolutionary Testing for the Verification of Timing Constraints, Real-Time Systems, 21:3, (241-268), Online publication date: 1-Nov-2001.
  188. Forrester J and Miller B An empirical study of the robustness of Windows NT applications using random testing Proceedings of the 4th conference on USENIX Windows Systems Symposium - Volume 4, (6-6)
Contributors
  • IBM Research

Recommendations

Fernando Berzal

Testing computer software involves making sure that software does what it was designed to do, and that it does not do anything that is unintended. The self-assessment test at the beginning of this book will probably make you aware of how far you are from properly testing software. Even if you excel at this test, which is unlikely, given the poor state of the practice in software testing, this book will force you to develop a broader perspective on the issue of software testing. In fact, testing spans a wide range of often-neglected topics in the computer science curricula. This extended edition of a classic book [1] keeps its focus on practical tactics and techniques for software testing. Some people may object to this book, arguing that its examples are dated. You will find code snippets in FORTRAN and even in PL/I, but every example illustrates key concepts that go beyond the syntactic details of the programming language of the hour. You will also find some Java examples, which will probably be as obsolete in 25 years as PL/I examples are today. Other people may say that the book is just full of generalities. They are partly right, although they fail to acknowledge the importance of clear and concise prose in technical writing. After the previously mentioned self-assessment test, the book focuses on the psychological and economical aspects of software testing. From a psychological perspective, programmers are not always good testers, because testing requires a different frame of mind. Testing is no more than executing a program with the intent of finding errors. This simple fact makes programmers bad candidates for testing software, especially for testing their own software. From an economical point of view, testing is a sticky issue, because it is impractical, and usually impossible, to find all of the errors in a software program. A discussion of general principles and vital testing guidelines precedes an overview of non-computer-based testing. Human testing, in its various forms (that is, inspections, walkthroughs, reviews, and desk checking), is quite effective in practice. A handy common error types checklist will improve your effectiveness. The book includes a sample one, for you to update and expand according to your programming environment. Even though complete testing is economically unfeasible, test case design methods exist to help you in your testing efforts. A complete chapter, of more than 45 pages, is devoted to the use of different logic coverage criteria, equivalence partitioning, boundary values, cause-effect graphs, and plain error guessing, all of which are useful in software testing. Although there is certainly room for improvement in the presentation of cause-effect graphing, this chapter is the best survey on test case design techniques I have ever read. After covering the basic tools of the trade, the book delves into the organization of the testing process. For unit testing, the authors advocate preparing the smallest set of test cases that cover the boundary conditions, and satisfy the multicondition coverage criterion (namely, the finer-grained coverage criterion). For integration testing, they recommend a bottom-up incremental strategy. Finally, they elaborate on 15 categories of system tests, to apply distinct testing processes to distinct development processes. In other words, they urge a multi-strategy approach, because each testing technique is oriented to detect distinct classes of errors, and the different techniques are complementary. The book also addresses key questions, such as when to stop testing, or what to do after a successful test case. A successful test case is a test case that yields an error, which you have to locate and fix, where locating the error takes the lion's share of the effort. Using common language, you have to debug your code. Two new chapters on trendy topics complete this updated edition of the book. "Extreme Testing" provides a primer on test-driven development, and discusses acceptance tests taken from user stories, two of the key practices of extreme programming. "Testing Internet Applications" includes a basic description of the many failure points of Internet-based applications. Both chapters are interesting, but fall short of the quality standard set by the original book. In short, this updated edition of an all-time software testing classic will make the book relevant for another couple of decades. Its key points are as important today as they were when it was originally published. Some bibliographic references were missed, and a more thorough glossary is needed to round out this excellent book on practical software testing. Time will tell if this landmark book survives another generation, or if the fiercer publishing environment of today relegates it to the shelf of past glories. Online Computing Reviews Service

Access critical reviews of Computing literature here

Become a reviewer for Computing Reviews.