Skip header Section
Skip Bibliometrics Section
Basics of Software Engineering ExperimentationDecember 2010
- Authors:
- Natalia Juristo,
- Ana M. Moreno
Skip Abstract Section
Abstract
Basics of Software Engineering Experimentation is a practical guide to experimentation in a field which has long been underpinned by suppositions, assumptions, speculations and beliefs. It demonstrates to software engineers how Experimental Design and Analysis can be used to validate their beliefs and ideas. The book does not assume its readers have an in-depth knowledge of mathematics, specifying the conceptual essence of the techniques to use in the design and analysis of experiments and keeping the mathematical calculations clear and simple. Basics of Software Engineering Experimentation is practically oriented and is specially written for software engineers, all the examples being based on real and fictitious software engineering experiments.
Cited By
Wyrich M, Bogner J and Wagner S (2023). 40 Years of Designing Code Comprehension Experiments: A Systematic Mapping Study, ACM Computing Surveys, 56:4, (1-42), Online publication date: 30-Apr-2024.- Ormeño Y, Panach J and Pastor O (2024). An empirical experiment of a usability requirements elicitation method to design GUIs based on interviews, Information and Software Technology, 164:C, Online publication date: 1-Dec-2023.
- Vegas S and Elbaum S Pitfalls in Experiments with DNN4SE: An Analysis of the State of the Practice Proceedings of the 31st ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering, (528-540)
- Luz C, Oliveirajr E and Steinmacher I A Conceptual Model to Support Teaching of Software Engineering Controlled (Quasi-)Experiments Proceedings of the XXXVII Brazilian Symposium on Software Engineering, (236-245)
- Bernárdez B, Panach J, Parejo J, Durán A, Juristo N and Ruiz-Cortés A (2023). An empirical study to evaluate the impact of mindfulness on helpdesk employees, Science of Computer Programming, 230:C, Online publication date: 1-Aug-2023.
- Desolda G, Aneke J, Ardito C, Lanzilotti R and Costabile M (2023). Explanations in warning dialogs to help users defend against phishing attacks, International Journal of Human-Computer Studies, 176:C, Online publication date: 1-Aug-2023.
- Malavolta I, Nirghin K, Scoccia G, Romano S, Lombardi S, Scanniello G and Lago P (2023). JavaScript Dead Code Identification, Elimination, and Empirical Assessment, IEEE Transactions on Software Engineering, 49:7, (3692-3714), Online publication date: 1-Jul-2023.
- Nocera S, Francese R and Scanniello G Training Bachelor Students to Design Better Quality Web Apps: Preliminary Results from a Prospective Empirical Investigation Proceedings of the 27th International Conference on Evaluation and Assessment in Software Engineering, (465-469)
- Nocera S, Romano S, Francese R and Scanniello G Training for Security: Planning the Use of a SAT in the Development Pipeline of Web Apps Proceedings of the 45th International Conference on Software Engineering: Software Engineering Education and Training, (40-45)
- Laudato G, Scalabrino S, Novielli N, Lanubile F and Oliveto R Predicting Bugs by Monitoring Developers during Task Execution Proceedings of the 45th International Conference on Software Engineering, (1110-1122)
- Henriquez V, Moreno A, Calvo-Manzano J, Feliu T and Scheihing E (2023). Organizational Type Mismatch in Agile SMEs, IT Professional, 25:2, (71-76), Online publication date: 1-Mar-2023.
- Romano S, Zampetti F, Baldassarre M, Di Penta M and Scanniello G Do Static Analysis Tools Affect Software Quality when Using Test-driven Development? Proceedings of the 16th ACM / IEEE International Symposium on Empirical Software Engineering and Measurement, (80-91)
- Cordeiro A An Open Science-Based Framework for Managing Experimental Data in Software Engineering Proceedings of the 26th International Conference on Evaluation and Assessment in Software Engineering, (342-346)
- Luz C, OliveiraJr E and Steinmacher I How Experimentation in Software Engineering has been taught? Survey and Research Agenda Proceedings of the 26th International Conference on Evaluation and Assessment in Software Engineering, (299-304)
- Melegati J, Edison H and Wang X (2022). XPro: A Model to Explain the Limited Adoption and Implementation of Experimentation in Software Startups, IEEE Transactions on Software Engineering, 48:6, (1929-1946), Online publication date: 1-Jun-2022.
- Cibrián E, Mendieta R, Álvarez-Rodríguez J and Llorens J Towards the reuse of physical models within the development life-cycle: a case study of Simulink models NOMS 2022-2022 IEEE/IFIP Network Operations and Management Symposium, (1-6)
- Priefer D, Rost W, Strüber D, Taentzer G and Kneisel P (2021). Applying MDD in the content management system domain, Software and Systems Modeling (SoSyM), 20:6, (1919-1943), Online publication date: 1-Dec-2021.
- Revoredo K, Djurica D and Mendling J (2021). A study into the practice of reporting software engineering experiments, Empirical Software Engineering, 26:6, Online publication date: 1-Nov-2021.
- Di Penta M How Empirical Research Supports Tool Development Proceedings of the 15th ACM / IEEE International Symposium on Empirical Software Engineering and Measurement (ESEM), (1-3)
- Lenarduzzi V, Dieste O, Fucci D and Vegas S Towards a Methodology for Participant Selection in Software Engineering Experiments Proceedings of the 15th ACM / IEEE International Symposium on Empirical Software Engineering and Measurement (ESEM), (1-6)
- Falcão L and Soares S Human-Oriented Software Engineering Experiments: The Large Gap in Experiment Reports Proceedings of the XXXV Brazilian Symposium on Software Engineering, (330-334)
- Panach J, Dieste Ó, Marín B, España S, Vegas S, Pastor Ó and Juristo N (2021). Evaluating Model-Driven Development Claims with Respect to Quality: A Family of Experiments, IEEE Transactions on Software Engineering, 47:1, (130-145), Online publication date: 1-Jan-2021.
- Urbieta M, Firmenich S, Bosetti G, Maglione P, Rossi G and Olivero M (2020). MDWA: a model-driven Web augmentation approach—coping with client- and server-side support, Software and Systems Modeling (SoSyM), 19:6, (1541-1566), Online publication date: 1-Nov-2020.
- Francese R, Risi M and Tortora G miniJava Proceedings of the International Conference on Advanced Visual Interfaces, (1-8)
- Sajedi‐Badashian A and Stroulia E (2020). Guidelines for evaluating bug‐assignment research, Journal of Software: Evolution and Process, 32:9, Online publication date: 3-Sep-2020.
- Minhas N, Masood S, Petersen K and Nadeem A (2019). A systematic mapping of test case generation techniques using UML interaction diagrams, Journal of Software: Evolution and Process, 32:6, Online publication date: 4-Jun-2020.
- Gonçalves E, Almendra C, Goulão M, Araújo J and Castro J (2019). Using empirical studies to mitigate symbol overload in iStar extensions, Software and Systems Modeling (SoSyM), 19:3, (763-784), Online publication date: 1-May-2020.
- Reyes R, Dieste O, C. E and Juristo N Publication Bias Proceedings of the 24th International Conference on Evaluation and Assessment in Software Engineering, (130-139)
- Zimmerle C, Oliveira W, Gama K and Castor F Reactive-based Complex Event Processing Proceedings of the XXXIII Brazilian Symposium on Software Engineering, (84-93)
- Marques L, Matsubara P, Nakamura W, Wiese I, Zaina L and Conte T UX-Tips Proceedings of the XXXIII Brazilian Symposium on Software Engineering, (224-233)
- D’Angelo M, Pagliari L, Caporuscio M, Mirandola R and Trubiani C Towards a Continuous Model-Based Engineering Process for QoS-Aware Self-adaptive Systems Software Engineering and Formal Methods, (69-76)
- Binalialhag T, Hassine J and Amyot D (2019). Static slicing of Use Case Maps requirements models, Software and Systems Modeling (SoSyM), 18:4, (2465-2505), Online publication date: 1-Aug-2019.
- Brdjanin D, Banjac G, Banjac D and Maric S (2019). An experiment in model-driven conceptual database design, Software and Systems Modeling (SoSyM), 18:3, (1859-1883), Online publication date: 1-Jun-2019.
- Zayan D, Sarkar A, Antkiewicz M, Maciel R and Czarnecki K (2019). Example-driven modeling, Software and Systems Modeling (SoSyM), 18:3, (2213-2239), Online publication date: 1-Jun-2019.
- Wang W, Kim I and Zheng Y Adjust Proceedings of the 41st International Conference on Software Engineering, (1005-1015)
- Barroso A, de J. Prado K, Soares M and do Nascimento R How personality traits influences quality of software developed by students Proceedings of the XV Brazilian Symposium on Information Systems, (1-8)
- Czepa C and Zdun U (2019). How Understandable Are Pattern-based Behavioral Constraints for Novice Software Designers?, ACM Transactions on Software Engineering and Methodology, 28:2, (1-38), Online publication date: 30-Apr-2019.
- Marín B, Frez J, Cruz-Lemus J and Genero M (2018). An Empirical Investigation on the Benefits of Gamification in Programming Courses, ACM Transactions on Computing Education, 19:1, (1-22), Online publication date: 31-Mar-2019.
- Razzaq A, Wasala A, Exton C and Buckley J (2018). The State of Empirical Evaluation in Static Feature Location, ACM Transactions on Software Engineering and Methodology, 28:1, (1-58), Online publication date: 23-Feb-2019.
- Francese R, Monaco C and Nicoletti C An Android application for helping in the identification of Children with Reading Difficulties Proceedings of the 4th EAI International Conference on Smart Objects and Technologies for Social Good, (226-231)
- Pazin M, Geraldi R and Oliveira E Comparing SMartySPEM and vSPEM for Modeling Variability in Software Processes Proceedings of the XVII Brazilian Symposium on Software Quality, (71-80)
- Neri H and Travassos G Measuresoftgram Proceedings of the 12th ACM/IEEE International Symposium on Empirical Software Engineering and Measurement, (1-4)
- Fucci D, Romano S, Baldassarre M, Caivano D, Scanniello G, Turhan B and Juristo N A longitudinal cohort study on the retainment of test-driven development Proceedings of the 12th ACM/IEEE International Symposium on Empirical Software Engineering and Measurement, (1-10)
- Romano S, Scanniello G, Fucci D, Juristo N and Turhan B The effect of noise on software engineers' performance Proceedings of the 12th ACM/IEEE International Symposium on Empirical Software Engineering and Measurement, (1-10)
- Santos A and Juristo N Comparing techniques for aggregating interrelated replications in software engineering Proceedings of the 12th ACM/IEEE International Symposium on Empirical Software Engineering and Measurement, (1-10)
- Fioravanti M, Oliveira C, Scatalon L and Barbosa E An Empirical Investigation on a Pedagogical Pattern Language for Mobile Learning Applications 2018 IEEE Frontiers in Education Conference (FIE), (1-9)
- Erra U, Scanniello G and Colonnese V (2018). Exploring the effectiveness of an augmented reality dressing room, Multimedia Tools and Applications, 77:19, (25077-25107), Online publication date: 1-Oct-2018.
- Teixeira E, Fonseca L and Soares S Threats to validity in controlled experiments in software engineering Proceedings of the XXXII Brazilian Symposium on Software Engineering, (52-61)
- Przybyłek A (2018). An empirical study on the impact of AspectJ on software evolvability, Empirical Software Engineering, 23:4, (2018-2050), Online publication date: 1-Aug-2018.
- Stol K and Fitzgerald B (2018). The ABC of Software Engineering Research, ACM Transactions on Software Engineering and Methodology, 27:3, (1-51), Online publication date: 31-Jul-2018.
- Besker T, Martini A and Bosch J Technical debt cripples software developer productivity Proceedings of the 2018 International Conference on Technical Debt, (105-114)
- Teixeira E (2018). Improving the Quality of Controlled Experiments in Software Engineering, ACM SIGSOFT Software Engineering Notes, 43:1, (1-6), Online publication date: 28-Mar-2018.
- Carvalho M, da Silva M, Gomes G, Santos A, Machado I, Souza M and de Almeida E (2018). On the implementation of dynamic software product lines, Journal of Systems and Software, 136:C, (74-100), Online publication date: 1-Feb-2018.
- Bernrdez B, Durn A, Parejo J and RuizCorts A (2018). An experimental replication on the effect of the practice of mindfulness in conceptual modeling performance, Journal of Systems and Software, 136:C, (153-172), Online publication date: 1-Feb-2018.
- Theisen C, Dunaiski M, Williams L and Visser W (2018). Software Engineering Research at the International Conference on Software Engineering in 2016, ACM SIGSOFT Software Engineering Notes, 42:4, (1-7), Online publication date: 11-Jan-2018.
- Fonseca L, Soares S and Seaman C Describing what experimental software engineering experts do when they design their experiments Proceedings of the 11th ACM/IEEE International Symposium on Empirical Software Engineering and Measurement, (211-216)
- Tiwari S and Gupta A (2017). Investigating comprehension and learnability aspects of use cases for software specification problems, Information and Software Technology, 91:C, (22-43), Online publication date: 1-Nov-2017.
- Rathore S and Kumar S (2017). Towards an ensemble based system for predicting the number of software faults, Expert Systems with Applications: An International Journal, 82:C, (357-382), Online publication date: 1-Oct-2017.
- Cirilo E, Cafeo B, Nunes I, Garcia A, Kulesza U and Lucena C Comprehensibility of Heterogeneous Configuration Knowledge Proceedings of the XXXI Brazilian Symposium on Software Engineering, (124-133)
- Fittkau F, Krause A and Hasselbring W (2017). Software landscape and application visualization for system comprehension with ExplorViz, Information and Software Technology, 87:C, (259-277), Online publication date: 1-Jul-2017.
- Ferreira W, Baldassarre M, Soares S, Cartaxo B and Visaggio G A Comparative Study of Model-Driven Approaches For Scoping and Planning Experiments Proceedings of the 21st International Conference on Evaluation and Assessment in Software Engineering, (78-87)
- Granda M, Condori-Fernández N, Vos T and Pastor O Effectiveness Assessment of an Early Testing Technique using Model-Level Mutants Proceedings of the 21st International Conference on Evaluation and Assessment in Software Engineering, (98-107)
- Wang C, Luo Z, Lin L and Daneva M How to Reduce Software Development Cost with Personnel Assignment Optimization Proceedings of the 21st International Conference on Evaluation and Assessment in Software Engineering, (270-279)
- Yskout K, Van Landuyt D and Joosen W Towards a platform for empirical software design studies Proceedings of the 1st International Workshop on Establishing the Community-Wide Infrastructure for Architecture-Based Software Engineering, (3-7)
- Jagroep E, Broekman J, van der Werf J, Brinkkemper S, Lago P, Blom L and van Vliet R Awakening awareness on energy consumption in software engineering Proceedings of the 39th International Conference on Software Engineering: Software Engineering in Society Track, (76-85)
- Vegas S Analyzing software engineering experiments Proceedings of the 39th International Conference on Software Engineering Companion, (513-514)
- De Renzis A, Garriga M, Flores A, Cechich A, Mateos C and Zunino A (2017). A domain independent readability metric for web service descriptions, Computer Standards & Interfaces, 50:C, (124-141), Online publication date: 1-Feb-2017.
- Bonifácio R, Borba P, Ferraz C and Accioly P (2017). Empirical assessment of two approaches for specifying software product line use case scenarios, Software and Systems Modeling (SoSyM), 16:1, (97-123), Online publication date: 1-Feb-2017.
- Prota T, Véras D and Ferraz C Reliability Evaluation of Behavioral Representations from Multimedia Applications Proceedings of the 22nd Brazilian Symposium on Multimedia and the Web, (223-226)
- Marter T, Babucke P, Lembken P and Hanenberg S Lightweight programming experiments without programmers and programs: an example study on the effect of similarity and number of object identifiers on the readability of source code using natural texts Proceedings of the 2016 ACM International Symposium on New Ideas, New Paradigms, and Reflections on Programming and Software, (1-14)
- Dias J, OliveiraJr E and Silva M Preliminary Empirical Evidence on SPrL Variability Management with EPF and SMartySPEM Proceedings of the XXX Brazilian Symposium on Software Engineering, (133-142)
- Francese R, Risi M, Scanniello G and Tortora G (2016). Proposing and assessing a software visualization approach based on polymetric views, Journal of Visual Languages and Computing, 34:C, (11-24), Online publication date: 1-Jun-2016.
- Juristo N and Vegas S Analyzing software engineering experiments Proceedings of the 38th International Conference on Software Engineering Companion, (900-901)
- Jagroep E, van der Werf J, Brinkkemper S, Procaccianti G, Lago P, Blom L and van Vliet R Software energy profiling Proceedings of the 38th International Conference on Software Engineering Companion, (523-532)
- Gómez O, Vegas S and Juristo N Impact of CS programs on the quality of test cases generation Proceedings of the 38th International Conference on Software Engineering Companion, (374-383)
- Aranda A, Dieste O and Juristo N (2016). Effect of Domain Knowledge on Elicitation Effectiveness: An Internally Replicated Controlled Experiment, IEEE Transactions on Software Engineering, 42:5, (427-451), Online publication date: 1-May-2016.
- Rathore S and Kumar S (2016). A Decision Tree Regression based Approach for the Number of Software Faults Prediction, ACM SIGSOFT Software Engineering Notes, 41:1, (1-6), Online publication date: 22-Feb-2016.
- Hanenberg S and Stefik A On the need to define community agreements for controlled experiments with human subjects: a discussion paper Proceedings of the 6th Workshop on Evaluation and Usability of Programming Languages and Tools, (61-67)
- Valentim N, Rabelo J, Oran A, Conte T and Marczak S A controlled experiment with usability inspection techniques applied to use case specifications Proceedings of the 18th International Conference on Model Driven Engineering Languages and Systems, (206-215)
- Falessi D, Codabux Z, Rong G, Stamelos I, Ferreira W, Wiese I, Barreiros E, Quesada-Lopez C and Tsirakidis P (2015). Trends in empirical research, ACM SIGSOFT Software Engineering Notes, 40:5, (30-35), Online publication date: 14-Sep-2015.
- Cappiello C, Matera M and Picozzi M (2015). A UI-Centric Approach for the End-User Development of Multidevice Mashups, ACM Transactions on the Web, 9:3, (1-40), Online publication date: 20-Jun-2015.
- de Souza I, Oliveira P, Bispo E, Inocencio A and Parreira P TESE - An Information System for Management of Experimental Software Engineering Projects Proceedings of the annual conference on Brazilian Symposium on Information Systems: Information Systems: A Computer Socio-Technical Perspective - Volume 1, (563-570)
- Fittkau F, Finke S, Hasselbring W and Waller J Comparing trace visualizations for program comprehension through controlled experiments Proceedings of the 2015 IEEE 23rd International Conference on Program Comprehension, (266-276)
- Vegas S, Dieste Ó and Juristo N Difficulties in running experiments in the software industry Proceedings of the Third International Workshop on Conducting Empirical Studies in Industry, (3-9)
- Siegmund J, Siegmund N and Apel S Views on internal and external validity in empirical software engineering Proceedings of the 37th International Conference on Software Engineering - Volume 1, (9-19)
- Murukannaiah P and Singh M (2015). Platys, ACM Transactions on Software Engineering and Methodology, 24:3, (1-32), Online publication date: 13-May-2015.
- Scanniello G, Gravino C, Risi M, Tortora G and Dodero G (2015). Documenting Design-Pattern Instances, ACM Transactions on Software Engineering and Methodology, 24:3, (1-35), Online publication date: 13-May-2015.
- Lehtinen T, Mäntylä M, Itkonen J and Vanhanen J (2015). Diagrams or structural lists in software project retrospectives - An experimental comparison, Journal of Systems and Software, 103:C, (17-35), Online publication date: 1-May-2015.
- Borges A, Ferreira W, Barreiros E, Almeida A, Fonseca L, Teixeira E, Silva D, Alencar A and Soares S Support mechanisms to conduct empirical studies in software engineering Proceedings of the 19th International Conference on Evaluation and Assessment in Software Engineering, (1-14)
- Torres A, Galante R and Pimenta M (2014). ENORM, ACM SIGMOD Record, 43:2, (23-28), Online publication date: 4-Dec-2014.
- Salvaneschi G, Amann S, Proksch S and Mezini M An empirical study on program comprehension with reactive programming Proceedings of the 22nd ACM SIGSOFT International Symposium on Foundations of Software Engineering, (564-575)
- Ricca F, Scanniello G, Torchiano M, Reggio G and Astesiano E (2014). Assessing the Effect of Screen Mockups on the Comprehension of Functional Requirements, ACM Transactions on Software Engineering and Methodology, 24:1, (1-38), Online publication date: 14-Oct-2014.
- Reimanis D, Izurieta C, Luhr R, Xiao L, Cai Y and Rudy G A replication case study to measure the architectural quality of a commercial system Proceedings of the 8th ACM/IEEE International Symposium on Empirical Software Engineering and Measurement, (1-8)
- Borges A, Ferreira W, Barreiros E, Almeida A, Fonseca L, Teixeira E, Silva D, Alencar A and Soares S Support mechanisms to conduct empirical studies in software engineering Proceedings of the 8th ACM/IEEE International Symposium on Empirical Software Engineering and Measurement, (1-4)
- González J, Juristo N and Vegas S A systematic mapping study on testing technique experiments Proceedings of the 8th ACM/IEEE International Symposium on Empirical Software Engineering and Measurement, (1-4)
- Bernárdez B, Durán A, Parejo J and Ruiz--Cortés A A controlled experiment to evaluate the effects of mindfulness in software engineering Proceedings of the 8th ACM/IEEE International Symposium on Empirical Software Engineering and Measurement, (1-10)
- Olsson C and Eriksson J Methodological Capabilities for Emergent Design 16th International Conference on Human-Computer Interaction. Theories, Methods, and Tools - Volume 8510, (110-121)
- Zayan D, Antkiewicz M and Czarnecki K Effects of using examples on structural model comprehension: a controlled experiment Proceedings of the 36th International Conference on Software Engineering, (955-966)
- Scanniello G, Staron M, Burden H and Heldal R On the effect of using SysML requirement diagrams to comprehend requirements Proceedings of the 18th International Conference on Evaluation and Assessment in Software Engineering, (1-10)
- Murukannaiah P and Singh M Xipho Proceedings of the 2014 international conference on Autonomous agents and multi-agent systems, (309-316)
- Scanniello G, Gravino C, Genero M, Cruz-Lemus J and Tortora G (2014). On the impact of UML analysis models on source-code comprehensibility and modifiability, ACM Transactions on Software Engineering and Methodology, 23:2, (1-26), Online publication date: 1-Mar-2014.
- Tiwari S and Gupta A Does increasing formalism in the use case template help? Proceedings of the 7th India Software Engineering Conference, (1-10)
- Hoppe M and Hanenberg S (2013). Do developers benefit from generic types?, ACM SIGPLAN Notices, 48:10, (457-474), Online publication date: 12-Nov-2013.
- Hoppe M and Hanenberg S Do developers benefit from generic types? Proceedings of the 2013 ACM SIGPLAN international conference on Object oriented programming systems languages & applications, (457-474)
- Fernandez A, Abrahão S, Insfran E and Matera M Usability Inspection in Model-Driven Web Development Proceedings of the 16th International Conference on Model-Driven Engineering Languages and Systems - Volume 8107, (740-756)
- Falessi D, Briand L, Cantone G, Capilla R and Kruchten P (2013). The value of design rationale information, ACM Transactions on Software Engineering and Methodology, 22:3, (1-32), Online publication date: 1-Jul-2013.
- Jain S, Babar M and Fernandez J Conducting empirical studies in industry Proceedings of the 1st International Workshop on Conducting Empirical Studies in Industry, (9-14)
- Dieste O, Juristo N and Martínez M Software industry experiments Proceedings of the 1st International Workshop on Conducting Empirical Studies in Industry, (2-8)
- Edison H, Bin Ali N and Torkar R (2013). Towards innovation measurement in the software industry, Journal of Systems and Software, 86:5, (1390-1407), Online publication date: 1-May-2013.
- Fernández-Sáez A, Chaudron M, Genero M and Ramos I Are forward designed or reverse-engineered UML diagrams more helpful for code maintenance? Proceedings of the 17th International Conference on Evaluation and Assessment in Software Engineering, (60-71)
- Maia M and Lafetá R (2013). On the impact of trace-based feature location in the performance of software maintainers, Journal of Systems and Software, 86:4, (1023-1037), Online publication date: 1-Apr-2013.
- Mayer C, Hanenberg S, Robbes R, Tanter É and Stefik A (2012). An empirical study of the influence of static type systems on the usability of undocumented software, ACM SIGPLAN Notices, 47:10, (683-702), Online publication date: 15-Nov-2012.
- Cartaxo B, Costa I, Abrantes D, Santos A, Soares S and Garcia V ESEML Proceedings of the 2012 workshop on Domain-specific modeling, (55-60)
- Mayer C, Hanenberg S, Robbes R, Tanter É and Stefik A An empirical study of the influence of static type systems on the usability of undocumented software Proceedings of the ACM international conference on Object oriented programming systems languages and applications, (683-702)
- Gómez M, Acuña S, Genero M and Cruz-Lemus J (2012). How Does the Extraversion of Software Development Teams Influence Team Satisfaction and Software Quality?, International Journal of Human Capital and Information Technology Professionals, 3:4, (11-24), Online publication date: 1-Oct-2012.
- Gravino C, Risi M, Scanniello G and Tortora G Do professional developers benefit from design pattern documentation? a replication in the context of source code comprehension Proceedings of the 15th international conference on Model Driven Engineering Languages and Systems, (185-201)
- Miranda B, Aranha E and Iyoda J Recommender systems for manual testing Proceedings of the ACM-IEEE international symposium on Empirical software engineering and measurement, (201-210)
- Wieringa R, Condori-Fernandez N, Daneva M, Mutschler B and Pastor O Lessons learned from evaluating a checklist for reporting experimental and observational research Proceedings of the ACM-IEEE international symposium on Empirical software engineering and measurement, (157-160)
- Telang P and Singh M Comma Proceedings of the 11th International Conference on Autonomous Agents and Multiagent Systems - Volume 2, (1073-1080)
- Di Penta M, Antoniol G, Germán D, Guéhéneuc Y and Adams B Five days of empirical software engineering: the PASED experience Proceedings of the 34th International Conference on Software Engineering, (1255-1258)
- Pankratius V, Schmidt F and Garretón G Combining functional and imperative programming for multicore software: an empirical study evaluating Scala and Java Proceedings of the 34th International Conference on Software Engineering, (123-133)
- Stuchlik A and Hanenberg S (2011). Static vs. dynamic type systems, ACM SIGPLAN Notices, 47:2, (97-106), Online publication date: 18-Mar-2012.
- Kleinschmager S and Hanenberg S How to rate programming skills in programming experiments? Proceedings of the 3rd ACM SIGPLAN workshop on Evaluation and usability of programming languages and tools, (15-24)
- Stuchlik A and Hanenberg S Static vs. dynamic type systems Proceedings of the 7th symposium on Dynamic languages, (97-106)
- Fernández-Sáez A, Genero M and Chaudron M Does the level of detail of UML models affect the maintainability of source code? Proceedings of the 2011th international conference on Models in Software Engineering, (134-148)
- Reijers H, Mendling J and Dijkman R (2011). Human and automatic modularizations of process models to enhance their comprehension, Information Systems, 36:5, (881-897), Online publication date: 1-Jul-2011.
- Di Cerbo F, Dodero G, Reggio G, Ricca F and Scanniello G Precise vs. ultra-light activity diagrams - an experimental assessment in the context of business process modelling Proceedings of the 12th international conference on Product-focused software process improvement, (291-305)
- Hanenberg S (2010). Faith, hope, and love, ACM SIGPLAN Notices, 45:10, (933-946), Online publication date: 17-Oct-2010.
- Hanenberg S (2010). An experiment about static and dynamic type systems, ACM SIGPLAN Notices, 45:10, (22-35), Online publication date: 17-Oct-2010.
- Hanenberg S Faith, hope, and love Proceedings of the ACM international conference on Object oriented programming systems languages and applications, (933-946)
- Hanenberg S An experiment about static and dynamic type systems Proceedings of the ACM international conference on Object oriented programming systems languages and applications, (22-35)
- Ricca F, Scanniello G, Torchiano M, Reggio G and Astesiano E On the effectiveness of screen mockups in requirements engineering Proceedings of the 2010 ACM-IEEE International Symposium on Empirical Software Engineering and Measurement, (1-10)
- Cruz-Lemus J, Genero M, Manso M, Morasca S and Piattini M (2009). Assessing the understandability of UML statechart diagrams with composite states--A family of empirical studies, Empirical Software Engineering, 14:6, (685-719), Online publication date: 1-Dec-2009.
- Feigenspan J, Kästner C, Apel S and Leich T How to compare program comprehension in FOSD empirically Proceedings of the First International Workshop on Feature-Oriented Software Development, (55-62)
- Ricca F, Di Penta M, Torchiano M, Tonella P, Ceccato M and Visaggio C Are fit tables really talking? Proceedings of the 30th international conference on Software engineering, (361-370)
- Cruz-Lemus J, Genero M, Morasca S and Piattini M Using practitioners for assessing the understandability of UML statechart diagrams with composite states Proceedings of the 2007 conference on Advances in conceptual modeling: foundations and applications, (213-222)
- Falessi D, Kruchten P and Cantone G Issues in applying empirical software engineering to software architecture Proceedings of the First European conference on Software Architecture, (257-262)
- Ricca F, Torchiano M, Ceccato M and Tonella P Talking tests Ninth international workshop on Principles of software evolution: in conjunction with the 6th ESEC/FSE joint meeting, (51-58)
- Ricca F, Di Penta M, Torchiano M, Tonella P and Ceccato M The Role of Experience and Ability in Comprehension Tasks Supported by UML Stereotypes Proceedings of the 29th international conference on Software Engineering, (375-384)
- Graham T, Kazman R and Walmsley C Agility and Experimentation Proceedings of the 29th international conference on Software Engineering, (519-528)
- Sjoberg D, Dyba T and Jorgensen M The Future of Empirical Methods in Software Engineering Research 2007 Future of Software Engineering, (358-378)
- Zannier C and Maurer F Social Factors Relevant to Capturing Design Decisions Proceedings of the Second Workshop on SHAring and Reusing architectural Knowledge Architecture, Rationale, and Design Intent
- Hannay J, Sjoberg D and Dyba T (2007). A Systematic Review of Theory Use in Software Engineering Experiments, IEEE Transactions on Software Engineering, 33:2, (87-107), Online publication date: 1-Feb-2007.
- Juristo N, Moreno A, Vegas S and Solari M (2006). In Search of What We Experimentally Know about Unit Testing, IEEE Software, 23:6, (72-80), Online publication date: 1-Nov-2006.
- Mendez G, Herrero P and Valladares R SIAPAS Proceedings of the 2006 international conference on On the Move to Meaningful Internet Systems: AWeSOMe, CAMS, COMINF, IS, KSinBIT, MIOS-CIAO, MONET - Volume Part I, (945-954)
- Vegas S, Juristo N, Moreno A, Solari M and Letelier P Analysis of the influence of communication between researchers on experiment replication Proceedings of the 2006 ACM/IEEE international symposium on Empirical software engineering, (28-37)
- Rainer A, Ciolkowski M, Pfahl D, Kitchenham B, Morasca S, Müller M, Travassos G and Vegas S Teaching empirical methods to undergraduate students working group results Proceedings of the 2006 international conference on Empirical software engineering issues: critical assessment and future directions, (158-162)
- Juristo N Educational objectives for empirical methods Proceedings of the 2006 international conference on Empirical software engineering issues: critical assessment and future directions, (143-150)
- Wohlin C Empirical software engineering Proceedings of the 2006 international conference on Empirical software engineering issues: critical assessment and future directions, (135-142)
- Zannier C and Maurer F (2005). A qualitative empirical evaluation of design decisions, ACM SIGSOFT Software Engineering Notes, 30:4, (1-7), Online publication date: 1-Jul-2005.
- Winkler D, Biffl S and Thurnher B Investigating the impact of active guidance on design inspection Proceedings of the 6th international conference on Product Focused Software Process Improvement, (458-473)
- Zannier C and Maurer F A qualitative empirical evaluation of design decisions Proceedings of the 2005 workshop on Human and social factors of software engineering, (1-7)
- Höst M, Wohlin C and Thelin T Experimental context classification Proceedings of the 27th international conference on Software engineering, (470-478)
- Briand L, Di Penta M and Labiche Y (2004). Assessing and Improving State-Based Class Testing, IEEE Transactions on Software Engineering, 30:11, (770-793), Online publication date: 1-Nov-2004.
- Briand L and Labiche Y (2004). Empirical studies of software testing techniques, ACM SIGSOFT Software Engineering Notes, 29:5, (1-3), Online publication date: 1-Sep-2004.
- Thelin T, Runeson P and Wohlin C (2003). An Experimental Comparison of Usage-Based and Checklist-Based Reading, IEEE Transactions on Software Engineering, 29:8, (687-704), Online publication date: 1-Aug-2003.
- Houdek F External experiments Lecture notes on empirical software engineering, (133-166)
Recommendations
Experimentation in software engineering
Experimentation in software engineering supports the advancement of the field through an iterative learning process. In this paper we present a framework for analyzing most of the experimental work performed in software engineering over the past several ...
Improving Software Engineering Research Through Experimentation Workbenches
From Software Engineering to Formal Methods and Tools, and BackAbstractExperimentation with software prototypes plays a fundamental role in software engineering research. In contrast to many other scientific disciplines, however, explicit support for this key activity in software engineering is relatively small. ...