skip to main content
Skip header Section
Verification and Validation in Scientific ComputingNovember 2010
Publisher:
  • Cambridge University Press
  • 40 W. 20 St. New York, NY
  • United States
ISBN:978-0-521-11360-1
Published:22 November 2010
Pages:
784
Skip Bibliometrics Section
Bibliometrics
Skip Abstract Section
Abstract

Advances in scientific computing have made modelling and simulation an important part of the decision-making process in engineering, science, and public policy. This book provides a comprehensive and systematic development of the basic concepts, principles, and procedures for verification and validation of models and simulations. The emphasis is placed on models that are described by partial differential and integral equations and the simulations that result from their numerical solution. The methods described can be applied to a wide range of technical fields, from the physical sciences, engineering and technology and industry, through to environmental regulations and safety, product and plant safety, financial investing, and governmental regulations. This book will be genuinely welcomed by researchers, practitioners, and decision makers in a broad range of fields, who seek to improve the credibility and reliability of simulation results. It will also be appropriate either for university courses or for independent study.

Cited By

  1. Denil J Validity in (Co-) Simulation Software Engineering and Formal Methods. SEFM 2022 Collocated Workshops, (193-199)
  2. Lunsford I and Bradley T Aircraft survivability modeling for multi-uav operational scenarios and emerging threats Proceedings of the 2020 Summer Simulation Conference, (1-12)
  3. Sargent R Verification and validation of simulation models Proceedings of the Winter Simulation Conference, (16-29)
  4. Minakowski P and Richter T (2020). Finite Element Error Estimates on Geometrically Perturbed Domains, Journal of Scientific Computing, 84:2, Online publication date: 3-Aug-2020.
  5. Coto A, Guanciale R and Tuosto E On Testing Message-Passing Components Leveraging Applications of Formal Methods, Verification and Validation: Verification Principles, (22-38)
  6. Jebeile J and Ardourel V (2019). Verification and Validation of Simulations Against Holism, Minds and Machines, 29:1, (149-168), Online publication date: 1-Mar-2019.
  7. Rueda-Ramírez A, Rubio G, Ferrer E and Valero E (2019). Truncation Error Estimation in the p-Anisotropic Discontinuous Galerkin Spectral Element Method, Journal of Scientific Computing, 78:1, (433-466), Online publication date: 1-Jan-2019.
  8. ACM
    Ivie P and Thain D (2018). Reproducibility in Scientific Computing, ACM Computing Surveys, 51:3, (1-36), Online publication date: 31-May-2019.
  9. Gfrerer M and Schanz M (2018). Code verification examples based on the method of manufactured solutions for Kirchhoff---Love and Reissner---Mindlin shell analysis, Engineering with Computers, 34:4, (775-785), Online publication date: 1-Oct-2018.
  10. Sargent R and Balci O History of verification and validation of simulation models Proceedings of the 2017 Winter Simulation Conference, (1-16)
  11. Phillips T, Derlaga J, Roy C and Borggaard J (2017). Error transport equation boundary conditions for the Euler and Navier-Stokes equations, Journal of Computational Physics, 330:C, (46-64), Online publication date: 1-Feb-2017.
  12. Matouš K, Geers M, Kouznetsova V and Gillman A (2017). A review of predictive nonlinear theories for multiscale modeling of heterogeneous materials, Journal of Computational Physics, 330:C, (192-220), Online publication date: 1-Feb-2017.
  13. Halpern F, Ricci P, Jolliet S, Loizu J, Morales J, Mosetto A, Musil F, Riva F, Tran T and Wersal C (2016). The GBS code for tokamak scrape-off layer simulations, Journal of Computational Physics, 315:C, (388-408), Online publication date: 15-Jun-2016.
  14. Thorne J and Katz A (2016). Source Term Discretization Effects on the Steady-State Accuracy of Finite Volume Schemes, Journal of Scientific Computing, 69:1, (146-169), Online publication date: 1-Oct-2016.
  15. ACM
    Yuan J and Ng S (2015). Calibration, Validation, and Prediction in Random Simulation Models, ACM Transactions on Modeling and Computer Simulation, 25:3, (1-25), Online publication date: 7-May-2015.
  16. ACM
    Benvenuti L, Kloss C and Pirker S Characterization of DEM particles by means of artificial neural networks and macroscopic experiments Proceedings of the 16th International Conference on Engineering Applications of Neural Networks (INNS), (1-8)
  17. Sargent R An introductory tutorial on verification and validation of simulation models Proceedings of the 2015 Winter Simulation Conference, (1729-1740)
  18. Barrett R, Crozier P, Doerfler D, Heroux M, Lin P, Thornquist H, Trucano T and Vaughan C (2015). Assessing the role of mini-applications in predicting key performance characteristics of scientific and engineering applications, Journal of Parallel and Distributed Computing, 75:C, (107-122), Online publication date: 1-Jan-2015.
  19. Kamojjala K, Brannon R, Sadeghirad A and Guilkey J (2015). Verification tests in solid mechanics, Engineering with Computers, 31:2, (193-213), Online publication date: 1-Apr-2015.
  20. Sargent R Verifying and validating simulation models Proceedings of the 2014 Winter Simulation Conference, (118-131)
  21. Pasdunkorale Arachchige J and Pettet G (2014). A finite volume method with linearisation in time for the solution of advection-reaction-diffusion systems, Applied Mathematics and Computation, 231:C, (445-462), Online publication date: 15-Mar-2014.
  22. Fullmer W, Lopez de Bertodano M, Chen M and Clausse A (2014). Analysis of stability, verification and chaos with the Kreiss-Yström equations, Applied Mathematics and Computation, 248:C, (28-46), Online publication date: 1-Dec-2014.
  23. Dosanjh S, Barrett R, Doerfler D, Hammond S, Hemmert K, Heroux M, Lin P, Pedretti K, Rodrigues A, Trucano T and Luitjens J (2014). Exascale design space exploration and co-design, Future Generation Computer Systems, 30:C, (46-58), Online publication date: 1-Jan-2014.
  24. Sargent R An introduction to verification and validation of simulation models Proceedings of the 2013 Winter Simulation Conference: Simulation: Making Decisions in a Complex World, (321-327)
  25. Jun Y and Ng S An entropy based sequential calibration approach for stochastic computer models Proceedings of the 2013 Winter Simulation Conference: Simulation: Making Decisions in a Complex World, (589-600)
  26. Wahba E (2013). Non-systematic grid refinement procedures for computational fluid dynamics, Applied Mathematics and Computation, 225, (829-842), Online publication date: 1-Dec-2013.
  27. Langston J, Leonard I and Steurer M Estimation of discretization error in electromagnetic transient simulation models of power systems Proceedings of the 2011 Grand Challenges on Modeling and Simulation Conference, (161-166)
Contributors
  • Sandia National Laboratories, New Mexico
  • Virginia Polytechnic Institute and State University

Recommendations

Reviews

Joan Catherine Horvath

This ambitious and well-written book is an excellent comprehensive review of what you need to know to evaluate or build a complex model or simulation of a physical process. Although the authors correctly note that users will need some significant mathematics to appreciate the entire book, a majority of it is more accessible than that. Although long (close to 800 pages) and dense, the book is organized in such a way that different users can easily use relevant parts of it and skim or skip the parts that are less so. As the authors note, the book develops the ideas needed to verify a simulation ("solving equations right") but also to validate it ("solving the right equations"). They do this with a mix of clear explanation, simple diagrams and flowcharts of good processes, a survey of necessary mathematics, and extensive references. The index is good, and allows readers to find concepts easily. This is a book about what can go wrong in a simulation, including what the authors call blind uncertainties: those errors that occur because no one thinks to allow for a particular phenomenon or error. This book admits that those types of errors exist, and discusses pragmatic ways to think about them. It covers many of the art aspects of developing a simulation: defining where your system begins and ends, prioritizing effort and fidelity where the system really needs it, and considering pragmatic human nature issues. Five major sections comprise the book. The first, on fundamental concepts, is a good review of terminology and concepts of verification, validation, and uncertainty. The next two sections move from verification of computer code to verification of the equations being solved. These sections start off with a rather general survey of the field of software engineering, and then move into a rather mathematically intense discussion. Those who are not concerned personally with issues of discretization and analysis of numerical and approximation errors can dip around in those 200 pages and read pieces that apply to their situations. The book is written modularly enough that this will not damage understanding of the big picture concepts later on. The last two sections discuss how to think about validating that a simulation reflects reality. One good discussion reviews how to think about using experimental data to validate software, given that sometimes software needs inputs that may not have been measured in a physical experiment, and what to consider if experimental data just is not practical to obtain. Finally, the book discusses project management issues. The book would be a good textbook for a senior-level engineering or physics undergraduate semester course, particularly a project-based one that develops requirements for a simple prototype numerical model of a system. Pure mathematicians might struggle with the examples that are mostly oriented toward aerospace systems. Students without some exposure to differential equations might panic when they see the solution verification chapters, but an instructor could easily skip that section and replace it with simpler metrics that are appropriate for a student project situation. If the book has a negative aspect, it is that it is somewhat skewed toward aerospace and a bit heavier on the acronyms than perhaps it needs to be. This is unfortunate, because it might scare off, say, biologists and others considering the issues in developing numerical models of their systems. A bit more diversity in the examples might be something that the authors could consider for a future edition. That said, one audience the authors do not mention in their discussion of potential readers is potential purchasers or users of a simulation system. This book would provide a manager who is not as familiar as he or she would like with the right questions to ask of technical staff, particularly since the authors close with a chapter on management responsibilities. An intense session of an afternoon or so with this book would be a good crash course or refresher for anyone who needs to deal with modeling or simulation issues. Online Computing Reviews Service

Access critical reviews of Computing literature here

Become a reviewer for Computing Reviews.