Verification, Validation, and Confirmation of Numerical Models in the Earth Sciences

  title={Verification, Validation, and Confirmation of Numerical Models in the Earth Sciences},
  author={Naomi Oreskes and Kristin Sharon Shrader-Frechette and Kenneth Belitz},
  pages={641 - 646}
Verification and validation of numerical models of natural systems is impossible. This is because natural systems are never closed and because model results are always nonunique. Models can be confirmed by the demonstration of agreement between observation and prediction, but confirmation is inherently partial. Complete confirmation is logically precluded by the fallacy of affirming the consequent and by incomplete access to natural phenomena. Models can only be evaluated in relative terms, and… 

Topics from this paper

Evaluating the performance of cryospheric models 1
Most prognostic cryospheric models have not been adequately calibrated and confirmed, and skepticism toward their predictions is therefore warranted.
On the term and concepts of numerical model validation in geoscientific applications
This contribution discusses some more general aspects of the (dynamic) process modeling for geoscientific applications including reflections about the slightly different understanding of the termsmodel and model validation in different scientific communities, and about the term and methods ofmodel calibration in the geoscienceifc context.
On the validation of high-resolution atmospheric mesoscale models
Abstract The central ideas of a validation concept are outlined. The concept is applicable to high-resolution atmospheric mesoscale models, which calculate wind, temperature and humidity fields as
Connections between simulations and observation in climate computer modeling. Scientist’s practices and “bottom-up epistemology” lessons
From practices observed in the two research centers developing and using a climate model in France, different ways in which the researchers establish links between models and empirical data are reviewed to highlight some elements of the epistemology of modeling.
A General Strategy for Physics-Based Model Validation Illustrated with Earthquake Phenomenology, Atmospheric Radiative Transfer, and Computational Fluid Dynamics
This article proposes to formulate validation as an iterative construction process that mimics the process occurring implicitly in the minds of scientists and offers a formal representation of the progressive build-up of trust in the model to replace incapacitating claims on the impossibility of validating a given model by an adaptive process of constructive approximation.
Polar ice sheets and global sea level: how well can we predict the future?
Abstract Geophysical models are based on hypotheses that are often derived from theoretical arguments or from observations, or a combination of both. Owing to the open nature of geophysical systems,
How well must climate models agree with observations?
  • D. Notz
  • Environmental Science, Medicine
    Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences
  • 2015
It is found that many standard metrics such as sea-ice area or volume only permit limited inferences about the shortcomings of individual models, and this can only meaningfully be done relative to a given purpose for using a model.
A Discourse About Quasi-realistic Climate Models and Their Applications in Paleoclimatic Studies
The role and application of quasi-realistic climate models in paleoclimatic studies is reviewed. Conceptual aspects of modelling, such as the validation of positive analogs and the application of
Measurements, Models, and Hypotheses in the Atmospheric Sciences
Measurements in atmospheric science sometimes determine universal functions, but more commonly data are collected in the form of case studies. Models are conceptual constructs that can be used to
Equifinality and Uncertainty in Geomorphological Modelling
Recent experience in modelling hydrological systems has revealed that good fits to the available data can be obtained with a wide variety of parameter sets that usually are dispersed throughout the


Ground-water models cannot be validated
Case histories of model applications to the Dakota Aquifer, South Dakota, to bedded salts in New Mexico, and to the upper Coachella Valley, California, illustrate that calibration produces a nonunique solution and that validation, per se, is a futile objective.
The role of the postaudit in model validation
Results of five postaudits suggest that it will be difficult and probably impossible to validate groundwater models by means of a postaudit because it is impossible to characterize the field setting in sufficient detail.
Predictive Accuracy of a Ground–Water Model — Lessons from a Postaudit
Hydrogeologic studies commonly include the development, calibration, and application of a deterministic simulation model. To help assess the value of using such models to make predictions, a
The Modeling Process and Model Validation
The safety assessment of underground disposal of nuclear or toxic wastes requires the use of models. Such models need to be validated to ensure, as much as possible, that they are a good
Applied groundwater modeling - simulation of flow and advective transport (4. pr.)
This second edition is extensively revised throughout with expanded discussion of modeling fundamentals and coverage of advances in model calibration and uncertainty analysis that are revolutionizing
Development of reaction models for ground-water systems
Abstract Methods are described for developing geochemical reaction models from the observed chemical compositions of ground water along a hydrologic flow path. The roles of thermodynamic speciation
Introduction to Groundwater Modeling: Finite Difference and Finite Element Methods
This is the first textbook specifically designed for university courses in groundwater modeling. There are books devoted to the exposition of the mechanics of groundwater, to the mathematics of
Assessment of Long-Term Salinity Changes in an Irrigated Stream-Aquifer System
Changes in salinity in groundwater and surface water in the Arkansas River valley of southeastern Colorado are primarily related to irrigation practices. A solute transport model was applied to an
Modeling flow and chemical quality changes in an irrigated stream‐aquifer system
Salinity increases in groundwater and surface water in the Arkansas River valley of southeastern Colorado are primarily related to irrigation practices. A digital computer model was developed to
How the laws of physics lie
In this sequence of philosophical essays about natural science, Nancy Cartwright argues that fundamental explanatory laws, the deepest and most admired successes of modern physics, do not in fact