What should we do when a model crashes? Recommendations for global sensitivity analysis of Earth and environmental systems models

@article{Sheikholeslami2019WhatSW,
  title={What should we do when a model crashes? Recommendations for global sensitivity analysis of Earth and environmental systems models},
  author={Razi Sheikholeslami and Saman Razavi and Amin Haghnegahdar},
  journal={Geoscientific Model Development},
  year={2019}
}
Abstract. Complex, software-intensive, technically advanced, and computationally demanding models, presumably with ever-growing realism and fidelity, have been widely used to simulate and predict the dynamics of the Earth and environmental systems. The parameter-induced simulation crash (failure) problem is typical across most of these models despite considerable efforts that modellers have directed at model development and implementation over the last few decades. A simulation failure mainly… 
4 Citations

VISCOUS: A Variance‐Based Sensitivity Analysis Using Copulas for Efficient Identification of Dominant Hydrological Processes

Global sensitivity analysis (GSA) has long been recognized as an indispensable tool for model analysis. GSA has been extensively used for model simplification, identifiability analysis, and

References

SHOWING 1-10 OF 79 REFERENCES

What do we mean by sensitivity analysis? The need for comprehensive characterization of “global” sensitivity in Earth and Environmental systems models

Sensitivity analysis is an essential paradigm in Earth and Environmental Systems modeling. However, the term “sensitivity” has a clear definition, based in partial derivatives, only when specified

Revisiting the Basis of Sensitivity Analysis for Dynamical Earth System Models

This paper investigates the problem of global sensitivity analysis (GSA) of Dynamical Earth System Models and proposes a basis for how such analyses should be performed. We argue that (a) performance

Failure analysis of parameter-induced simulation crashes in climate models

Support vector machine (SVM) classification from machine learning was applied to quantify and predict the probability of failure as a function of the values of 18 POP2 parameters, which experienced a series of simulation crashes within the Parallel Ocean Program (POP2) component of the Community Climate System Model (CCSM4).

Estimating Probability Distributions from Complex Models with Bifurcations: The Case of Ocean Circulation Collapse

Studying the uncertainty in computationally expensive models has required the development of specialized methods, including alternative sampling techniques and response surface approaches. However,

Ancient numerical daemons of conceptual hydrological modeling: 2. Impact of time stepping schemes on model analysis and prediction

Despite the widespread use of conceptual hydrological models in environmental research and operations, they remain frequently implemented using numerically unreliable methods. This paper considers

Tuning without over-tuning: parametric uncertainty quantification for the NEMO ocean model

The method, which is referred to here as iterative refocussing (though also known as history matching), avoids many of the common pitfalls of automatic tuning procedures that are based on optimisation of a cost function, principally the over-tuning of a climate model due to using only partial observations.

Reducing climate model biases by exploring parameter space with large ensembles of climate model simulations and statistical emulation

Abstract. Understanding the unfolding challenges of climate change relies on climate models, many of which have large summer warm and dry biases over Northern Hemisphere continental midlatitudes.

A new framework for comprehensive, robust, and efficient global sensitivity analysis: 1. Theory

A new and general sensitivity analysis framework (called VARS), based on an analogy to “variogram analysis,” that provides an intuitive and comprehensive characterization of sensitivity across the full spectrum of scales in the factor space is presented.
...