What do I make of your Latinorum? Sensitivity auditing of mathematical modelling.

@article{Saltelli2012WhatDI,
  title={What do I make of your Latinorum? Sensitivity auditing of mathematical modelling.},
  author={Andrea Saltelli and {\^A}ngela Guimar{\~a}es Pereira and Jeroen P. van der Sluijs and Silvio Funtowicz},
  journal={International Journal of Foresight and Innovation Policy},
  year={2012},
  volume={9},
  pages={213}
}
Sensitivity analysis, mandated by existing guidelines as a good practice to use in conjunction to mathematical modelling, is as such insufficient to ensure quality in the treatment of uncertainty of science for policy. If one accepts that policy-related science calls for an extension of the traditional internal, peer review-based methods of quality assurance to higher levels of supervision, where extended participation and explicit value judgments are necessary, then by the same token… Expand
Does modelling need a Reformation? Ideas for a new grammar of modelling
The quality of mathematical modelling is looked at from the perspective of science's own quality control arrangement and recent crises. It is argued that the crisis in the quality of modelling is atExpand
Is mathematical modelling an instrument of knowledge co-production?
TLDR
This work constructs a co-productive assessment framework by first retrieving criticisms targeted at expected utility theory in relation to its epistemic and ethical limits in dealing with ‘true’ uncertainty, and proposes an alternative ‘public’ space of calculation in which the conditions for co-production are set up on a pragmatic and moral account of rational expectations. Expand
What is wrong with evidence based policy, and how can it be improved?
TLDR
The solution implies abandoning dreams of prediction, control and optimization obtained by relying on a limited set of simplified narratives to define the problem and moving instead to an open exploration of a broader set of plausible and relevant stories. Expand
Why so many published sensitivity analyses are false: A systematic review of sensitivity analysis practices
TLDR
Results from a bibliometric analysis are used to show that many published sensitivity analysis methods fail the elementary requirement to properly explore the space of the input factors. Expand
The fallacy of evidence based policy
The use of science for policy is at the core of a perfect storm generated by the insurgence of several concurrent crises: of science, of trust, of sustainability. The modern positivistic model ofExpand
29. The NUSAP approach to uncertainty appraisal and communication
The knowledge base available for decision-making on contemporary environmental and sustainability issues is often characterised by an imperfect understanding of the complex systems involved.Expand
Using Uncertainty and Sensitivity Analyses in Socioecological Agent-Based Models to Improve Their Analytical Performance and Policy Relevance
TLDR
A simulation framework based on quantitative uncertainty and sensitivity analyses to build parsimonious ABMs that serve two purposes: exploration of the outcome space to simulate low-probability but high-consequence events that may have significant policy implications, and explanation of model behavior to describe the system with higher accuracy. Expand
The Future of Sensitivity Analysis: An essential discipline for systems modeling and policy support
TLDR
A multidisciplinary group of researchers and practitioners revisit the current status of Sensitivity analysis, and outline research challenges in regard to both theoretical frameworks and their applications to solve real-world problems. Expand
Variance-based sensitivity analysis: The quest for better estimators and designs between explorativity and economy
Abstract Variance-based sensitivity indices have established themselves as a reference among practitioners of sensitivity analysis of model outputs. A variance-based sensitivity analysis typicallyExpand
From sociology of quantification to ethics of quantification
Quantifications are produced by several disciplinary houses in a myriad of different styles. The concerns about unethical use of algorithms, unintended consequences of metrics, as well as the warningExpand
...
1
2
3
4
5
...

References

SHOWING 1-10 OF 82 REFERENCES
How to avoid a perfunctory sensitivity analysis
TLDR
A novel geometric proof of the inefficiency of OAT is introduced, with the purpose of providing the modeling community with a convincing and possibly definitive argument against OAT. Expand
Exploring the quality of evidence for complex and contested policy decisions
Policy decisions on complex environmental risks often involve contested science. Typically there are no 'facts' that entail a unique correct policy. The evidence that is embodied in scientific policyExpand
Uncertainty and sensitivity analysis techniques as tools for the quality assessment of composite indicators
TLDR
To what extent the use of uncertainty and sensitivity analysis may increase transparency or make policy inference more defensible by applying the methodology to a known composite indicator: the United Nations's technology achievement index is discussed. Expand
Sensitivity analysis didn't help. A practitioner's critique of the Stern review
Abstract The subject of this note is (a) the “Technical Annex to postscript” of the Stern review, which presents a sensitivity analysis (SA) addressing the conclusions of Stern review itself as wellExpand
Combining Quantitative and Qualitative Measures of Uncertainty in Model-Based Environmental Assessment: The Nusap System
TLDR
It is shown that extension of the pedigree scheme to include societal dimensions of uncertainty, such as problem framing and value-laden assumptions, further promotes reflexivity and collective learning and that NUSAP pedigree assessment has the potential to foster a deeper social debate and a negotiated management of complex environmental problems. Expand
Science for the post-normal age
In response to the challenges of policy issues of risk and the environment, a new type of science-‘post-normal’-is emerging. This is analysed in contrast to traditional problem-solving strategies,Expand
Models of Science and Policy
In this chapter we will focus on the role of science in the development and implementation of policy. Specifically, we will present and briefly discuss a number of conceptual models that describe theExpand
Probabilistic sensitivity analysis of complex models: a Bayesian approach
In many areas of science and technology, mathematical models are built to simulate complex real world phenomena. Such models are typically implemented in large computer programs and are also veryExpand
Global Sensitivity Analysis
TLDR
This paper demonstrates practical approaches for determining relative parameter sensitivity with respect to a model's optimal objective function value, decision variables, and other analytic functions of a solution. Expand
A method for the analysis of assumptions in model-based environmental assessments
TLDR
This method for the analysis of assumptions enables the analysts to make conscious, well-underpinned, transparent choices, and pinpoints the issues in the chain that are important to communicate to the audience of the assessment report. Expand
...
1
2
3
4
5
...