Non-linear regression models for Approximate Bayesian Computation

@article{Blum2010NonlinearRM,
  title={Non-linear regression models for Approximate Bayesian Computation},
  author={Michael G. B. Blum and Olivier François},
  journal={Statistics and Computing},
  year={2010},
  volume={20},
  pages={63-73}
}
Approximate Bayesian inference on the basis of summary statistics is well-suited to complex problems for which the likelihood is either mathematically or computationally intractable. However the methods that use rejection suffer from the curse of dimensionality when the number of summary statistics is increased. Here we propose a machine-learning approach to the estimation of the posterior density by introducing two innovations. The new method fits a nonlinear conditional heteroscedastic… 
Random Forest Adjustment for Approximate Bayesian Computation
TLDR
A novel method for regression adjustment in approximate Bayesian computation to help improve the accuracy and computational efficiency of the posterior inference is proposed and is capable of capturing the potential nonlinear relationship between the parameters of interest and summary statistics.
Approximate Bayesian computation
TLDR
An introduction to ABC is given, the approximation behaviour of ABC is described, some current challenges facing ABC methods are discussed and advice is provided on the successful implementation of ABC.
On the Asymptotic Efficiency of Approximate Bayesian Computation Estimators
TLDR
An iterative importance sampling algorithm is suggested that will be evaluated empirically on a stochastic volatility model and gives conditions on the importance sampling proposal distribution such that the variance of the estimator will be the same order as that of the maximum likelihood estimator based on the summary statistics used.
Piecewise Approximate Bayesian Computation: fast inference for discretely observed Markov models using a factorised posterior distribution
TLDR
This work proposes a new “piecewise” ABC approach suitable for discretely observed Markov models that involves writing the posterior density of the parameters as a product of factors, each a function of only a subset of the data, and then using ABC within each factor.
Approximate Bayesian Computation by Modelling Summary Statistics in a Quasi-likelihood Framework
TLDR
This work discusses an automatic proposal distribution useful for ABC-MCMC algorithms and is inspired by the theory of quasi-likelihood (QL) functions, which is obtained by modelling the distribution of the summary statistics as a function of the parameters.
Approximate Bayesian Computation: A Nonparametric Perspective
Approximate Bayesian Computation is a family of likelihood-free inference techniques that are well suited to models defined in terms of a stochastic generating mechanism. In a nutshell, Approximate
Fast Approximate Bayesian Computation for discretely observed Markov models using a factorised posterior distribution
TLDR
This work proposes a new "piecewise" ABC approach suitable for discretely observed Markov models that involves writing the posterior density of the parameters as a product of factors, each a function of only a subset of the data, and then using ABC within each factor.
Constructing summary statistics for approximate Bayesian computation: semi‐automatic approximate Bayesian computation
TLDR
This work shows how to construct appropriate summary statistics for ABC in a semi‐automatic manner, and shows that optimal summary statistics are the posterior means of the parameters.
Convergence Properties of Approximate Bayesian Computation
TLDR
Preliminary results for the asymptotic behaviour of the ABCLOC estimate are given, showing that it potentially has a faster asymPTotic rate of convergence than the basic versions of ABC for high-dimensional summary statistics.
...
...

References

SHOWING 1-10 OF 72 REFERENCES
Approximate Bayesian computation in population genetics.
TLDR
A key advantage of the method is that the nuisance parameters are automatically integrated out in the simulation step, so that the large numbers of nuisance parameters that arise in population genetics problems can be handled without difficulty.
Adaptive approximate Bayesian computation
TLDR
Sequential techniques can enhance the efficiency of the approximate Bayesian computation algorithm, as in Sisson et al.'s (2007) partial rejection control version, which compares favourably with two other versions of the approximation algorithm.
Approximate Bayesian computation scheme for parameter inference and model selection in dynamical systems
TLDR
This paper discusses and applies an ABC method based on sequential Monte Carlo (SMC) to estimate parameters of dynamical models and develops ABC SMC as a tool for model selection; given a range of different mathematical descriptions, it is able to choose the best model using the standard Bayesian model selection apparatus.
Bayesian Data Analysis
TLDR
Detailed notes on Bayesian Computation Basics of Markov Chain Simulation, Regression Models, and Asymptotic Theorems are provided.
Monte Carlo Methods of Inference for Implicit Statistical Models
TLDR
Methods of inference which can be used for implicit statistical models whose distribution theory is intractable are developed, and the kernel method of probability density estimation is advocated for estimating a log-likelihood from simulations of such a model.
Efficient Estimation of Conditional Variance Functions in Stochastic Regression
Conditional heteroscedasticity has been often used in modelling and understanding the variability of statistical data. Under a general setup which includes the nonlinear time series model as a
Approximate Bayesian Computation for epidemiological models: Application to the Cuban HIV-AIDS epidemic with contact-tracing and unobserved infectious population
TLDR
This paper applies the Approximate Bayesian Computation framework to calibrate an epidemiological model dedicated to the analysis of the HIV contact-tracing program in Cuba, and makes predictions concerning the efficiency of the detection system, and the evolution of the disease in the forthcoming years.
ABC likelihood-free methods for model choice in Gibbs random fields
TLDR
This paper shows in this paper how to implement an ABC algorithm geared towards model choice in the general setting of Gibbs random fields, demonstrating in particular that there exists a sufficient statistic across models.
Integration within the Felsenstein equation for improved Markov chain Monte Carlo methods in population genetics
  • J. HeyR. Nielsen
  • Mathematics
    Proceedings of the National Academy of Sciences
  • 2007
TLDR
An approach in which Markov chain Monte Carlo simulations are used to integrate over the space of genealogies, whereas other parameters are integrated out analytically, resulting in an approximation to the full joint posterior density of the model parameters.
Markov chain Monte Carlo without likelihoods
TLDR
A Markov chain Monte Carlo method for generating observations from a posterior distribution without the use of likelihoods is presented, which can be used in frequentist applications, in particular for maximum-likelihood estimation.
...
...