Corpus ID: 1607379

Firefly Monte Carlo: Exact MCMC with Subsets of Data

@inproceedings{Maclaurin2014FireflyMC,
  title={Firefly Monte Carlo: Exact MCMC with Subsets of Data},
  author={D. Maclaurin and R. Adams},
  booktitle={UAI},
  year={2014}
}
  • D. Maclaurin, R. Adams
  • Published in UAI 2014
  • Computer Science, Mathematics
  • Markov chain Monte Carlo (MCMC) is a popular tool for Bayesian inference. However, MCMC cannot be practically applied to large data sets because of the prohibitive cost of evaluating every likelihood term at every iteration. Here we present Firefly Monte Carlo (FlyMC) MCMC algorithm with auxiliary variables that only queries the likelihoods of a subset of the data at each iteration yet simulates from the exact posterior distribution. FlyMC is compatible with modern MCMC algorithms, and only… CONTINUE READING

    Figures, Tables, and Topics from this paper.

    Paper Mentions

    BLOG POST
    An Approximate MCMC Method for Convex Hulls
    Parallelizing MCMC with Random Partition Trees
    48
    Scalable Metropolis-Hastings for Exact Bayesian Inference with Large Datasets
    6
    Variational Consensus Monte Carlo
    34
    On Markov chain Monte Carlo methods for tall data
    144
    Speeding Up MCMC by Efficient Data Subsampling
    63
    Informed sub-sampling MCMC: approximate Bayesian inference for large datasets
    6
    Comparing consensus Monte Carlo strategies for distributed Bayesian computation
    11
    Merging MCMC Subposteriors through Gaussian-Process Approximations
    18

    References

    Publications referenced by this paper.
    SHOWING 1-10 OF 35 REFERENCES
    Towards scaling up Markov chain Monte Carlo: an adaptive subsampling approach
    142
    CODA: convergence diagnosis and output analysis for MCMC
    2186
    Austerity in MCMC Land: Cutting the Metropolis-Hastings Budget
    177
    The pseudo-marginal approach for efficient Monte Carlo computations
    613
    Bayesian Learning via Stochastic Gradient Langevin Dynamics
    1053
    Black Box Variational Inference
    604
    Stochastic variational inference
    1462
    Variational inference in nonconjugate models
    155
    Optimal scaling of discrete approximations to Langevin diffusions
    455