Corpus ID: 52910756

Extending Stan for Deep Probabilistic Programming

  title={Extending Stan for Deep Probabilistic Programming},
  author={Javier Burroni and Guillaume Baudart and Louis Mandel and Martin Hirzel and Avraham Shinnar},
Deep probabilistic programming combines deep neural networks (for automatic hierarchical representation learning) with probabilistic models (for principled handling of uncertainty). Unfortunately, it is difficult to write deep probabilistic models, because existing programming frameworks lack concise, high-level, and clean ways to express them. To ease this task, we extend Stan, a popular high-level probabilistic programming language, to use deep neural networks written in PyTorch. Training… Expand
Probabilistic Models with Deep Neural Networks
An overview of the main concepts, methods, and tools needed to use deep neural networks within a probabilistic modeling framework is provided. Expand
Ultrasound Nerve Segmentation Using Deep Probabilistic Programming
The Dice loss, accuracy, time consumption and output image quality in the results show the applicability of deep probabilistic programming in the long run, and a neuroscience decision support system is proposed based on the proposed approach. Expand
Yaps: Python Frontend to Stan
Yaps is introduced, a new frontend to Stan based on reinterpreted Python that can be accomplished by reinterpreting the Python syntax and tested on over a thousand Stan models and made it available open-source. Expand
Horse Racing Prediction using Deep Probabilistic Programming with Python and PyTorch ( Uber Pyro )
Faculty of Engineering Department of Computer Science and Engineering BEng degree in Computer Engineering Horse Racing Prediction using Deep Probabilistic Programming with Python and PyTorch (UberExpand


Deep Probabilistic Programming
Edward, a Turing-complete probabilistic programming language, is proposed, which makes it easy to fit the same model using a variety of composable inference methods, ranging from point estimation to variational inference to MCMC. Expand
Pyro: Deep Universal Probabilistic Programming
Pyro uses stochastic variational inference algorithms and probability distributions built on top of PyTorch, a modern GPU-accelerated deep learning framework to accommodate complex or model-specific algorithmic behavior. Expand
ZhuSuan: A Library for Bayesian Deep Learning
In this paper we introduce ZhuSuan, a python probabilistic programming library for Bayesian deep learning, which conjoins the complimentary advantages of Bayesian methods and deep learning. ZhuSuanExpand
Structured Inference Networks for Nonlinear State Space Models
A unified algorithm is introduced to efficiently learn a broad class of linear and non-linear state space models, including variants where the emission and transition distributions are modeled by deep neural networks. Expand
Stochastic Backpropagation and Approximate Inference in Deep Generative Models
We marry ideas from deep neural networks and approximate Bayesian inference to derive a generalised class of deep, directed generative models, endowed with a new algorithm for scalable inference andExpand
Auto-Encoding Variational Bayes
A stochastic variational inference and learning algorithm that scales to large datasets and, under some mild differentiability conditions, even works in the intractable case is introduced. Expand
Venture: a higher-order probabilistic programming platform with programmable inference
Stochastic regeneration linear runtime scaling in cases where many previous approaches scaled quadratically is shown, and how to use stochastic regeneration and the SPI to implement general-purpose inference strategies such as Metropolis-Hastings, Gibbs sampling, and blocked proposals based on particle Markov chain Monte Carlo and mean-field variational inference techniques are shown. Expand
Gen: a general-purpose probabilistic programming system with programmable inference
It is shown that Gen outperforms state-of-the-art probabilistic programming systems, sometimes by multiple orders of magnitude, on diverse problems including object tracking, estimating 3D body pose from a depth image, and inferring the structure of a time series. Expand
Probabilistic programming in Python using PyMC3
This paper is a tutorial-style introduction to PyMC3, a new open source Probabilistic Programming framework written in Python that uses Theano to compute gradients via automatic dierentiation as well as compile probabilistic programs on-the-fly to C for increased speed. Expand
Automated learning with a probabilistic programming language: Birch
A formal description of models expressed as programs is introduced, and some of the ways in which probabilistic programming languages can reveal the structure and form of these, in order to tailor inference methods are discussed. Expand