Learning Stochastic Recurrent Networks

@article{Bayer2014LearningSR,
  title={Learning Stochastic Recurrent Networks},
  author={Justin Bayer and Christian Osendorfer},
  journal={CoRR},
  year={2014},
  volume={abs/1411.7610}
}
Leveraging advances in variational inference, we propose to enhance recurrent neural networks with latent variables, resulting in Stochastic Recurrent Networks (STORNs). The model i) can be trained with stochastic gradient methods, ii) allows structured and multi-modal conditionals at each time step, iii) features a reliable estimator of the marginal likelihood and iv) is a generalisation of deterministic recurrent neural networks. We evaluate the method on four polyphonic musical data sets and… CONTINUE READING

5 Figures & Tables

Topics

Statistics

020402015201620172018
Citations per Year

91 Citations

Semantic Scholar estimates that this publication has 91 citations based on the available data.

See our FAQ for additional information.