GSNs : Generative Stochastic Networks
@article{Alain2015GSNsG, title={GSNs : Generative Stochastic Networks}, author={G. Alain and Yoshua Bengio and L. Yao and J. Yosinski and Eric Thibodeau-Laufer and Saizheng Zhang and Pascal Vincent}, journal={ArXiv}, year={2015}, volume={abs/1503.05571} }
We introduce a novel training principle for generative probabilistic models that is an alternative to maximum likelihood. The proposed Generative Stochastic Networks (GSN) framework generalizes Denoising Auto-Encoders (DAE) and is based on learning the transition operator of a Markov chain whose stationary distribution estimates the data distribution. The transition distribution is a conditional distribution that generally involves a small move, so it has fewer dominant modes and is unimodal in… Expand
Figures, Tables, and Topics from this paper
29 Citations
Supervised kernel approach for automated learning using General Stochastic Networks
- Computer Science
- Eng. Appl. Artif. Intell.
- 2018
- 4
Generalization of iterative sampling in autoencoders
- Computer Science
- 2020 19th IEEE International Conference on Machine Learning and Applications (ICMLA)
- 2020
- Highly Influenced
- PDF
Generative Modeling by Estimating Gradients of the Data Distribution
- Computer Science, Mathematics
- NeurIPS
- 2019
- 107
- PDF
Discrete Object Generation with Reversible Inductive Construction
- Computer Science, Mathematics
- NeurIPS
- 2019
- 9
- PDF
Unregularized Auto-Encoder with Generative Adversarial Networks for Image Generation
- Computer Science
- ACM Multimedia
- 2018
- 5
Transportation analysis of denoising autoencoders: a novel method for analyzing deep neural networks
- Computer Science, Mathematics
- ArXiv
- 2017
- 4
- PDF
Learning robust features by extended generative stochastic networks
- Computer Science
- Int. J. Model. Simul. Sci. Comput.
- 2018
References
SHOWING 1-10 OF 81 REFERENCES
Deep Generative Stochastic Networks Trainable by Backprop
- Mathematics, Computer Science
- ICML
- 2014
- 317
- PDF
On the Equivalence between Deep NADE and Generative Stochastic Networks
- Computer Science, Mathematics
- ECML/PKDD
- 2014
- 8
- PDF
A Generative Process for sampling Contractive Auto-Encoders
- Computer Science, Mathematics
- ICML 2012
- 2012
- 65
Deep Unsupervised Learning using Nonequilibrium Thermodynamics
- Computer Science, Mathematics
- ICML
- 2015
- 126
- PDF