Unsupervised Learning in Recurrent Neural Networks ?

  title={Unsupervised Learning in Recurrent Neural Networks ?},
  author={Magdalena Klapper-Rybicka and Nicol N. Schraudolph and Juergen Schmidhuber},
While much work has been done on unsupervised learning in feedforward neural network architectures, its potential with (theoretically more powerful) recurrent networks and time-varying inputs has rarely been explored. Here we train Long Short-Term Memory (LSTM) recurrent networks to maximize two information-theoretic objectives for unsupervised learning: Binary Information Gain Optimization (BINGO) and Nonparametric Entropy Optimization (NEO). LSTM learns to discriminate different types of… CONTINUE READING
4 Extracted Citations
54 Extracted References
Similar Papers

Similar Papers

Loading similar papers…