Fast training of recurrent networks based on the EM algorithm

@article{Ma1998FastTO,
  title={Fast training of recurrent networks based on the EM algorithm},
  author={Sheng-Fei Ma and C. Ji},
  journal={IEEE transactions on neural networks},
  year={1998},
  volume={9 1},
  pages={
          11-26
        }
}
  • Sheng-Fei Ma, C. Ji
  • Published 1998
  • Mathematics, Medicine, Computer Science
  • IEEE transactions on neural networks
In this work, a probabilistic model is established for recurrent networks. The expectation-maximization (EM) algorithm is then applied to derive a new fast training algorithm for recurrent networks through mean-field approximation. This new algorithm converts training a complicated recurrent network into training an array of individual feedforward neurons. These neurons are then trained via a linear weighted regression algorithm. The training time has been improved by five to 15 times on… Expand
A learning algorithm for recurrent neural networks and its application to nonlinear identification
  • Y. Yamamoto, P. Nikiforuk
  • Computer Science
  • Proceedings of the 1999 IEEE International Symposium on Computer Aided Control System Design (Cat. No.99TH8404)
  • 1999
New results on recurrent network training: unifying the algorithms and accelerating convergence
  • A. Atiya, A. Parlos
  • Computer Science, Medicine
  • IEEE Trans. Neural Networks Learn. Syst.
  • 2000
A new EM-based training algorithm for RBF networks
Improving Generalization Capabilities of Dynamic Neural Networks
A new supervised learning algorithm for multilayered and interconnected neural networks
...
1
2
3
4
...

References

SHOWING 1-10 OF 44 REFERENCES
An Efficient EM-based Training Algorithm for Feedforward Neural Networks
The problem of learning long-term dependencies in recurrent networks
Hierarchical Mixtures of Experts and the EM Algorithm
A Cost Function for Internal Representations
A statistical approach to learning and generalization in layered neural networks
Introduction to the theory of neural computation
...
1
2
3
4
5
...