Learning State Space Trajectories in Recurrent Neural Networks
@article{Pearlmutter1989LearningSS,
title={Learning State Space Trajectories in Recurrent Neural Networks},
author={Barak A. Pearlmutter},
journal={Neural Computation},
year={1989},
volume={1},
pages={263-269}
}Many neural network learning procedures compute gradients of the errors on the output layer of units after they have settled to their final values. We describe a procedure for finding E/wij, where E is an error functional of the temporal trajectory of the states of a continuous recurrent network and wij are the weights of that network. Computing these quantities allows one to perform gradient descent in the weights to minimize E. Simulations in which networks are taught to move through limit… Expand
Topics from this paper
710 Citations
Generating network trajectories using gradient descent in state space
- Computer Science
- 1998 IEEE International Joint Conference on Neural Networks Proceedings. IEEE World Congress on Computational Intelligence (Cat. No.98CH36227)
- 1998
- 1
A simplex optimization approach for recurrent neural network training and for learning time-dependent trajectory patterns
- Computer Science
- IJCNN'99. International Joint Conference on Neural Networks. Proceedings (Cat. No.99CH36339)
- 1999
Initial state training procedure improves dynamic recurrent networks with time-dependent weights
- Mathematics, Computer Science
- IEEE Trans. Neural Networks
- 2001
- 3
Recurrent neural networks for temporal learning of time series
- Computer Science
- IEEE International Conference on Neural Networks
- 1993
- 1
A Learning Algorithm for Continually Running Fully Recurrent Neural Networks
- Computer Science
- Neural Computation
- 1989
- 3,447
A learning algorithm to teach spatiotemporal patterns to recurrent neural networks
- Computer Science
- Biological Cybernetics
- 2004
- 22
Learning scheme for recurrent neural network by genetic algorithm
- Computer Science
- Proceedings of 1993 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS '93)
- 1993
Recurrent Backpropagation and the Dynamical Approach to Adaptive Neural Computation
- Computer Science
- Neural Computation
- 1989
- 181
- PDF
Learning temporal patterns in recurrent neural networks
- Computer Science
- 1990 IEEE International Conference on Systems, Man, and Cybernetics Conference Proceedings
- 1990
- 7
References
SHOWING 1-10 OF 26 REFERENCES
A Learning Algorithm for Continually Running Fully Recurrent Neural Networks
- Computer Science
- Neural Computation
- 1989
- 3,447
- Highly Influential
Generalization of back-propagation to recurrent neural networks.
- Computer Science, Medicine
- Physical review letters
- 1987
- 867
Learning state space trajectories in recurrent neural networks : a preliminary report.
- Computer Science
- 1988
- 110
- PDF
Generalization of backpropagation with application to a recurrent gas market model
- Computer Science
- Neural Networks
- 1988
- 811
- PDF
Phoneme recognition using time-delay neural networks
- Computer Science
- IEEE Trans. Acoust. Speech Signal Process.
- 1989
- 2,626
- PDF