# Learning State Space Trajectories in Recurrent Neural Networks

@article{Pearlmutter1989LearningSS, title={Learning State Space Trajectories in Recurrent Neural Networks}, author={Barak A. Pearlmutter}, journal={Neural Computation}, year={1989}, volume={1}, pages={263-269} }

Many neural network learning procedures compute gradients of the errors on the output layer of units after they have settled to their final values. We describe a procedure for finding E/wij, where E is an error functional of the temporal trajectory of the states of a continuous recurrent network and wij are the weights of that network. Computing these quantities allows one to perform gradient descent in the weights to minimize E. Simulations in which networks are taught to move through limit… Expand

#### Topics from this paper

#### 710 Citations

Generating network trajectories using gradient descent in state space

- Computer Science
- 1998 IEEE International Joint Conference on Neural Networks Proceedings. IEEE World Congress on Computational Intelligence (Cat. No.98CH36227)
- 1998

1

A simplex optimization approach for recurrent neural network training and for learning time-dependent trajectory patterns

- Computer Science
- IJCNN'99. International Joint Conference on Neural Networks. Proceedings (Cat. No.99CH36339)
- 1999

Initial state training procedure improves dynamic recurrent networks with time-dependent weights

- Mathematics, Computer Science
- IEEE Trans. Neural Networks
- 2001

3

Recurrent neural networks for temporal learning of time series

- Computer Science
- IEEE International Conference on Neural Networks
- 1993

1

A Learning Algorithm for Continually Running Fully Recurrent Neural Networks

- Computer Science
- Neural Computation
- 1989

3,447

A learning algorithm to teach spatiotemporal patterns to recurrent neural networks

- Computer Science
- Biological Cybernetics
- 2004

22

Learning scheme for recurrent neural network by genetic algorithm

- Computer Science
- Proceedings of 1993 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS '93)
- 1993

Recurrent Backpropagation and the Dynamical Approach to Adaptive Neural Computation

- Computer Science
- Neural Computation
- 1989

181- PDF

Learning temporal patterns in recurrent neural networks

- Computer Science
- 1990 IEEE International Conference on Systems, Man, and Cybernetics Conference Proceedings
- 1990

7

#### References

SHOWING 1-10 OF 26 REFERENCES

A Learning Algorithm for Continually Running Fully Recurrent Neural Networks

- Computer Science
- Neural Computation
- 1989

3,447 Highly Influential

Generalization of back-propagation to recurrent neural networks.

- Computer Science, Medicine
- Physical review letters
- 1987

867

Learning state space trajectories in recurrent neural networks : a preliminary report.

- Computer Science
- 1988

110- PDF

Generalization of backpropagation with application to a recurrent gas market model

- Computer Science
- Neural Networks
- 1988

811- PDF

Phoneme recognition using time-delay neural networks

- Computer Science
- IEEE Trans. Acoust. Speech Signal Process.
- 1989

2,626- PDF