Backpropagation-decorrelation: online recurrent learning with O(N) complexity

  title={Backpropagation-decorrelation: online recurrent learning with O(N) complexity},
  author={J. J. Steil},
  journal={2004 IEEE International Joint Conference on Neural Networks (IEEE Cat. No.04CH37541)},
  pages={843-848 vol.2}
We introduce a new learning rule for fully recurrent neural networks which we call backpropagation-decorrelation rule (BPDC). It combines important principles: one-step backpropagation of errors and the usage of temporal memory in the network dynamics by means of decorrelation of activations. The BPDC rule is derived and theoretically justified from regarding learning as a constraint optimization problem and applies uniformly in discrete and continuous time. It is very easy to implement, and… CONTINUE READING
Highly Influential
This paper has highly influenced 22 other papers. REVIEW HIGHLY INFLUENTIAL CITATIONS
Highly Cited
This paper has 329 citations. REVIEW CITATIONS


Publications citing this paper.

330 Citations

Citations per Year
Semantic Scholar estimates that this publication has 330 citations based on the available data.

See our FAQ for additional information.


Publications referenced by this paper.
Showing 1-10 of 24 references