Corpus ID: 9994916

BackPropagation Through Time

  title={BackPropagation Through Time},
  author={Jiang Guo},
  • Jiang Guo
  • Published 2013
  • This report provides detailed description and necessary derivations for the BackPropagation Through Time (BPTT) algorithm. BPTT is often used to learn recurrent neural networks (RNN). Contrary to feed-forward neural networks, the RNN is characterized by the ability of encoding longer past information, thus very suitable for sequential models. The BPTT extends the ordinary BP algorithm to suit the recurrent neural architecture. 1 Basic Definitions For a two-layer feed-forward neural network, we… CONTINUE READING
    22 Citations

    Figures and Tables from this paper

    Suitable Recurrent Neural Network for Air Quality Prediction With Backpropagation Through Time
    Prediction of Li-Ion Battery State of Charge Using Multilayer Perceptron and Long Short-Term Memory Models
    • 17
    Multilayer Long Short-Term Memory (LSTM) Neural Networks in Time Series Analysis
    Fuel Price Prediction Using RNN


    Recurrent neural network based language model
    • 4,185
    • PDF
    Learning task-dependent distributed representations by backpropagation through structure
    • C. Goller, A. Küchler
    • Computer Science
    • Proceedings of International Conference on Neural Networks (ICNN'96)
    • 1996
    • 501
    • PDF