Recurrent Orthogonal Networks and Long-Memory Tasks


Although RNNs have been shown to be powerful tools for processing sequential data, finding architectures or optimization strategies that allow them to model very long term dependencies is still an active area of research. In this work, we carefully analyze two synthetic datasets originally outlined in (Hochreiter & Schmidhuber, 1997) which are used to… (More)

6 Figures and Tables


  • Presentations referencing similar topics