Sequential Recurrent Neural Networks for Language Modeling

  title={Sequential Recurrent Neural Networks for Language Modeling},
  author={Youssef Oualil and Clayton Greenberg and Mittul Singh and Dietrich Klakow},
Feedforward Neural Network (FNN)-based language models estimate the probability of the next word based on the history of the last N words, whereas Recurrent Neural Networks (RNN) perform the same task based only on the last word and some context information that cycles in the network. This paper presents a novel approach, which bridges the gap between these… CONTINUE READING