Corpus ID: 195317051

Neural Stored-program Memory

@article{Le2020NeuralSM,
  title={Neural Stored-program Memory},
  author={Hung Le and T. Tran and S. Venkatesh},
  journal={ArXiv},
  year={2020},
  volume={abs/1906.08862}
}
  • Hung Le, T. Tran, S. Venkatesh
  • Published 2020
  • Computer Science, Mathematics
  • ArXiv
  • Neural networks powered with external memory simulate computer behaviors. These models, which use the memory to store data for a neural controller, can learn algorithms and other complex tasks. In this paper, we introduce a new memory to store weights for the controller, analogous to the stored-program memory in modern computer architectures. The proposed model, dubbed Neural Stored-program Memory, augments current memory-augmented neural networks, creating differentiable machines that can… CONTINUE READING
    7 Citations
    Neurocoder: Learning General-Purpose Computation Using Stored Neural Programs
    Distributed Memory based Self-Supervised Differentiable Neural Computer
    Self-Attentive Associative Memory
    • 4
    • PDF
    Self-Assttentive Associative Memory
    Neural Status Registers
    • 1
    • PDF

    References

    SHOWING 1-10 OF 37 REFERENCES
    Hybrid computing using a neural network with dynamic external memory
    • 888
    • Highly Influential
    • PDF
    Learning to Remember More with Less Memorization
    • 13
    • PDF
    Scaling Memory-Augmented Neural Networks with Sparse Reads and Writes
    • 97
    • PDF
    Gated Fast Weights for On-The-Fly Neural Program Generation
    • 14
    • PDF
    Neural Turing Machines
    • 1,319
    • Highly Influential
    • PDF
    Using Fast Weights to Attend to the Recent Past
    • 113
    • PDF
    On the Computational Power of Neural Nets
    • 756
    End-To-End Memory Networks
    • 1,566
    • PDF
    The Dynamics of Discrete-Time Computation, with Application to Recurrent Neural Networks and Finite State Machine Extraction
    • M. Casey
    • Computer Science, Medicine
    • Neural Computation
    • 1996
    • 203
    Dual Memory Neural Computer for Asynchronous Two-view Sequential Learning
    • 19
    • PDF