Corpus ID: 211076318

Self-Attentive Associative Memory

@article{Le2020SelfAttentiveAM,
  title={Self-Attentive Associative Memory},
  author={Hung T. Le and T. Tran and S. Venkatesh},
  journal={ArXiv},
  year={2020},
  volume={abs/2002.03519}
}
  • Hung T. Le, T. Tran, S. Venkatesh
  • Published 2020
  • Computer Science, Mathematics, Psychology
  • ArXiv
  • Heretofore, neural networks with external memory are restricted to single memory with lossy representations of memory interactions. A rich representation of relationships between memory pieces urges a high-order and segregated relational memory. In this paper, we propose to separate the storage of individual experiences (item memory) and their occurring relationships (relational memory). The idea is implemented through a novel Self-attentive Associative Memory (SAM) operator. Found upon outer… CONTINUE READING
    4 Citations

    Figures and Tables from this paper.

    H-Mem: Harnessing synaptic plasticity with Hebbian Memory Networks
    Learning Associative Inference Using Fast Weight Memory
    Neurocoder: Learning General-Purpose Computation Using Stored Neural Programs
    A Qualitative Evaluation of Language Models on Automatic Question-Answering for COVID-19
    • 1
    • PDF

    References

    SHOWING 1-10 OF 45 REFERENCES
    Relational recurrent neural networks
    • 94
    • Highly Influential
    • PDF
    Learning to Remember More with Less Memorization
    • 13
    • PDF
    Hybrid computing using a neural network with dynamic external memory
    • 886
    • Highly Influential
    • PDF
    Metalearned Neural Memory
    • 15
    • PDF
    Generalization Through the Recurrent Interaction of Episodic Memories
    • 190
    • PDF
    Neural Stored-program Memory
    • 7
    • PDF
    Working Memory for Conjunctions Relies on the Medial Temporal Lobe
    • 360
    • PDF