# Continuous Online Sequence Learning with an Unsupervised Neural Network Model

@article{Cui2016ContinuousOS, title={Continuous Online Sequence Learning with an Unsupervised Neural Network Model}, author={Yuwei Cui and Chetan Surpur and Subutai Ahmad and J. Hawkins}, journal={Neural Computation}, year={2016}, volume={28}, pages={2474-2504} }

The ability to recognize and predict temporal sequences of sensory inputs is vital for survival in natural environments. Based on many known properties of cortical neurons, hierarchical temporal memory (HTM) sequence memory recently has been proposed as a theoretical framework for sequence learning in the cortex. In this letter, we analyze properties of HTM sequence memory and apply it to sequence learning and prediction problems with streaming data. We show the model is able to continuously… Expand

#### Topics from this paper

#### 151 Citations

A comparative study of HTM and other neural network models for online sequence learning with streaming data

- Computer Science
- 2016 International Joint Conference on Neural Networks (IJCNN)
- 2016

Memorize-Generalize: An online algorithm for learning higher-order sequential structure with cloned Hidden Markov Models

- Computer Science
- 2019

Hierarchical temporal memory and recurrent neural networks for time series prediction: An empirical validation and reduction to multilayer perceptrons

- Computer Science
- Neurocomputing
- 2020

Hierarchical Temporal Memory Introducing Time Axis in Connection Segments

- Computer Science
- 2018 Joint 10th International Conference on Soft Computing and Intelligent Systems (SCIS) and 19th International Symposium on Advanced Intelligent Systems (ISIS)
- 2018

Using High-Order Prior Belief Predictions in Hierarchical Temporal Memory for Streaming Anomaly Detection

- Computer Science
- 2018

HTM-MAT: An online prediction software toolbox based on cortical machine learning algorithm

- Computer Science
- ArXiv
- 2017

Learning higher-order sequential structure with cloned HMMs

- Computer Science, Mathematics
- ArXiv
- 2019

Deviant Learning Algorithm: Learning Sparse Mismatch Representations through Time and Space

- Computer Science
- ArXiv
- 2016

#### References

SHOWING 1-10 OF 103 REFERENCES

A Critical Review of Recurrent Neural Networks for Sequence Learning

- Computer Science
- ArXiv
- 2015

Matching Recall and Storage in Sequence Learning with Spiking Neural Networks

- Medicine
- The Journal of Neuroscience
- 2013

A Fast and Accurate Online Sequential Learning Algorithm for Feedforward Networks

- Computer Science, Medicine
- IEEE Transactions on Neural Networks
- 2006

Supervised Learning in Spiking Neural Networks with ReSuMe: Sequence Learning, Classification, and Spike Shifting

- Psychology, Medicine
- Neural Computation
- 2010

A Mathematical Formalization of Hierarchical Temporal Memory’s Spatial Pooler

- Computer Science, Mathematics
- Front. Robot. AI
- 2017

A Learning Algorithm for Continually Running Fully Recurrent Neural Networks

- Computer Science
- Neural Computation
- 1989

Learned spatiotemporal sequence recognition and prediction in primary visual cortex

- Computer Science, Psychology
- Nature Neuroscience
- 2014