HDC-MiniROCKET: Explicit Time Encoding in Time Series Classification with Hyperdimensional Computing

@article{Schlegel2022HDCMiniROCKETET,
  title={HDC-MiniROCKET: Explicit Time Encoding in Time Series Classification with Hyperdimensional Computing},
  author={Kenny Schlegel and Peer Neubert and Peter Protzel},
  journal={2022 International Joint Conference on Neural Networks (IJCNN)},
  year={2022},
  pages={1-8}
}
Classification of time series data is an important task for many application domains. One of the best existing methods for this task, in terms of accuracy and computation time, is MiniROCKET. In this work, we extend this approach to provide better global temporal encodings using hyperdimensional computing (HDC) mechanisms. HDC (also known as Vector Symbolic Architectures, VSA) is a general method to explicitly represent and process information in high-dimensional vectors. It has previously been… 

Figures and Tables from this paper

A Survey on Hyperdimensional Computing aka Vector Symbolic Architectures, Part II: Applications, Cognitive Models, and Challenges

Existing applications, the role of HDC/VSA in cognitive computing and architectures, as well as directions for future work are surveyed, most of the applications lie within the Machine Learning/Artificial Intelligence domain, however, there are also other applications to provide a complete picture.

HyperSeed: Unsupervised Learning with Vector Symbolic Architectures

A novel unsupervised machine learning algorithm named Hyperseed that draws on the principles of vector symbolic architectures (VSAs) for fast learning of a topology preserving feature map of unlabeled data that relies on two major operations of VSA, binding and bundling.

Research on Seismic Signal Analysis Based on Machine Learning

A novel lightweight collaborative learning for seismic sensing signals (LCL-SSS) is proposed based on the method of feature extraction in MiniRocket combined with unsupervised classification, which gives new vitality to the un Supervised classification method that could not be used originally and opens up a new path for the unsuper supervised classification of seismic sensing signal.

Vector Symbolic Architectures as a Computing Framework for Emerging Hardware

It is demonstrated in this article that the field-like algebraic structure of VSA offers simple but powerful operations on high-dimensional vectors that can support all data structures and manipulations relevant to modern computing.

References

SHOWING 1-10 OF 38 REFERENCES

InceptionTime: Finding AlexNet for Time Series Classification

An important step towards finding the AlexNet network for TSC is taken by presenting InceptionTime---an ensemble of deep Convolutional Neural Network models, inspired by the Inception-v4 architecture, which outperforms HIVE-COTE's accuracy together with scalability.

MiniRocket: A Very Fast (Almost) Deterministic Transform for Time Series Classification

This work reformulates Rocket into a new method, MiniRocket, which is up to 75 times faster than Rocket on larger datasets, and almost deterministic (and optionally, fully deterministic), while maintaining essentially the same accuracy.

ROCKET: exceptionally fast and accurate time series classification using random convolutional kernels

This paper shows that simple linear classifiers using random convolutional kernels achieve state-of-the-art accuracy with a fraction of the computational expense of existing methods for time series classification.

TS-CHIEF: a scalable and accurate forest algorithm for time series classification

A novel TSC algorithm, TS-CHIEF (Time Series Combination of Heterogeneous and Integrated Embedding Forest), which rivals HIVE-COTE in accuracy but requires only a fraction of the runtime.

Multivariate Time Series Classification with WEASEL+MUSE

The novelty of WEASEL+MUSE lies in its specific way of extracting and filtering multivariate features from MTS by encoding context information into each feature, resulting in a small, yet very discriminative feature set useful for MTS classification.

The great multivariate time series classification bake off: a review and experimental evaluation of recent algorithmic advances

It is demonstrated that four classifiers are significantly more accurate than the benchmark dynamic time warping algorithm and that one of these recently proposed classifiers achieves significant improvement on the archive datasets in at least an order of magnitude less time than the other three.

Binary Shapelet Transform for Multiclass Time Series Classification

A one vs all encoding scheme is evaluated which simplifies the quality assessment calculations, speeds up the execution through facilitating more frequent early abandon and increases accuracy for multi-class problems.

The great time series classification bake off: a review and experimental evaluation of recent algorithmic advances

This work implemented 18 recently proposed algorithms in a common Java framework and compared them against two standard benchmark classifiers (and each other) by performing 100 resampling experiments on each of the 85 datasets, indicating that only nine of these algorithms are significantly more accurate than both benchmarks.

The BOSS is concerned with time series classification in the presence of noise

This model combines the extraction of substructures with the tolerance to extraneous and erroneous data using a noise reducing representation of the time series to improve classification accuracies in diverse application areas and on the official UCR classification benchmark datasets by a large margin.

A Survey on Hyperdimensional Computing aka Vector Symbolic Architectures, Part II: Applications, Cognitive Models, and Challenges

Existing applications, the role of HDC/VSA in cognitive computing and architectures, as well as directions for future work are surveyed, most of the applications lie within the Machine Learning/Artificial Intelligence domain, however, there are also other applications to provide a complete picture.