Self-Supervised Masked Convolutional Transformer Block for Anomaly Detection

@article{Madan2022SelfSupervisedMC,
  title={Self-Supervised Masked Convolutional Transformer Block for Anomaly Detection},
  author={Neelu Madan and Nicolae-Catalin Ristea and Radu Tudor Ionescu and Kamal Nasrollahi and Fahad Shahbaz Khan and Thomas Baltzer Moeslund and Mubarak Shah},
  journal={ArXiv},
  year={2022},
  volume={abs/2209.12148}
}
—Anomaly detection has recently gained increasing attention in the field of computer vision, likely due to its broad set of applications ranging from product fault detection on industrial production lines and impending event detection in video surveillance to finding lesions in medical scans. Regardless of the domain, anomaly detection is typically framed as a one-class classification task, where the learning is conducted on normal examples only. An entire family of successful anomaly detection… 
[PDF] Semantic Reader
6 Citations
Background Citations
1
Methods Citations
2
Results Citations
2

6 Citations

Deep Industrial Image Anomaly Detection: A Survey

This paper provides a comprehensive review of deep learning-based image anomaly detection techniques, from the perspectives of neural network architectures, levels of supervision, loss functions, metrics and datasets.

Deep Visual Anomaly Detection in Industrial Manufacturing: A Survey

This paper provides a comprehensive review of deep learning-based visual anomaly detection techniques, from the perspectives of neural network architectures, levels of supervision, loss functions, metrics and datasets.

Lightning Fast Video Anomaly Detection via Adversarial Knowledge Distillation

A very fast frame-level model for anomaly detection in video, which learns to detect anomalies by distilling knowledge from multiple highly accurate object-level teacher models, which achieves the best trade-off between speed and accuracy.

Aerial Image Object Detection With Vision Transformer Detector (ViTDet)

The empirical study shows that ViTDet’s simple design achieves good performance on natural scene images and can be easily embedded into any detector architecture and that it achieves the competitive performance for oriented bounding box (OBB) object detection.

Improved Anomaly Detection by Using the Attention-Based Isolation Forest

A new modification of the isolation forest called the attention-based isolation forest (ABIForest) is proposed for solving the anomaly detection problem. It incorporates an attention mechanism in the…

Cluster-aware Contrastive Learning for Unsupervised Out-of-distribution Detection

Cluster-aware Contrastive Learning (CCL) framework for unsupervised OOD detection is proposed, which considers both instance-level and semantic-level information and design a cluster-aware contrastive loss function to enhance OOD discriminative ability.

References

SHOWING 1-10 OF 99 REFERENCES

Self-Supervised Predictive Convolutional Attentive Block for Anomaly Detection

The proposed self-supervised block is generic and can easily be incorporated into various state-of-the-art anomaly detection methods, providing empirical evidence that shows considerable performance improvements on MVTec AD, Avenue, and ShanghaiTech.

MVTec AD — A Comprehensive Real-World Dataset for Unsupervised Anomaly Detection

This work introduces the MVTec Anomaly Detection (MVTec AD) dataset containing 5354 high-resolution color images of different object and texture categories, and conducts a thorough evaluation of current state-of-the-art unsupervised anomaly detection methods based on deep architectures such as convolutional autoencoders, generative adversarial networks, and feature descriptors using pre-trained convolved neural networks.

CutPaste: Self-Supervised Learning for Anomaly Detection and Localization

This work proposes a two-stage framework for building anomaly detectors using normal training data only, which first learns self-supervised deep representations and then builds a generative one-class classifier on learned representations.

Anomaly Detection in Medical Imaging With Deep Perceptual Autoencoders

A new powerful method of image anomaly detection that relies on the classical autoencoder approach with a re-designed training pipeline to handle high-resolution, complex images, and a robust way of computing an image abnormality score is introduced.

Anomaly Detection Using Deep Learning Based Image Completion

Results on surface images of decorated plastic parts demonstrate that this one-class unsupervised learning on fault-free samples is suitable for detection of visible anomalies and moreover surpasses all other tested methods.

Learning Memory-Guided Normality for Anomaly Detection

This work proposes to use a memory module with a new update scheme where items in the memory record prototypical patterns of normal data, boosting the discriminative power of both memory items and deeply learned features from normal data and lessening the representation capacity of CNNs.

SSMTL++: Revisiting Self-Supervised Multi-Task Learning for Video Anomaly Detection

This work revisits the self-supervised multi-task learning framework for video anomaly detection, proposing several updates to the original method, and modernizes the 3D convolutional backbone by introducing multi-head self-attention modules, inspired by the recent success of vision transformers.

Anomaly Detection in Video via Self-Supervised and Multi-Task Learning

This paper is the first to approach anomalous event detection in video as a multi-task learning problem, integrating multiple self-supervised and knowledge distillation proxy tasks in a single architecture and outperforms the state-of-the-art methods on three benchmarks.

Fully Convolutional Neural Network for Fast Anomaly Detection in Crowded Scenes

Synthetic Temporal Anomaly Guided End-to-End Video Anomaly Detection

A temporal pseudo anomaly synthesizer that generates fake-anomalies using only normal data is proposed that will improve the basic AEs in achieving superiority against several existing state-of-the-art models.
...