• Corpus ID: 6386302

Spatio-temporal Video Parsing for Abnormality Detection

  title={Spatio-temporal Video Parsing for Abnormality Detection},
  author={Borislav Antic and Bj{\"o}rn Ommer},
Abnormality detection in video poses particular challenges due to the infinite size of the class of all irregular objects and behaviors. Thus no (or by far not enough) abnormal training samples are available and we need to find abnormalities in test data without actually knowing what they are. Nevertheless, the prevailing concept of the field is to directly search for individual abnormal local patches or image regions independent of another. To address this problem, we propose a method for… 
Anomaly detection in video
Novel approaches for learning motion features and modelling normal spatio-temporal dynamics for anomaly detection using deep convolutional neural networks and a sequence-to-sequence encoder-decoder for prediction and reconstruction are presented.
Crowd Scene Analysis in Video Surveillance
A novel feature descriptor is proposed to encode regional optical flow features of video frames, where adaptive quantization and binarization of the feature code are employed to improve the discriminant ability of crowd motion patterns.
Perceptual Metric Learning for Video Anomaly Detection /Author=Ramachandra, Bharathkumar; Jones, Michael J.; Vatsavai, Ranga /CreationDate=April 17, 2021 /Subject=Artificial Intelligence, Computer Vision, Machine Learning
Perceptual Metric Learning for Video Anomaly Detection introduces a new approach to localize anomalies in surveillance video using a Siamese convolutional neural network to learn a metric between a pair of video patches (spatio-temporal regions of video).
Learning a distance function with a Siamese network to localize anomalies in videos
This work introduces a new approach to localize anomalies in surveillance video by using a Siamese convolutional neural network to learn a distance function between a pair of video patches (spatio-temporal regions of video).
Anomaly detection techniques in surveillance videos
  • Xiaoli Li, Z. Cai
  • Computer Science
    2016 9th International Congress on Image and Signal Processing, BioMedical Engineering and Informatics (CISP-BMEI)
  • 2016
The current improvement made toward video-based human abnormal activity detection and wide applications in various fields range from monitoring in public spaces to personal health rehabilitation are explained.
Street Scene: A new dataset and evaluation protocol for video anomaly detection
This paper introduces a large and varied new dataset called Street Scene, as well as two new evaluation criteria that provide a better estimate of how an algorithm will perform in practice.
Contextual Information Based Anomaly Detection for a Multi-Scene UAV Aerial Videos
A new UAV based multi-scene anomaly detection dataset is developed with frame-level annotations for the development of computer aided systems and a new inference strategy is proposed that utilizes few anomalous samples along with normal samples to identify better decision boundaries.
A Survey of Single-Scene Video Anomaly Detection
This article summarizes research trends on the topic of anomaly detection in video feeds of a single scene and categorizes and situates past research into an intuitive taxonomy, and provides a comprehensive comparison of the accuracy of many algorithms on standard test sets.


Video parsing for abnormality detection
A probabilistic model is presented that localizes abnormalities using statistical inference and outperforms the state-of-the-art to achieve a frame-based abnormality classification performance of 91% and the localization performance improves by 32% to 76%.
Detecting Irregularities in Images and in Video
  • Oren Boiman, M. Irani
  • Computer Science
    Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1
  • 2005
This work addresses the problem of detecting irregularities in visual data, e.g., detecting suspicious behaviors in video sequences, or identifying salient patterns in images, using a probabilistic graphical model.
Video anomaly detection based on local statistical aggregates
A key insight of the paper is that if anomalies are local optimal decision rules are local even when the nominal behavior exhibits global spatial and temporal statistical dependencies, this insight helps collapse the large ambient data dimension for detecting local anomalies.
Context-Aware Activity Recognition and Anomaly Detection in Video
A mathematical framework to jointly model related activities with both motion and context information for activity recognition and anomaly detection and demonstrates the benefit of joint modeling and recognition of activities in a wide-area scene and the effectiveness of the proposed method in anomaly detection.
Anomaly Detection and Localization in Crowded Scenes
The detection and localization of anomalous behaviors in crowded scenes is considered, and a joint detector of temporal and spatial anomalies is proposed. The proposed detector is based on a video
Learning object motion patterns for anomaly detection and improved object detection
The proposed method provides a new higher-level layer to the traditional surveillance pipeline for anomalous event detection and scene model feedback and successfully used the proposed scene model to detect local as well as global anomalies in object tracks.
Abnormality detection using low-level co-occurring events
Anomaly detection in crowded scenes
A novel framework for anomaly detection in crowded scenes is presented and the proposed representation is shown to outperform various state of the art anomaly detection techniques.
Sparse reconstruction cost for abnormal event detection
The method provides a unified solution to detect both local abnormal events and global abnormal events through a sparse reconstruction over the normal bases and extends it to support online abnormal event detection by updating the dictionary incrementally.
Detecting unusual activity in video
  • Hua Zhong, Jianbo Shi, M. Visontai
  • Computer Science
    Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004.
  • 2004
It is proved that an efficient, globally optimal algorithm exists for the co- embedding problem and an important sub-family of correspondence functions can be reduced to co-embedding prototypes and segments to N-D Euclidean space.