Audio Based Event Detection for Multimedia Surveillance

@article{Atrey2006AudioBE,
  title={Audio Based Event Detection for Multimedia Surveillance},
  author={Pradeep K. Atrey and Namunu Chinthaka Maddage and M. Kankanhalli},
  journal={2006 IEEE International Conference on Acoustics Speech and Signal Processing Proceedings},
  year={2006},
  volume={5},
  pages={V-V}
}
  • P. Atrey, N. Maddage, M. Kankanhalli
  • Published 14 May 2006
  • Computer Science
  • 2006 IEEE International Conference on Acoustics Speech and Signal Processing Proceedings
With the increasing use of audio sensors in surveillance and monitoring applications, event detection using audio streams has emerged as an important research problem. This paper presents a hierarchical approach for audio based event detection for surveillance. The proposed approach first classifies a given audio frame into vocal and nonvocal events, and then performs further classification into normal and excited events. We model the events using a Gaussian mixture model and optimize the… 

Figures and Tables from this paper

Events Detection for an Audio-Based Surveillance System
TLDR
The automatic shot detection system presented is based on a novelty detection approach which offers a solution to detect abnormality (abnormal audio events) in continuous audio recordings of public places and takes advantage of potential similarity between the acoustic signatures of the different types of weapons by building a hierarchical classification system.
Early event detection in audio streams
TLDR
An evaluation on the ITC-Irst database shows that the proposed system outperforms the best baseline system by 16% and 8% in terms of detection error rate and detection accuracy respectively.
Audio-Based Event Detection in Videos - a Comprehensive Survey
TLDR
This survey presents an exhaustive review of efforts in the past years to address the issues of using audio-based cues in video event detection and existing methods that are based on audio features and modeling techniques that have been used are summarized.
An Overview of Audio Event Detection Methods from Feature Extraction to Classification
TLDR
This work entails reviewing and categorizing existing AED schemes into preprocessing, feature extraction, and classification methods, and critically comparing audio detection methods and algorithms according to accuracy and false alarms using different types of datasets.
Comparison of Different Feature Types for Acoustic Event Detection System
TLDR
The aim was to automatically detect shots and sounds of breaking glass in different SNR conditions and to comparison of different feature extraction algorithms used for the parametric representation of the foreground and background sounds in a noisy environment.
Event classification for living environment surveillance using audio sensor networks
TLDR
This work first compares two classical acoustic features — the Fast Fourier Transform based acoustic features and the Mel-Frequency Cepstral Coefficient basedoustic features, and then presents a hierarchical classification approach for distinguishing abnormal or catastrophic events.
Audio Events Detection and classification using extended R-FCN Approach
TLDR
A new audio event detection and classification approach based on R-FCN—a state-of-the-art fully convolutional network framework for visual object detection that can output the positions of audio events directly which can input a two-dimensional representation of arbitrary length sound without any size regularization.
Consumer-level multimedia event detection through unsupervised audio signal modeling
TLDR
A novel acoustic characterization approach to multimedia event detection (MED) task for unconstrained and unstructured consumer-level videos through audio signal modeling that better accounts for temporal dependencies than previously proposed MFCC bag-of-word approaches.
Probabilistic Detection Methods for Acoustic Surveillance Using Audio Histograms
TLDR
Novel probabilistic detection methods using audio histograms for acoustic event detection in a multimedia surveillance environment using a cell phone-based alert system for an assisted living environment is discussed as a future scope of the proposed method.
...
...

References

SHOWING 1-6 OF 6 REFERENCES
Events Detection for an Audio-Based Surveillance System
TLDR
The automatic shot detection system presented is based on a novelty detection approach which offers a solution to detect abnormality (abnormal audio events) in continuous audio recordings of public places and takes advantage of potential similarity between the acoustic signatures of the different types of weapons by building a hierarchical classification system.
Automatic surveillance of the acoustic activity in our living environment
TLDR
An acoustic surveillance system comprised of a computer and microphone situated in a typical office environment that continuously analyzes the acoustic activity at the recording site, separates all interesting events, and stores them in a database is reported.
Automatic sound detection and recognition for noisy environment
TLDR
The detection algorithm, based on a median filter, features a highly robust performance even under important background noise conditions, and a rather good recognition rate can be reached, even under severe gaussian white noise degradations.
Timeline-based information assimilation in multimedia surveillance and monitoring systems
TLDR
A hierarchical probabilistic method for information assimilation in order to detect events of interest in a surveillance and monitoring environment and the experimental results show the utility of the method.
Content based music structure analysis, Ph.D. thesis, School of Computing, National University of Singapore
  • 2006
Content based music structure analysis
  • Content based music structure analysis
  • 2006