Visual Saliency Based on Scale-Space Analysis in the Frequency Domain

@article{Li2013VisualSB,
  title={Visual Saliency Based on Scale-Space Analysis in the Frequency Domain},
  author={Jian Li and Martin D. Levine and Xiangjing An and Xin Xu and Hangen He},
  journal={IEEE Transactions on Pattern Analysis and Machine Intelligence},
  year={2013},
  volume={35},
  pages={996-1010}
}
  • Jian Li, M. Levine, +2 authors Hangen He
  • Published 2013
  • Mathematics, Computer Science, Medicine
  • IEEE Transactions on Pattern Analysis and Machine Intelligence
We address the issue of visual saliency from three perspectives. First, we consider saliency detection as a frequency domain analysis problem. Second, we achieve this by employing the concept of nonsaliency. Third, we simultaneously consider the detection of salient regions of different size. The paper proposes a new bottom-up paradigm for detecting visual saliency, characterized by a scale-space analysis of the amplitude spectrum of natural images. We show that the convolution of the image… Expand
Spectral saliency via automatic adaptive amplitude spectrum analysis
TLDR
The proposed method to detect visual saliency, especially with salient objects of different sizes and locations via automatic adaptive amplitude spectrum analysis, outperforms the existing state-of-the-art saliency models for predicting human eye fixations in terms of accuracy and robustness. Expand
Finding the Secret of Image Saliency in the Frequency Domain
TLDR
It is found that the secret of visual saliency may mainly hide in the phases of intermediate frequencies, and a novel approach to design the saliency detector under the assistance of prior knowledge obtained through both unsupervised and supervised learning processes is proposed. Expand
Visual saliency based on frequency domain analysis and spatial information
TLDR
Experimental results show that the proposed model can achieve high performance in terms of the average AUC and F-measure evaluation metrics and outperform state-of-the-art baselines. Expand
Modified Scale-Space Analysis in Frequency Domain Based on Adaptive Multiscale Gaussian Filter for Saliency Detection
TLDR
The adaptive multiscale Gaussian filter (MSS) for scale-space analysis in the frequency domain is proposed, extended from an adaptive median filter which is a powerful method to remove the noise from the input image. Expand
Visual Saliency Based on Two-Dimensional Fractional Fourier Transform
TLDR
A novel visual saliency model based on two-dimensional fractional Fourier transform generates a robust saliency map from the input image with Gaussian or salt-and-pepper noise and provides a concept called the noise sensitivity scale (NSS). Expand
Visual Saliency Detection of Stereoscopic 3D images based on Scale-Space Analysis
Visual saliency alludes to the particular fixation on prominent or significant regions in a scene that have likewise been appeared to relate with vital objects and their relationships. VisualExpand
A Multi-Scale Colour and Keypoint Density-Based Approach for Visual Saliency Detection
TLDR
This paper proposes a new saliency method based on the combination of the distribution of interest points in the image with multiscale analysis, a centre bias module and a machine learning approach, and uses perceptually uniform colour spaces to study how colour impacts on the extraction of saliency. Expand
Visual saliency detection via image complexity feature
TLDR
This paper constructs a heuristic framework to systematically combine two different types of saliency detection models, separately using local and global features, in order to predict human fixation points more accurately. Expand
A saliency-based approach to detection of infrared target
Automatic target detection in infrared images is a hot research field of national defense technology. We propose a new saliency-based infrared target detection model in this paper, which is based onExpand
Multi-Scale Amplitude Spectrum Substitution for Visual Saliency Detection
Saliency detection is among the fundamental issues in simulating human visual mechanism. In this paper, we propose a new framework called Amplitude Spectrum Substitution (ASS) to summarize typicalExpand
...
1
2
3
4
5
...

References

SHOWING 1-10 OF 52 REFERENCES
A Novel Multiresolution Spatiotemporal Saliency Detection Model and Its Applications in Image and Video Compression
TLDR
Extensive tests of videos, natural images, and psychological patterns show that the proposed PQFT model is more effective in saliency detection and can predict eye fixations better than other state-of-the-art models in previous literature. Expand
Saliency Detection: A Spectral Residual Approach
TLDR
A simple method for the visual saliency detection is presented, independent of features, categories, or other forms of prior knowledge of the objects, and a fast method to construct the corresponding saliency map in spatial domain is proposed. Expand
Bottom-up saliency is a discriminant process
  • D. Gao, N. Vasconcelos
  • Computer Science
  • 2007 IEEE 11th International Conference on Computer Vision
  • 2007
TLDR
The resulting saliency detector is shown to replicate the fundamental properties of the psychophysics of pre-attentive vision, including stimulus pop-out, inability to detect feature conjunctions, asymmetries with respect to feature presence vs. absence, and compliance with Weber's law. Expand
SUN: A Bayesian framework for saliency using natural statistics.
TLDR
In the model, saliency is computed locally, which is consistent with the neuroanatomy of the early visual system and results in an efficient algorithm with few free parameters, which provides a straightforward explanation for many search asymmetries observed in humans. Expand
Spatiotemporal Saliency in Dynamic Scenes
TLDR
The algorithm is inspired by biological mechanisms of motion-based perceptual grouping and extends a discriminant formulation of center-surround saliency previously proposed for static imagery, and yields a robust, versatile, and fully unsupervised spatiotemporal saliency algorithm, applicable to scenes with highly dynamic backgrounds and moving cameras. Expand
The discriminant center-surround hypothesis for bottom-up saliency
TLDR
In result, discriminant saliency is shown to predict eye fixations better than previous models, and produces background subtraction algorithms that outperform the state-of-the-art in computer vision. Expand
On the plausibility of the discriminant center-surround hypothesis for visual saliency.
TLDR
The discriminant saliency detectors outperform previously proposed methods from both the saliency and the general computer vision literatures and make accurate quantitative predictions of various psychophysics of human saliency for both static and motion stimuli. Expand
A Nonparametric Approach to Bottom-Up Visual Saliency
TLDR
The model is rather simplistic and essentially parameter-free, and contrasts recent developments in the field that usually aim at higher prediction rates at the cost of additional parameters and increasing model complexity, and in fact learns image features that resemble findings from several previous studies. Expand
Video processing with scale-aware saliency: Application to Frame Rate Up-Conversion
  • N. Jacobson, Truong Q. Nguyen
  • Computer Science
  • 2011 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP)
  • 2011
TLDR
The ability of the algorithm to detect salient objects at multiple scales allows for class-leading performance both objectively in terms of PSNR/SSIM as well as subjectively. Expand
Frequency-tuned salient region detection
TLDR
This paper introduces a method for salient region detection that outputs full resolution saliency maps with well-defined boundaries of salient objects that outperforms the five algorithms both on the ground-truth evaluation and on the segmentation task by achieving both higher precision and better recall. Expand
...
1
2
3
4
5
...