Video concept detection by audio-visual grouplets

@article{Jiang2012VideoCD,
  title={Video concept detection by audio-visual grouplets},
  author={Wei Jiang and Alexander C. Loui},
  journal={International Journal of Multimedia Information Retrieval},
  year={2012},
  volume={1},
  pages={223-238}
}
We investigate general concept classification in unconstrained videos by joint audio-visual analysis. An audio-visual grouplet (AVG) representation is proposed based on analyzing the statistical temporal audio-visual interactions. Each AVG contains a set of audio and visual codewords that are grouped together according to their strong temporal correlations in videos, and the AVG carries unique audio-visual cues to represent the video content. By using the entire AVGs as building elements, video… CONTINUE READING

Citations

Publications citing this paper.
SHOWING 1-4 OF 4 CITATIONS

Distributed cross-media multiple binary subspace learning

  • International Journal of Multimedia Information Retrieval
  • 2015
VIEW 1 EXCERPT
CITES BACKGROUND

Enhancing video concept detection with the use of tomographs

  • 2013 IEEE International Conference on Image Processing
  • 2013
VIEW 1 EXCERPT
CITES METHODS

References

Publications referenced by this paper.
SHOWING 1-10 OF 44 REFERENCES

Multimodal information fusion for video concept detection

  • 2004 International Conference on Image Processing, 2004. ICIP '04.
  • 2004
VIEW 4 EXCERPTS
HIGHLY INFLUENTIAL

Soundtrack classification by transient events

  • 2011 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP)
  • 2011
VIEW 3 EXCERPTS

Grouplet: A structured image representation for recognizing human and object interactions

  • 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition
  • 2010
VIEW 1 EXCERPT