A reranking approach for context-based concept fusion in video indexing and retrieval

Abstract

We propose to incorporate hundreds of pre-trained concept detectors to provide contextual information for improving the performance of multimodal video search. The approach takes initial search results from established video search methods (which typically are conservative in usage of concept detectors) and mines these results to discover and leverage co-occurrence patterns with detection results for hundreds of other concepts, thereby refining and reranking the initial video search result. We test the method on TRECVID 2005 and 2006 automatic video search tasks and find improvements in mean average precision (MAP) of 15%-30%. We also find that the method is adept at discovering contextual relationships that are unique to news stories occurring in the search set, which would be difficult or impossible to discover even if external training data were available.

DOI: 10.1145/1282280.1282331

Extracted Key Phrases

6 Figures and Tables

Statistics

0102020072008200920102011201220132014201520162017
Citations per Year

91 Citations

Semantic Scholar estimates that this publication has 91 citations based on the available data.

See our FAQ for additional information.

Cite this paper

@inproceedings{Kennedy2007ARA, title={A reranking approach for context-based concept fusion in video indexing and retrieval}, author={Lyndon S. Kennedy and Shih-Fu Chang}, booktitle={CIVR}, year={2007} }