Evaluation campaigns and TRECVid

@inproceedings{Smeaton2006EvaluationCA,
  title={Evaluation campaigns and TRECVid},
  author={A. Smeaton and P. Over and Wessel Kraaij},
  booktitle={MIR '06},
  year={2006}
}
The TREC Video Retrieval Evaluation (TRECVid)is an international benchmarking activity to encourage research in video information retrieval by providing a large test collection, uniform scoring procedures, and a forum for organizations 1 interested in comparing their results. TRECVid completed its fifth annual cycle at the end of 2005 and in 2006 TRECVid will involve almost 70 research organizations, universities and other consortia. Throughout its existence, TRECVid has benchmarked both… Expand
The trecvid 2008 BBC rushes summarization evaluation
TLDR
An evaluation of automatic video summarization systems run on rushes from several BBC dramatic series indicated that while it was still difficult to exceed the performance of the baseline on including ground truth, the baseline was outperformed by most other systems with respect to avoiding redundancy/junk and presenting the summary with a pleasant tempo/rhythm. Expand
Creating a web-scale video collection for research
TLDR
This paper begins by considering a number of important design questions for a large-scale, widely available, multimedia test collection intended to support long-term scientific evaluation and comparison of content-based video analysis and exploitation systems and reports on the progress in creating such a multimedia collection from publicly available Internet Archive videos with Creative Commons licenses. Expand
The ARGOS campaign: Evaluation of video analysis and indexing tools
TLDR
The type of tasks evaluated, the way the content set has been produced, metrics and tools developed for the evaluations and some of the results obtained at the end of the first phase are described. Expand
The MediaMill TRECVID 2006 Semantic Video Search Engine
TLDR
The 2008 edition of the TRECVID bench- mark has been the most successful MediaMill participation to date, resulting in the top ranking for both concept de- tection and interactive search, and a runner-up ranking for automatic retrieval. Expand
TRECVID 2007 Search Tasks by NUS-ICT
TLDR
The overall framework of the video search and retrieval for both automated and interactive system is shown, which focuses on designing a high performance feedback system, from which users can make use of several autofeedback and active learning functions to improve the retrieval performance. Expand
TREC Video Retrieval Evaluation : notebook papers and slides
In this paper we describe our TRECVID 2012 video retrieval experiments. The MediaMill team participated in four tasks: semantic indexing, multimedia event detection, multimedia event recounting andExpand
IRIM at TRECVID 2010 : Semantic Indexing and Instance Search
TLDR
The IRIM group is a consortium of French teams work- ing on Multimedia Indexing and Retrieval and its participation to the TRECVID 2011 se- mantic indexing and instance search tasks is described. Expand
Content-based video retrieval: Three example systems from TRECVid
TLDR
This article shows three exemplar systems which demonstrate the state of the art in interactive, content-based retrieval of video shots, and these three are just three of the more than 20 systems developed for the 2007 iteration of the annual TRECVid benchmarking activity. Expand
UvA-DARE ( Digital Academic Repository ) The MediaMill TRECVID 2008 semantic video search engine
In this paper we describe our TRECVID 2008 video retrieval experiments. The MediaMill team participated in three tasks: concept detection, automatic search, and interactive search. Rather thanExpand
Evaluation of Image Annotation Using Amazon Mechanical Turk in ImageCLEF
TLDR
In this article the evaluation of THESEUS core technologies within ImageCLEF is explained in detail and a special focus lies on the acquisition of ground truth data using MTurk. Expand
...
1
2
3
4
5
...

References

SHOWING 1-10 OF 40 REFERENCES
Successful approaches in the TREC video retrieval evaluations
TLDR
Interactive approaches have substantially outperformed all non-interactive approaches, with most systems relying heavily on the user's ability to refine queries and reject spurious answers. Expand
The Use and Utility of High-Level Semantic Features in Video Retrieval
TLDR
An investigation into the best interactive search submissions shows that for 29 pairs, topic performance would have improved had users had access to ideal classifiers for those features, and the benefits derive from generic features applied to generic topics, and in one case a specific feature applied to a specific topic. Expand
On the detection of semantic concepts at TRECVID
TLDR
Trends in the emerging concept detection systems, architectures and algorithms are studied and strategies that have yielded reasonable success, and challenges and gaps that lie ahead are analyzed. Expand
Towards a Standard Protocol for the Evaluation of Video-to-Shots Segmentation Algorithms
TLDR
A general framework to evaluate and compare several temporal video segmentation algorithms and some solutions to these problems are given in this study and are applied for evaluating different methods developed in various contexts. Expand
The Turn - Integration of Information Seeking and Retrieval in Context
TLDR
The Turn represents a wide-ranging perspective of IS&R by providing a novel unique research framework, covering both individual and social aspects of information behavior, including the generation, searching, retrieval and use of information. Expand
The Semantic Pathfinder: Using an Authoring Metaphor for Generic Multimedia Indexing
TLDR
The semantic pathfinder extracts semantic concepts from video by exploring different paths through three consecutive analysis steps, which derive from the observation that produced video is the result of an authoring-driven process. Expand
PAN-Uncovering Plagiarism , Authorship , and Social Software Misuse ImageCLEF 2013-Cross Language Image Annotation and Retrieval INEX-INitiative for the Evaluation of XML retrieval
23 26 September 2013 Valencia Spain The CLEF 2013 is next year’s edition of the popular CLEF campaign and workshop series which contributed to the systematic evaluation of information access systems,Expand
On the surplus value of semantic video analysis beyond the key frame
Typical semantic video analysis methods aim for classification of camera shots based on extracted features from a single keyframe only. In this paper, we sketch a video analysis scenario and evaluateExpand
Randomization, Bootstrap and Monte Carlo Methods in Biology
Preface to the Second Edition Preface to the First Edition Randomization The Idea of a Randomization Test Examples of Randomization Tests Aspects of Randomization Testing Raised by the ExamplesExpand
Introduction to the Special Issue on INEX
This special issue contains articles describing XML retrieval approaches developed and evaluated during the second year of INEX, the evaluation initiative for XML retrieval.
...
1
2
3
4
...