Knowledge-Driven Video Information Retrieval with LOD: From Semi-Structured to Structured Video Metadata

  title={Knowledge-Driven Video Information Retrieval with LOD: From Semi-Structured to Structured Video Metadata},
  author={Leslie F. Sikos and David M. W. Powers},
  journal={Proceedings of the Eighth Workshop on Exploiting Semantic Annotations in Information Retrieval},
  • L. SikosD. Powers
  • Published 22 October 2015
  • Computer Science
  • Proceedings of the Eighth Workshop on Exploiting Semantic Annotations in Information Retrieval
In parallel with the tremendously increasing number of video contents on the Web, many technical specifications and standards have been introduced to store technical details and describe the content of, and add subtitles to, online videos. Some of these specifications are based on unstructured data with limited machine-processability, data reuse, and interoperability, while others are XML-based, representing semi-structured data. While low-level video features can be derived automatically, high… 

Tables from this paper

Ontology-Based Structured Video Annotation for Content-Based Video Retrieval via Spatiotemporal Reasoning

This work states that rule-based mechanisms are efficient in describing the temporal information of actions and video events and can be described in a machine-interpretable form using formal definitions from structured data resources.

RDF-powered semantic video annotation tools with concept mapping to Linked Data for next-generation video indexing: a comprehensive review

  • L. Sikos
  • Computer Science
    Multimedia Tools and Applications
  • 2016
A comprehensive review of video annotations tools generating structured data output for video clips, regions of interest, frames, and media fragments, with a focus on Linked Data support.

A Novel Approach to Multimedia Ontology Engineering for Automated Reasoning over Audiovisual LOD Datasets

VidOnt, the very first multimedia ontology with SROIQ(D) expressivity and a DL-safe ruleset has been introduced for next-generation multimedia reasoning, and best practices for developing multimedia ontologies are presented, based on my ontology engineering approach.

Utilizing multimedia ontologies in video scene interpretation via information fusion and automated reasoning

  • L. Sikos
  • Computer Science
    2017 Federated Conference on Computer Science and Information Systems (FedCSIS)
  • 2017
This paper presents an approach for combining multimedia ontologies for video scene representation, while taking into account the specificity of the scenes to describe, minimizing the number of ontologies, complying with standards, minimizing reasoning complexity, and whenever possible, maintaining decidability.

VidOnt: a core reference ontology for reasoning over video scenes*

  • L. Sikos
  • Computer Science
    J. Inf. Telecommun.
  • 2018
This paper describes a formally grounded core reference ontology for video representation, which addresses many of the issues and limitations of multimedia ontologies.

A semantic parliamentary multimedia approach for retrieval of video clips with content understanding

The results show how semantic enhancement is a key enabler for improved video retrieval on parliamentary multimedia content.

Spatiotemporal Reasoning for Complex Video Event Recognition in Content-Based Video Retrieval

A hybrid description logic-based architecture that employs general, spatial, temporal, and fuzzy axioms for video scene representation and automated reasoning-based scene interpretation, while achieving a favorable tradeoff between expressivity and reasoning complexity is presented.

V4Ann: Representation and Interlinking of Atom-Based Annotations of Digital Content

V4Ann is presented, an ontology-based framework for semantically representing, aggregating and combining annotations (atoms) coming from visual and textual analysis of digital content so as to facilitate the systematic process, integration and organisation of information and establish innovative value chains and end-user applications.

A novel ontology for 3D semantics: ontology-based 3D model indexing and content-based video retrieval applied to the medical domain

  • L. Sikos
  • Computer Science
    Int. J. Metadata Semant. Ontologies
  • 2017
This paper presents the most comprehensive formally grounded 3D ontology to date that maps the entire XSD-based vocabulary of the industry standard X3D to OWL 2, complemented by fundamental concepts and roles of the 3D modelling industry not covered by X3d.

Report on the Eighth Workshop on Exploiting Semantic Annotations in Information Retrieval (ESAIR '15)

An "annotations in action" track was dedicated to demonstrations that showcase innovative prototype systems, in addition to the regular research and position paper contributions, which featured invited talks from leaders in the field.



Semantic Annotation of Images and Videos for Multimedia Analysis

This paper uses M-OntoMat-Annotizer in order to construct ontologies that include prototypical instances of high-level domain concepts together with a formal specification of corresponding visual descriptors, allowing for new kinds of multimedia content analysis and reasoning.

Semantic Integration and Retrieval of Multimedia Metadata

This work has used the generated MPEG-7 OWL ontology as an “upper-ontology” for multimedia metadata, where three different music schemas have been linked and it has been possible to retrieve related information from instances of all the metadata sources.

Advanced (X) HTML5 Metadata and Semantics for Web 3.0 Videos

Certain metadata formats provide a high level of flexibility adequate to combine them with other vocabularies, making it possible to write truly sophisticated, machine-readable metadata for video components of the Social Semantic Web.

Enquiring MPEG-7 based multimedia ontologies

A systematic survey of the state of the art MPEG-7 based multimedia ontologies is presented, and issues that hinder interoperability as well as possible directions towards their harmonisation are highlighted.

Adding Multimedia to the Semantic Web: Building an MPEG-7 ontology

The trials and tribulations of building such an ontology represented in RDF Schema are described and it is demonstrated how this ontology can be exploited and reused by other communities on the semantic web to enable the inclusion and exchange of multimedia content through a common understanding of the associated MPEG-7 multimedia content descriptions.

Multimedia Data Management: Using Metadata to Integrate and Apply Digital Media

Multimedia Data Management takes the reader on an incisive and up-to-the-minute tour of metadata discoveries and clearly shows the reader areas waiting to be explored in the complex job of managing multimedia.

Overview on Using Metadata to manage Multimedia Data

This paper introduces the reader to the key role that metadata can play for managing various digital media, often also called new media, such as image, audio, and video in information systems. We

Integration of OWL Ontologies in MPEG-7 and TV-Anytime Compliant Semantic Indexing

The methodology and mechanisms presented here open up opportunities for reusing ontology tools and ontologies across a large number of applications (with or without audiovisual content) and across different professional and user communities.

Enrichment and Ranking of the YouTube Tag Space and Integration with the Linked Data Cloud

A framework for semantic enrichment, ranking and integration of web video tags using Semantic Web technologies is described and the resulting semantic tag space is modelled via a local graph based on co-occurrence distances for ranking.

Mastering Structured Data on the Semantic Web: From HTML5 Microdata to Linked Open Data

Mastering Structured Data on the Semantic Web demonstrates how to represent and connect structured data to reach a wider audience, encourage data reuse, and provide content that can be automatically processed with full certainty.