In this paper, a novel framework for description of rich media content is introduced. Firstly, the concept of 'content objects' is provided. Content objects are rich media presentations, enclosing different types of media, along with real-world information and user-related information. These highly complex presentations require a suitable description scheme… (More)
This paper presents some recent developments at DIST-InfoMus Lab on multimodal and cross-modal processing of multimedia data streams with a particular focus on interactive systems exploiting Tangible Acoustic Interfaces (TAIs). In our research multimodal and cross-modal algorithms are employed for enhancing the extraction and analysis of the expressive… (More)
The W3C's XML Schema has now become the accepted standard for validation of XML documents. However, schema validation only goes so far. Real world users of XML have found a need for validation beyond the structure and datatype validation provided by XML Schema, such as cross-field validation and real-time access to external data sources. Various mechanisms… (More)
In this paper, we report on work around the I-SEARCH EU (FP7 ICT STREP) project whose objective is the development of a multimodal search engine. We present the project's objectives, and detail the achieved results, amongst which a Rich Unified Content Description format.
In this paper, we report on work around the I-SEARCH EU (FP7 ICT STREP) project whose objective is the development of a multimodal search engine targeted at mobile and desktop devices. Each of these device classes has its specific hardware capabilities and set of supported features. In order to provide a common multimodal search experience across device… (More)
This paper presents a brief survey of currently ongoing research at DIST – InfoMus Lab on multimodal interfaces with a particular focus on Tangible Acoustic Interfaces (TAIs). A relevant aspect of our research is the multimodal analysis of the high-level expressive, emotional information, the involved non-verbal communication mechanisms, the role of such… (More)
The Mobile Orchestra Explorer paradigm enables active experience of prerecorded music: users can navigate and express themselves in a shared (physical or virtual) orchestra space, populated by the sections of a prerecorded music. The user moves in a room with his/her mobile phone in his/her hand: the music performed by the orchestra sections is rendered… (More)