Jullien Bouchet

Learn More
Although several real multimodal systems have been built, their development still remains a difficult task. In this paper we address this problem of development of multimodal interfaces by describing a component-based approach, called ICARE, for rapidly developing multimodal interfaces. ICARE stands for Interaction-CARE (Complementarity Assignment(More)
Multimodal interactive systems support multiple interaction techniques such as the synergistic use of speech, gesture and eye gaze tracking. The flexibility they offer results in an increased complexity that current software development tools do not address appropriately. In this paper we describe a component-based approach, called ICARE, for specifying and(More)
The area of multimodal interaction has expanded rapidly and since the seminal " Put that there " demonstrator of R. Bolt that combines speech, gesture and eye tracking, significant achievements have been made in terms of both modalities and real multimodal systems. Nevertheless the design and development of multimodal systems still remains a difficult task.(More)
The main characteristic of a mobile collaborative mixed system is that augmentation of the physical environment of one user occurs through available knowledge of where the user is and what the other users are doing. Links between the physical and digital worlds are no longer static but dynamically defined by users to create a collaborative augmented(More)
Multimodal interactive systems offer a flexibility of interaction that increases their complexity. ICARE is a component-based approach to specify and develop multimodal interfaces using a fusion mechanism in a modality independent way. ICARE being reused to produce several multimodal applications, we want to ensure the correctness of its fusion mechanism.(More)
In this paper we present a method for automatically testing interactive multimodal systems. The proposed approach was originally dedicated to synchronous programming which is mainly used for real-time systems. Nevertheless, the behaviour of real-time systems, consisting of cycles starting by reading an external input and ending by issuing an output, is to a(More)
This paper presents a method for automatically testing interactive multimodal systems. The method is based on the Lutess testing environment, originally dedicated to synchronous software specified using the Lustre language. The behaviour of synchronous systems, consisting of cycles starting by reading an external input and ending by issuing an output, is to(More)
RESUME Les applications mobiles et pervasives font intervenir de multiples techniques d'interaction combinant le plus souvent de façon synergique des modalités actives (parole, geste, etc.) et des modalités passives (direction du regard, position de l'utilisateur, etc.). De tels systèmes sont le résultat d'une conception et d'un développement de plus en(More)
The main characteristic of a mobile collaborative Mixed Reality (MR) system is that augmentation of the physical environment of one user occurs through available knowledge of where the user is and what the other users are doing. Links between the physical and digital worlds are no longer static but dynamically defined by users to create a collaborative(More)