Learn More
—We present the MuDiS project. The main goal of MuDiS is to develop a Multimodal Dialogue System that can be adapted quickly to a wide range of various scenarios. In this interdisciplinary project, we unite researchers from diverse areas, including computational linguistics, computer science, electrical engineering, and psychology. The different research(More)
— This paper presents a concept of a smart working environment designed to allow true joint-actions of humans and industrial robots. The proposed system perceives its environment with multiple sensor modalities and acts in it with an industrial robot manipulator to assemble capital goods together with a human worker. In combination with the reactive(More)
In this paper a concept and its implementation of an ergonomic cognitive assistant system for supporting human workers at complex assembly tasks in industrial environments is introduced. Depending on the level of the user's product knowledge this mixed-initiative system follows and gains knowledge from the human worker's construction steps while it is also(More)
Keywords: Adaptive control Hybrid assembly Instruction based learning Multi-modal interaction Worker surveillance a b s t r a c t Efficient cooperation of humans and industrial robots is based on a common understanding of the task as well as the perception and understanding of the partner's action in the next step. In this article, a hybrid assembly station(More)
In this paper, we present a novel approach for multimodal interactions between humans and industrial robots. The application scenario is situated in a factory, where a human worker is supported by a robot to accomplish a given hybrid assembly scenario, that covers manual and automated assembly steps. The robot is acting as an assistant as well as a fully(More)
This paper presents a system for another input modality in a multimodal human-machine interaction scenario. In addition to other common input modalities, e.g. speech, we extract head gestures by image interpretation techniques based on machine learning algorithms to have a nonverbal and familiar way of interacting with the system. Our experimental(More)
— This paper presents an overview about a programming concept for an industrial HRI cell designed for packaging of electronic consumer goods. The focus of this work lies on the interplay of the involved software components. Furthermore, developed methods for programming the software components of the HRI cell are described within a sample use case. Finally,(More)
In this paper we present our approach for a new contact-free Human-Machine Interface (cfHMI). This cfHMI is designed for controlling applications – instruction presentation, robot control – in the so-called " Cognitive Factory Scenario " , introduced in [1]. However, the interface can be applied in other environments and areas of application as well. Due to(More)
This paper presents a system for human-robot communication situated in an ambient assisted living scenario, where the robot performs an order-and-serve-procedure. The interaction is based on different modalities that extract information from the auditory and the visual channel in order to obtain an intuitive and natural dialog. The required interaction(More)