Experimental Evaluation of a Multi-modal User Interface for a Robotic Service

  title={Experimental Evaluation of a Multi-modal User Interface for a Robotic Service},
  author={Alessandro G. Di Nuovo and Ning Wang and Frank Broz and Tony Belpaeme and Ray Jones and Angelo Cangelosi},
This paper reports the experimental evaluation of a Multi-Modal User Interface (MMUI) designed to enhance the user experience in terms of service usability and to increase acceptability of assistive robot systems by elderly users. The MMUI system offers users two main modalities to send commands: they are a GUI, usually running on the tablet attached to the robot, and a SUI, with a wearable microphone on the user. The study involved fifteen participants, aged between 70 and 89 years old, who… 
The multi-modal interface of Robot-Era multi-robot services tailored for the elderly
The user-centred design and the experimental evaluation in realistic environments of a web-based multi-modal user interface tailored for elderly users of near future multi-robot services demonstrate positive evaluation of usability and willingness to use by elderly users.
Editorial: Language Development in the Digital Age
Questions and issues about the consequences of this new digital reality for children’s acquisition of the most fundamental of all human skills: language and communication can only be addressed by means of an interdisciplinary approach that aims at developing new methods of data collection and analysis in a longitudinal perspective.
Speech and Language in Humanoid Robots


A web based Multi-Modal Interface for elderly users of the Robot-Era multi-robot services
  • A. Nuovo, F. Broz, P. Dario
  • Computer Science
    2014 IEEE International Conference on Systems, Man, and Cybernetics (SMC)
  • 2014
The design and technical implementation of a web based Multi-Modal User Interface (MMUI) tailored for elderly users of the robotic services developed by the EU FP7 Large-Scale Integration Project Robot-Era is presented.
A User-Centric Design of Service Robots Speech Interface for the Elderly
The design and implementation of a user-centric speech interface incorporating the state of the art speech technologies, is fully integrated into application contexts and facilitates the actualization of the robotic services in different scenarios.
Touch and Speech: Multimodal Interaction for Elderly Persons
In order to evaluate the minutely developed multimodal interactive system, the touch and speech input modalities of the current system were evaluated by an elaborated experimental study with altogether 31 elderly and there is no significant evidence for one preferred modality.
User Acceptance of a Mobile LED Projector on a Socially Assistive Robot
A prototype of a LED projector module mounted on and carried by the humanoid robot NAO was iteratively developed in the KSERA project and could be shown that the novel solution of the mobile projector was well accepted bringing added value from the points of view of older persons as well as care experts.
Examples of multimodal user interfaces for socially assistive robots in Ambient Assisted Living environments
  • P. Mayer, C. Beck, P. Panek
  • Computer Science
    2012 IEEE 3rd International Conference on Cognitive Infocommunications (CogInfoCom)
  • 2012
Though the different projects specialise in diverse dedicated functionalities, the applied approaches regarding the MMUI were found to be very similar in the broad view.
Multimodal Robot Feedback for Eldercare *
This position paper describes the approach to the design of multimodal feedback for the Robot-Era project, including handheld devices as well as the robot itself, and discusses some of the unique challenges present in designing feedback for an elderly user population.
A Review of Mobile Robotic Telepresence
An overview of the various systems, application areas, and challenges found in the literature concerning mobile robotic telepresence is provided and a set terminology for the field is proposed as there is currently a lack of standard terms for the different concepts related to MRP systems.
Development of a Socially Believable Multi-Robot Solution from Town to Home
This paper aimed to present some technological aspects that have been faced to develop the Robot-Era system, a multi-robotic system that is able to act in a socially believable way in the environments daily inhabited by humans, such as urban areas, buildings and homes.
Talking About Task Progress: Towards Integrating Task Planning and Dialog for Assistive Robotic Services
A human-robot interaction experiment is presented investigating what type of feedback people prefer in verbal updates by a service robot about distributed assistive services, finding feedback about time until task completion more useful than feedback about events in task progress or no feedback.
Socially assistive robotics [Grand Challenges of Robotics]
Even as socially assistive robotic technology is still in its early stages of development, the next decade promises systems that will be used in hospitals, schools, and homes in therapeutic programs that monitor, encourage, and assist their users.