Emergent Action Language on Real Robots

  title={Emergent Action Language on Real Robots},
  author={Luc L. Steels and Michael Spranger and Remi van Trijp and Sebastian H{\"o}fer and Manfred Hild},
  booktitle={Language Grounding in Robots},
Almost all languages in the world have a way to formulate commands. Commands specify actions that the body should undertake (such as “stand up”), possibly involving other objects in the scene (such as “pick up the red block”). Action language involves various competences, in particular (i) the ability to perform an action and recognize which action has been performed by others (the so-called mirror problem), and (ii) the ability to identify which objects are to participate in the action (e.g… 

A Practical Guide to Studying Emergent Communication through Grounded Language Games

A high-level robot interface that extends the Babel software system is introduced, presenting for the first time a toolkit that provides flexible modules for dealing with each subtask involved in running advanced grounded language game experiments.

The Talking Heads experiment

The motivation, the cognitive mechanisms used by the agents, the various installations of the Talking Heads, the experimental results that were obtained, and the interaction with humans are described.

Real-Time Vision-Based Gesture Learning for Human-Robot Interaction in Social Humanoid Robotics

The results obtained show that the chosen approach to real-time gesture learning is feasible and could be extended to more complex scenarios and further research should tackle refinement of the system and use it to apply in human-robot interaction scenario.

The development of a robust symbolic communication system for robots via embodied iterated imitation

This research introduces multiple cycles of iterated imitation during which the symbols of the language evolve and adapt to the uncertainties in robots’ sensors and actuators and proposes as a model that explains how structural syntax emerges and evolves in a symbolic communication system.

Real-Time Vision-Based Learning for Human-Robot Interaction in Social Humanoid Robotics

The research will focus on real-time learning paradigm and its application in social robotics and will provide information necessary for a social robot to infer emotional state of a human demonstrator.

The Embodied Crossmodal Self Forms Language and Interaction: A Computational Cognitive Review

It is hypothesized that the development of computational models of the self are very appropriate for considering joint verbal and physical interaction and provide the substantial potential to foster the psychological and cognitive understanding of language grounding.

Evolution of combinatorial structure in learned forms through embodied iterated learning in a robot collective

It is shown that shared chunks that consisted of similar movement sequences emerge in the learned forms, and as these emergent shared sequences can be learned with high accuracy, they cause a cumulative increase in the learnability of the collections.

Co-evolving Language and Social Structure Using a Genetic Algorithm

Experimental work demonstrates that agents are able to build social structures that resembles real life social topologies, although the naming game might happen too rapid in respect to the evolving social structure, so the presented model is suited for further investigation of social, or other functional, traits that can influence language evolution.

Interactive natural language acquisition in a multi-modal recurrent neural architecture

A neurocognitively plausible model for embodied language acquisition from real-world interaction of a humanoid robot with its environment is proposed and features hierarchical concept abstraction, concept decomposition, multi-modal integration, and self-organisation of latent representations.

Myon, a New Humanoid

This chapter introduces the modular humanoid robot Myon, covering its mechatronical design, embedded low-level software, distributed processing architecture, and the complementary experimental



The robot in the mirror

Robots play a situated embodied language game called the Action Game in which they ask each other to perform bodily actions and establish and continuously adapt networks linking perception, body representation, action and language.

Emergent mirror systems for body language

This chapter investigates how a vocabulary for talking about body actions can emerge in a population of grounded autonomous agents instantiated as humanoid robots. The agents play a Posture Game

Grounding Language through Evolutionary Language Games

  • L. Steels
  • Computer Science
    Language Grounding in Robots
  • 2012
This chapter introduces a new experimental paradigm for studying issues in the grounding of language and robots, and the integration of all aspects of intelligence into a single system. The paradigm

Language Grounding in Robots

A Perceptual System for Language Game Experiments and Grounded Internal Body Models for Communication for Communication.

Evolving Humanoid Behaviours for Language Games

A modular approach to neural control is taken and is supported by a corresponding evolutionary algorithm, such that complete neural control networks are composed of specific functional units, the so called neuro-modules.

Can Body Language Shape Body Image?

If the robot has the capacity to ‘imagine’ the behavior of his own body through selfsimulation, he is better able to guess what action corresponds to a visual image produced by another robot and thus guess the meaning of an unknown word, leading to a significant speed-up in the way individual agents are able to coordinate visual categories, motor behaviors and language.

Fluid Construction Grammar on Real Robots

This chapter introduces very briefly the framework and tools for lexical and grammatical processing that have been used in the evolutionary language game experiments reported in this book. This

Force Dynamics in Language and Cognition

Overall, force dynamics emerges as a fundamental notional system that structures conceptual material pertaining to force interaction in a common way across a linguistic range: the physical, psychological, social, inferential, discourse, and mental-model domains of reference and conception.

The mirror-neuron system.

A neurophysiological mechanism appears to play a fundamental role in both action understanding and imitation, and those properties specific to the human mirror-neuron system that might explain the human capacity to learn by imitation are stressed.