Emergent Action Language on Real Robots

@inproceedings{Steels2012EmergentAL,
  title={Emergent Action Language on Real Robots},
  author={Luc L. Steels and Michael Spranger and Remi van Trijp and Sebastian H{\"o}fer and Manfred Hild},
  booktitle={Language Grounding in Robots},
  year={2012}
}
Almost all languages in the world have a way to formulate commands. Commands specify actions that the body should undertake (such as “stand up”), possibly involving other objects in the scene (such as “pick up the red block”). Action language involves various competences, in particular (i) the ability to perform an action and recognize which action has been performed by others (the so-called mirror problem), and (ii) the ability to identify which objects are to participate in the action (e.g… 

A Practical Guide to Studying Emergent Communication through Grounded Language Games

TLDR
A high-level robot interface that extends the Babel software system is introduced, presenting for the first time a toolkit that provides flexible modules for dealing with each subtask involved in running advanced grounded language game experiments.

The Talking Heads experiment

TLDR
The motivation, the cognitive mechanisms used by the agents, the various installations of the Talking Heads, the experimental results that were obtained, and the interaction with humans are described.

Real-Time Vision-Based Gesture Learning for Human-Robot Interaction in Social Humanoid Robotics

TLDR
The results obtained show that the chosen approach to real-time gesture learning is feasible and could be extended to more complex scenarios and further research should tackle refinement of the system and use it to apply in human-robot interaction scenario.

Developmental and Evolutionary Lexicon Acquisition in Cognitive Agents/Robots with Grounding Principle: A Short Review

TLDR
This review not only presents a survey of the methodologies and relevant computational cognitive agents or robotic models, but also highlights the advantages and progress of these approaches for the language grounding issue.

The development of a robust symbolic communication system for robots via embodied iterated imitation

TLDR
This research introduces multiple cycles of iterated imitation during which the symbols of the language evolve and adapt to the uncertainties in robots’ sensors and actuators and proposes as a model that explains how structural syntax emerges and evolves in a symbolic communication system.

Real-Time Vision-Based Learning for Human-Robot Interaction in Social Humanoid Robotics

TLDR
The research will focus on real-time learning paradigm and its application in social robotics and will provide information necessary for a social robot to infer emotional state of a human demonstrator.

The Embodied Crossmodal Self Forms Language and Interaction: A Computational Cognitive Review

TLDR
It is hypothesized that the development of computational models of the self are very appropriate for considering joint verbal and physical interaction and provide the substantial potential to foster the psychological and cognitive understanding of language grounding.

Evolution of combinatorial structure in learned forms through embodied iterated learning in a robot collective

TLDR
It is shown that shared chunks that consisted of similar movement sequences emerge in the learned forms, and as these emergent shared sequences can be learned with high accuracy, they cause a cumulative increase in the learnability of the collections.

Learning to Parse Grounded Language using Reservoir Computing

  • Xavier HinautMichael Spranger
  • Computer Science
    2019 Joint IEEE 9th International Conference on Development and Learning and Epigenetic Robotics (ICDL-EpiRob)
  • 2019
TLDR
This paper develops a model of Reservoir Computing called Reservoir Parser (ResPars) for learning to parse Natural Language from grounded data coming from humanoid robots and shows that ResPars is able to generalize on grounded compositional semantics by combining it with Incremental Recruitment Language.

Co-evolving Language and Social Structure Using a Genetic Algorithm

TLDR
Experimental work demonstrates that agents are able to build social structures that resembles real life social topologies, although the naming game might happen too rapid in respect to the evolving social structure, so the presented model is suited for further investigation of social, or other functional, traits that can influence language evolution.

References

SHOWING 1-10 OF 26 REFERENCES

The robot in the mirror

TLDR
Robots play a situated embodied language game called the Action Game in which they ask each other to perform bodily actions and establish and continuously adapt networks linking perception, body representation, action and language.

Emergent mirror systems for body language

This chapter investigates how a vocabulary for talking about body actions can emerge in a population of grounded autonomous agents instantiated as humanoid robots. The agents play a Posture Game

Grounding Language through Evolutionary Language Games

  • L. Steels
  • Computer Science
    Language Grounding in Robots
  • 2012
This chapter introduces a new experimental paradigm for studying issues in the grounding of language and robots, and the integration of all aspects of intelligence into a single system. The paradigm

Language Grounding in Robots

TLDR
A Perceptual System for Language Game Experiments and Grounded Internal Body Models for Communication for Communication.

Evolving Humanoid Behaviours for Language Games

TLDR
A modular approach to neural control is taken and is supported by a corresponding evolutionary algorithm, such that complete neural control networks are composed of specific functional units, the so called neuro-modules.

Fluid Construction Grammar on Real Robots

This chapter introduces very briefly the framework and tools for lexical and grammatical processing that have been used in the evolutionary language game experiments reported in this book. This

Force Dynamics in Language and Cognition

TLDR
Overall, force dynamics emerges as a fundamental notional system that structures conceptual material pertaining to force interaction in a common way across a linguistic range: the physical, psychological, social, inferential, discourse, and mental-model domains of reference and conception.

Intrinsic Motivation Systems for Autonomous Mental Development

TLDR
The mechanism of Intelligent Adaptive Curiosity is presented, an intrinsic motivation system which pushes a robot towards situations in which it maximizes its learning progress, thus permitting autonomous mental development.

The mirror-neuron system.

TLDR
A neurophysiological mechanism appears to play a fundamental role in both action understanding and imitation, and those properties specific to the human mirror-neuron system that might explain the human capacity to learn by imitation are stressed.