• Corpus ID: 1817849

Identification of Unmodeled Objects from Symbolic Descriptions

  title={Identification of Unmodeled Objects from Symbolic Descriptions},
  author={Andrea Baisero and Stefan Otte and P{\'e}ter Englert and Marc Toussaint},
Successful human-robot cooperation hinges on each agent's ability to process and exchange information about the shared environment and the task at hand. Human communication is primarily based on symbolic abstractions of object properties, rather than precise quantitative measures. A comprehensive robotic framework thus requires an integrated communication module which is able to establish a link and convert between perceptual and abstract information. The ability to interpret composite… 

Figures and Tables from this paper


Asking for Help Using Inverse Semantics
This work demonstrates an approach for enabling a robot to recover from failures by communicating its need for specific help to a human partner using natural language, and presents a novel inverse semantics algorithm for generating effective help requests.
Language Bootstrapping: Learning Word Meanings From Perception–Action Association
This work addresses the problem of bootstrapping language acquisition for an artificial system similarly to what is observed in experiments with human infants and shows that the robot is able to form useful word-to-meaning associations, even without considering grammatical structure in the learning process and in the presence of recognition errors.
“Look at this!” learning to guide visual saliency in human-robot interaction
This work trains a conditional random field to integrate features that reflect low-level visual saliency, the likelihood of salient objects, the probability that a given pixel is pointed at, and - if available - spoken information about the target object's visual appearance.
Describing objects by their attributes
This paper proposes to shift the goal of recognition from naming to describing, and introduces a novel feature selection method for learning attributes that generalize well across categories.
The Origins of Syntax in Visually Grounded Robotic Agents
Learning to detect unseen object classes by between-class attribute transfer
The experiments show that by using an attribute layer it is indeed possible to build a learning object detection system that does not require any training images of the target classes, and assembled a new large-scale dataset, “Animals with Attributes”, of over 30,000 animal images that match the 50 classes in Osherson's classic table of how strongly humans associate 85 semantic attributes with animal classes.
Newton methods for k-order Markov Constrained Motion Problems
This is a documentation of a framework for robot motion optimization that aims to draw on classical constrained optimization methods, especially by defining a very general class of robot motion problems while at the same time introducing abstractions that directly reflect the API of the source code.
Language games for autonomous robots
Language games both integrate the various activities required for dialogue and ground unknown words or phrases in a specific context, which helps constrain possible meanings.
Constructing and Sharing Perceptual Distinctions
The paper describes a mechanism whereby agents generate perceptual distinctions through a series of adaptive discrimination games and share these distinctions through adaptive language games. Results
ORK: Object Recognition Kitchen
  • ORK: Object Recognition Kitchen