Making Sense of Indoor Spaces Using Semantic Web Mining and Situated Robot Perception

  title={Making Sense of Indoor Spaces Using Semantic Web Mining and Situated Robot Perception},
  author={Jay Young and Valerio Basile and Markus Suchi and Lars Kunze and Nick Hawes and Markus Vincze and Barbara Caputo},
Intelligent Autonomous Robots deployed in human environments must have understanding of the wide range of possible semantic identities associated with the spaces they inhabit – kitchens, living rooms, bathrooms, offices, garages, etc. We believe robots should learn this information through their own exploration and situated perception in order to uncover and exploit structure in their environments – structure that may not be apparent to human engineers, or that may emerge over time during a… 

SOMA : A Framework for Understanding Change in Everyday Environments Using Semantic Object Maps

A novel semantic mapping framework which maps locations of objects, regions of interest, and movements of people over time to allow robots to reason semantically, spatially, and temporally about their environment.

Semantic Localization of a Robot in a Real Home

This work uses images from five different residences to create a dataset with which the base model was trained and implements a methodology of recognition and scene learning in a real domestic environment.

Towards robust grasps: Using the environment semantics for robotic object affordances

The business problem that motivated the innovation, Kiva technology and the benefits it brought to customers, and the future of applications of robotics in warehouses are explained, as well as examples of the kinds of things that mobile robots can learn over long autonomous operations in such environments.

A Knowledge Retrieval Framework for Household Objects and Actions with External Knowledge

The framework provides knowledge about sequences of actions on how to perform human scaled tasks in a household environment, answers queries about household objects, and performs semantic matching between entities from the web knowledge graphs DBpedia, ConceptNet, and WordNet, with the ones existing in the authors' knowledge graph.

Knowledge Acquisition and Reasoning Systems for Service Robots: A Short Review of the State of the Art

  • P. K. PrasadW. Ertel
  • Computer Science
    2020 5th International Conference on Robotics and Automation Engineering (ICRAE)
  • 2020
This paper aims to deliver a review of the state of the art artificial intelligence approaches taken by researchers to enable robots to acquire and process knowledge of their environment and situation leading to robotic awareness by compiling the modern techniques used in this field.

Object-Action Association Extraction from Knowledge Graphs

This paper proposes a novel method for extracting and evaluating relations between objects and actions from knowledge graphs, such as ConceptNet and WordNet, taking into consideration semantic similarity methods.

Human-centric partitioning of the environment

An object based approach for human-centric partitioning of the environment that is autonomous, requires only a small set of perceptual data and does not even require people to be present while generating the regions.

Next-best-view planning for environment exploration and 3D model construction

This paper describes a next-best-view planning for a mobile robot with limited sensors capability to explore and construct a 3D model of an indoor environment and results confirm the effectiveness and validity of the proposed system.

A Review on Intelligent Object Perception Methods Combining Knowledge-based Reasoning and Machine Learning

This paper attempts a systematic investigation of how knowledge-based methods contribute to diverse object perception tasks.

Commonsense Reasoning with Argumentation for Cognitive Robotics

This thesis develops methods for enhancing the commonsense reasoning capabilities of a cognitive robotic system that acts in a household environment by developing argumentation frameworks that can facilitate commonsense knowledge.



Towards Lifelong Object Learning by Integrating Situated Robot Perception and Semantic Web Mining

By integrating situated robot perception and Semantic Web mining, robots can continuously extend their object knowledge beyond perceptual models which allows them to reason about task-related objects, and it is believed that the proposed system can be an essential component in a lifelong learning framework which acquires knowledge about objects from real world observations.

Bayesian space conceptualization and place classification for semantic maps in mobile robotics

Large-scale semantic mapping and reasoning with heterogeneous modalities

A probabilistic framework combining heterogeneous, uncertain, information such as object observations, shape, size, appearance of rooms and human input for semantic mapping that relies on the concept of spatial properties which make the semantic map more descriptive, and the system more scalable and better adapted for human interaction.

Autonomous Learning of Object Models on a Mobile Robot

This article presents and evaluates a system, which allows a mobile robot to autonomously detect, model, and re-recognize objects in everyday environments without human interaction, in normal indoor scenes.

Populating a Knowledge Base with Object-Location Relations Using Distributional Semantics

An approach to extract knowledge from large text corpora, in particular knowledge that facilitates object manipulation by embodied intelligent systems that need to act in the world by calculating relatedness scores for objects and locations using techniques from distributional semantics.

Meta-rooms: Building and maintaining long term spatial models in a dynamic world

A novel method for re-creating the static structure of cluttered office environments from multiple observations collected by an autonomous robot equipped with an RGB-D depth camera over extended periods of time is presented.

Dora , a Robot Exploiting Probabilistic Knowledge under Uncertain Sensing for Efficient Object Search

Dora demonstrates how to combine task and observation planning in the presence of uncertainty by autonomously switching between contingent and sequential planning sessions to exploit uncertain common-sense knowledge.

NASARI: a Novel Approach to a Semantically-Aware Representation of Items

A vector representation technique that combines the complementary knowledge of both lexicographic and encyclopedic resources, such as Wikipedia, and attains state-of-the-art performance on multiple datasets in two standard benchmarks: word similarity and sense clustering.

Deep Residual Learning for Image Recognition

This work presents a residual learning framework to ease the training of networks that are substantially deeper than those used previously, and provides comprehensive empirical evidence showing that these residual networks are easier to optimize, and can gain accuracy from considerably increased depth.