Autonomous planning based on spatial concepts to tidy up home environments with service robots

  title={Autonomous planning based on spatial concepts to tidy up home environments with service robots},
  author={Akira Taniguchi and Shota Isobe and Lotfi El Hafi and Yoshinobu Hagiwara and Tadahiro Taniguchi},
  journal={Advanced Robotics},
  pages={471 - 489}
ABSTRACT Tidy-up tasks by service robots in home environments are challenging in robotics applications because they involve various interactions with the environment. In particular, robots are required not only to grasp, move, and release various home objects but also to plan the order and positions for placing the objects. In this paper, we propose a novel planning method that can efficiently estimate the order and positions of the objects to be tidied up by learning the parameters of a… 
Towards the development of an intuitive teleoperation system for human support robot using a VR device
This paper implements a singularity robust inverse kinematics algorithm to achieve a coordinated whole-body motion of the robot for safe and intuitive operation and develops a Robot Operating System (ROS)-based control framework building on the software application programming interfaces (APIs).
Systematic Mapping Literature Review of Mobile Robotics Competitions
This paper presents a systematic mapping literature review about the mobile robotics competitions that took place over the last few decades in order to obtain an overview of the main objectives,
Software development environment for collaborative research workflow in robotic system integration
A containerized Software Development Environment (SDE) based on a collaborative workflow relying on open-source technologies for robotic system integration and deployment and shows that several research institutions successfully deployed it in multiple international competitions with various robotic platforms.
Housekeep: Tidying Virtual Households using Commonsense Reasoning
A modular baseline approach for Housekeep is proposed that lever-ages a fine-tuned large language model (LLM) trained on an internet text corpus for effective planning and shows that the baseline agent generalizes to rearranging unseen objects in unknown environments.
System and method of automatic collection of objects in the room
The developed software makes it possible to evaluate the implemented method’s effectiveness in a real-life system, including the small number of system components and an improved movement trajectory.
My House, My Rules: Learning Tidying Preferences with Graph Neural Networks
NatNet is presented: a novel Variational Autoencoder architecture using Graph Neural Network layers, which can extract a low-dimensional latent preference vector from a user by observing how they arrange scenes, and can generate an arrangement which is tailored to that user’s spatial preferences.
Semiotically adaptive cognition: toward the realization of remotely-operated service robots for the new normal symbiotic society
This paper argues that the development of semiotically adaptive cognitive systems is key to the installation of service robotics technologies in the authors' service environments and describes three challenges: the learning of local knowledge, the acceleration of onsite and online learning, and the augmentation of human–robot interactions.


Human-robot collaborative high-level control with application to rescue robotics
An approach for definition and execution of complex robot behaviors based on hierarchical state machines is presented, allowing to flexibly change the structure of behaviors on the fly during runtime through assistance of a remote operator.
An Everyday Robotic System that Maintains Local Rules Using Semantic Map Based on Long-Term Episodic Memory
A framework that lets robots record long-term episodic memories in their deployed environments, autonomously builds probabilistic object localization map as structurization of logged data and autonomously makes adapted task plans based on the map is developed.
A review of spatial reasoning and interaction for real-world robotics
This article presents a review of research in three major fields relevant for this discussion of spatial reasoning and interaction, and important approaches are outlined and relations between the fields are highlighted, and challenging applications as well as open problems are discussed.
Semantic mapping for mobile robotics tasks: A survey
Semantic Mapping Based on Spatial Concepts for Grounding Words Related to Places in Daily Environments
A novel statistical semantic mapping method called SpCoMapping is proposed, which integrates probabilistic spatial concept acquisition based on multimodal sensor information and a Markov random field applied for learning the arbitrary shape of a place on a map.
Development of Human Support Robot as the research platform of a domestic mobile manipulator
This paper describes HSR’s development background since 2006, and technical detail of hardware design and software architecture, and describes its omnidirectional mobile base using the dual-wheel caster-drive mechanism, which is the basis of HSR's operational movement and a novel whole body motion control system.
Which Robot Behavior Can Motivate Children to Tidy up Their Toys? Design and Evaluation of “Ranger”
This case study explores two different robot behaviors (proactive vs. reactive) and their impact on children’s interaction with the robot and the tidying behavior and shows that the proactive robot tended to encourage more playful and explorative behavior in children, whereas the reactive robot triggered more tidies behavior.
System for augmented human–robot interaction through mixed reality and robot training by non-experts in customer service environments
A complete robot system that has been given the highest evaluation score at the Customer Interaction Task of the Future Convenience Store Challenge at the World Robot Summit 2018 is presented, which implements several key technologies including a hierarchical spatial concepts formation for general robot task planning and a mixed reality interface to enable users to intuitively visualize the current state of the robot perception and naturally interact with it.
A flexible and scalable SLAM system with full 3D motion estimation
A system for fast online learning of occupancy grid maps requiring low computational resources is presented that combines a robust scan matching approach using a LIDAR system with a 3D attitude estimation system based on inertial sensing to achieve reliable localization and mapping capabilities in a variety of challenging environments.
OctoMap: an efficient probabilistic 3D mapping framework based on octrees
An open-source framework to generate volumetric 3D environment models based on octrees and uses probabilistic occupancy estimation that represents not only occupied space, but also free and unknown areas and an octree map compression method that keeps the 3D models compact.