• Publications
  • Influence
System for augmented human–robot interaction through mixed reality and robot training by non-experts in customer service environments
TLDR
A complete robot system that has been given the highest evaluation score at the Customer Interaction Task of the Future Convenience Store Challenge at the World Robot Summit 2018 is presented, which implements several key technologies including a hierarchical spatial concepts formation for general robot task planning and a mixed reality interface to enable users to intuitively visualize the current state of the robot perception and naturally interact with it.
Autonomous planning based on spatial concepts to tidy up home environments with service robots
TLDR
A novel planning method that can efficiently estimate the order and positions of the objects to be tidied up by learning the parameters of a probabilistic generative model and develops an autonomous robotic system to perform the tidy-up operation.
Restock and straightening system for retail automation using compliant and mobile manipulation
TLDR
The proposed mobile manipulator features a custom-made end effector with compact and compliant design to safely and effectively manipulate products in retail stores to restock shelves, dispose expired products, and straighten products in Retail environments.
Vibration-Reducing End Effector for Automation of Drilling Tasks in Aircraft Manufacturing
In this letter, we present an end effector that can drill holes compliant to aeronautic standards while mounted on a lightweight robot arm. There is an unmet demand for a robotic solution capable of
Model-based approach for gaze estimation from corneal imaging using a single camera
TLDR
A method to estimate the gaze direction using cornea images captured by a single camera to develop wearable devices capable of obtaining natural user responses from eye movements and scene images reflected on the cornea is described.
SpCoMapGAN: Spatial Concept Formation-based Semantic Mapping with Generative Adversarial Networks
TLDR
This paper proposes SpCoMapGAN, which generates the semantic map in a newly visited environment by training an inference model using previously estimated semantic maps and uses generative adversarial networks (GANs) to transfer semantic information based on room arrangements to a newly visiting environment.
Adaptive motion generation using imitation learning and highly compliant end effector for autonomous cleaning
TLDR
This study proposes an end-to-end robotic framework to perform various tasks related to toilet cleanup, including the design of a complaint and multipurpose end-effector, an adaptive motion generation algorithm, and an autonomous mobile manipulator capable of garbage detection, garbage disposal and liquid removal.
Standing on Giant’s Shoulders: Newcomer’s Experience from the Amazon Robotics Challenge 2017
TLDR
This chapter reflects on the lessons learned from the participation in the Amazon Robotics Challenge 2017, which it is believed are valuable to future robot challenge participants, as well as warehouse automation system designers.
Teaching System for Multimodal Object Categorization by Human-Robot Interaction in Mixed Reality
As service robots are becoming essential to support aging societies, teaching them how to perform general service tasks is still a major challenge preventing their deployment in daily-life
Climbing on Giant’s Shoulders: Newcomer’s Road into the Amazon Robotics Challenge 2017
TLDR
The aim of this paper is to speed up development for those who come after and, as first-time contenders like us, have to develop a solution from zero.
...
...