• Corpus ID: 245123729

Learn from Human Teams: a Probabilistic Solution to Real-Time Collaborative Robot Handling with Dynamic Gesture Commands

  title={Learn from Human Teams: a Probabilistic Solution to Real-Time Collaborative Robot Handling with Dynamic Gesture Commands},
  author={Rui Chen and Alvin C M Shek and Changliu Liu},
We study real-time collaborative robot (cobot) handling, where the cobot maneuvers a workpiece under human commands. This is useful when it is risky for humans to directly handle the workpiece. However, it is hard to make the cobot both easy to command and flexible in possible operations. In this work, we propose a Real-Time Collaborative Robot Handling (RTCoHand) framework that allows the control of cobot via user-customized dynamic gestures. This is hard due to variations among users, human… 


A human-centered approach to robot gesture based communication within collaborative working processes
This work identified gestures that are relevant for co-working tasks from human observations that were transferred to robotic systems of increasing abstraction and experimentally evaluated how well these gestures are recognized by humans.
Gesture recognition for human-robot collaboration: A review
Online Recognition of Incomplete Gesture Data to Interface Collaborative Robots
An HRI framework to classify large vocabularies of interwoven static gestures (SGs) and dynamic gestures (DGs) captured with wearable sensors and compares equally or favorably with different commonly used classifiers is introduced.
A multi-view hand gesture RGB-D dataset for human-robot interaction scenarios
A baseline evaluation of the Innsbruck Multi-View Hand Gesture (IMHG) dataset recorded with two RGB-D cameras is presented and a probabilistic appearance-based framework to detect a hand gesture and estimate its pose using two cameras is adopted.
Kinect-based robotic manipulation: From human hand to end-effector
This method enables an operator to control the end-effector easily with only one hand in actual real time and has been verified in the water-pouring tasks with a 5-DOFs modular manipulator.
OpenPose: Realtime Multi-Person 2D Pose Estimation Using Part Affinity Fields
OpenPose is released, the first open-source realtime system for multi-person 2D pose detection, including body, foot, hand, and facial keypoints, and the first combined body and foot keypoint detector, based on an internal annotated foot dataset.
Motion-Based Gesture Recognition Algorithms for Robot Manipulation
This paper provides an in-depth, unbiased comparison of different algorithms used to recognize gestures based primarily on the single 3D accelerometer recordings, and takes two of the most popular and arguably the best recognition methods currently in use and sets them against a relatively novel approach founded on distance metric learning.
Object position and orientation tracking for manipulators considering nonnegligible sensor physics
Real-time object tracking for manipulators has been applied to industrial automation such as assembly and human robot collaboration. During the tracking process, the vision sensor is used as a