Machine-Vision-Based Human-Oriented Mobile Robots: A Review

  title={Machine-Vision-Based Human-Oriented Mobile Robots: A Review},
  author={Miha Fin{\vz}gar and Primoz Podrzaj},
  journal={Strojniski Vestnik-journal of Mechanical Engineering},
  • M. FinžgarP. Podrzaj
  • Published 8 May 2017
  • Computer Science
  • Strojniski Vestnik-journal of Mechanical Engineering
In this paper we present a study of vision-based, human-recognition solutions in human-oriented, mobile-robot applications. Human recognition is composed of detection, tracking and identification. Here, we provide an analysis of each step. The applied vision systems can be conventional 2D, stereo or omnidirectional. The camera sensor can be designed to detect light in the visible or infrared parts of the electromagnetic spectrum. Regardless of the method or the type of sensor chosen, the best… 

Figures and Tables from this paper

Smart Sensing and Adaptive Reasoning for Enabling Industrial Robots with Interactive Human-Robot Capabilities in Dynamic Environments—A Case Study

This work presents a case study in which a robotic manipulator, namely a KUKA KR90 R3100, is provided with smart sensing capabilities such as vision and adaptive reasoning for real-time collision avoidance and online path planning in dynamically-changing environments.

Real-Time Person Re-Identification for Mobile Robots to Improve Human-Robot Interaction

The proposed person re-identification system will enable assistive mobile robots to robustly and accurately identify their users, and is a preliminary step to improve trust and attain natural and personalized interaction between robots and patients.

Autonomous Bayesian escorting of a human integrating intention and obstacle avoidance

Experimental analysis shows that the incorporation of the proposed human intention model reduces human position prediction error by approximately 33% when turning, improving escorting accuracy by 50%.

Design and Implementation of Fuzzy PID Controller into Multi Agent Smart Library System Prototype

The paper compares the transient response and steady state error of each of controller and experimental results show that the Fuzzy-PID controller produced the best performance and good trajectory of robot from its current position to its target position.

Using Ontology as a Strategy for Modeling the Interface Between the Cognitive and Robotic Systems

This work contributes to the social robotics area by defining an architecture, called Cognitive Model Development Environment (CMDE) that models the interaction between cognitive and robotic systems and formalizes the definition of an ontology, called OntPercept, that model the perception of the environment using the information captured by the sensors present in the robotic system.

Nonlinear Control of a Flexible Joint Robotic Manipulator with Experimental Validation

The design and implementation of robust nonlinear control approaches to obtain the desired trajectory tracking of a flexible joint manipulator driven with a direct-current (DC) geared motor and results obtained from MATLAB/Simulink and the experimental platform verify the performance of the proposed control algorithms.

Influence of Video Delay on Quality, Presence, and Sickness in Viewport Adaptive Immersive Streaming

A viewport adaptive simulator is developed to render simultaneously two layers of immersive video to allow different adaptation schemes and delay values and shows a clear influence of the delay condition and the adaptation scheme on the perceived quality and a small influence on the sense of presence.

A Simulation Study for the Sustainability and Reduction of Waste in Warehouse Logistics

In this study, the authors have investigated warehouse processes to identify critical ones that are wasteful. The aim of this research study was to improve the efficiency of warehouse processes by

La eliminación de metales tóxicos presentes en efluentes líquidos mediante resinas de cambio iónico. Parte V: níquel(II))/H + /Dowex C400

The cationic exchange resin Dowex C400 was used to remove nickel(II) from aqueous solutions of different pH values and under various experimental conditions: stirring speed of the aqueous

Human-Leg Detection in 3D Feature Space for a Person-Following Mobile Robot Using 2D LiDARs

It is demonstrated that human legs can be detected with improved accuracy by learning the classification boundary in 3D feature space.



Human Detection from a Mobile Robot Using Fusion of Laser and Vision Information

A novel adaptive projection technique, which is based on a probabilistic formulation of the classifier performance, is introduced in the laser module, which enhances the generalization of the system, while at the same time, increasing the outdoor performance in comparison with current methods.

Vision‐based control of a line‐tracing mobile robot

A vision‐based control of a line‐tracing mobile robot is presented that makes it possible to implement a more advanced predictive control algorithm and an obstacle avoidance algorithm is presented.


This article presents a new approach to human detection and targeted person tracking by a mobile robot based on earlier methods that used stereo vision-based tracking linked directly with Hu moment-based detection, and implemented the tracking method before the Kalman filter-based estimation.


The supervisory control of the Person-Following Robot Platform is presented to enable mobile robot platform to recognize the person in indoor environment, and to localize it with accuracy high enough to allow adequate human-robot interaction.

Providing the basis for human-robot-interaction: a multi-modal attention system for a mobile robot

An attention system for a mobile robot which enables the robot to shift its attention to the person of interest and to maintain attention during interaction is presented.

Audio-visual multi-person tracking for active robot perception

  • Barış BayramG. Ince
  • Computer Science
    2015 IEEE/SICE International Symposium on System Integration (SII)
  • 2015
The aim of the successive motion modality is to enable a robot having intelligent and human-like behaviors by using the output from the sensor fusion framework and obstacle detection.

People recognition by mobile robots

In the proposed system, people are first detected with a thermal camera, using image analysis techniques to segment the persons in the thermal images, using an affine transformation to solve the image correspondence between the two cameras.

Stereo Vision-Based Human Tracking for Robotic Follower

A novel approach to combine stereo vision-based human detection with human tracking using a modified Kalman filter is presented to enable mobile robots to follow a human co-worker.

Computationally intelligent system for thermal vision people detection and tracking in robotic applications

A system for real-time robust segmentation of human in a thermal image used for supervisory control of mobile robot platform to recognize the person in indoor environment, and to localize it with accuracy high enough to allow adequate human-robot interaction.

RGB-D, Laser and Thermal Sensor Fusion for People following in a Mobile Robot

A multiple sensor fusion approach that combines three kinds of sensors in order to detect people using RGB-D vision, lasers and a thermal sensor mounted on a mobile platform and it is shown that the combination of different sensory cues increases the reliability of the people following system.