An Event-Related Potential-Based Adaptive Model for Telepresence Control of Humanoid Robot Motion in an Environment Cluttered With Obstacles

Abstract

This paper develops an event-related potential -based adaptive model for the control of humanoid robot movements in an environment with cluster obstacles based on live video feedback. This model adaptively determines the repetition number according to an individuals’ mental state to speed up the robot control cycle. N200 and P300 potential features increase in the frontal and occipital areas when using robot images as visual stimuli, so it is able to effectively recognize target visual stimuli by processing Fisher’s linear discriminant analysis and to identify a subject’s intention by using support vector machine, in parallel. The off-line evaluations show that, compared with a non-adaptive model, the adaptive model increases the accuracy rate from 88.8% to 92.9% a change of 4.1% and the information transfer rate from 41.3 bits/min to 46.3 bits/min a change of 5.0 bits/min. Eight subjects participated in telepresence controlling a NAO humanoid robot to move in an office environment with cluster obstacles. The successful maneuvers demonstrate that the brain-controlled humanoid robot can be applied for surveillance and exploration in unknown environments based on live video feedback, which are Manuscript received October 18, 2015; revised January 19, 2016; accepted January 22, 2016. Copyright (c) 2016 IEEE. Personal use of this material is permitted. However, permission to use this material for any other purposes must be obtained from the IEEE by sending a request to pubs-permissions@ieee.org. This work was supported in part by the National Natural Science Foundation of China under Grant 61473207, and in part by the State Key Laboratory of Robotics at Shenyang Institute of Automation under Grant 2014-Z03. M. Li is with the School of Electrical Engineering and Automation, Tianjin University, Tianjin 300072, China (e-mail: shelldream@tju.edu.cn). W. Li is with Shenyang Institute of Automation, Chinese Academy of Sciences, Shenyang 110016, China, with the School of Electrical Engineering and Automation, Tianjin University, Tianjin 300072, China, and also with the Department of Computer & Electrical Engineering and Computer Science, California State University, Bakersfield, California 93311, USA (corresponding author, e-mail: wli@csub.edu). L. Niu is with the Department of Math and Computer Science, West Virginia State University, Orangeburg , SC 29118, USA (lniu@wvstateu.edu) H. Zhou is with McGovern Institute for Brain Research, Massachusetts Institute of Technology, Cambridge, MA 02139, USA, and also with Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences, Shenzhen, Guangdong 518055, China (e-mail: zhouhuih@mit.edu). G. Chen is with Intelligent Fusion Technology, Germantown, MD 20876, USA (gchen@intfusiontech.com). F. Duan is with the Department of Automation and Intelligence Science, College of Computer and Control Engineering, Nankai University, Tianjin 300071, China (e-mail: duanf@nankai.edu.cn). evaluated by using the new metrics for the performance of the BRI system.

DOI: 10.1109/TIE.2016.2538740

8 Figures and Tables

Cite this paper

@article{Li2017AnEP, title={An Event-Related Potential-Based Adaptive Model for Telepresence Control of Humanoid Robot Motion in an Environment Cluttered With Obstacles}, author={Mengfan Li and Wei Li and Linwei Niu and Huihui Zhou and Genshe Chen and Feng Duan}, journal={IEEE Trans. Industrial Electronics}, year={2017}, volume={64}, pages={1696-1705} }