A portable, self-contained neuroprosthetic hand with deep learning-based finger control

  title={A portable, self-contained neuroprosthetic hand with deep learning-based finger control},
  author={Anh Tuan Nguyen and Markus W. Drealan and Diu Khue Luu and Ming Jiang and Jian Xu and Jonathan Cheng and Qi Zhao and Edward W. Keefer and Zhi Yang},
  journal={Journal of Neural Engineering},
Objective. Deep learning-based neural decoders have emerged as the prominent approach to enable dexterous and intuitive control of neuroprosthetic hands. Yet few studies have materialized the use of deep learning in clinical settings due to its high computational requirements. Approach. Recent advancements of edge computing devices bring the potential to alleviate this problem. Here we present the implementation of a neuroprosthetic hand with embedded deep learning-based control. The neural… 

Development of FPGA-based deep learning orthosis actuating system using bio signal data

The 3D-printed hand orthosis for patients who has low motor function from the spinal cord injury (SCI) or stroke is developed, and the hand motion actuating system with Field-Programmable Gate Array (FPGA) using Electroencephalogram (EEG) and Electromyogram (EMG).

Instinctive Real-time sEMG-based Control of Prosthetic Hand with Reduced Data Acquisition and Embedded Deep Learning Training

It is shown in this paper that accurate results for embedded, instinctive, multi-grasp control can be achieved with only 2 low-cost sensors, a simple neural network, and minimal amount of training data.

Artificial Intelligence Enables Real-Time and Intuitive Control of Prostheses via Nerve Interface

This study demonstrates the potential of AI-enabled nerve technology, underling the next generation of dexterous and intuitive prosthetic hands.

Towards On-device Deep Neural Network Inference and Model Update for Real-time Gesture Classification

This study demonstrates the deployment of DNN on-device for real-time gesture classification inference using an optimized edge adaptive convolutional neural network using a short-time Fourier transform (STFT) spectrogram input.

Active upper limb prostheses: a review on current state and upcoming breakthroughs

The sources of input and feedback involved in the system control (at user-level and device-level), alongside the related algorithms used in signal analysis are defined to move the boundaries in prosthetic innovation beyond the development of a tool and toward the engineering of human-centered artificial limbs.

A Simplified Model of Motor Control

A heuristic model for motor control is proposed that conceptually and mathematically accounts for the entire motor process, from target to endpoint, and suggests a maximum threshold for delays in position feedback for effective movement.



A bioelectric neural interface towards intuitive prosthetic control for amputees

It is demonstrated that the information channel established by the proposed neural interface is sufficient to provide high accuracy control of a prosthetic hand up to 15 degrees of freedom (DOF) and is intuitive as it directly maps complex prosthesis movements to the patient’s true intention.

Deep Learning with Convolutional Neural Networks Applied to Electromyography Data: A Resource for the Classification of Movements for Prosthetic Hands

The results show that convolutional neural networks with a very simple architecture can produce accurate results comparable to the average classical classification methods, and show that several factors can be fundamental for the analysis of sEMG data.

The SmartHand transradial prosthesis

The SmartHand holds the promise to be experimentally fitted on transradial amputees and employed as a bi-directional instrument for investigating -during realistic experiments- different interfaces, control and feedback strategies in neuro-engineering studies.

A Deep Learning Framework for Decoding Motor Imagery Tasks of the Same Hand Using EEG Signals

This study presents a novel three-stage framework for decoding MI tasks associated with the same hand for able-bodied and transradial amputated subjects and demonstrates the efficacy of the proposed framework.

Inexpensive and Portable System for Dexterous High-Density Myoelectric Control of Multiarticulate Prostheses

This work developed an inexpensive and portable EMG control system by integrating low-cost microcontrollers with a six-channel surface EMG (sEMG) acquisition device that performs satisfactorily and highlights the practicality and efficiency of the modified Kalman filter for dexterous EMG-based control.

Online Myoelectric Control of a Dexterous Hand Prosthesis by Transradial Amputees

A real-time pattern recognition algorithm based on k-nearest neighbors and lazy learning was used to classify, voluntary EMG signals and to simultaneously control movements of a dexterous artificial hand and statistical analysis of the data revealed a difference in control accuracy based on the aetiology of amputation, type of prostheses regularly used and also between able-bodied participants and amputees.

Deep Learning Movement Intent Decoders Trained With Dataset Aggregation for Prosthetic Limb Control

The short-term and long-term performances of MLP- and CNN-based decoders trained with DAgger demonstrated their potential to provide more accurate and naturalistic control of prosthetic hands than alternate approaches.

Decoding EEG and LFP signals using deep learning: heading TrueNorth

Merging deep learning and TrueNorth technologies for real-time analysis of brain-activity data at the point of sensing will create the next generation of wearables at the intersection of neurobionics and artificial intelligence.

A recurrent neural network for closed-loop intracortical brain-machine interface decoders.

The ability of a simplified type of RNN, one with limited modifications to the internal weights called an echostate network (ESN), to effectively and continuously decode monkey reaches during a standard center-out reach task using a cortical brain–machine interface (BMI) in a closed loop is explored.

Selectivity and Longevity of Peripheral-Nerve and Machine Interfaces: A Review

This paper reviews the nerve-machine interface modalities with more focus on peripheral nerve interfaces, which are responsible for provision of sensory feedback and proposes a hybrid interface technique for achieving better selectivity and long-term stability using the available nerve interfacing techniques.