• Corpus ID: 10815590

Using Learned Predictions as Feedback to Improve Control and Communication with an Artificial Limb: Preliminary Findings

  title={Using Learned Predictions as Feedback to Improve Control and Communication with an Artificial Limb: Preliminary Findings},
  author={Adam S. R. Parker and Ann L. Edwards and Patrick M. Pilarski},
Many people suffer from the loss of a limb. Learning to get by without an arm or hand can be very challenging, and existing prostheses do not yet fulfil the needs of individuals with amputations. One promising solution is to provide greater communication between a prosthesis and its user. Towards this end, we present a simple machine learning interface to supplement the control of a robotic limb with feedback to the user about what the limb will be experiencing in the near future. A real-time… 

Figures from this paper

Exploring the Impact of Machine-Learned Predictions on Feedback from an Artificial Limb

A simple machine learning interface to supplement the control of a robotic limb with feedback to the user about what the limb will be experiencing in the near future, and demonstrates initial evidence that prediction learning and machine intelligence can benefit not just control, but also feedback from an artificial limb.

Machine learning and unlearning to autonomously switch between the functions of a myoelectric arm

The autonomous switching approach is described and it is demonstrated that it is able to both learn and subsequently unlearn to switch autonomously during ongoing use, a key requirement for maintaining human-centered shared control.

Adaptive and Autonomous Switching: Shared Control of Powered Prosthetic Arms Using Reinforcement Learning

This work advances an RL method termed adaptive switching for use during real time control of a prosthetic arm, and combines it with another machine learning control method, termed autonomous switching, to further decrease the number of manual switching interactions required of a user.

Communicative Capital for Prosthetic Agents

The hypothesis that assistive devices, and specifically artificial arms and hands, can and should be viewed as agents is developed and a new schema for interpreting the capacity of a human-machine collaboration as a function of both the human's and machine's degrees of agency is proposed.

Using artificial intelligence to improve the control of prosthetic legs

A wearable gait lab was developed consisting of a number of sensors attached to the limbs of eight volunteers and it was found that each individual needed different parameters to tune the features presented to the ANN.

Prosthetic Devices as Goal-Seeking Agents

The perspective that assistive devices, and specifically artificial arms and hands, may be beneficially viewed as goal-seeking agents is developed and it is suggested that taking this perspective enables more powerful interactions between human users and next generation prosthetic devices.

Learned human-agent decision-making, communication and joint action in a virtual reality environment

A virtual reality environment wherein a human and an agent can adapt their predictions, their actions, and their communication so as to pursue a simple foraging task is contributed and comparisons suggest the utility of studying human-machine coordination in avirtual reality environment, and identify further research that will expand the understanding of persistent human- machine joint action.



Adaptive artificial limbs: a real-time approach to prediction and anticipation

The research presents a new approach to acquiring and maintaining predictive knowledge during the online ongoing operation of an assistive robot and suggests that real-time learning of predictions and anticipations is a significant step toward more intuitive myoelectric prostheses and other assistive robotic devices.

Online human training of a myoelectric prosthesis controller via actor-critic reinforcement learning

To the authors' knowledge, this is the first my-oelectric control approach that facilitates the online learning of new amputee-specific motions based only on a one-dimensional (scalar) feedback signal provided by the user of the prosthesis.

Dynamic switching and real-time machine learning for improved human control of assistive biomedical robots

Preliminary results indicate that real-time machine learning, specifically online prediction and anticipation, may be an important tool for developing more robust and intuitive controllers for assistive biomedical robots.

Teachable robots: Understanding human teaching behavior to build more effective robot learners

Prediction Precedes Control in Motor Learning

Updates in Targeted Sensory Reinnervation for Upper Limb Amputation

Surgical approaches that have been used for sensory reinnervation in upper arm amputation are reviewed and the resultant outcomes and potential functional utility of the techniques are compared.

Electromyogram-based neural network control of transhumeral prostheses.

Evaluated the feasibility of predicting dynamic arm movements based on EMG signals from a set of muscles that would likely be intact in patients with transhumeral amputation by integrating a fully implanted electromyographic (EMG) recording system with a wireless telemetry system that communicates with the patient's prosthesis.

Multi-timescale nexting in a reinforcement learning robot

This paper presents results with a robot that learns to next in real time, making thousands of predictions about sensory input signals at timescales from 0.1 to 8 seconds, and extends nexting beyond simple timescale by letting the discount rate be a function of the state.

Myoelectric forearm prostheses: state of the art from a user-centered perspective.

Focus should be on validating EMG-sensing results with patients, improving simultaneous control of wrist movements and grasps, deriving optimal parameters for force and position feedback, and taking into account the psychophysical aspects of feedback, such as intensity perception and spatial acuity.

Sensory feedback in upper limb prosthetics

This paper presents an overview of the principal works and devices employed to provide upper limb amputees with sensory feedback and the principal features, advantages and disadvantages of the different methods are presented.