Sensory substitution and the human–machine interface

@article{BachyRita2003SensorySA,
  title={Sensory substitution and the human–machine interface},
  author={Paul Bach-y-Rita and Stephen W. Kercel},
  journal={Trends in Cognitive Sciences},
  year={2003},
  volume={7},
  pages={541-546}
}
Recent advances in the instrumentation technology of sensory substitution have presented new opportunities to develop systems for compensation of sensory loss. In sensory substitution (e.g. of sight or vestibular function), information from an artificial receptor is coupled to the brain via a human-machine interface. The brain is able to use this information in place of that usually transmitted from an intact sense organ. Both auditory and tactile systems show promise for practical sensory… Expand

Paper Mentions

Interventional Clinical Trial
The purpose of this study is to evaluate the safety and efficacy of the BrainPort balance device in improving balance in people with balance deficits due to stroke.  
ConditionsCerebrovascular Accident
InterventionDevice
Interventional Clinical Trial
The purpose of this study is to assess the safety and efficacy of the BrainPort balance device in improving balance and gait as measured by clinically accepted standardized balance… Expand
ConditionsGait Disorders, Vestibular Diseases
InterventionDevice
Interventional Clinical Trial
The purpose of this study is to determine whether the BrainPort™ balance device is safe and effective in the treatment of balance disorders in patients with Bilateral Vestibular… Expand
ConditionsVestibular Disease
InterventionDevice
Substituting the Senses
Sensory substitution devices are a type of sensory prosthesis that (typically) convert visual stimuli transduced by a camera into tactile or auditory stimulation. They are designed to be used byExpand
Cognitive and brain mechanisms in sensory substitution of vision: a contribution to the study of human perception.
TLDR
This paper addresses some of the major questions raised by sensory substitution, demonstrates how the study of sensory substitution enhances the understanding of human perception and brain plasticity and provides an overview of rehabilitation potentialities. Expand
Beyond sensory substitution--learning the sixth sense.
TLDR
The results indicate that the sensory information provided by the belt is processed and boosts performance, and if inconsistent with other sensory signals leads to variable performance, does interact with the vestibular nystagmus and in half of the experimental subjects leads to qualitative changes of sensory experience. Expand
Sensory Substitution Systems
Sensory substitution enables the experience of one sense through another one, mostly by using input from artificial modalities. Since the 1960’s, sensory substitution devices have been developed toExpand
Multisensory and spatial processes in sensory substitution.
  • M. Auvray
  • Psychology, Medicine
  • Restorative neurology and neuroscience
  • 2019
TLDR
The factors underlying the learning of sensory substitution devices, their adequacy to the target population, and ways of improving their design by the use of crossmodal correspondences and by taking into account individual differences in the used reference frames are focused on. Expand
Sensory Substitution and Augmentation - What's Happening "Under the Hood" in Our Brain
Sensory substitution devices (SSDs) are non-invasive human-machine interfaces which sense information via one modality and transform it into another, in which it is transmitted to the user. SSDs holdExpand
Other ways of seeing: From behavior to neural mechanisms in the online “visual” control of action with sensory substitution
TLDR
It appears that the use of sensory substitution devices utilizes the neural visual system; this suggests the hypothesis that sensory substitution draws on the same underlying mechanisms as unimpaired visual control of action. Expand
Sensory augmentation: integration of an auditory compass signal into human perception of space
TLDR
It is argued that it is the reliability of the magnetic signal that allows vestibular spatial recalibration, and the coding scheme mimicking sensorimotor contingencies of distal sounds that permits fast integration, and it is proposed that contingency-mimetic feedback has great potential for creating sensory augmentation devices that achieve fast and genuinely perceptual experiences. Expand
Neural Correlates of Sensory Substitution in Vestibular Pathways following Complete Vestibular Loss
TLDR
Together the results provide direct evidence that the substitution by extravestibular inputs in vestibular pathways provides a neural correlate for the improvements in gaze stability that are observed following the total loss of vestibul inputs. Expand
Bidirectional brain-computer interfaces.
TLDR
A bidirectional BCI is described, a system which translates neural signals recorded from the motor cortex into signals to control a device and provides somatosensory feedback by translating external sensor information to electric stimulation patterns delivered to the cortex. Expand
...
1
2
3
4
5
...

References

SHOWING 1-10 OF 59 REFERENCES
Sensori-"motor" coupling by observed and imagined movement
Sensory systems are associated with motor systems for perception. In the absence of motor control over the orientation of the sensory input, a person may have no idea from where the information isExpand
Brain–machine interfaces: computational demands and clinical needs meet basic neuroscience
TLDR
This review focuses on two challenges: establishing a 'closed loop' between sensory input and motor output and controlling neural plasticity to achieve the desired behavior of the brain-machine system. Expand
Closing an open-loop control system: vestibular substitution through the tongue.
TLDR
It is demonstrated that head-body postural coordination can be restored by means of vestibular substitution using a head-mounted accelerometer and a brain-machine interface that employs a unique pattern of electrotactile stimulation on the tongue. Expand
Brain plasticity: ‘visual’ acuity of blind persons via the tongue
The 'visual' acuity of blind persons perceiving information through a newly developed human-machine interface, with an array of electrical stimulators on the tongue, has been quantified using aExpand
A real-time experimental prototype for enhancement of vision rehabilitation using auditory substitution
TLDR
An experimental prototype based on a personal computer connected to a miniature head-fixed video camera and to headphones which has so far demonstrated prototype usefulness for pattern recognition and an integrated circuit of this system is to be developed. Expand
Vision Substitution by Tactile Image Projection
WE describe here a vision substitution system which is being developed as a practical aid for the blind and as a means of studying the processing of afferent information in the central nervousExpand
Auditory Coding of Visual Patterns for the Blind
Recognition tasks of simple visual patterns have been used to assess an early visual – auditory sensory-substitution system, consisting of the coupling of a rough model of the human retina with anExpand
Changes in occipital cortex activity in early blind humans using a sensory substitution device
TLDR
The metabolic recruitment of the occipital cortex in early blind subjects using a substitution prosthesis could reflect a concurrent stimulation of functional cross-modal sensory connections and could be interpreted as a prolonged plasticity in the occIPital cortex early deprived of visual afferences. Expand
Occipital Activation by Pattern Recognition in the Early Blind Using Auditory Substitution for Vision
TLDR
The results suggest that activity of the extrastriate visual cortex of early blind subjects can be modulated and bring additional evidence that early visual deprivation leads to cross-modal cerebral reorganization. Expand
A sensorimotor account of vision and visual consciousness.
TLDR
It is proposed that seeing is a way of acting, which provides a natural and principled way of accounting for visual consciousness, and for the differences in the perceived quality of sensory experience in the different sensory modalities. Expand
...
1
2
3
4
5
...