A real-time experimental prototype for enhancement of vision rehabilitation using auditory substitution

@article{Capelle1998ARE,
  title={A real-time experimental prototype for enhancement of vision rehabilitation using auditory substitution},
  author={Christian Capelle and Charles Trullemans and Patricia Arno and Claude Veraart},
  journal={IEEE Transactions on Biomedical Engineering},
  year={1998},
  volume={45},
  pages={1279-1293}
}
The rehabilitation of blindness, using noninvasive methods, requires sensory substitution. A theoretical frame for sensory substitution has been proposed (C. Veraart, 1989) which consists of a model of the deprived sensory system connected to an inverse model of the substitutive sensory system. This paper addresses the feasibility of this conceptual model in the case of auditory substitution, and its implementation as a rough model of the retina connected to an inverse linear model of the… Expand
VBTones a visual to auditory device for the blind
Sensory substitution contains methods which send perceptible information of a sensory organ to the brain through other sensory modalities, resulting in the rehabilitation of the lost perception.Expand
Simulation of the Retina: a Tool for Visual prostheses
TLDR
This paper presents a biologically plausible model of the retina at the cell level and its implementation as a real-time retinal simulation software, which features the non-uniform sampling of the visual information by the photoreceptor cells, thenon-separable spatio-temporal properties ofThe retina, the subsequent generation of the Parvocellular and Magnocellular pathways, and the nonlinear equalization of luminance and contrast at the local level. Expand
Toward local and global perception modules for vision substitution
TLDR
The novelty is the simultaneous sonification of colour and depth, the last parameter being coded by sound rhythm in this work, which proposes to extend the local perception module by introducing a new global perception module aiming at providing the user with a clear picture of the entire scene characteristics. Expand
A perceptual interface for vision substitution in a color matching experiment
TLDR
This work verifies the hypothesis that sounds from musical instruments provide an alternative way to vision for obtaining color information from the environment and demonstrates that blindfolded individuals were able to accurately match pairs of colored socks. Expand
On the use of the auditory pathway to represent image scenes in real-time
TLDR
The system principles of design and several experiments that have been carried out by several blindfolded persons with See ColOr prototypes related to static pictures on a tablet and simple video images, including the pairing of colored socks and following a colored serpentine painted on the ground are presented. Expand
An audiodisplay tool for visually impaired people: the sound screen system
  • C. Liard, Azeddine Beghdadi
  • Computer Science
  • Proceedings of the Sixth International Symposium on Signal Processing and its Applications (Cat.No.01EX467)
  • 2001
TLDR
This contribution presents a flexible realtime system designed for vision rehabilitation using sensory substitution based on the auditive localization of virtual sound sources based on some findings in psychoacoustics obtained from actual experiments. Expand
The Vibe: a versatile vision-to-audition sensory substitution device
TLDR
The results of an experiment involving a pointing task to targets memorised through visual perception or through their auditory conversion by the Vibe are given, to demonstrate the validity and interest of this method of vision to audition conversion. Expand
See ColOr: an extended sensory substitution device for the visually impaired
Purpose – The purpose of this paper is to overcome the limitations of sensory substitution methods (SSDs) to represent high-level or conceptual information involved in vision, which are mainlyExpand
Auditory coding of visual patterns for the blind.
TLDR
Simple pattern recognition is possible with a fairly natural vision-to-audition coding scheme, given the possibility for the subjects to have sensory--motor interactions while using the device. Expand
Auditory Coding of Visual Patterns for the Blind
Recognition tasks of simple visual patterns have been used to assess an early visual – auditory sensory-substitution system, consisting of the coupling of a rough model of the human retina with anExpand
...
1
2
3
4
5
...

References

SHOWING 1-10 OF 40 REFERENCES
An experimental system for auditory image representations
  • Peter B. L. Meijer
  • Computer Science, Medicine
  • IEEE Transactions on Biomedical Engineering
  • 1992
TLDR
Computerized sampling of the system output and subsequent calculation of the approximate inverse (sound-to-image) mapping provided the first convincing experimental evidence for the preservation of visual information in sound representations of complicated images. Expand
Auditory coding of visual patterns for the blind.
TLDR
Simple pattern recognition is possible with a fairly natural vision-to-audition coding scheme, given the possibility for the subjects to have sensory--motor interactions while using the device. Expand
Neurophysiological approach to the design of visual prostheses: a theoretical discussion.
  • C. Veraart
  • Engineering, Medicine
  • Journal of medical engineering & technology
  • 1989
This paper deals with the design of systems of sensory substitution of vision in case of blindness. Using the rules of man-machine interactions, one proposes the following optimal design for sensoryExpand
Inherent problems of attempts to apply sonar and vibrotactile sensory aid technology to the perceptual needs of the blind.
  • R. D. Easton
  • Psychology, Medicine
  • Optometry and vision science : official publication of the American Academy of Optometry
  • 1992
TLDR
The capabilities of sonar and vibrotactile sensory aids' capabilities are considered in terms of the major functions of vision, that is, the exteroceptive perception of objects, surfaces, and events of the environment, and the proprioception perception of the self. Expand
A Relatively High-Resolution Reading Aid for the Blind
TLDR
It is shown here that most of these reading aids for the blind have violated the well-known sampling theorem and it is suggested that this may be a significant factor in the observed reading-rate limitation. Expand
Sensory Functions of the Skin of Humans
Welcoming Address.- How it Started: A Personal Review.- Psychophysical and Neurophysiological Methods to Study Patients with Sensory Disturbances.- Precision and Ambiguity in Coding VibrotactileExpand
Electrotactile and vibrotactile displays for sensory substitution systems
TLDR
The authors review the methods used to present visual, auditory, and modified tactile information to the skin and discuss present and potential future applications of sensory substitution, including tactile vision substitution (TVS), tactile auditory substitution, and remote tactile sensing or feedback (teletouch). Expand
Physiological Studies of the Efferent Recurrent Auditory System
TLDR
That a genuine inhibitory effect was indeed exerted on the acoustic input was further established by a detailed parametric study (Desmedt, 1962) and by the recording from single auditory axons (Fex, 1962; Wiedeehold and Kiang, 1970). Expand
Tactile vision substitution: past and future.
  • P. Bach-y-Rita
  • Psychology, Medicine
  • The International journal of neuroscience
  • 1983
TLDR
The theoretical basis for sensory substitution is examined primarily in regard to the capacity of the somatosensory system to mediate high resolution "visual" information. Expand
Ferrier lecture - Functional architecture of macaque monkey visual cortex
  • D. Hubel, T. Wiesel
  • Geography, Medicine
  • Proceedings of the Royal Society of London. Series B. Biological Sciences
  • 1977
TLDR
In most respects the above description fits the newborn monkey just as well as the adult, suggesting that area 17 is largely genetically programmed. Expand
...
1
2
3
4
...