An experimental system for auditory image representations

@article{Meijer1992AnES,
  title={An experimental system for auditory image representations},
  author={Peter B. L. Meijer},
  journal={IEEE Transactions on Biomedical Engineering},
  year={1992},
  volume={39},
  pages={112-121}
}
  • Peter B. L. Meijer
  • Published 1 February 1992
  • Computer Science
  • IEEE Transactions on Biomedical Engineering
An experimental system for the conversion of images into sound patterns was designed to provide auditory image representations within some of the known limitations of the human hearing systems possibly as a step towards the development of a vision substitution device for the blind. The application of an invertible (one-to-one) image-to-sound mapping ensures the preservation of visual information. The system implementation involves a pipelined special-purpose computer connected to a standard… 
A perceptual interface for vision substitution in a color matching experiment
TLDR
This work verifies the hypothesis that sounds from musical instruments provide an alternative way to vision for obtaining color information from the environment and demonstrates that blindfolded individuals were able to accurately match pairs of colored socks.
A real-time experimental prototype for enhancement of vision rehabilitation using auditory substitution
TLDR
An experimental prototype based on a personal computer connected to a miniature head-fixed video camera and to headphones which has so far demonstrated prototype usefulness for pattern recognition and an integrated circuit of this system is to be developed.
Visual Perception Substitution by the Auditory Sense
TLDR
The methodology to develop a sensory substitution system that allows the transformation of digital images captured from a web cam into sound patterns, using a novel scanning method from the center to the left and right side of the image.
Algorithms and Techniques for Image to Sound Conversion for Helping the Visually Impaired People - Application Proposal
  • A. Cazan, R. Varbanescu, D. Popescu
  • Computer Science
    2007 14th International Workshop on Systems, Signals and Image Processing and 6th EURASIP Conference focused on Speech and Image Processing, Multimedia Communications and Services
  • 2007
TLDR
The system is designed for the visually impaired people and will convert real time images into sounds, respecting a certain algorithm, to preserve the visual information, but not forgetting the limitations imposed by the human hearing system.
Review on image sonification: A non-visual scene representation
TLDR
This survey approaches to summarize the methodologies and issues of the implemented and unimplemented experimental systems developed for subjective sonification of image scenes and let researchers accumulate knowledge about the previous direction of researches in this domain.
Guiding visual attention in grayscale images for auditory substitution systems
TLDR
This work introduces a novel decolorization strategy inspired from the ability of the human visual system to automatically attend to the salient regions of complex scenes, which performs fast being able to preserve the original appearance as well in the decolorized image version.
Census-based vision for auditory depth images and speech navigation of visually impaired users
TLDR
Experimental results show that visually impaired users can perceive the image easily and without training by adding verbal description to the visually image aid, and the performance was not influenced by various lighting.
Sonification of images for the visually impaired using a multi-level approach
TLDR
This paper presents a system that strives to give visually impaired persons direct perceptual access to images via an acoustic signal and argues that this multi-level approach gives users direct access to what is where in the image, yet it still exploits the potential of recent developments in Computer Vision and Machine Learning.
...
...

References

SHOWING 1-10 OF 21 REFERENCES
A Tactile Vision-Substitution System for the Blind: Computer-Controlled Partial Image Sequencing
TLDR
A computer-controlled tactile vision-substitution system as part of a study to maximize the use of the skin's ability to process spatial and temporal information.
Developments in Electronic Aids for the Blind and Visually Impaired
  • J. Brabyn
  • Art
    IEEE Engineering in Medicine and Biology Magazine
  • 1985
In summary, there are many specific problems frequently faced by the blind and visually impaired that are amenable to solutions through appropriate applications of electronics and microcomputer
Information transmission across the skin: high-resolution tactile sensory aids for the deaf and the blind.
  • F. Saunders
  • Medicine
    The International journal of neuroscience
  • 1983
TLDR
An electrotactile sensory aid for profoundly deaf children, which displays acoustic information on the skin of the abdomen, via a belt of elect rotactile stimulators, and the resulting tactile patterns provide cues for recognizing environmental sounds, enhance the accuracy of lipreading, and enable the child to monitor his/her own voice.
Visual Substitution Systems: Control and Information Processing Considerations
A detailed discussion of the visual mechanisms found in the higher vertebrates is used as the basis for exploring the problems found in creating visual substitution systems. Specific attention is
Vision Substitution by Tactile Image Projection
WE describe here a vision substitution system which is being developed as a practical aid for the blind and as a means of studying the processing of afferent information in the central nervous
An Audio Display for the Blind
  • R. Fish
  • Computer Science, Physics
    IEEE Transactions on Biomedical Engineering
  • 1976
An auditory code capable of transducing two dimensional patterns and pictures for presentation to blind people has been developed. The image to be presented is detected by a television camera or
Artificial Vision for the Blind: Electrical Stimulation of Visual Cortex Offers Hope for a Functional Prosthesis
TLDR
Electrical stimulation of the occipital cortex resulted in discrete photic sensations or "phosphenes" in two volunteers who had been totally blind for 7 and 28 years, respectively, which reinforces the hope that a functional visual prosthesis can be developed.
A 64-Solenoid, Four-Level Fingertip Search Display for the Blind
TLDR
The design and prototype model of a nonvibrating fingertip search display device that translates a visual image into a contour map of raised pins similar to transitory braille, designed for use in experiments to determine the importance of fingertip exploration in tactile vision substitution.
Electronic Aids for Blind Persons : an Interdisciplinary Subject
TLDR
The subject is reviewed, showing the advances in reading aids to have had a smoother and more successful passage than has been experienced by the mobility aids.
High Resolution Vision Prosthesis Systems: Research after 15 Years
Using an article by R. Fish, published a decade ago, as a point of departure, the authors propose that no significant advances in high resolution devices in vision substitution systems have been made
...
...