An experimental system for auditory image representations

  title={An experimental system for auditory image representations},
  author={Peter B. L. Meijer},
  journal={IEEE Transactions on Biomedical Engineering},
  • Peter B. L. Meijer
  • Published 1992
  • Computer Science, Medicine
  • IEEE Transactions on Biomedical Engineering
An experimental system for the conversion of images into sound patterns was designed to provide auditory image representations within some of the known limitations of the human hearing systems possibly as a step towards the development of a vision substitution device for the blind. The application of an invertible (one-to-one) image-to-sound mapping ensures the preservation of visual information. The system implementation involves a pipelined special-purpose computer connected to a standard… Expand
On the use of the auditory pathway to represent image scenes in real-time
The system principles of design and several experiments that have been carried out by several blindfolded persons with See ColOr prototypes related to static pictures on a tablet and simple video images, including the pairing of colored socks and following a colored serpentine painted on the ground are presented. Expand
A perceptual interface for vision substitution in a color matching experiment
This work verifies the hypothesis that sounds from musical instruments provide an alternative way to vision for obtaining color information from the environment and demonstrates that blindfolded individuals were able to accurately match pairs of colored socks. Expand
A real-time experimental prototype for enhancement of vision rehabilitation using auditory substitution
An experimental prototype based on a personal computer connected to a miniature head-fixed video camera and to headphones which has so far demonstrated prototype usefulness for pattern recognition and an integrated circuit of this system is to be developed. Expand
Visual Perception Substitution by the Auditory Sense
The methodology to develop a sensory substitution system that allows the transformation of digital images captured from a web cam into sound patterns, using a novel scanning method from the center to the left and right side of the image. Expand
Algorithms and Techniques for Image to Sound Conversion for Helping the Visually Impaired People - Application Proposal
  • A. Cazan, R. Varbanescu, D. Popescu
  • Computer Science
  • 2007 14th International Workshop on Systems, Signals and Image Processing and 6th EURASIP Conference focused on Speech and Image Processing, Multimedia Communications and Services
  • 2007
The system is designed for the visually impaired people and will convert real time images into sounds, respecting a certain algorithm, to preserve the visual information, but not forgetting the limitations imposed by the human hearing system. Expand
Review on image sonification: A non-visual scene representation
This survey approaches to summarize the methodologies and issues of the implemented and unimplemented experimental systems developed for subjective sonification of image scenes and let researchers accumulate knowledge about the previous direction of researches in this domain. Expand
Toward local and global perception modules for vision substitution
The novelty is the simultaneous sonification of colour and depth, the last parameter being coded by sound rhythm in this work, which proposes to extend the local perception module by introducing a new global perception module aiming at providing the user with a clear picture of the entire scene characteristics. Expand
Guiding visual attention in grayscale images for auditory substitution systems
Image-to-sound substitution systems aim to provide mobility assistance for visually disabled persons by exploiting the auditory augmentation. In general the existing auditory substitution systems,Expand
Census-based vision for auditory depth images and speech navigation of visually impaired users
Experimental results show that visually impaired users can perceive the image easily and without training by adding verbal description to the visually image aid, and the performance was not influenced by various lighting. Expand
Sonification of images for the visually impaired using a multi-level approach
This paper presents a system that strives to give visually impaired persons direct perceptual access to images via an acoustic signal and argues that this multi-level approach gives users direct access to what is where in the image, yet it still exploits the potential of recent developments in Computer Vision and Machine Learning. Expand


A Tactile Vision-Substitution System for the Blind: Computer-Controlled Partial Image Sequencing
A computer-controlled tactile vision-substitution system as part of a study to maximize the use of the skin's ability to process spatial and temporal information. Expand
Developments in Electronic Aids for the Blind and Visually Impaired
  • J. Brabyn
  • Computer Science, Medicine
  • IEEE Engineering in Medicine and Biology Magazine
  • 1985
In summary, there are many specific problems frequently faced by the blind and visually impaired that are amenable to solutions through appropriate applications of electronics and microcomputerExpand
Information transmission across the skin: high-resolution tactile sensory aids for the deaf and the blind.
  • F. Saunders
  • Computer Science, Medicine
  • The International journal of neuroscience
  • 1983
An electrotactile sensory aid for profoundly deaf children, which displays acoustic information on the skin of the abdomen, via a belt of elect rotactile stimulators, and the resulting tactile patterns provide cues for recognizing environmental sounds, enhance the accuracy of lipreading, and enable the child to monitor his/her own voice. Expand
Visual Substitution Systems: Control and Information Processing Considerations
A detailed discussion of the visual mechanisms found in the higher vertebrates is used as the basis for exploring the problems found in creating visual substitution systems. Specific attention isExpand
Vision Substitution by Tactile Image Projection
WE describe here a vision substitution system which is being developed as a practical aid for the blind and as a means of studying the processing of afferent information in the central nervousExpand
An Audio Display for the Blind
  • R. Fish
  • Computer Science, Medicine
  • IEEE Transactions on Biomedical Engineering
  • 1976
An auditory code capable of transducing two dimensional patterns and pictures for presentation to blind people has been developed. The image to be presented is detected by a television camera orExpand
Artificial Vision for the Blind: Electrical Stimulation of Visual Cortex Offers Hope for a Functional Prosthesis
Electrical stimulation of the occipital cortex resulted in discrete photic sensations or "phosphenes" in two volunteers who had been totally blind for 7 and 28 years, respectively, which reinforces the hope that a functional visual prosthesis can be developed. Expand
A 64-Solenoid, Four-Level Fingertip Search Display for the Blind
The design and prototype model of a nonvibrating fingertip search display device that translates a visual image into a contour map of raised pins similar to transitory braille, designed for use in experiments to determine the importance of fingertip exploration in tactile vision substitution. Expand
Electronic Aids for Blind Persons : an Interdisciplinary Subject
Aids for the handicapped is an emotive subject; ?electronic aids for the blind? is highly emotive because of the innovation the field has seen over the past 20 years and the controversy over what isExpand
High Resolution Vision Prosthesis Systems: Research after 15 Years
Using an article by R. Fish, published a decade ago, as a point of departure, the authors propose that no significant advances in high resolution devices in vision substitution systems have been madeExpand