An enhanced musical experience for the deaf: design and evaluation of a music display and a haptic chair

@article{Nanayakkara2009AnEM,
  title={An enhanced musical experience for the deaf: design and evaluation of a music display and a haptic chair},
  author={Suranga Nanayakkara and Elizabeth A. Taylor and Lonce L. Wyse and Sim Heng Ong},
  journal={Proceedings of the SIGCHI Conference on Human Factors in Computing Systems},
  year={2009}
}
Music is a multi-dimensional experience informed by much more than hearing alone, and is thus accessible to people of all hearing abilities. In this paper we describe a prototype system designed to enrich the experience of music for the deaf by enhancing sensory input of information via channels other than in-air audio reception by the ear. The system has two main components-a vibrating 'Haptic Chair' and a computer display of informative visual effects that correspond to features of the music… 
Enhancing Musical Experience for the Hearing-Impaired Using Visual and Haptic Displays
TLDR
The system described in this article has the potential to be a valuable aid in speech therapy, and a user study is being carried out to explore the effectiveness of the Haptic Chair for this purpose, and it is expected that the concepts presented would be useful in converting other types of environmental sounds into a visual display and/or a tactile input device.
Music Aid—Towards a Collaborative Experience for Deaf and Hearing People in Creating Music
TLDR
It is found that visualization of sound along with a haptic feedback can help deaf people interpret and interact with music and in order for the target groups to create melodic sequences together in a satisfactory manner, more detailed visualization and distributed haptic output is necessary.
Wearable musical haptic sleeves for people with hearing impairment
TLDR
To develop an affordable wearable haptic device for people with hearing disabilities to experience music, a design development strategy which is based on testing different assistive technologies and to check their efficacy to transmit musical notes into other human sensory inputs is adopted.
The haptic chair as a speech training aid for the deaf
TLDR
Improvements in word clarity observed over the duration of two follow-up studies indicate that the Haptic Chair has the potential to make a significant contribution to speech therapy for the deaf.
Audio-Tactile Rendering: A Review on Technology and Methods to Convey Musical Information through the Sense of Touch
TLDR
This review is intended for researchers in the fields of haptics, assistive technologies, music, psychology, and human–computer interaction as well as artists that may make use of it as a reference to develop upcoming research on HMPs and ATR.
Haptic Music Player—Synthetic audio-tactile stimuli generation based on the notes’ pitch and instruments’ envelope mapping
TLDR
To evaluate the perceived crossmodal similarity between users, two experiments were performed and suggest, that the users' envelope perception was masked by the changes in amplitude and frequency between the notes.
Can Haptic Stimulation Enhance Music Perception in Hearing-Impaired Listeners?
TLDR
Effective haptic techniques for providing complex sound information could offer a non-invasive, affordable means for enhancing listening more broadly in hearing-impaired individuals, as well as understanding speech in noisy environments.
A haptic ATM interface to assist visually impaired users
TLDR
Results of an evaluation of a haptic interface intended to convey non audio-visual directions to an ATM user indicate that users with varying levels of visual impairment are able to appropriately detect, distinguish and act on the prompts given to them by the haptic keypad.
Felt Sound: A Shared Musical Experience for the Deaf and Hard of Hearing
We present a musical interface specifically designed for inclusive performance that offers a shared experience for both individuals who are hard of hearing as well as those who are not. This
Hearing through Vibrations: Perception of Musical Emotions by Profoundly Deaf People
TLDR
The findings from a mixed-methods study with 16 profoundly deaf participants are presented and the benefits and limitations of using vibrations to convey musical emotions to profoundly deaf users are highlighted.
...
...

References

SHOWING 1-10 OF 31 REFERENCES
Towards a model human cochlea: sensory substitution for crossmodal audio-tactile displays
TLDR
This research is aimed at designing a chair-based interface to support deaf and hard of hearing users in experiencing musical content associated with film, and seeks to develop this multisensory crossmodal display as a framework for supporting research in enhancing sensory entertainment experiences for universal design.
Modelling Perceptual Elements of Music in a Vibrotactile Display for Deaf Users: A Field Study
TLDR
Preliminary results from this work suggest that the MHC can potentially offer a more effective means of expressing basic emotional information from music in a vibrotactile display when the signals more closely match the perceptual elements of the music such as melody and instrument parts.
Can you see what i hear?: the design and evaluation of a peripheral sound display for the deaf
TLDR
Two visual displays for providing awareness of environmental audio to deaf individuals are developed that support both monitoring and notification of sounds, support discovery of new sounds, and do not require a priori knowledge of sounds to be detected.
Cutaneous Grooves: Composing for the Sense of Touch
TLDR
A system that facilitates the composition and perception of intricate, musically structured spatio-temporal patterns of vibration on the surface of the body is described, and some potential evolutionary branches of tactile composition are posited.
Visualizing non-speech sounds for the deaf
TLDR
An investigation of peripheral, visual displays to help people who are deaf maintain an awareness of sounds in the environment and presents a set of visual design preferences and functional requirements for peripheral visualizations of non-speech audio that will help improve future applications.
Music-listening systems
TLDR
This dissertation examines the psychoacoustic origins of the early stages of music listening in humans, using both experimental and computer-modeling approaches to form a set of computer signal-processing and pattern-recognition tools that can mimic human perceptual abilities on a variety of musical tasks.
Modeling Tonality: Applications to Music Cognition
TLDR
A mathematical model for tonality, the underlying principles for tonal music, is proposed, which simultaneously incorporates pitch, interval, chord and key relations, and is shown to predict the correct key with high accuracy.
Creating Visual Music in Jitter: Approaches and Techniques
TLDR
This article introduces Jitter, the format of image matrices, and the software’s capabilities for drawing hardware-accelerated graphics using the OpenGL standard, followed by a survey of techniques for acquiring event and signal data from musical processes.
Foundations of a Visual Music
TLDR
A groundwork for a practical theory of visual music composition is proposed and the idea that it is possible to resolve visual dissonance to consonance, and so move a viewer through time in a way similar to tonal harmony in music is developed.
Music as a Trigger for Peak Experiences Among a College Staff Population
ABSTRACT: Peak experiences, as described by Maslow (1962) and others, can be triggered by a variety of activities. This study surveyed 102 college staff members, 93% of whom had previously admitted
...
...