Haptic Wave: A Cross-Modal Interface for Visually Impaired Audio Producers

@article{Tanaka2016HapticWA,
  title={Haptic Wave: A Cross-Modal Interface for Visually Impaired Audio Producers},
  author={Atau Tanaka and Adam Parkinson},
  journal={Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems},
  year={2016}
}
  • A. Tanaka, A. Parkinson
  • Published 7 May 2016
  • Computer Science
  • Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems
We present the Haptic Wave, a device that allows cross-modal mapping of digital audio to the haptic domain, intended for use by audio producers/engineers with visual impairments. We describe a series of participatory design activities adapted to non-sighted users where the act of prototyping facilitates dialog. A series of workshops scoping user needs, and testing a technology mock up and lo-fidelity prototype fed into the design of a final high-spec prototype. The Haptic Wave was tested in the… 

Figures from this paper

Human-Sound Interaction: Towards a Human-Centred Sonic Interaction Design approach
TLDR
This paper prototyped SoundSculpt, a cross-modal audio, holographic projection and mid-air haptic feedback system that has the potential to foster new ways of interaction with sound and to make them accessible to diverse musicians, sound artists and audience.
Cross-modal terrains: navigating sonic space through haptic feedback
TLDR
The idea of using virtual textural terrains as a means of generating haptic profiles for force-feedback controllers and the potential of this approach to afford engaging musical experiences for both the performer and the audience as iterated through numerous performances is discussed.
Musical Multimodal Interaction: From Bodies to Ecologies
TLDR
This keynote revisits two decades of interactive music practice that has paralleled the development of the field of multimodal interaction research and four projects situate multi-modal interaction at the heart of artistic research.
Musical Haptic Wearables for Synchronisation of Visually-impaired Performers: a Co-design Approach
TLDR
Results indicate that wireless tactile communication represents a promising avenue to cater effectively to the needs of visually-impaired performers.
Tangible Signals - Physical Representation of Sound and Haptic Control Feedback
  • J. Vetter
  • Art
    Tangible and Embedded Interaction
  • 2019
TLDR
This project investigates the dynamic physical representation and haptic feedback control of computer music and sound data using motorized and augmented objects and focuses on artistic and performative contributions that this approach offers.
Slide-Tone and Tilt-Tone: 1-DOF Haptic Techniques for Conveying Shape Characteristics of Graphs to Blind Users
TLDR
Two refreshable, 1-DOF audio-haptic interfaces based on haptic cues fundamental to object shape perception based on Slide-tone and Tilt-tone are introduced, finding that BVI participants appreciated the additional shape information, versatility, and reinforced understanding these interfaces provide and that task accuracy was comparable to using interactive tactile graphics or sonification alone.
Tangible Signals - Prototyping Interactive Physical Sound Displays
This work-in-progress paper presents three tangible user interface prototypes that use sensor technology in combination with mechanical actuators to provide an interactive physical display of sound
Sounds and (Braille) cells: co-designing music technology with blind and visually impaired musicians
Music creation technologies often use highly visual representations of music and mouse/touch screen gestures for manipulating it. While graphic user interfaces can make music creation more
Embodied Musical Interaction Body Physiology, Cross Modality, and Sonic Experience
Music is a natural partner to human-computer interaction, offering tasks and use cases for novel forms of interaction. The richness of the relationship between a performer and their instrument in
Embodied Musical Interaction - Body Physiology, Cross Modality, and Sonic Experience
  • A. Tanaka
  • Art
    New Directions in Music and Human-Computer Interaction
  • 2019
TLDR
This chapter discusses how the concept of embodied interaction can be one way to think about music interaction and proposes how the three “paradigms” of HCI and three design accounts from the interaction design literature can serve as a lens through which to consider types of music HCI.
...
1
2
3
4
5
...

References

SHOWING 1-10 OF 47 REFERENCES
HapticWave: Presenting the Multiple Voices, Artefacts and Materials of a Design Research Project
The HapticWave is a haptic audio waveform display device that has been developed in collaboration with a group of audio engineers and producers with visual impairments for use in real world recording
Putting the feel in ’look and feel‘
TLDR
An investigation of the use of touch as a way of reducing visual overload in the conventional desktop using the PHANToM haptic device as a means of interacting with a conventional graphical user interface results indicated that the haptic effects did not improve users performance in terms of task completion time.
Real world haptic exploration for telepresence of the visually impaired
  • Chung Hyuk Park, A. Howard
  • Computer Science
    2012 7th ACM/IEEE International Conference on Human-Robot Interaction (HRI)
  • 2012
TLDR
A framework that integrates visual perception from heterogeneous vision sensors and enables real-time interactive haptic representation of the real world through a mobile manipulation robotic system and quantitative results are provided along with qualitative results through a set of human subject testing.
Non-Visual Haptic Interaction Design - Guidelines and Applications
TLDR
It has been demonstrated that a blind person can orientate and navigate in a virtual haptic environment and that these tasks can be further supported by using complementary information such as sound and Braille.
Motors, Music and Motion
TLDR
The classes were developed to provide foundations for design students to leverage the potential of non-visual modes of interaction and provide them with tools and skills to develop complex multimodal, embodied experiences.
Multimodal Presentation of Two-Dimensional Charts: An Investigation Using Open Office XML and Microsoft Excel
TLDR
The nonvisual accessibility issues associated with the graphing component of Microsoft Excel are investigated and a novel approach and system is proposed to provide flexible multi-modal presentation schemes which can help visually impaired users in comprehending the most commonly used two dimensional business charts.
Haptic perception: A tutorial
TLDR
This tutorial focuses on the sense of touch within the context of a fully active human observer and describes an extensive body of research on “what” and “where” channels, the former dealing with haptic perception of objects, surfaces, and their properties, and the latter with perception of spatial layout on the skin and in external space relative to the perceiver.
Setting the Standards for Haptic and Tactile Interactions: ISO's Work
TLDR
This paper gives an update on the status of the work in progress and the recently published International Standard on tactile/haptic interactions.
Multimodal 'eyes-free' interaction techniques for wearable devices
TLDR
Two multimodal interaction techniques designed to overcome problems and allow truly mobile, 'eyes-free' device use are presented, one of which is a 3D audio radial pie menu that uses head gestures for selecting items.
Tactile perceptions of digital textiles: a design research approach
TLDR
A new perspective from which the production of multi-touch interactive video representations of the tactile qualities of materials is considered is offered, and methods to animate and bring these properties alive using design methods are developed.
...
1
2
3
4
5
...