• Corpus ID: 211548520

Embodied Musical Interaction Body Physiology, Cross Modality, and Sonic Experience

  title={Embodied Musical Interaction Body Physiology, Cross Modality, and Sonic Experience},
  author={Tom Mudd and - KatieWilkie and McKenna and Andrew P. McPherson and Marcelo M. Wanderley},
Music is a natural partner to human-computer interaction, offering tasks and use cases for novel forms of interaction. The richness of the relationship between a performer and their instrument in expressivemusical performance can provide valuable insight to human-computer interaction (HCI) researchers interested in applying these forms of deep interaction to other fields. Despite the longstanding connection between music and HCI, it is not an automatic one, and its history arguably points to as… 

Figures and Tables from this paper


Sonic Interaction Design
Form Follows Sound: Designing Interactions from Sonic Memories
A participatory approach to sonic interaction design is proposed that first considers the affordances of sounds in order to imagine embodied interaction, and based on this, generates interaction models for interaction designers wishing to work with sound.
Detecting and Adapting to Users' Cognitive and Affective State to Develop Intelligent Musical Interfaces
This chapter considers intelligent musical interfaces that can measure cognitive or affective states implicitly in real-time to allow musically appropriate adaptations by the system without conscious effort on the part of the user.
Compositional and Performance Mapping in Computer Chamber Music: A Case Study
The DMI mapping problem is considered in the context of the creation and performance of a heterogeneous computer chamber music piece, a trio for violin, biosensors, and computer, and the rich musical possibilities and technical challenges of the integration of digital musical instruments intoComputer chamber music are demonstrated.
Haptic Wave: A Cross-Modal Interface for Visually Impaired Audio Producers
A series of participatory design activities adapted to non-sighted users where the act of prototyping facilitates dialog is described, gleans insight into working with users with visual impairments, and transforms perspective to think of them as experts in non-visual interfaces for all users.
The SonicFinder: An Interface That Uses Auditory Icons
This work discusses sound effects and source metaphors as methods of extending auditory icons beyond the limitations implied by literal mappings, and speculation on future directions for such interfaces is speculated.
HapticWave: Presenting the Multiple Voices, Artefacts and Materials of a Design Research Project
The HapticWave is a haptic audio waveform display device that has been developed in collaboration with a group of audio engineers and producers with visual impairments for use in real world recording
New interfaces for musical expression
This workshop brings together interface experts interested in musical controllers and musicians and composers involved in the development of new musical interfaces to discuss issues covered at past CHI meetings.
Where the Action Is - The Foundations of Embodied Interaction
This book addresses the philosophical bases of human-computer interaction and looks in particular at how tangible and social approaches to interaction are related, how they can be used to analyze and understand embodied interaction, and how they could affect the design of future interactive systems.
Understanding Gesture Expressivity through Muscle Sensing
A study explores the notion of gesture power in terms of control and sensing, and fundamental aspects of muscle activity and ways to capture information through electromyography and mechanomyography are presented.