Embodied Musical Interaction - Body Physiology, Cross Modality, and Sonic Experience

  title={Embodied Musical Interaction - Body Physiology, Cross Modality, and Sonic Experience},
  author={Atau Tanaka},
  booktitle={New Directions in Music and Human-Computer Interaction},
  • A. Tanaka
  • Published in
    New Directions in Music and…
    7 February 2019
  • Art
Music is a natural partner to human-computer interaction, offering tasks and use cases for novel forms of interaction. The richness of the relationship between a performer and their instrument in expressive musical performance can provide valuable insight to human-computer interaction (HCI) researchers interested in applying these forms of deep interaction to other fields. Despite the longstanding connection between music and HCI, it is not an automatic one, and its history arguably points to… 
Designing Digital Musical Instruments: Adopting an ecological lens to identify design considerations
Important considerations for the design of a Digital Musical Instrument (DMI) arise at the intersection of the disciplines of New Musical Interface design (NMI), Human-computer Interaction (HCI), and
Material-Oriented Musical Interactions
  • Tom Mudd
  • Art
    New Directions in Music and Human-Computer Interaction
  • 2019
This chapter explores different perspectives on the role of musical tools in musical interactions, with a particular focus on entanglements of agency. These perspectives can run the full gamut from
Understanding Music Interaction, and Why It Matters
This introductory chapter reviews the relationship between music and human-computer interaction and outlines research themes and issues that emerge from the collected work of researchers and practitioners in this book.
Motor Variability in Complex Gesture Learning: Effects of Movement Sonification and Musical Background
Future studies to take into account participants’ musical background, consider longitudinal study to examine these effects on complex gestures, and use awareness when interpreting the results given a specific design of gesture and sound are recommended.
‘How We Were Never Posthuman’: Technologies of the Embodied Voice in Pamela Z's Voci
Abstract This article analyses composer Pamela Z's work in light of critiques of posthumanism from Black studies and sound/music studies. Z's large-scale multimedia work Voci (2003), which the artist


Sonic Interaction Design
The Body as Musical Instrument
This chapter explores the possibility of thinking of the human body as musical instrument. It builds on the philosophy of phenomenology to discuss body schemata that might be considered
Form Follows Sound: Designing Interactions from Sonic Memories
A participatory approach to sonic interaction design is proposed that first considers the affordances of sounds in order to imagine embodied interaction, and based on this, generates interaction models for interaction designers wishing to work with sound.
Detecting and Adapting to Users' Cognitive and Affective State to Develop Intelligent Musical Interfaces
This chapter considers intelligent musical interfaces that can measure cognitive or affective states implicitly in real-time to allow musically appropriate adaptations by the system without conscious effort on the part of the user.
Compositional and Performance Mapping in Computer Chamber Music: A Case Study
The DMI mapping problem is considered in the context of the creation and performance of a heterogeneous computer chamber music piece, a trio for violin, biosensors, and computer, and the rich musical possibilities and technical challenges of the integration of digital musical instruments intoComputer chamber music are demonstrated.
Haptic Wave: A Cross-Modal Interface for Visually Impaired Audio Producers
A series of participatory design activities adapted to non-sighted users where the act of prototyping facilitates dialog is described, gleans insight into working with users with visual impairments, and transforms perspective to think of them as experts in non-visual interfaces for all users.
New interfaces for musical expression
This workshop brings together interface experts interested in musical controllers and musicians and composers involved in the development of new musical interfaces to discuss issues covered at past CHI meetings.
The SonicFinder: An Interface That Uses Auditory Icons
This work discusses sound effects and source metaphors as methods of extending auditory icons beyond the limitations implied by literal mappings, and speculation on future directions for such interfaces is speculated.
HapticWave: Presenting the Multiple Voices, Artefacts and Materials of a Design Research Project
The HapticWave is a haptic audio waveform display device that has been developed in collaboration with a group of audio engineers and producers with visual impairments for use in real world recording
Where the Action Is - The Foundations of Embodied Interaction
This book addresses the philosophical bases of human-computer interaction and looks in particular at how tangible and social approaches to interaction are related, how they can be used to analyze and understand embodied interaction, and how they could affect the design of future interactive systems.