• Corpus ID: 15487175

Triggering Sounds from Discrete Air Gestures: What Movement Feature Has the Best Timing?

  title={Triggering Sounds from Discrete Air Gestures: What Movement Feature Has the Best Timing?},
  author={Luke Dahl},
  • Luke Dahl
  • Published in NIME 2014
  • Computer Science
Motion sensing technologies enable musical interfaces where a performer moves their body “in the air” without manipulating or contacting a physical object. These interfaces work well when the movement and sound are smooth and continuous, but it has proven difficult to design a system which triggers discrete sounds with precision that allows for complex rhythmic performance. We conducted a study where participants perform “airdrumming” gestures in time to rhythmic sounds. These movements are… 

Figures and Tables from this paper

Studying the Timing of Discrete Musical Air Gestures

A study of “air drumming” gestures to understand what the authors do with their bodies when they gesture in the air to trigger a sound and it is shown that timing differences between hand and wrist features can be used to group performers into different movement styles.

Musical Instruments, Body Movement, Space, and Motion Data: Music as an Emergent Multimodal Choreography

Music is a complex multimodal medium experienced not only via sounds but also through body movement. Musical instruments can be seen as technological objects coupled with a repertoire of gestures. We

Communication for coordination: gesture kinematics and conventionality affect synchronization success in piano duos

Musicians’ synchronization with leaders’ first onsets improved as cueing gesture smoothness and magnitude increased and prototypicality decreased, and Synchronization was also more successful with more experienced Leaders’ gestures.

Dynamic Time Warping for Music Conducting Gestures Evaluation

A new metric is proposed for the DTW, allowing better alignment between two gesture movements without the use of explicit maxima local points and experimental results indicate that the classification scheme represents an improvement over other existing related approaches.

Instrumental movements of neophytes: analysis of movement Periodicities, Commonalities and individualities in Mimed violin performance

Body movement and embodied knowledge play an important part in how we express and understand music. The gestures of a musician playing an instrument are part of a shared knowledge that contributes to

Musical Virtual Instruments and Auditory Perception: Some Issues”

Eshofuni@TheAbyssis a multidisciplinary project and performance, proposing real-time representations of brain phenomena using a braincomputer interface. It implements novel representational

Analysis of Mimed Violin Performance Movements of Neophytes - Patterns, Periodicities, Commonalities and Individualities

This study investigates the extent in which the movement vocabulary of violin performance is part of the embodied knowledge of individuals with no experience in playing the instrument, specifically modified to be more accessible to neophytes.

Hand Gestures in Music Production

This paper analyzes typical music production scenarios and derives where freehand input yields added value, and gives an overview of related research and discusses aspects of the technical integration into music studio setups.

Doing vs. Being: A philosophy of design for artful VR

We present a practical philosophy for how to design artfully for virtual reality. Framing this design philosophy is the balance of doing vs. being as a central duality in all design for VR. The

Latent Mappings: Generating Open-Ended Expressive Mappings Using Variational Autoencoders

The latent mapping is introduced, which leverages the latent space of an unsupervised machine learning algorithm such as a Variational Autoencoder trained on a corpus of unlabelled gestural data from the creator.



Sensorimotor synchronization: A review of the tapping literature

  • B. Repp
  • Psychology
    Psychonomic bulletin & review
  • 2005
This review summarizes theories and empirical findings obtained with the tapping task on the role of intention, rate limits, the negative mean asynchrony, variability, models of error correction, perturbation studies, neural correlates of SMS, and SMS in musical contexts.

Ping-pong: Using smartphones to measure distances and relative positions

A novel system for real­time range and geometry estimation of a group of smartphones co­located in a shared physical space is presented and it is believed that such system opens the possibility for new ways of interaction that could benefit musical expression, social interaction and gaming.

User Interface Comparison for Virtual Drums

An experimental study comparing different user interfaces for a virtual drum shows that hitting the drum alternately from both sides with motion going through the drum plate was less accurate than the traditional one sided hitting.

Airstic Drum: A Drumstick for Integration of Real and Virtual Drums

The proposed Airstic Drum achieves high portability and performance quality by integrating real and virtual drums, and it outputs digital sound only when the drummer strokes virtual drums.

Playing the accent : comparing striking velocity and timing in an ostinato rhythm performed by four drummers

Four percussion players’ strategies for performing an accented stroke were studied by capturing movement trajectories.The players played on a force plate with markers on the drumstick, hand, and lo

First arrival picking on common-offset trace collections for automatic estimation of static corrections

The increase in the number of geophone groups in production records during recent years and the requirement for accurate basic static corrections for high resolution records have made it necessary to

Modeling an air percussion for composition and performance

A method for strike recognition using the Flock of Birds is presented, as well as its use for artistic purpose, and both artistic and technical aspects of the project are developed.

Three dimensional baton and gesture

  • US Patent 4,980,519
  • 1990

From Real to Virtual: A Comparison of Input Devices for Percussion Tasks

Results suggest that certain gestures such as hand height amplitude can be adapted to these gestural controllers with little change and that in general subjects’ timing variability is significantly affected when playing on the Lightning and Radio Baton when compared to the more familiar tom drum and VDrum.

Three dimensional baton and gesture sensor

  • US Patent
  • 1990