From Shape to Sound: sonification of two dimensional curves by reenaction of biological movements

Abstract

In this study, we propose a method to synthesize sonic metaphors of two dimensional curves based on the mental representation of friction sound produced by the interaction between the pencil and the paper when somebody is drawing or writing. The relevance of this approach is firstly presented. Secondly, synthesized friction sounds that enable the investigation of the relevance of kinematics in the perception of a gesture underlying a sound are described. In the third part, a biological law linking the curvature of a shape to the velocity of the gesture which has drawn the shape is calibrated from the auditory point of view. This law enables generation of synthesized friction sounds coherent with human gestures.

3 Figures and Tables

Showing 1-10 of 10 references

Sonification of Drawings by Virtually Reenacting Biological Movements. Versatile Sound Models for Interaction in Audio-Graphic Virtual Environments

  • E Thoret, M Aramaki, R Kronland-Martinet, J L Velay, S Ystad
  • 2011

The Senses Considered as Perceptual Systems

  • J J Gibson
  • 1966