The purpose of this paper is to provide an overview of sonification research, including the current status of the field and a proposed research agenda.
The real world presents our sensory systems with a continuous stream of undifferentiated information. Segmentation of this stream at event boundaries is necessary for object identification and feature extraction. Here, we investigate the neural dynamics of event segmentation in entire musical symphonies under natural listening conditions. We isolated… (More)
The Sonification Application and Research Toolbox (SonART) is an open-source effort to develop a platform-independent collection of methods to map data to sonification parameters. A set of graphical user interface tools that will provide practical and intuitive utilities for experimentation and auditory display. SonART aims to provide publicly available,… (More)
To utilize visual information for musical purpose, inevitable time-based nature of sound should be understood and considered. Time is the principle dimension within which all other auditory parameters are placed, and this poses a particular challenge to effective sonification of time independent images and their applications to music. In this paper we… (More)
A goal of sonification research is the intuitive audio representation of complex, multidimensional data. The authors present two facets of this research that may provide insight into the creative process. First, they discuss aspects of categorical perception in non-verbal auditory scene analysis and propose that these characteristics are simplified models… (More)
We describe a perceptual space for timbre, define an objective metric that takes into account perceptual orthogonality and measure the quality of timbre interpolation. We discuss three timbre representations and measure perceptual judgments. We determine that a timbre space based on Mel-frequency cepstral coefficients (MFCC) is a good model for a perceptual… (More)
This paper describes a perceptual space for timbre, defines an objective metric that takes into account perceptual orthogonality, and measures the quality of timbre interpolation applicable to perceptually valid timbral sonification. We discuss two timbre representations and measure perceptual judgment. We determined that a timbre space based on… (More)
We explore the potential for and implications of musical (or proto-musical) social interaction and collaboration using currently available technologies embedded into mobile phones. The dynamics of this particular brand of social intercourse and the emergence of an associated aesthetic is described. The clichéd concept of a global village is made a vibrant… (More)