The purpose of this paper is to provide an overview of sonification research, including the current status of the field and a proposed research agenda.
The real world presents our sensory systems with a continuous stream of undifferentiated information. Segmentation of this stream at event boundaries is necessary for object identification and feature extraction. Here, we investigate the neural dynamics of event segmentation in entire musical symphonies under natural listening conditions. We isolated… (More)
The Sonification Application and Research Toolbox (SonART) is an open-source effort to develop a platform-independent collection of methods to map data to sonification parameters. A set of graphical user interface tools that will provide practical and intuitive utilities for experimentation and auditory display. SonART aims to provide publicly available,… (More)
To utilize visual information for musical purpose, inevitable time-based nature of sound should be understood and considered. Time is the principle dimension within which all other auditory parameters are placed, and this poses a particular challenge to effective sonification of time independent images and their applications to music. In this paper we… (More)
A goal of sonification research is the intuitive audio representation of complex, multidimensional data. The authors present two facets of this research that may provide insight into the creative process. First, they discuss aspects of categorical perception in non-verbal auditory scene analysis and propose that these characteristics are simplified models… (More)
Voluntary finger movements result in a maximal ERD in the 10-12 Hz band close to electrodes C3 and C4, overlying the sensorimotor hand areas. This ERD focus is not very pronounced with EEG data recorded against a common reference electrode (monopolar recording). After transformation of the raw data using common average, local average and weighted average… (More)
This paper describes a perceptual space for timbre, defines an objective metric that takes into account perceptual orthogonality, and measures the quality of timbre interpolation applicable to perceptually valid timbral sonification. We discuss two timbre representations and measure perceptual judgment. We determined that a timbre space based on… (More)
We describe a perceptual space for timbre, define an objective metric that takes into account perceptual orthogonality and measure the quality of timbre interpolation. We discuss three timbre representations and measure perceptual judgments. We determine that a timbre space based on Mel-frequency cepstral coefficients (MFCC) is a good model for a perceptual… (More)