Psychoacoustical Signal Processing for Three-dimensional Sonification

  title={Psychoacoustical Signal Processing for Three-dimensional Sonification},
  author={Tim Ziemer and Holger Schultheis},
  journal={Proceedings of the 25th International Conference on Auditory Display (ICAD 2019)},
  • Tim Ziemer, Holger Schultheis
  • Published 1 June 2019
  • Physics
  • Proceedings of the 25th International Conference on Auditory Display (ICAD 2019)
Physical attributes of sound interact perceptually, which makes it challenging to present a large amount of information simultaneously via sonification, without confusing the user. This paper presents the theory and implementation of a psychoacoustic signal processing approach for three-dimensional sonification. The direction and distance along the dimensions are presented via multiple perceptually orthogonal sound attributes in one auditory stream. Further auditory streams represent additional… 

Figures and Tables from this paper

Three Orthogonal Dimensions for Psychoacoustic Sonification
This study demonstrates how a location in three-dimensional space can be sonified unambiguously by the implementation of perceptually orthogonal psychoacoustic attributes in monophonic playback.
Psychoacoustic Sonification as User Interface for Human-Machine Interaction
This paper presents psychoacoustic sonification as an alternative interface for human-machine interaction, and presents exemplary use cases from various application areas where users can benefit from psychoacoustics.
Exploring Sonification Mapping Strategies for Spatial Auditory Guidance in Immersive Virtual Environments
Spatial auditory cues are important for many tasks in immersive virtual environments, especially guidance tasks. However, due to the limited fidelity of spatial sounds rendered by generic
Tiltification — An Accessible App to Popularize Sonification
It is argued that the distribution of sonification apps through mainstream channels is a contribution to establish sonification in the market and make it better known to users outside the scientific domain.
Sonification as a Reliable Alternative to Conventional Visual Surgical Navigation
The results demonstrated that the proposed sonification-based method is as accurate as the state of the art while decreas-ing the surgeon’s need to focus on visual navigation displays instead of the natural focus on surgical tools and targeted anatomy during task execution.
The CURAT Sonification Game: Gamification for Remote Sonification Evaluation
The multi-platform CURAT Sonification Game is introduced that allows for experimental evaluation of the subjective appropriateness and effectiveness of the sonification design by a large population during long-term usage.
Recommendations to Develop, Distribute and Market Sonification Apps
This paper developed, distributed, and promoted Tiltification, a smartphone app that utilizes sonification to inform users about the tilt angle of their phone, so that they can use it as a torpedo level.
Expergefactor: sonic interaction design for an alarm clock app
We present a prototype for an alarm clock app that is based on sonic interaction design, called the Expergefactor. It consists of two parts that solely rely on rotating the phone and receiving


Using psychoacoustical models for information sonification
This paper presents a method for their application and discusses effects and implications of using this method for designing auditory displays, and sound examples of auditory graphing based on psychoacoustical models will be presented at the conference for discussion.
Evaluation of psychoacoustic sound parameters for sonification
This research evaluates data-to-sound mappings that are based on psychoacoustic sensations, in an attempt to move towards using data- to-sound MSPs that are aligned with the listener's perception of the data value's auditory connotations.
A Psychoacoustic Auditory Display for Navigation
Trajectory analysis indicates that users were able to accurately find sonified targets and integrate the sonified dimensions to approach the target on the shortest path.
Spatial auditory display for acoustics and music collections
This thesis concludes that virtual Ambisonics is an efficient and accurate means to render a binaural auditory display consisting of noise signals placed on the horizontal plane without head tracking.
Auditory Scene Analysis
Pattern recognition by audio representation of multivariate analytical data
An objective recipe, based on the statistical distribution of data on each axis in k-dimensional space, for audio display of multivariate analytical data, so that the trained ear can associate each sound with a good estimate of the value in the original measurement.
Auditory information design
The TaDa approach is an integrated approach that addresses an array of issues through a multifaceted system of methods drawn from HCI, visualisation, graphic design and sound design that shows that sounds can be useful in a wide variety of information processing activities which have not been explored before.
Pitch and loudness interact in auditory displays: can the data get lost in the map?
A perceptual interaction between dynamic changes in pitch and loudness, as well as perceived asymmetries in directional acoustic change, that distorted the data relations represented in an auditory display is demonstrated.
Psychoacoustic sonification design for navigation in surgical interventions
A psychoacoustically motivated sonification design to guide clinicians in two-dimensional space is presented, e.g., to navigate a scalpel towards a target resection trajectory, ablation needle
Psychoacoustic auditory display for navigation: an auditory assistance system for spatial orientation tasks
The psychoacoustic auditory display could serve as an alternative or complement to conventional assistance systems for vehicle or airplane control, or for minimally invasive surgery, and interactive sonification guides users to an invisible target location in two-dimensional space.