Interacting with sonification systems: closing the loop

@article{Hunt2004InteractingWS,
  title={Interacting with sonification systems: closing the loop},
  author={Andy Hunt and Thomas Hermann and Sandra Pauletto},
  journal={Proceedings. Eighth International Conference on Information Visualisation, 2004. IV 2004.},
  year={2004},
  pages={879-884}
}
  • Andy Hunt, T. Hermann, S. Pauletto
  • Published 14 July 2004
  • Computer Science
  • Proceedings. Eighth International Conference on Information Visualisation, 2004. IV 2004.
This paper stresses the importance of the human user being tightly embedded within an interactive control loop for exploring data sets using sound. We consider the quality of interaction, and how this can be improved in computer systems by learning from real-world acoustic interactions. We describe how different sonification methods can utilise the human feedback loop to enhance the perception and analysis of the data under investigation. Some considerations are given regarding systems and… 

Interactive sonification of motion

  • Computer Science
  • 2013
This thesis investigates how this link between auditory perception and motor control can be reinforced by means of interactive sonification, and develops and investigates computational models for the sonification of motion data with a particular focus on expressive movement and gesture, and for theSonification of elite athletes movements.

A MALLEABLE DEVICE WITH APPLICATIONS TO SONIFICATION-BASED DATA EXPLORATION

The device allows continuous localized interaction by providing a malleable interaction surface, and acts as a tangible user interface object, integrated into a tangible computing framework called tDesk.

Oversketching and associated audio-based feedback channels for a virtual sketching application

An extension to an existing immersive virtual sketching application which consists of an oversketching interaction mode, and a set of associated audio-based feedback signals, that allows users to make incremental corrections to the drawing.

An interaction-based model for auditory substitution of tactile percepts

  • Á. CsapóP. Baranyi
  • Computer Science
    2010 IEEE 14th International Conference on Intelligent Engineering Systems
  • 2010
The goal is to develop engineering systems for the remote teleoperation of robots using sensory substitution to convey feedback information in meaningful ways to reduce the cognitive load for the user on the one hand, and help alleviate the effect of control instabilities and network delays on the other.

Interactive Sonification of Abstract Data - Framework, Design Space, Evaluation, and User Tool

The application to geo-referenced data demonstrated that the ADC framework provided a rich set of task-oriented actions (AISAs) that were effective for blind users to accomplish complex tasks with multiple highly coordinated data views and showed that some widely used techniques in visualization can adapt to the auditory mode.

WEARABLE SETUP FOR GESTURE AND MOTION BASED CLOSED LOOP AUDIO INTERACTION

The wearable sensor and feedback system presented in this paper is a type of audio-haptic display which contains onboard sensors, embedded sound synthesis, external sensors, and on the feedback side

AN EXPLORATION OF DESIGN PARAMETERS FOR HUMAN-INTERACTIVE SYSTEMS WITH COMPACT SPHERICAL LOUDSPEAKER ARRAYS

The exploration and evaluation of design parameters is introduced for applications of compact spherical loudspeaker arrays in the context of human-interactive systems. Applications include:

Towards a numerically tractable model for the auditory substitution of tactile percepts

  • Á. CsapóP. Baranyi
  • Computer Science
    2010 3rd International Symposium on Resilient Control Systems
  • 2010
It is argued that it would be worthwhile to create a system in which the sound parameters could be locally tuned to enhance performance on a user-per-user basis and it is demonstrated that it is possible to convert models into such canonical forms.

Methods for Personalized Design of Data Sonification

This thesis examines the process of designing personalized soni cations – audio representations of data – from the perspective of the everyday end user, who is the ultimate listener and interpreter

A Model of Nature Soundscape for Calm Information Display

A perceptual model is proposed to link the acoustic parameters of individual nature sounds and the perceptual attributes of the nature soundscape to offer the designers and practitioners a new tool to utilize nature sounds in the design of the auditory display which could support the calm technology.

References

SHOWING 1-10 OF 17 REFERENCES

The Discipline of Interactive Sonification

This paper defines the sub-topic of Interactive Sonification, explains how a certain quality of interaction is required, overviews current sonification techniques, provides examples of the techniques being applied interactively, and outlines a research agenda for this topic.

Real-Time Control of Sonification Models with an Audio-Haptic Interface

The Data-Solid Sonification Model is introduced, which provides an acoustic representation of the local neighborhood relations in high-dimensional datasets for binary classification problems and is parameterized by a reduced data representation obtained from a growing neural gas network.

A Toolkit for Interactive Sonification

An Interactive Sonification Toolkit is developed which allows the designer to process and scale data sets, then rapidly change the sonification method, and the human user can then interact with the data in a fluid manner, continually controlling the position within the set.

Principal Curve Sonification

A new approach to render sonifications for high-dimensional data, allowing the user to perceive the "main" structure of the data distribution by computing the principal curve of theData set, which is a trajectory that passes through the "middle" of thedata and allows to define a time order on the data points.

The Importance of Parameter Mapping in Electronic Instrument Design

This paper presents a review of a series of experiments which have contributed towards the understanding of the mapping layer in electronic instruments, and suggests that this can define the very essence of an instrument.

Crystallization sonification of high-dimensional datasets

The Crystallization Sonification model is introduced, a sonification model for exploratory analysis of high-dimensional datasets designed to provide information about the intrinsic data dimensionality and the global data Dimensionality, as well as the transitions between a local and global view on a dataset.

Sonification for Exploratory Data Analysis

ion Emotion Tone Therapeutic Cycle

The Importance of Interaction in Sonification

The importance of interaction in sonification is reviewed, how a certain quality of interaction is required is described, examples of the techniques being applied interactively are provided, and a plan of future work is outlined to develop interaction techniques to aid sonification.

International Community for Auditory Display http

  • International Community for Auditory Display http

An interactive sonification toolkit

  • Proceedings of the Int. Conf. on Auditory Display. ICAD
  • 2004