Interacting with sonification systems: closing the loop

@article{Hunt2004InteractingWS,
  title={Interacting with sonification systems: closing the loop},
  author={Andy Hunt and Thomas Hermann and Sandra Pauletto},
  journal={Proceedings. Eighth International Conference on Information Visualisation, 2004. IV 2004.},
  year={2004},
  pages={879-884}
}
  • A. Hunt, T. Hermann, S. Pauletto
  • Published 2004
  • Computer Science
  • Proceedings. Eighth International Conference on Information Visualisation, 2004. IV 2004.
This paper stresses the importance of the human user being tightly embedded within an interactive control loop for exploring data sets using sound. We consider the quality of interaction, and how this can be improved in computer systems by learning from real-world acoustic interactions. We describe how different sonification methods can utilise the human feedback loop to enhance the perception and analysis of the data under investigation. Some considerations are given regarding systems and… Expand
Oversketching and associated audio-based feedback channels for a virtual sketching application
TLDR
An extension to an existing immersive virtual sketching application which consists of an oversketching interaction mode, and a set of associated audio-based feedback signals, that allows users to make incremental corrections to the drawing. Expand
An interaction-based model for auditory substitution of tactile percepts
  • Á. Csapó, P. Baranyi
  • Computer Science
  • 2010 IEEE 14th International Conference on Intelligent Engineering Systems
  • 2010
TLDR
The goal is to develop engineering systems for the remote teleoperation of robots using sensory substitution to convey feedback information in meaningful ways to reduce the cognitive load for the user on the one hand, and help alleviate the effect of control instabilities and network delays on the other. Expand
WEARABLE SETUP FOR GESTURE AND MOTION BASED CLOSED LOOP AUDIO INTERACTION
The wearable sensor and feedback system presented in this paper is a type of audio-haptic display which contains onboard sensors, embedded sound synthesis, external sensors, and on the feedback sideExpand
AN EXPLORATION OF DESIGN PARAMETERS FOR HUMAN-INTERACTIVE SYSTEMS WITH COMPACT SPHERICAL LOUDSPEAKER ARRAYS
The exploration and evaluation of design parameters is introduced for applications of compact spherical loudspeaker arrays in the context of human-interactive systems. Applications include:Expand
Methods for Personalized Design of Data Sonification
This thesis examines the process of designing personalized soni cations – audio representations of data – from the perspective of the everyday end user, who is the ultimate listener and interpreterExpand
Guiding visual search tasks using gaze-contingent auditory feedback
TLDR
In the presented approach, gaze-contingent auditory feedback (sonification) is used to guide visual attention and it is shown that people are able to make use of this guidance to speed up visual search tasks significantly. Expand
Surface Interactions for Interactive Sonification
TLDR
This paper presents novel interaction modes for Model-Based Sonification via interactive surfaces and discusses the available interaction modes with multi-touch surfaces and how these interactions can be profitably used to control spatial and non-spatial sonification models. Expand
On the Role of Auditory Feedback in Robot-Assisted Movement Training after Stroke: Review of the Literature
TLDR
Several scenarios are proposed in which the use of auditory feedback may contribute to overcome some of the main limitations of current rehabilitation systems, in terms of user engagement, development of acute-phase and home rehabilitation devices, learning of more complex motor tasks, and improving activities of daily living. Expand
Multi-touch interactions for model-based sonification
TLDR
Novel interaction modes for Model-Based Sonification (MBS) via a multi-touch interface are presented and how these interactions can be profitably used to control spatial and non-spatial sonification models are discussed. Expand
Assisting End Users in the Design of Sonification Systems
TLDR
This dissertation focuses on the design of sonifications, which are the representation of data using sound, which is an ideal domain for end-user development and data-driven design creation. Expand
...
1
2
...

References

SHOWING 1-10 OF 16 REFERENCES
The Importance of Interaction in Sonification
TLDR
The importance of interaction in sonification is reviewed, how a certain quality of interaction is required is described, examples of the techniques being applied interactively are provided, and a plan of future work is outlined to develop interaction techniques to aid sonification. Expand
The Discipline of Interactive Sonification
TLDR
This paper defines the sub-topic of Interactive Sonification, explains how a certain quality of interaction is required, overviews current sonification techniques, provides examples of the techniques being applied interactively, and outlines a research agenda for this topic. Expand
Real-Time Control of Sonification Models with an Audio-Haptic Interface
TLDR
The Data-Solid Sonification Model is introduced, which provides an acoustic representation of the local neighborhood relations in high-dimensional datasets for binary classification problems and is parameterized by a reduced data representation obtained from a growing neural gas network. Expand
Principal Curve Sonification
TLDR
A new approach to render sonifications for high-dimensional data, allowing the user to perceive the "main" structure of the data distribution by computing the principal curve of theData set, which is a trajectory that passes through the "middle" of thedata and allows to define a time order on the data points. Expand
The Importance of Parameter Mapping in Electronic Instrument Design
TLDR
This paper presents a review of a series of experiments which have contributed towards the understanding of the mapping layer in electronic instruments, and suggests that this can define the very essence of an instrument. Expand
Crystallization sonification of high-dimensional datasets
TLDR
The Crystallization Sonification model is introduced, a sonification model for exploratory analysis of high-dimensional datasets designed to provide information about the intrinsic data dimensionality and the global data Dimensionality, as well as the transitions between a local and global view on a dataset. Expand
International Community for Auditory Display http
  • International Community for Auditory Display http
An interactive sonification toolkit
  • Proceedings of the Int. Conf. on Auditory Display. ICAD
  • 2004
Radical User Interfaces for Real-time Musical Control
  • Radical User Interfaces for Real-time Musical Control
  • 2000
Radical User Interfaces for Real-time Musical Control, Ph.D
  • thesis, University of York,
  • 2000
...
1
2
...