The Audio-Corsi: an acoustic virtual reality-based technological solution for evaluating audio-spatial memory abilities

@article{Setti2021TheAA,
  title={The Audio-Corsi: an acoustic virtual reality-based technological solution for evaluating audio-spatial memory abilities},
  author={Walter Setti and Isaac Engel and Luigi F. Cuturi and Monica Gori and Lorenzo Picinali},
  journal={Journal on Multimodal User Interfaces},
  year={2021},
  volume={16},
  pages={207-218}
}
Spatial memory is a cognitive skill that allows the recall of information about the space, its layout, and items’ locations. We present a novel application built around 3D spatial audio technology to evaluate audio-spatial memory abilities. The sound sources have been spatially distributed employing the 3D Tune-In Toolkit, a virtual acoustic simulator. The participants are presented with sequences of sounds of increasing length emitted from virtual auditory sources around their heads. To… 

Evaluation of a Motion Platform Combined with an Acoustic Virtual Reality Tool: a Spatial Orientation Test in Sighted and Visually Impaired People

The feasibility of a setup composed of a motion platform and an acoustic virtual reality tool with sighted and visually impaired participants and the performance in a self-motion discrimination task with and without auditory cues are investigated.

How much I moved: Robust biases in self-rotation perception

Vestibular cues are crucial to sense the linear and angular acceleration of our head in three-dimensional space. Previous literature showed that vestibular information precociously combines with

References

SHOWING 1-10 OF 46 REFERENCES

A novel paradigm to study spatial memory skills in blind individuals through the auditory modality

An audio test inspired by a validated spatial memory test for blind individuals is designed, showing that sighted subjects performed better than blind participants after the exploration of the semantic scene, suggesting that blind participants focus on the perceived sound positions and do not use items’ locations learned during the exploration.

eCorsi: implementation and testing of the Corsi block-tapping task for digital tablets

Results showed that average span and error rates were essentially analogous to the ones obtained in the main standardization studies, which have used the original physical version of the Corsi test, suggesting that the subject's response is not planned during sequence presentation, but between the end of the presentation and the beginning of the response.

Semantic Elaboration in Auditory and Visual Spatial Memory

The results support the hypotheses that the semantic representation of items, as well as the presentation of items in different modalities, facilitate spatial learning and memory.

The role of vision in the Corsi block-tapping task: evidence from blind and sighted people.

The good performance of blind people, especially adventitiously ones, was interpreted as evidence that sequential haptic inputs were organized spatially in serial-spatial memory in blind people.

3D Tune-In Toolkit: An open-source library for real-time binaural spatialisation

The technical details of the 3D Tune-In Toolkit are presented, outlining its architecture and describing the processes implemented in each of its components, followed by a comparison between the features offered by the 3DTI Toolkit and those found in other currently available open- and closed-source binaural renderers.

The Box Task: A tool to design experiments for assessing visuospatial working memory

The Box Task is described, a paradigm for the computerized assessment of visuospatial working memory in which hidden objects have to be searched by opening closed boxes that are shown at different locations on the computer screen.

Plasticity in the neural coding of auditory space in the mammalian brain.

  • A. KingC. ParsonsD. Moore
  • Psychology, Biology
    Proceedings of the National Academy of Sciences of the United States of America
  • 2000
Experience-induced plasticity allows the neural circuitry underlying sound localization to be customized to individual characteristics, such as the size and shape of the head and ears, and to compensate for natural conductive hearing losses, including those associated with middle ear disease in infancy.

Hearing visual motion in depth

It is shown that an auditory aftereffect occurs from adaptation to visual motion in depth, and psychophysical evidence is provided that, for processing of motion in Depth, the auditory system responds to both auditory changing intensity and visualmotion in depth.

Hearing What the Eyes See

Investigation of whether visually portrayed temporal structure receives automatic, obligatory encoding in the auditory domain finds that the perceptual system automatically and obligatorily abstracts temporal structure from its visual form and represents this structure using an auditory code, resulting in the experience of hearing visual rhythms.