A framework for computer-assisted sound design systems supported by modelling affective and perceptual properties of soundscape

@article{Thorogood2019AFF,
  title={A framework for computer-assisted sound design systems supported by modelling affective and perceptual properties of soundscape},
  author={Miles Thorogood and Jianyu Fan and Philippe Pasquier},
  journal={Journal of New Music Research},
  year={2019},
  volume={48},
  pages={264 - 280}
}
ABSTRACT Autonomously generating artificial soundscapes for video games, virtual reality, and sound art presents several non-trivial challenges. We outline a system called Audio Metaphor that is built upon the notion that sound design for soundscape compositions is emotionally informed. We first define the problem space of generating soundscape compositions referencing the sound design and soundscape literature. Next, we survey the state-of-the-art soundscape generation systems and establish… 
Multi-Label Sound Event Retrieval Using A Deep Learning-Based Siamese Structure With A Pairwise Presence Matrix
TLDR
This work proposes different Deep Learning architectures with a Siamesestructure and a Pairwise Presence Matrix for sound event retrieval, aimed at finding audio samples similar to an audio query based on their acoustic or semantic content.
Research on the Algorithm System for Generation and Creation by Computer Artificial Intelligence and Support Vector Machine
  • Xu Wu
  • Computer Science
    Journal of Physics: Conference Series
  • 2021
TLDR
The project in this paper shows that intelligent algorithm as a composition tool for music generation and creation is an effective music production program and will bring new development to music production.
Neo-Noumena: Augmenting Emotion Communication
TLDR
This work explores "Neo-Noumena", a communicative neuroresponsive system that uses brain-computer interfacing and artificial intelligence to read one's emotional states and dynamically represent them to others in mixed reality through two head-mounted displays.

References

SHOWING 1-10 OF 86 REFERENCES
Soundscape Generation for Virtual Environments using Community-Provided Audio Databases
TLDR
The design methodology incorporates the use of concatenative synthesis to construct a sound environment using online community-provided sonic material, and an application is described in which sound environments are generated for Google Street View using the online sound database Freesound.
The positive soundscape project
The Positive Soundscape Project is a multi-disciplinary investigation of soundscape perception which started in October 2006. This paper communicates the aims and design of the project and discusses
Sonic Experience: A Guide to Everyday Sounds
Le repertoire des effets sonores en anglais. Never before has the everyday soundtrack of urban space been so cacophonous. Since the 1970s, sound researchers have attempted to classify noise, music,
Automatic Recognition of Eventfulness and Pleasantness of Soundscape
TLDR
A gold standard for soundscape affect recognition is generated by averaging responses from people provided people agreed with each other enough and the correlation between the level of pleasantness and thelevel of eventfulness is tested based upon the gold standard.
SimScene : a web-based acoustic scenes simulator
TLDR
This paper introduces a soundscape simulator called SimScene, designed to be used as an experimental tool to characterize the mental representation of sound environments, developed in Javascript using the standard Web Audio technology, and thus fully supported by most modern web browsers.
Emo-soundscapes: A dataset for soundscape emotion recognition
TLDR
A dataset of audio samples called Emo-Soundscapes and two evaluation protocols for machine learning models to benchmark SER are proposed and how the mixing of various soundscape recordings influences their perceived emotion is studied.
Computationally Created Soundscapes with Audio Metaphor
TLDR
This work presents Audio Metaphor, a system for creating novel soundscape compositions that processes natural language queries derived from Twitter for retrieving semantically linked sound recordings from online user-contributed audio databases.
Audio Metaphor: Audio Information Retrieval for Soundscape Composition
TLDR
Audio Metaphor facilitated audience interaction by listening for Tweets that the audience addressed to the performance; in this case, it processed the Twitter feed in realtime to recommend audio files to the soundscape composer.
Impress: A Machine Learning Approach to Soundscape Affect Classification for a Music Performance Environment
TLDR
A new system called Impress is presented that uses supervised machine learning for the acquisition and realtime feedback of soundscape a↵ect, and an audio features vector of audio descriptors was used to represent an audio signal for fitting multiple regression models to predictsoundscape a ↵ect.
Designing Sound
TLDR
The thesis is that any sound can be generated from first principles, guided by analysis and synthesis, and readers use the Pure Data (Pd) language to construct sound objects, which are more flexible and useful than recordings.
...
1
2
3
4
5
...