Retrieval and management system for layer sound effect library

@article{Yang2020RetrievalAM,
  title={Retrieval and management system for layer sound effect library},
  author={Jiale Yang and Ying Zhang and Yang Hai},
  journal={Cogn. Comput. Syst.},
  year={2020},
  volume={2},
  pages={247-253}
}
: Here, the authors present a novel interactive prototype system that enhances the effectiveness and ingenuity for sound designers to explore the sound effect library created by layering in multi-methods. They combine the explored methods of semantic keyword, acoustic feature, and layer relationship. In particular, the system visualises the layer relationship via circle pack, which facilitates the sound designers’ understanding on the components of the mixed sound effect by the designed layer… 

Figures and Tables from this paper

Representation Learning for the Automatic Indexing of Sound Effects Libraries

It is shown that a task-species but dataset-independent representation can successfully address data issues such as class imbalance, inconsistent class labels, and insufficient dataset size, outperforming established representations such as OpenL3.

References

SHOWING 1-10 OF 38 REFERENCES

Browsing Sound and Music Libraries by Similarity

This paper presents a prototype tool for browsing through multimedia libraries using content-based multimedia information retrieval techniques. It is composed of several groups of components for

A proposal and evaluation of new timbre visualization methods for audio sample browsers

It is found that shape significantly improves task performance, while color and texture have little effect, and new methods for generating textural labels and positioning samples based on perceptual representations of timbre are proposed.

Exploring the Benefits of 2D Visualizations for Drum Samples Retrieval

This study shows that spatial visualizations do improve the overall exploration experience, and reveals the potential of similarity-based arrangements for the support of creative processes.

SOUND SEARCH BY CONTENT-BASED NAVIGATION IN LARGE DATABASES

We propose to apply the principle of interactive real-time corpus-based concatenative synthesis to search in effects or instrument sound databases, which becomes content-based navigation in a space

Fuzzy Content-Based Audio Retrieval Using Visualization Tools

The presented approach applies visualization tools to speed up retrieval time compared to a simple KD-Tree algorithm and finds that the application of UMAP yield an order of-magnitude speed-up at a loss of accuracy and that the approach scales well with larger datasets.

A Semantic and Content-Based Search User Interface for Browsing Large Collections of Foley Sounds

This work investigates an audio search engine that associates content-based features and semantic meta-data using Apache Solr deployed in a fully integrated server architecture and proposes a search user interface in which the user can perform both text-based queries and visual browsing in a window where sounds are organized according to their audio features.

Sound Sharing and Retrieval

This chapter describes how to build an audio database by outlining different aspects to be taken into account and discusses metadata-based descriptions of audio content and different searching and browsing techniques that can be used to navigate the database.

SoundTorch: Quick Browsing in Large Audio Collections

User tests show that this method can leverage the human brain’s capability to single out sounds from a spatial mixture and enhance browsing in large collections of audio content.

Semantic browsing of sound databases without keywords

This paper presents and studies the efficiency of two sound presentation strategies that organize sounds spatially so as to reflect an underlying semantic hierarchy and demonstrates the usefulness of using an implicit semantic organization to display sounds, both in terms of search speed and of efficiency of learning.

Search Result Clustering in Collaborative Sound Collections

This work proposes a graph-based approach using audio features for clustering diverse sound collections obtained when querying large online databases, and shows that using a confidence measure for discarding inconsistent clusters improves the quality of the partitions.