• Corpus ID: 5815777

AudioQuilt: 2D Arrangements of Audio Samples using Metric Learning and Kernelized Sorting

@inproceedings{Fried2014AudioQuilt2A,
  title={AudioQuilt: 2D Arrangements of Audio Samples using Metric Learning and Kernelized Sorting},
  author={Ohad Fried and Zeyu Jin and Reid Oda and Adam Finkelstein},
  booktitle={NIME},
  year={2014}
}
The modern musician enjoys access to a staggering number of audio samples. Composition software can ship with many gigabytes of data, and there are many more to be found online. However, conventional methods for navigating these libraries are still quite rudimentary, and often involve scrolling through alphabetical lists. We present AudioQuilt, a system for sample exploration that allows audio clips to be sorted according to user taste, and arranged in any desired 2D formation such that similar… 

Figures from this paper

Musicmapper: interactive 2d representations of music samples for in-browser remixing and exploration
TLDR
The source code and demo video of the MusicMapper web application, a web application that allows nonexpert users to find and visualize distinctive samples from a song without any manual intervention, and enables remixing by having users play back clusterings of such samples, are presented.
Audealize: Crowdsourced Audio Production Tools
TLDR
Audealize is an interface that bridges the gap between low-level parameters of existing audio production tools and programmatic goals and can be accessed at http://audealize.appspot.com, an example of a general design approach that can apply to other domains.
SIEVE: A PLUGIN FOR THE AUTOMATIC CLASSIFICATION AND INTELLIGENT BROWSING OF KICK AND SNARE SAMPLES
TLDR
This paper presents a new plugin for working with a large collection of kick and snare samples within a music production context using an audio plug-in built using the JUCE software framework.
Groove Explorer: An Intelligent Visual Interface for Drum Loop Library Navigation
TLDR
Preliminary work is presented into the Groove Explorer using Self-Organizing Maps, a large library of symbolic drum loops is automatically mapped on a 2D space according to rhythmic similarity, to make the tool scalable to large libraries.
Master's Thesis: Self-Organizing Maps for Sound Corpus Organization
TLDR
This work implements the Self-Organizing Map (SOM), an established machine learning algorithm for dimensionality reduction and data visualization, and applies it to sound corpus organization, and presents SOM Browser, a fast, visual interface for sample library exploration.
Analysis of Drum Machine Kick and Snare Sounds
The use of electronic drum samples is widespread in contemporary music productions, with music producers having an unprecedented number of samples available to them. The development of new tools to
Exploring the Benefits of 2D Visualizations for Drum Samples Retrieval
TLDR
This study shows that spatial visualizations do improve the overall exploration experience, and reveals the potential of similarity-based arrangements for the support of creative processes.
Searching for Audio by Sketching Mental Images of Sound: A Brave New Idea for Audio Retrieval in Creative Music Production
TLDR
It is argued that the development of a search system that allows for visual queries to audio collections is desired by users and should inform and drive future research in audio retrieval.
Vocal imitation for query by vocalisation
TLDR
The ability of musicians to vocalise synthesised and percussive sounds is investigated, and the suitability of different audio features for predicting the perceptual similarity between vocal imitations and imitated sounds is evaluated.
IsoMatch: Creating Informative Grid Layouts
TLDR
This work presents a fast algorithm that can work on large collections and quantitatively evaluate how well distances are preserved and shows that it can be used for infographics, collection exploration, summarization, data visualization, and even for solving problems such as where to seat family members at a wedding.
...
1
2
...

References

SHOWING 1-10 OF 32 REFERENCES
SoundTorch: Quick Browsing in Large Audio Collections
TLDR
User tests show that this method can leverage the human brain’s capability to single out sounds from a spatial mixture and enhance browsing in large collections of audio content.
Freesound 2: An Improved Platform for Sharing Audio Clips
Freesound.org is an online collaborative sound database where people from different disciplines share recorded sound clips under Creative Commons licenses. It was started in 2005 and it is being
A Matlab Toolbox for Music Information Retrieval
We present MIRToolbox, an integrated set of functions written in Matlab, dedicated to the extraction from audio files of musical features related, among others, to timbre, tonality, rhythm or form.
Computational Models of Similarity for Drum Samples
TLDR
The results indicate that instrument class data can be used as alternative to data from listening tests to evaluate sound similarity models and show that the model based on auditory images yields a very high average correlation with human similarity ratings and clearly outperforms the MPEG-7 recommendation.
HIERARCHICAL ORGANIZATION AND VISUALIZATION OF DRUM SAMPLE LIBRARIES
TLDR
This paper presents a hierarchical user interface for efficient exploration and retrieval based on a computational model of similarity and self-organizing maps for automatically structuring and visualizing large sample libraries through audio signal analysis.
Assistive music browsing using self-organizing maps
TLDR
The foundation of the approach is the automatic extraction of features for describing musical content and the use of self-organizing maps to create two-dimensional representations of music collections, with the ultimate goal is effective browsing without using any meta-data.
Principles and Applications of Interactive Corpus-Based Concatenative Synthesis
TLDR
This work will show musical applications of pieces that explore the new concepts made possible by corpus-based concatenative synthesis, as a content-based extension to granular synthesis providing direct access to specific sound characteristics.
Mused: Navigating the Personal sample Library
TLDR
An interactive scatter plot with dynamic queries to browse, discover, and select material from the personal sample library, a large database of event-synchronous audio segments extracted from a user’s digital music collection.
Distance Metric Learning with Application to Clustering with Side-Information
TLDR
This paper presents an algorithm that, given examples of similar (and, if desired, dissimilar) pairs of points in �”n, learns a distance metric over ℝn that respects these relationships.
Metric Learning: A Survey
  • B. Kulis
  • Computer Science
    Found. Trends Mach. Learn.
  • 2013
TLDR
Metric Learning: A Review presents an overview of existing research in this topic, including recent progress on scaling to high-dimensional feature spaces and to data sets with an extremely large number of data points.
...
1
2
3
4
...