• Corpus ID: 225118165

Essentia.js: A JavaScript Library for Music and Audio Analysis on the Web

@inproceedings{Correya2020EssentiajsAJ,
  title={Essentia.js: A JavaScript Library for Music and Audio Analysis on the Web},
  author={Albin Andrew Correya and Dmitry Bogdanov and Luis Joglar-Ongay and Xavier Serra},
  booktitle={ISMIR},
  year={2020}
}
Open-source software libraries for audio/music analysis and feature extraction have a significant impact on the development of Audio Signal Processing and Music Information Retrieval (MIR) systems. Despite the abundance of such tools on the native computing platforms, there is a lack of an extensive and easy-to-use reference library for audio feature extraction on the Web. In this paper, we present Essentia.js, an open-source JavaScript (JS) library for audio and music analysis on both web… 

Figures from this paper

Audio and Music Analysis on the Web using Essentia.js

This work wrote the API using TypeScript for static typing, and to be able to transpile the library for new and old JS targets (for forward and backward compatibility) as the ECMAScript (ES)14 specification continues to evolve.

Essentia TensorFlow Models for Audio and Music Processing on the Web

A collection of open pre-trained TensorFlow.js models for music-related tasks on the Web, including genres, moods, danceability, voice or instrumentation, tempo estimation, and music feature embeddings are presented.

An Educational Guide through the FMP Notebooks for Teaching and Learning Fundamentals of Music Processing

This paper provides a guide through the FMP notebooks, a comprehensive collection of educational material for teaching and learning fundamentals of music processing (FMP) with a particular focus on

References

SHOWING 1-10 OF 32 REFERENCES

Meyda: an Audio Feature Extraction Library for the Web Audio API

Myda provides the first library for audio feature extraction in the web client, which will enable music information retrieval systems, complex visualisations and a wide variety of technologies and creative projects that previously were relegated to native software.

JS-Xtract: A Realtime Audio Feature Extraction Library for the Web

JS-Xtract is an efficient modular JavaScript library for audio feature extraction, capable of operating on arbitrary time-series data, or being bound to Web Audio objects. The library implements an

Web Audio Modules

This paper proposes the WAM API – which integrates into the existing Web Audio API – and provides its implementation for JavaScript and C++ bindings, and finds that the performance is sufficient for reasonable polyphony, depending on the complexity of the processing algorithms.

Web Audio Evaluation Tool: A Browser-based Listening Test Environment

This paper proposes a tool supporting a wide variety of easily configurable, multi-stimulus perceptual audio evaluation tests over the web with multiple test interfaces, preand post-test surveys, custom configuration, collection of test metrics and other features.

madmom: A New Python Audio and Music Signal Processing Library

Madmom is an open-source audio processing and music information retrieval (MIR) library written in Python that features a concise, NumPy-compatible, object oriented design with simple calling conventions and sensible default values for all parameters that facilitates fast prototyping of MIR applications.

An Evaluation of Audio Feature Extraction Toolboxes

This paper allows a software engineer or researcher to quickly and easily select a suitable audio feature extraction toolbox.

Numerical computing on the web: benchmarking for the future

A new benchmarking approach was developed, which allowed for centralized benchmarking, including benchmarking on mobile and IoT devices, and studied the performance evolution of JavaScript, the relative performance of WebAssembly, the performance of server-side Node.js, and a comprehensive performance showdown for a wide range of devices.

Bringing the web up to speed with WebAssembly

The motivation, design and formal semantics of WebAssembly are described, some preliminary experience with implementations are provided, and it is described how WebAssembly is an abstraction over modern hardware, making it language-, hardware-, and platform-independent, with use cases beyond just the Web.

Audioworklet: the Future of Web Audio

The design of AudioWorklet brings JavaScript-based audio processing that is fast, reliable and secure while addressing numerous problems found in the earlier ScriptProcessorNode.

EarSketch : Teaching computational music remixing in an online Web Audio based learning environment

The technical framework of EarSketch is explored in greater detail and the opportunities and challenges associated with using the Web Audio API to realize the project are discussed.