• Corpus ID: 40689409

Intelligent audio plugin framework for the Web Audio API

@inproceedings{Jillings2017IntelligentAP,
  title={Intelligent audio plugin framework for the Web Audio API},
  author={Nicholas Jillings and Yonghao Wang and Ryan Stables and Joshua D. Reiss},
  year={2017}
}
The Web Audio API introduced native audio processing into web browsers. Audio plugin standards have been created for developers to create audio-rich processors and deploy them into media rich websites. It is critical these standards support flexible designs with clear host-plugin interaction to ease integration and avoid non-standard plugins. Intelligent features should be embedded into standards to help develop next-generation interfaces and designs. This paper presents a discussion on audio… 

Figures from this paper

Towards an open Web Audio plugin standard
TLDR
This paper presents the proposal including guidelines and proof of concept implementations for an open Web Audio plug-in standard - essentially the infrastructure to support high level audio plug-ins for the browser.
Web Audio Modules 2.0: an Open Web Audio Plugin Standard
TLDR
This work aims to create a continuum between native and browser based audio app development and to appeal to programmers from both worlds.
WAP: Ideas for a Web Audio Plug-in Standard
TLDR
This paper presents the work achieved so far in the development of a draft API specification, a small preliminary SDK, online plug-in validators and a set of examples written in JavaScript, which show how to discover plug-ins from repositories, how to instantiate aplug-in and how to connectplug-ins together.
FAUST online IDE: dynamically compile and publish FAUST code as WebAudio Plugins
TLDR
This paper presents a solution based around FAUST, its redesigned Web based editor, and the integration of a plugin GUI editor allowing to directly test, generate and deploy WAP plugins.
Develop WebAudio Plugins in a Web Browser
We propose to demo an online IDE based around the FAUST DSP audio language that includes a source code editor, an embedded compiler and a GUI editor allowing to directly test, generate and deploy
WebAudio Virtual Tube Guitar Amps and Pedal Board Design
TLDR
The latest experiments with the WebAudio API are exposed to design different types of gears for guitarists: real-time simulations of tube guitars amplifiers, fx pedals, and their integration in a virtual pedal board.
Low latency audio processing
TLDR
This thesis investigated the fundamental causes of the latency in a modern digital audio processing system: group delay, buffering delay, and physical propagation delay and their associated system components and proposed new scheduling algorithms for the operating system suitable for low latency audio processing.
Guitarists will be happy: guitar tube amp simulators and FX pedals in a virtual pedal board, and more!
HAL is a multi-disciplinary open access archive for the deposit and dissemination of scientific research documents, whether they are published or not. The documents may come from teaching and
Real-Time Sound Synthesis of Audience Applause
TLDR
A procedural model for synthesizing applause sounds that contains novel aspects to ensure high quality and usability is investigated, and the implementation contains meaningful parameters that allow a user to configure and change the sound to achieve a multitude of different types of applause.
From wikis to tube guitar amplifier simulations, the universal web platform... (Des wikis aux simulations d'amplificateurs de guitare à lampes, le Web plateforme universelle...)
TLDR
HAL is a multi-disciplinary open access archive for the deposit and dissemination of scientific research documents, whether they are published or not, for teaching and research institutions in France or abroad.
...
...

References

SHOWING 1-10 OF 15 REFERENCES
WAAX: Web Audio API eXtension
TLDR
Common issues in web audio programming are described, how WAAX can speed up the development is illustrated, and future developments are discussed.
Web Audio Modules
TLDR
This paper proposes the WAM API – which integrates into the existing Web Audio API – and provides its implementation for JavaScript and C++ bindings, and finds that the performance is sufficient for reasonable polyphony, depending on the complexity of the processing algorithms.
JS-Xtract: A Realtime Audio Feature Extraction Library for the Web
JS-Xtract is an efficient modular JavaScript library for audio feature extraction, capable of operating on arbitrary time-series data, or being bound to Web Audio objects. The library implements an
Audealize: Crowdsourced Audio Production Tools
TLDR
Audealize is an interface that bridges the gap between low-level parameters of existing audio production tools and programmatic goals and can be accessed at http://audealize.appspot.com, an example of a general design approach that can apply to other domains.
MIXPLORATION: rethinking the audio mixer interface
TLDR
The mixer interface is rethink, describing an alternative interface for exploring the space of possible mixes of four audio tracks and users responded that the proposed alternative interface facilitated exploration and that they considered the process of rating mixes to be beneficial.
The Studio Ontology Framework
TLDR
The primary aim of this ontology is to capture the nuances of record production by providing an explicit, application and situation independent conceptualisation of the studio environment.
Mobile application development
Web apps are cheaper to develop and deploy than native apps, but can they match the native user experience?
Variation in Multitrack Mixes: Analysis of Low-level Audio Signal Features
To further the development of intelligent music production tools, towards generating mixes that would realistically be created by a human mix-engineer, it is important to understand what kind of
SAFE: A System for the Extraction and Retrieval of Semantic Audio Descriptors
TLDR
This tutorial jumps right in to the power of VST plugins without dragging you through basic VST installation and data collection.
Intelligent systems for mixing multichannel audio
  • J. Reiss
  • Computer Science
    2011 17th International Conference on Digital Signal Processing (DSP)
  • 2011
TLDR
This paper describes an emerging field of multichannel audio signal processing where the inter-channel relationships are exploited in order to manipulate theMultichannel content.
...
...