Cloud-smart Musical Instrument Interactions

  title={Cloud-smart Musical Instrument Interactions},
  author={Luca Turchet and Johan Pauwels and C. Fischione and Gy{\"o}rgy Fazekas},
  journal={ACM Transactions on Internet of Things},
  pages={1 - 29}
Large online music databases under Creative Commons licenses are rarely recorded by well-known artists, therefore conventional metadata-based search is insufficient in their adaptation to instrument players’ needs. The emerging class of smart musical instruments (SMIs) can address this challenge. Thanks to direct internet connectivity and embedded processing, SMIs can send requests to repositories and reproduce the response for improvisation, composition, or learning purposes. We present a… 

Figures and Tables from this paper

Elk Audio OS
The Elk Audio OS is a Linux-based OS optimized for ultra-low-latency and high-performance audio and sensor processing on embedded hardware, as well as for handling wireless connectivity to local and remote networks.
Blockchain-based internet of musical things
Transformation of Nonmultiple Cluster Music Cyclic Shift Topology to Music Performance Style
  • Jing Li
  • Computer Science
  • 2021
A feature extraction method for extracting segment features from nonmultiple cluster music files, and a music style classification system is implemented in the MATLAB environment that can effectively classify music performance styles.
Populating the Smart Musical Instruments Ontology with Data
This paper presents a linked data service exposing metadata about SMIs structured according to the Smart Musical Instruments Ontology, as well as a Web application for its extension and retrieval, showing how to retrieve detailed information using metadata describing the SMIs domain.
Voice-based interface for accessible soundscape composition: composing soundscapes by vocally querying online sounds repositories
An Internet of Audio Things ecosystem devised to support soundscape composition via vocal interactions that involves a commercial voice-based interface and the cloud-based repository of audio content is presented.
Optical Music Recognition: State of the Art and Major Challenges
This paper reviews relevant works in OMR, including fundamental methods and significant outcomes, and highlights different stages of the OMR pipeline, which often lack standard input and output representation and standardised evaluation.


Examples of use cases with Smart Instruments
Some of the novel interactions enabled by Sensus technology are presented, which are based on connectivity of the instrument to smart devices, virtual reality headsets, and the cloud.
Encumbered Interaction: a Study of Musicians Preparing to Perform
Challenges for augmenting guitars within the rehearsal process are identified by supporting interaction that is encumbered, contextual and connected, and a range of possible responses are suggested.
Interaction design: beyond human-computer interaction
There's Not an App for ThatOptimizing Human-Computer Interaction With Emerging TechnologiesCross-disciplinary Advances in Human Computer InteractionInteraction Design human-computer Interaction interdisciplinary Interaction Design interaction designAbout FaceDesigning the User InterfaceFuture InteractiondesignDesign for How People ThinkThoughtful Interaction design human-Computer interaction.
Making the Most of Wi-Fi: Optimisations for Robust Wireless Live Music Performance
The manufacture and testing of a prototype directional antenna that is designed to maximise sensitivity to a performer’s signal while suppressing interference from elsewhere is summarized and a set of recommended Wi-Fi configurations to reduce latency and increase throughput is proposed.
Jam with Jamendo: Querying a Large Music Collection by Chords from a Learner's Perspective
A web app prototype that allows novice and expert musicians to discover songs in Jamendo's music collection by specifying a set of chords, and identifies some design recommendations for future applications of music learning and music search engines focusing on the user experience when interacting with sound.
Smart Mandolin: autobiographical design, implementation, use cases, and lessons learned
  • L. Turchet
  • Computer Science
    Audio Mostly Conference
  • 2018
This paper presents the Smart Mandolin, an exemplar of the family of the so-called smart instruments. Developed according to the paradigms of autobiographical design, it consists of a conventional
Confidence Measures and Their Applications in Music Labelling Systems Based on Hidden Markov Models
Music labelling, chord and key recognition, probabilistic models, confidence measure, usability, channel separation from stereo signals, Audio Commons.
entomopathogenic fungi in soybean aphid population dynamics will be presented during this talk. The black cutworm, Agrotis ipsilon (Hufnagel) is considered one of the most important pests of golf
  • 2000