Jamming with a Smart Mandolin and Freesound-based Accompaniment

  title={Jamming with a Smart Mandolin and Freesound-based Accompaniment},
  author={Luca Turchet and Mathieu Barthet},
  journal={2018 23rd Conference of Open Innovations Association (FRUCT)},
  • L. Turchet, M. Barthet
  • Published 1 November 2018
  • Art
  • 2018 23rd Conference of Open Innovations Association (FRUCT)
This paper presents an Internet of Musical Things ecosystem involving musicians and audiences interacting with a smart mandolin, smartphones, and the Audio Commons online repository Freesound. The ecosystem has been devised to support performer-instrument and performer-audience interactions through the generation of musical accompaniments exploiting crowd-sourced sounds. We present two use cases investigating how audio content retrieved from Freesound can be leveraged by performers or audiences… 

Figures from this paper

Voice-based interface for accessible soundscape composition: composing soundscapes by vocally querying online sounds repositories
An Internet of Audio Things ecosystem devised to support soundscape composition via vocal interactions that involves a commercial voice-based interface and the cloud-based repository of audio content Freesound.org is presented.
An ubiquitous smart guitar system for collaborative musical practice
An ubiquitous smart guitar system which uses the guitar as a hub for collaborative music making and a survey conducted with 18 performers shows a positive emotional engagement with the system which overall was found easy to use and novel.
Cloud-smart Musical Instrument Interactions
A smart guitar prototype is presented that allows retrieving songs from large online music databases using criteria different from conventional music search, which were derived from interviewing 30 guitar players.
SOURCE: a Freesound Community Music Sampler
  • F. Font
  • Computer Science
    Audio Mostly Conference
  • 2021
This paper describes the architecture of SOURCE and the different ways in which it interacts with Freesound and sees SOURCE as a proof of concept device that can be used as and extendable base system on top of which further research on the interaction between hardware devices and online large sound collections can be carried out.
Populating the Smart Musical Instruments Ontology with Data
This paper presents a linked data service exposing metadata about SMIs structured according to the Smart Musical Instruments Ontology, as well as a Web application for its extension and retrieval, showing how to retrieve detailed information using metadata describing the SMIs domain.
C Minor: a Semantic Publish/Subscribe Broker for the Internet of Musical Things
This paper proposes C Minor, a CoAP-based semantic publish/subscribe broker specifically designed to meet the requirements of Internet of Musical Things applications, but relevant for any IoT scenario.


Playsound.space: Inclusive Free Music Improvisations Using Audio Commons
Results indicate that the system was found easy to use and supports creative collaboration and expressiveness irrespective of musical ability.
Live Repurposing of Sounds: MIR Explorations with Personal and Crowdsourced Databases
A live coding system built on SuperCollider enabling the use of audio content from online Creative Commons (CC) sound databases such as Freesound or personal sound databases and its potential in facilitating tailorability of the tool to their own creative workflows is demonstrated.
Datascaping: Data Sonification as a Narrative Device in Soundscape Composition
This paper investigates the use of data sonification as a narrative tool in soundscape composition, and shows a strong ability in participants to decode and comprehend additional layers of narrative information communicated through the soundscape.
Open Symphony: Creative Participation for Audiences of Live Music Performances
Open Symphony is designed to explore audience-performer interaction in live music performances, assisted by digital technology, and identified further design challenges around audience sense of control, learnability, and compositional structure.
Freesound 2: An Improved Platform for Sharing Audio Clips
Freesound.org is an online collaborative sound database where people from different disciplines share recorded sound clips under Creative Commons licenses. It was started in 2005 and it is being
Smart Mandolin: autobiographical design, implementation, use cases, and lessons learned
  • L. Turchet
  • Computer Science
    Audio Mostly Conference
  • 2018
This paper presents the Smart Mandolin, an exemplar of the family of the so-called smart instruments. Developed according to the paradigms of autobiographical design, it consists of a conventional
Designing collaborative musical experiences for broad audiences
The design and audience evaluation of a collaborative interactive music system titled Polymetros, designed for broad audiences, and an audience evaluation that was conducted during an exhibition at a major art museum in the UK attended by large numbers of the general public across the age range are presented.
An Overview on Networked Music Performance Technologies
This paper offers a review of the psycho-perceptual studies conducted in the past decade, aimed at identifying latency tolerance thresholds for synchronous real-time musical performance, and provides an overview of hardware/software enabling technologies for NMP.
A Web Application for Audience Participation in Live Music Performance: The Open Symphony Use Case
A web-based application enabling audiences to collaboratively contribute to the creative process during live music performances and enhancing audience engagement and creating new forms of live music experiences is presented.
Open band: Audience Creative Participation Using Web Audio Synthesis
This work investigates a web-based open environment enabling collaborative music experiences. We propose an artifact, Open Band, which enables collective sound dialogues in a web “agora”, blurring