Internet of Musical Things: Vision and Challenges

  title={Internet of Musical Things: Vision and Challenges},
  author={Luca Turchet and C. Fischione and Georg Essl and Dami{\'a}n Keller and Mathieu Barthet},
  journal={IEEE Access},
The Internet of Musical Things (IoMusT) is an emerging research field positioned at the intersection of Internet of Things, new interfaces for musical expression, ubiquitous music, human–computer interaction, artificial intelligence, and participatory art. From a computer science perspective, IoMusT refers to the networks of computing devices embedded in physical objects (musical things) dedicated to the production and/or reception of musical content. Musical things, such as smart musical… 

Figures and Tables from this paper

The Internet of Audio Things: State of the Art, Vision, and Challenges
The state of the art of this field is reviewed, then a vision for the IoAuT is presented, which enables the connection of digital and physical domains by means of appropriate information and communication technologies, fostering novel applications and services based on auditory information.
An ubiquitous smart guitar system for collaborative musical practice
An ubiquitous smart guitar system which uses the guitar as a hub for collaborative music making and a survey conducted with 18 performers shows a positive emotional engagement with the system which overall was found easy to use and novel.
The things of the Internet of Musical Things: defining the difficulties to standardize the behavior of these devices
This paper proposes software, hardware and communication protocols standards that these devices must follow, in order to improve the user experience and make this field more widespread and easier to understand.
Managing an IoMusT environment and devices
Sunower is presented, a tool that allows communication between different technological and musical elements present in an IoMusT environment, focusing on its management strategies based on a parallel established with other tools that help in musical practice via the network.
The Potential Role of Internet of Musical Things in Therapeutic Applications
This paper will develop a review of what has been achieved in the IoMusT domain, and look ahead to see which trajectories are most likely for the future, particular within the guiding framework of ubiquitous music and computing.
Touching the audience: musical haptic wearables for augmented and participatory live music performances
Suggestions for practitioners interested in designing wearables for enriching the musical experience of audiences of live music via the sense of touch point towards the need of mechanisms of personalization, systems able to minimize the latency between the sound and the vibrations, and a time of adaptation to the vibrations.
Populating the Smart Musical Instruments Ontology with Data
This paper presents a linked data service exposing metadata about SMIs structured according to the Smart Musical Instruments Ontology, as well as a Web application for its extension and retrieval, showing how to retrieve detailed information using metadata describing the SMIs domain.
Towards a Semantic Architecture for the Internet of Musical Things
This paper proposes a semantically-enriched Internet of Musical Things architecture which relies on a semantic audio server and edge computing techniques, and employs a SPARQL Event Processing Architecture as an interoperability enabler allowing multiple heterogeneous Musical Things to cooperate.
On Designing, Composing and Performing Networked Collective Interactions
In this article, we discuss some of our research with Local Area Networks (LAN) in the context of sound installations or musical performances. Our systems, built on top of Web technologies, enable
Sunflower: An Interactive Artistic Environment based on IoMusT Concepts
A demonstration of how Sunflower works in the accomplishment of an artistic presentation is shown, also emphasizing its approach, the technologies that support it, and the advances it can bring to the area of IoMusT.


Towards the Internet of Musical Things
The paper presents the main concepts of IoMUT and discusses the related implications and challenges of the Internet of Musical Things.
Internet of Music Things: an edge computing paradigm for opportunistic crowdsensing
This work presents the crowdsensing architecture for music composition, a class of qualitative music composition applications in the context of the Internet of Things, and discusses an analytical case study of music crowdsensing challenges, and demonstrates edge-cloud computing paradigm along with deliberate outcomes.
The Aesthetics, History and Future Challenges of Interconnected Music Networks
An overview of the field of Interconnected Musical Networks – live performance systems that allow players to influence, share, and shape each other’s music in real-time, and two IMN projects that were developed in the Hyperinstruments group at MIT Media Laboratory are presented.
Musical Performance Practice on Sensor-based Instruments
A personal reflection on a performance practice developed on sensor based instruments, drawn from several years of concert performance with the BioMuse, ensemble work with Sensorband, and the application of instrumental thinking to an installation and network based project: Global String.
The Digital Music Lab
The DML system empowers musicologists by addressing several challenges: distributed processing of audio and other music data, management of the data analysis process and results, remote analysis of data under copyright, logical inference on the extracted information and metadata, and visual web-based interfaces for exploring and querying the music collections.
Computer Musicking: HCI, CSCW and Collaborative Digital Musical Interaction
This chapter explores the confluence of these domains, giving particular attention to challenges posed by the auditory nature of music and the open-ended characteristics of musical interaction.
Prototyping of Ubiquitous Music Ecosystems
The authors present three case studies of prototype deployments for creative musical activities and the limitations and advantages of the three approaches proposed, the hybrid Java/JavaScript environment, the HTML5 audio library and the PNaCl Csound infrastructure.
The Internet of Things vision: Key features, applications and open issues
Ubiquitous music
By outfitting a por table media player with an extra sensor here, a little bit of networking there, researchers are already creating a ubiquitous music experience that makes the iPod feel as quaint as a cassette Walkman.
Augmented Groove: Collaborative Jamming in Augmented Reality
Augmented Groove is a musical interface that explores use of augmented reality, 3D interfaces, and physical, tangible interaction for conducting multimedia musical performance, so several users can gather around the mixing table and "jam" together.