The Internet of Audio Things: State of the Art, Vision, and Challenges

@article{Turchet2020TheIO,
  title={The Internet of Audio Things: State of the Art, Vision, and Challenges},
  author={Luca Turchet and Gy{\"o}rgy Fazekas and Mathieu Lagrange and Hossein Shokri Ghadikolaei and C. Fischione},
  journal={IEEE Internet of Things Journal},
  year={2020},
  volume={7},
  pages={10233-10249}
}
The Internet of Audio Things (IoAuT) is an emerging research field positioned at the intersection of the Internet of Things, sound and music computing, artificial intelligence, and human–computer interaction. The IoAuT refers to the networks of computing devices embedded in physical objects (Audio Things) dedicated to the production, reception, analysis, and understanding of audio in distributed environments. Audio Things, such as nodes of wireless acoustic sensor networks, are connected by an… 

Figures from this paper

Elk Audio OS
TLDR
The Elk Audio OS is a Linux-based OS optimized for ultra-low-latency and high-performance audio and sensor processing on embedded hardware, as well as for handling wireless connectivity to local and remote networks.
A Comparative Survey on Wireless Sensor Networks based Internet of Things (IoT)
TLDR
The purpose of the study is to represent a discussion of contrast and similarities of the Internet of Things (IoT) with the most effective wireless sensor networks, and application requirements such as quality of service, security, scalability etc. for WSN and IOT are compared.
Energy Efficiency is Not Enough:Towards a Batteryless Internet of Sounds
TLDR
This position paper advocates for digital sobriety in the design and usage of wireless acoustic sensors, and presents a simple-minded detector of sine tones in background noise, which relies on a fixed-point implementation of the fast Fourier transform (FFT).
Populating the Smart Musical Instruments Ontology with Data
TLDR
This paper presents a linked data service exposing metadata about SMIs structured according to the Smart Musical Instruments Ontology, as well as a Web application for its extension and retrieval, showing how to retrieve detailed information using metadata describing the SMIs domain.
Towards Citizen Science for Smart Cities: A Framework for a Collaborative Game of Bird Call Recognition Based on Internet of Sound Practices
TLDR
It is suggested that engagement in Citizen Science projects applied on Smart Cities infrastructure can be enhanced through contextual and structural game elements realized through augmented audio interactive mechanisms.
Virtual Reconstruction of Visually Conveyed Images under Multimedia Intelligent Sensor Network Node Layout
TLDR
This paper proposes image virtual reconstruction theory based on visual communication research, treats imagevirtual reconstruction content as open data links and customized domain ontology, establishes an interdisciplinary interactive research framework through the technical means of visual communication, solves the problem of data heterogeneity brought by image virtual reconstructing, and establishes a three-dimensional visualization research method and principle ofVisual communication.
Streaaam: A fully automated experimental audio streaming server
TLDR
The project’s technical implementation, software development and program curation cycles, pedagogical experiences with the project thus far, and plans for future work are discussed.
Voice-based interface for accessible soundscape composition: composing soundscapes by vocally querying online sounds repositories
TLDR
An Internet of Audio Things ecosystem devised to support soundscape composition via vocal interactions that involves a commercial voice-based interface and the cloud-based repository of audio content Freesound.org is presented.
Implementing Remote Audio as a Diagnostics Tool for Maritime Autonomous Surface Ships
TLDR
The use and application of a remote server to feed audio and other data in the simulated virtual engine and to create hypothetical failures scenarios for testing and training are examined.
Comparative Assessment of Data Augmentation for Semi-Supervised Polyphonic Sound Event Detection
TLDR
This work proposes a CRNN system exploiting unlabeled data with semi-supervised learning based on the “Mean teacher” method, in combination with data augmentation to overcome the limited size of the training dataset and to further improve the performances.
...
1
2
...

References

SHOWING 1-10 OF 180 REFERENCES
Internet of Musical Things: Vision and Challenges
TLDR
This paper presents a vision in which the IoMusT enables the connection of digital and physical domains by means of appropriate information and communication technologies, fostering novel musical applications and services and identifies key capabilities missing from today's systems.
The Internet of Things vision: Key features, applications and open issues
  • E. Borgia
  • Computer Science
    Comput. Commun.
  • 2014
Practical Considerations for Acoustic Source Localization in the IoT Era: Platforms, Energy Efficiency, and Performance
TLDR
Different algorithms and implementations over several state-of-the-art platforms are discussed, analyzing important aspects, such as the tradeoffs between performance, energy efficiency, and exploitation of parallelism by taking into account real-time constraints.
Applications and trends in wireless acoustic sensor networks: A signal processing perspective
  • A. Bertrand
  • Computer Science
    2011 18th IEEE Symposium on Communications and Vehicular Technology in the Benelux (SCVT)
  • 2011
TLDR
An overview of applications and trends in the field of WASNs is given, and it is explained how advances in the area of signal processing can relax the high-demanding constraints on the network layer design.
Smart Audio Sensors in the Internet of Things Edge for Anomaly Detection
TLDR
This paper proposes a design framework for smart audio sensors able to record and pre-process raw audio streams, before wirelessly transmitting the computed audio features to a modular IoT gateway, capable of detecting audio anomalies in real-time.
The Internet of Things—A survey of topics and trends
TLDR
The current state of research on the Internet of Things is reported on by examining the literature, identifying current trends, describing challenges that threaten IoT diffusion, presenting open research questions and future directions and compiling a comprehensive reference list to assist researchers.
From the Internet of Things to the Web of Things: Resource-oriented Architecture and Best Practices
TLDR
This chapter describes the Web of Things (WoT) architecture and best practices based on the RESTful principles that have already contributed to the popular success, scalability, and evolvability of the Web.
...
1
2
3
4
5
...