Embodied Interactions with E-Textiles and the Internet of Sounds for Performing Arts

@article{Skach2018EmbodiedIW,
  title={Embodied Interactions with E-Textiles and the Internet of Sounds for Performing Arts},
  author={Sophie Skach and Anna Xamb{\'o} and Luca Turchet and Ariane Stolfi and Rebecca Stewart and Mathieu Barthet},
  journal={Proceedings of the Twelfth International Conference on Tangible, Embedded, and Embodied Interaction},
  year={2018}
}
  • Sophie Skach, Anna Xambó, M. Barthet
  • Published 18 March 2018
  • Art
  • Proceedings of the Twelfth International Conference on Tangible, Embedded, and Embodied Interaction
This paper presents initial steps towards the design of an embedded system for body-centric sonic performance. The proposed prototyping system allows performers to manipulate sounds through gestural interactions captured by textile wearable sensors. The e-textile sensor data control, in real-time, audio synthesis algorithms working with content from Audio Commons, a novel web-based ecosystem for re-purposing crowd-sourced audio. The system enables creative embodied music interactions by… 

Figures from this paper

An Interactive Garment for Orchestra Conducting: IoT-enabled Textile & Machine Learning to Direct Musical Performance
TLDR
A wearable interactive system comprising of textile sensors embedded into a suit, low-power transmission and gesture recognition using creative computing tools, designed such that the training of the algorithms can be intuitively controlled by the conductor, in sync with the MIDI clock.
Textile Designer Perspective on Haptic Interface Design: A Sensorial Platform for Conversation Between Discipline
TLDR
A case study, where a textile designer’s role extends beyond the prototype production, and the findings show that textile design can augment data collection and analysis.
Making Grooves with Needles: Using e-textiles to Encourage Gender Diversity in Embedded Audio Systems Design
TLDR
It is proposed that flexibility in learning, communal dissemination of knowledge, and gendering of tools are prominent reasons why women engage with technology via e-textiles.
SenseBox: A DIY Prototyping Platform to Create Audio Interfaces for Therapy
TLDR
SenseBox, a low-cost, open-source, customizable hardware/software prototyping platform to turn everyday objects into audio triggers for people with disabilities, is presented.
Voice-based interface for accessible soundscape composition: composing soundscapes by vocally querying online sounds repositories
TLDR
An Internet of Audio Things ecosystem devised to support soundscape composition via vocal interactions that involves a commercial voice-based interface and the cloud-based repository of audio content Freesound.org is presented.
sssnake: a remote multiplayer toy for children
TLDR
Ssssnake is a soft toy that allows multi-user play over distance as well as single users playing alone and has a haptic interface that combines social interaction inspired from online gaming with a playful way to learn about music and instruments.
Jamming with a Smart Mandolin and Freesound-based Accompaniment
TLDR
Two use cases investigating how audio content retrieved from Freesound can be leveraged by performers or audiences to produce accompanying soundtracks for music performance with a smart mandolin are presented.
Internet of Musical Things: Vision and Challenges
TLDR
This paper presents a vision in which the IoMusT enables the connection of digital and physical domains by means of appropriate information and communication technologies, fostering novel musical applications and services and identifies key capabilities missing from today's systems.
Interactive sonification and the IoT: the case of smart sonic shoes for clinical applications
  • L. Turchet
  • Computer Science
    Audio Mostly Conference
  • 2019
TLDR
This paper describes a prototype of connected shoes for interactive sonification that can be remotely controlled and can collect data about the gait of a walker to help guide and improve walking actions of patients with motor impairments.
Speculative Design as a Collaborative Practice: Ameliorating the Consequences of Illiteracy through Digital Touch
This article and the design fictions it presents are bound up with an ongoing qualitative-ethnographic study with Imazighen, the native people in remote Morocco. This group of people is marked by
...
1
2
...

References

SHOWING 1-10 OF 30 REFERENCES
Embodied Music Interaction: Creative Design Synergies Between Music Performance and HCI
In music performance, a range of novel digital musical interfaces (DMIs) has been explored that share both real-time and musical interaction. This chapter draws on the theoretical strand in the
The Serendiptichord: Reflections on the Collaborative Design Process between Artist and Researcher
TLDR
This paper reflects on the collaborative process and how defining both creative and research roles for each party led to a successful creative partnership built on mutual respect and open communication.
Augmented Groove: Collaborative Jamming in Augmented Reality
TLDR
Augmented Groove is a musical interface that explores use of augmented reality, 3D interfaces, and physical, tangible interaction for conducting multimedia musical performance, so several users can gather around the mixing table and "jam" together.
Towards an integrated methodological framework for understanding embodiment in HCI
TLDR
It is argued that exploiting synergies between embodiment and technology exploring synergies across the fields of Digital Arts and Social Sciences can contribute towards an integrated, innovative and progressive framework for understanding digital body interactions.
Hacking the Body 2.0: Flutter/Stutter
Flutter/Stutter is an improvisational dance piece, part of the Hacking the Body 2.0 project, that uses networked soft circuit sensors to trigger sound and haptic actuators in the form of a small
Towards the Internet of Musical Things
TLDR
The paper presents the main concepts of IoMUT and discusses the related implications and challenges of the Internet of Musical Things.
Smart instruments : Towards an ecosystem of interoperable devices connecting performers and audiences
This paper proposes a new class of augmented musical instruments, “Smart Instruments”, which are characterized by embedded computational intelligence, bidirectional wireless connectivity, an embedd
Digital Bodies: Creativity and Technology in the Arts and Humanities
  • E. Marchevska
  • Art
    International Journal of Performance Arts and Digital Media
  • 2019
This is a book review of Digital Bodies: Creativity and Technology in the Arts and Humanities. This collection is informed by the shared belief of the editors and contributors alike, regardless of
Talking Through Your Arse: Sensing Conversation with Seat Covers
TLDR
This work uses custom built fabric sensors to test whether it can detect people’s involvement in a conversation using only pressure changes on the seats they are sitting in, and shows that even from this impoverished data it can distinguish between talking, backchanneling and laughter.
Audio Commons: bringing Creative Commons audio content to the creative industries
TLDR
The Audio Commons Initiative is presented, which is aimed at promoting the use of open audio content and at developing technologies with which to support the ecosystem composed by content repositories, production tools and users.
...
1
2
3
...