• Corpus ID: 28497208

"Did you laugh enough today?" - Deep Neural Networks for Mobile and Wearable Laughter Trackers

  title={"Did you laugh enough today?" - Deep Neural Networks for Mobile and Wearable Laughter Trackers},
  author={Gerhard Hagerer and Nicholas Cummins and Florian Eyben and Bj{\"o}rn Schuller},
In this paper we describe a mobile and wearable devices app that recognises laughter from speech in real-time. The laughter detection is based on a deep neural network architecture, which runs smoothly and robustly, even natively on a smartwatch. Further, this paper presents results demonstrating that our approach achieves state-of-the-art laughter detection performance on the SSPNet Vocalization Corpus (SVC) from the 2013 Interspeech Computational Paralinguistics Challenge Social Signals Sub… 

Figures and Tables from this paper

Robust Laughter Detection for Wearable Wellbeing Sensing

To build a noise-robust online-capable laughter detector for behavioural monitoring on wearables, context-sensitive Long Short-Term Memory Deep Neural Networks are incorporated and potentially improves the detection of vocal cues when the amount of training data is small and robustness and efficiency are required.

Laughter Recognition Using Non-invasive Wearable Devices

This paper evaluates the feasibility of a novel, multi-modal approach to recognize laughter episodes using physiological and body movement data gathered with unobtrusive, wrist-worn devices and shows that laughter episodes can be distinguished from non-laughter episodes with an accuracy of 81%.

Non-Verbal Vocalisation and Laughter Detection Using Sequence-to-Sequence Models and Multi-Label Training

This paper presents studies using sequence-to-sequence deep neural networks where multiple NVV classes are included rather than mapping them to “other” and allow more than one label per sample, and shows that this approach yields better performance than the standard approach on NVV detection.

Latest Advances in Computational Speech Analysis for Mobile Sensing

Within this chapter, a selection of state-of-the-art speech analysis toolkits, which enable this research, are introduced and their advantages and limitations concerning mobile sensing are discussed.

Which Model is Best: Comparing Methods and Metrics for Automatic Laughter Detection in a Naturalistic Conversational Dataset

This paper replicates previous work on laughter detection on artificial datasets and extends them by validating the methods on a larger and more naturalistic dataset made up of 60 spontaneous conversations with the best performing model achieving an AUC of 90.39 ± 1.10.

Digital Phenotyping and Mobile Sensing: New Developments in Psychoinformatics

This book offers a snapshot of cutting-edge applications of mobile sensing for digital phenotyping in the field of Psychoinformatics, and presents relevant case studies and good scientific practices, thus addressing researchers and professionals alike.

Laughter as a Controller in a Stress Buster Game

The design and validation of a game, "Laugh Out Loud", in which laughter acts as the controller of the game mechanics, in which the goal is to bloom a wilted flower by laughing.



Social signal classification using deep blstm recurrent neural networks

This paper investigates the effect of applying deep bidirectional Long Short-Term Memory recurrent neural networks to the Interspeech 2013 Computational Paralinguistics Social Signals Sub-Challenge dataset requiring frame-wise, speaker-independent detection and classification of laughter and filler vocalizations in speech.

Laughter detection in the wild: demonstrating a tool for mobile social signal processing and visualization

A demonstrator for laughter recognition that was implemented with MobileSSI, a flexible software framework for Android and embedded Linux platforms, that provides developers with tools to record, analyze and recognize human behavior in real-time on mobile devices.

Detecting autism, emotions and social signals using adaboost

This paper treats sub-challenges of paralinguistic detection, categorizing whole (albeit short) recordings by speaker emotion, conflict or the presence of development disorders (autism) as general classification tasks and applies the general-purpose machine learning meta-algorithm, AdaBoost.MH, and its recently proposed variant, Ada boost.BA, to them.

Paralinguistic event detection from speech using probabilistic time-series smoothing and masking

Improved area under receiver operating characteristic (ROC) curve for laughters and fillers suggests the importance of using temporal context for detecting these paralinguistic events.

Enhancing LSTM RNN-Based Speech Overlap Detection by Artificially Mixed Data

This paper presents a new method for Long Short-Term Memory Recurrent Neural Network (LSTM) based speech overlap detection, and speakers’ gender is recognised, as the first successful combination of this kind within one model.

The INTERSPEECH 2013 computational paralinguistics challenge: social signals, conflict, emotion, autism

The INTERSPEECH 2013 Computational Paralinguistics Challenge provides for the first time a unified test-bed for Social Signals such as laughter in speech. It further introduces conflict in group

An Event Driven Fusion Approach for Enjoyment Recognition in Real-time

This paper investigates the less prevalent approach of event driven fusion, which indirectly accumulates asynchronous events in all modalities for final predictions, and presents a fusion approach, handling short-timed events in a vector space, of special interest for real-time applications.

Neuroendocrine and stress hormone changes during mirthful laughter.

The mirthful laughter experience appears to reduce serum levels of cortisol, dopac, epinephrine, and growth hormone, which have implications for the reversal of the neuroendocrine and classical stress hormone response.

Inverse association between sense of humor and coronary heart disease.