Development of a Sound Source Localization System for Assisting Group Conversation

  title={Development of a Sound Source Localization System for Assisting Group Conversation},
  author={Mihoko Otake and Myagmarbayar Nergui and Seong-eun Moon and Kentaro Takagi and Tsutomu Kamashima and Kazuhiro Nakadai},
In this study, we developed a sound source localization system, which consists of Jellyfish-02 and HARK robot audition software, in order to reduce the number of wires for evaluating speech duration. Sound source localization performance of Jellyfish-02 is evaluated by precision, recall, and F-measure. Performance of Jellyfish-02 is superior to conventional microphone arrays. During the experiment, we found that F-measure becomes smaller as the number of speakers increases. We investigated the… 

Development of a Tool for Assisting Group Conversation by Re-Voicing Supportive Responses

The main purpose of this study is to develop the system that assists group conversation, which is capable of dealing with following things, face detection and recognition, speech certain contents recognition, repetition or re-voice of supportive responses based on the result of speech contents recognized, and sound source localization using less sensory environment.

Sound Source Localization and Separation

This article presents common methods for sound source localization and separation, and their applications to robots. Sound source localization is an estimate of the location or direction of a

Development of a Robotic Pet Using Sound Source Localization with the HARK Robot Audition System

We have developed a self-propelling robotic pet, in which the robot audition software HARK (Honda Research Institute Japan Audition for Robots with Kyoto University) was installed to equip it with

Development of Laughter Motion on the Cognitive Robot "Bono-02" Assisting Group Conversation

In recent years, Japan is facing the problem of super-aged society. One problem of super aged society is that the number of patients with dementia is increasing. People who don't have much social

Design and Development of an Automated Coimagination Support System

The initial design and development of an automated coimagination support system that can handle different configurations and be used easily either by healthy participants or elderly participants via a natural voice interface is proposed.



Design and Implementation of Robot Audition System 'HARK' — Open Source Software for Listening to Three Simultaneous Speakers

This paper presents the design and implementation of the HARK robot audition software system consisting of sound source localization modules, sound source separation modules and automatic speech

Design and implementation of a robot audition system for automatic speech recognition of simultaneous speech

A real-time robot audition system based on preprocessing consisting of sound source localization and separation with a microphone array and system integration based on missing feature theory (MFT) is constructed for Honda ASIMO and Humanoid SIG2 with 8-ch microphone arrays.

Sound source localization for robot auditory systems

A search space clustering method designed to speed up the SRP-PHAT based sound source localization algorithm for intelligent home robots equipped with small scale microphone arrays is proposed.

A system that assists group conversation of older adults by evaluating speech duration and facial expression of each participant during conversation

The results demonstrated that the system which evaluates both speech duration and facial expression of each participant can make all participants to take part in the conversation evenly and actively.

Real-time super-resolution Sound Source Localization for robots

This work proposes two methods, MUSIC based on Generalized Singular Value Decomposition (GSVD-MUSIC), and Hierarchical SSL (H-SSL), which drastically reduces the computational cost while maintaining noise-robustness in localization.

A real-time 3D sound localization system with miniature microphone array for virtual reality

This paper presents a real-time three-dimensional (3D) wideband sound localization system designed with a miniature XYZO microphone array. Unlike the conventional microphone arrays for sound

3D sound source localization system based on learning of binaural hearing

A newly built sound source localization system that can detect the direction of a sound source arbitrarily located in front of it is reported.