Development of a Tool for Assisting Group Conversation by Re-Voicing Supportive Responses

2013 ◽  
Vol 446-447 ◽  
pp. 1040-1044 ◽  
Author(s):  
Myagmarbayar Nergui ◽  
Mihoko Otake
Keyword(s):  
Young Adults ◽  
Cognitive Function ◽  
Source Localization ◽  
Sound Source ◽  
Recognition Rate ◽  
Sound Source Localization ◽  
Sensory Environment ◽  
Face Detection And Recognition ◽  
Correct Recognition Rate ◽  
Detection And Recognition

Interactive group conversation is very important for improvement of cognitive function and prevention of dementia. Interactive means that all the participants participate equally and actively into group conversation. How to make group conversation more interactive for all participants is a challenging task. Main purpose of this study is to develop the system that assists group conversation, which is capable of dealing with following things, face detection and recognition, speech certain contents recognition, repetition or re-voice of supportive responses based on the result of speech contents recognition, and sound source localization using less sensory environment. We did dialogue experiments with arbitrary pairs among seven young adults and analyzed 14 dialogue data for calculating correct recognition rate of face and speech certain contents, for synthesizing speech based on the result of recognition, and for calculating sound source. The performance of the developed system was preliminary verified through the experimental results. The developed system can be used as a basis of assisting group conversation.

scholarly journals Towards Robust Multiple Blind Source Localization Using Source Separation and Beamforming

Sensors ◽  
2021 ◽  
Vol 21 (2) ◽  
pp. 532
Author(s):  
Henglin Pu ◽  
Chao Cai ◽  
Menglan Hu ◽  
Tianping Deng ◽  
Rong Zheng ◽  
...  
Keyword(s):  
Source Localization ◽  
Sound Source ◽  
Indoor Localization ◽  
Weighting Function ◽  
Signal To Noise Ratio ◽  
Source Separation ◽  
Sound Source Localization ◽  
Angle Of Arrival ◽  
Sound Sources ◽  
Localization Algorithms

Multiple blind sound source localization is the key technology for a myriad of applications such as robotic navigation and indoor localization. However, existing solutions can only locate a few sound sources simultaneously due to the limitation imposed by the number of microphones in an array. To this end, this paper proposes a novel multiple blind sound source localization algorithms using Source seParation and BeamForming (SPBF). Our algorithm overcomes the limitations of existing solutions and can locate more blind sources than the number of microphones in an array. Specifically, we propose a novel microphone layout, enabling salient multiple source separation while still preserving their arrival time information. After then, we perform source localization via beamforming using each demixed source. Such a design allows minimizing mutual interference from different sound sources, thereby enabling finer AoA estimation. To further enhance localization performance, we design a new spectral weighting function that can enhance the signal-to-noise-ratio, allowing a relatively narrow beam and thus finer angle of arrival estimation. Simulation experiments under typical indoor situations demonstrate a maximum of only 4∘ even under up to 14 sources.

scholarly journals Multimodal Fusion for Indoor Sound Source Localization

2021 ◽  
pp. 107906
Author(s):  
Jinhui Chen ◽  
Ryoichi Takashima ◽  
Xingchen Guo ◽  
Zhihong Zhang ◽  
Xuexin Xu ◽  
...  
Keyword(s):  
Source Localization ◽  
Sound Source ◽  
Multimodal Fusion ◽  
Sound Source Localization
Sign in / Sign up

Export Citation Format

Share Document