scholarly journals AlloST: Low-Resource Speech Translation Without Source Transcription

2021 ◽  
Author(s):  
Yao-Fei Cheng ◽  
Hung-Shin Lee ◽  
Hsin-Min Wang
Keyword(s):  
Speech Translation ◽  
Low Resource

Speech translation for low-resource languages: the case of Pashto

2005 ◽  
Author(s):  
Andreas Kathol ◽  
Kristin Precoda ◽  
Dimitra Vergyri ◽  
Wen Wang ◽  
Susanne Riehemann
Keyword(s):  
Speech Translation ◽  
Low Resource

scholarly journals IMS’ Systems for the IWSLT 2021 Low-Resource Speech Translation Task

2021 ◽  
Author(s):  
Pavel Denisov ◽  
Manuel Mager ◽  
Ngoc Thang Vu
Keyword(s):  
Speech Translation ◽  
Low Resource

scholarly journals Leveraging Multimodal Out-of-Domain Information to Improve Low-Resource Speech Translation

2021 ◽  
Vol 2021 ◽  
pp. 1-14
Author(s):  
Wenbo Zhu ◽  
Hao Jin ◽  
WeiChang Yeh ◽  
Jianwen Chen ◽  
Lufeng Luo ◽  
...  
Keyword(s):  
Large Scale ◽  
Small Sample ◽  
Training Data ◽  
Label Free ◽  
Speech Translation ◽  
Low Resource ◽  
Training Samples ◽  
Limited Effectiveness ◽  
Fine Tune ◽  
Domain Information

Speech translation (ST) is a bimodal conversion task from source speech to the target text. Generally, deep learning-based ST systems require sufficient training data to obtain a competitive result, even with a state-of-the-art model. However, the training data is usually unable to meet the completeness condition due to the small sample problems. Most low-resource ST tasks improve data integrity with a single model, but this optimization has a single dimension and limited effectiveness. In contrast, multimodality is introduced to leverage different dimensions of data features for multiperspective modeling. This approach mutually addresses the gaps in the different modalities to enhance the representation of the data and improve the utilization of the training samples. Therefore, it is a new challenge to leverage the enormous multimodal out-of-domain information to improve the low-resource tasks. This paper describes how to use multimodal out-of-domain information to improve low-resource models. First, we propose a low-resource ST framework to reconstruct large-scale label-free audio by combining self-supervised learning. At the same time, we introduce a machine translation (MT) pretraining model to complement text embedding and fine-tune decoding. In addition, we analyze the similarity at the decoder side. We reduce multimodal invalid pseudolabels by performing random depth pruning in the similarity layer to minimize error propagation and use additional CTC loss in the nonsimilarity layer to optimize the ensemble loss. Finally, we study the weighting ratio of the fusion technique in the multimodal decoder. Our experiment results show that the proposed method is promising for low-resource ST, with improvements of up to +3.6 BLEU points compared to baseline low-resource ST models.

scholarly journals ON-TRAC’ systems for the IWSLT 2021 low-resource speech translation and multilingual speech translation shared tasks

2021 ◽  
Author(s):  
Hang Le ◽  
Florentin Barbier ◽  
Ha Nguyen ◽  
Natalia Tomashenko ◽  
Salima Mdhaffar ◽  
...  
Keyword(s):  
Speech Translation ◽  
Low Resource

Diagnosis of neonatal sepsis in low resource settings: C-reactive protein or procalcitonin?

2016 ◽  
Vol 03 (02) ◽  
pp. 079-083
Author(s):  
Lawrence Mbuagbaw ◽  
Francisca Monebenimp ◽  
Bolaji Obadeyi ◽  
Grace Bissohong ◽  
Marie-Thérèse Obama ◽  
...  
Keyword(s):  
Neonatal Sepsis ◽  
C Reactive Protein ◽  
Low Resource Settings ◽  
Low Resource ◽  
Reactive Protein
Sign in / Sign up

Export Citation Format

Share Document