scholarly journals The Negative Effect of Machine Translation on Cross–Lingual Question Answering

2007 ◽  
pp. 494-505 ◽  
Author(s):  
Sergio Ferrández ◽  
Antonio Ferrández
Keyword(s):  
Machine Translation ◽  
Question Answering ◽  
Negative Effect ◽  
Cross Lingual

scholarly journals Unsupervised Neural Machine Translation with SMT as Posterior Regularization

2019 ◽  
Vol 33 ◽  
pp. 241-248 ◽  
Author(s):  
Shuo Ren ◽  
Zhirui Zhang ◽  
Shujie Liu ◽  
Ming Zhou ◽  
Shuai Ma
Keyword(s):  
Machine Translation ◽  
Language Models ◽  
Translation Process ◽  
Weak Supervision ◽  
Neural Machine Translation ◽  
Back Translation ◽  
Negative Effect ◽  
Model Training ◽  
Cross Lingual ◽  
Pseudo Data

Without real bilingual corpus available, unsupervised Neural Machine Translation (NMT) typically requires pseudo parallel data generated with the back-translation method for the model training. However, due to weak supervision, the pseudo data inevitably contain noises and errors that will be accumulated and reinforced in the subsequent training process, leading to bad translation performance. To address this issue, we introduce phrase based Statistic Machine Translation (SMT) models which are robust to noisy data, as posterior regularizations to guide the training of unsupervised NMT models in the iterative back-translation process. Our method starts from SMT models built with pre-trained language models and word-level translation tables inferred from cross-lingual embeddings. Then SMT and NMT models are optimized jointly and boost each other incrementally in a unified EM framework. In this way, (1) the negative effect caused by errors in the iterative back-translation process can be alleviated timely by SMT filtering noises from its phrase tables; meanwhile, (2) NMT can compensate for the deficiency of fluency inherent in SMT. Experiments conducted on en-fr and en-de translation tasks show that our method outperforms the strong baseline and achieves new state-of-the-art unsupervised machine translation performance.

Cross-Lingual Question Answering Using Off-the-Shelf Machine Translation

2005 ◽  
pp. 446-457 ◽  
Author(s):  
Kisuh Ahn ◽  
Beatrice Alex ◽  
Johan Bos ◽  
Tiphaine Dalmas ◽  
Jochen L. Leidner ◽  
...  
Keyword(s):  
Machine Translation ◽  
Question Answering ◽  
Cross Lingual

scholarly journals An Investigation of Machine Translation Evaluation Metrics in Cross-lingual Question Answering

2015 ◽  
Author(s):  
Kyoshiro Sugiyama ◽  
Masahiro Mizukami ◽  
Graham Neubig ◽  
Koichiro Yoshino ◽  
Sakriani Sakti ◽  
...  
Keyword(s):  
Machine Translation ◽  
Question Answering ◽  
Evaluation Metrics ◽  
Machine Translation Evaluation ◽  
Cross Lingual

scholarly journals An Investigation of Machine Translation Evaluation Metrics in Cross-lingual Question Answering

2016 ◽  
Vol 23 (5) ◽  
pp. 437-461
Author(s):  
Kyoshiro Sugiyama ◽  
Masahiro Mizukami ◽  
Graham Neubig ◽  
Koichiro Yoshino ◽  
Yu Suzuki ◽  
...  
Keyword(s):  
Machine Translation ◽  
Question Answering ◽  
Evaluation Metrics ◽  
Machine Translation Evaluation ◽  
Cross Lingual

scholarly journals On the Limitations of Cross-lingual Encoders as Exposed by Reference-Free Machine Translation Evaluation

2020 ◽  
Author(s):  
Wei Zhao ◽  
Goran Glavaš ◽  
Maxime Peyrard ◽  
Yang Gao ◽  
Robert West ◽  
...  
Keyword(s):  
Machine Translation ◽  
Machine Translation Evaluation ◽  
Cross Lingual ◽  
Free Machine

scholarly journals The data-driven Bulgarian WordNet: BTBWN

2018 ◽  
Author(s):  
Petya Osenova ◽  
Kiril Simov
Keyword(s):  
Information Retrieval ◽  
Machine Translation ◽  
Semantic Information ◽  
Data Driven ◽  
Lexical Resources ◽  
Multilingual Information Retrieval ◽  
Cross Lingual ◽  
Princeton Wordnet ◽  
Word Senses

The data-driven Bulgarian WordNet: BTBWNThe paper presents our work towards the simultaneous creation of a data-driven WordNet for Bulgarian and a manually annotated treebank with semantic information. Such an approach requires synchronization of the word senses in both - syntactic and lexical resources, without limiting the WordNet senses to the corpus or vice versa. Our strategy focuses on the identification of senses used in BulTreeBank, but the missing senses of a lemma also have been covered through exploration of bigger corpora. The identified senses have been organized in synsets for the Bulgarian WordNet. Then they have been aligned to the Princeton WordNet synsets. Various types of mappings are considered between both resources in a cross-lingual aspect and with respect to ensuring maximum connectivity and potential for incorporating the language specific concepts. The mapping between the two WordNets (English and Bulgarian) is a basis for applications such as machine translation and multilingual information retrieval. Oparty na danych WordNet bułgarski: BTBWNW artykule przedstawiono naszą pracę na rzecz jednoczesnej budowy opartego na danych wordnetu dla języka bułgarskiego oraz ręcznie oznaczonego informacjami semantycznymi banku drzew. Takie podejście wymaga uzgodnienia znaczeń słów zarówno w zasobach składniowych, jak i leksykalnych, bez ograniczania znaczeń umieszczanych w wordnecie do tych obecnych w korpusie, jak i odwrotnie. Nasza strategia koncentruje się na identyfikacji znaczeń stosowanych w BulTreeBank, przy czym brakujące znaczenia lematu zostały również zbadane przez zgłębienie większych korpusów. Zidentyfikowane znaczenia zostały zorganizowane w synsety bułgarskiego wordnetu, a następnie powiązane z synsetami Princeton WordNet. Rozmaite rodzaje rzutowań są rozpatrywane pomiędzy obydwoma zasobami w kontekście międzyjęzykowym, a także w odniesieniu do zapewnienia maksymalnej łączności i możliwości uwzględnienia pojęć specyficznych dla języka bułgarskiego. Rzutowanie między dwoma wordnetami (angielskim i bułgarskim) jest podstawą dla aplikacji, takich jak tłumaczenie maszynowe i wielojęzyczne wyszukiwanie informacji.

scholarly journals Expanding the JHU Bible Corpus for Machine Translation of the Indigenous Languages of North America

2021 ◽  
Vol 1 (2) ◽  
Author(s):  
Garrett Nicolai ◽  
Edith Coates ◽  
Ming Zhang ◽  
Miika Silfverberg
Keyword(s):  
North America ◽  
Machine Translation ◽  
Indigenous Languages ◽  
Low Resource ◽  
Bible Translations ◽  
Cross Lingual

We present an extension to the JHU Bible corpus, collecting and normalizing more than thirty Bible translations in thirty Indigenous languages of North America. These exhibit a wide variety of interesting syntactic and morphological phenomena that are understudied in the computational community. Neural translation experiments demonstrate significant gains obtained through cross-lingual, many-to-many translation, with improvements of up to 8.4 BLEU over monolingual models for extremely low-resource languages.

Robust cross-lingual knowledge base question answering via knowledge distillation

2021 ◽  
Vol ahead-of-print (ahead-of-print) ◽  
Author(s):  
Shaofei Wang ◽  
Depeng Dang
Keyword(s):  
Knowledge Base ◽  
Design Methodology ◽  
Question Answering ◽  
Ground Truth ◽  
Student Model ◽  
Content Type ◽  
Final Performance ◽  
Knowledge Distillation ◽  
The Cross ◽  
Cross Lingual

PurposePrevious knowledge base question answering (KBQA) models only consider the monolingual scenario and cannot be directly extended to the cross-lingual scenario, in which the language of questions and that of knowledge base (KB) are different. Although a machine translation (MT) model can bridge the gap through translating questions to the language of KB, the noises of translated questions could accumulate and further sharply impair the final performance. Therefore, the authors propose a method to improve the robustness of KBQA models in the cross-lingual scenario.Design/methodology/approachThe authors propose a knowledge distillation-based robustness enhancement (KDRE) method. Specifically, first a monolingual model (teacher) is trained by ground truth (GT) data. Then to imitate the practical noises, a noise-generating model is designed to inject two types of noise into questions: general noise and translation-aware noise. Finally, the noisy questions are input into the student model. Meanwhile, the student model is jointly trained by GT data and distilled data, which are derived from the teacher when feeding GT questions.FindingsThe experimental results demonstrate that KDRE can improve the performance of models in the cross-lingual scenario. The performance of each module in KBQA model is improved by KDRE. The knowledge distillation (KD) and noise-generating model in the method can complementarily boost the robustness of models.Originality/valueThe authors first extend KBQA models from monolingual to cross-lingual scenario. Also, the authors first implement KD for KBQA to develop robust cross-lingual models.

Events Automatic Extraction from Arabic Texts

2020 ◽  
pp. 1686-1704
Author(s):  
Emna Hkiri ◽  
Souheyl Mallat ◽  
Mounir Zrigui
Keyword(s):  
Information Retrieval ◽  
Natural Language Processing ◽  
Text Mining ◽  
Machine Translation ◽  
Language Processing ◽  
Question Answering ◽  
Arabic Language ◽  
Event Extraction ◽  
Mining Machine ◽  
Open Domain

The event extraction task consists in determining and classifying events within an open-domain text. It is very new for the Arabic language, whereas it attained its maturity for some languages such as English and French. Events extraction was also proved to help Natural Language Processing tasks such as Information Retrieval and Question Answering, text mining, machine translation etc… to obtain a higher performance. In this article, we present an ongoing effort to build a system for event extraction from Arabic texts using Gate platform and other tools.

Sign in / Sign up

Export Citation Format

Share Document