scholarly journals Statistical-based system combination approach to gain advantages over different machine translation systems

Heliyon ◽  
2019 ◽  
Vol 5 (9) ◽  
pp. e02504 ◽  
Author(s):  
Debajyoty Banik ◽  
Asif Ekbal ◽  
Pushpak Bhattacharyya ◽  
Siddhartha Bhattacharyya ◽  
Jan Platos
Information ◽  
2021 ◽  
Vol 12 (3) ◽  
pp. 98 ◽  
Author(s):  
Yajuan Wang ◽  
Xiao Li ◽  
Yating Yang ◽  
Azmat Anwar ◽  
Rui Dong

Both the statistical machine translation (SMT) model and neural machine translation (NMT) model are the representative models in Uyghur–Chinese machine translation tasks with their own merits. Thus, it will be a promising direction to combine the advantages of them to further improve the translation performance. In this paper, we present a hybrid framework of developing a system combination for a Uyghur–Chinese machine translation task that works in three layers to achieve better translation results. In the first layer, we construct various machine translation systems including SMT and NMT. In the second layer, the outputs of multiple systems are combined to leverage the advantage of SMT and NMT models by using a multi-source-based system combination approach and the voting-based system combination approaches. Moreover, instead of selecting an individual system’s combined outputs as the final results, we transmit the outputs of the first layer and the second layer into the final layer to make a better prediction. Experiment results on the Uyghur–Chinese translation task show that the proposed framework can significantly outperform the baseline systems in terms of both the accuracy and fluency, which achieves a better performance by 1.75 BLEU points compared with the best individual system and by 0.66 BLEU points compared with the conventional system combination methods, respectively.


Author(s):  
Marta R. Costa-jussà ◽  
Josep M. Crego ◽  
David Vilar ◽  
José A. R. Fonollosa ◽  
José B. Mariño ◽  
...  

Author(s):  
Xuancheng Huang ◽  
Jiacheng Zhang ◽  
Zhixing Tan ◽  
Derek F. Wong ◽  
Huanbo Luan ◽  
...  

System combination is an important technique for combining the hypotheses of different machine translation systems to improve translation performance. Although early statistical approaches to system combination have been proven effective in analyzing the consensus between hypotheses, they suffer from the error propagation problem due to the use of pipelines. While this problem has been alleviated by end-to-end training of multi-source sequence-to-sequence models recently, these neural models do not explicitly analyze the relations between hypotheses and fail to capture their agreement because the attention to a word in a hypothesis is calculated independently, ignoring the fact that the word might occur in multiple hypotheses. In this work, we propose an approach to modeling voting for system combination in machine translation. The basic idea is to enable words in hypotheses from different systems to vote on words that are representative and should get involved in the generation process. This can be done by quantifying the influence of each voter and its preference for each candidate. Our approach combines the advantages of statistical and neural methods since it can not only analyze the relations between hypotheses but also allow for end-to-end training. Experiments show that our approach is capable of better taking advantage of the consensus between hypotheses and achieves significant improvements over state-of-the-art baselines on Chinese-English and English-German machine translation tasks.


1993 ◽  
Vol 8 (1-2) ◽  
pp. 49-58 ◽  
Author(s):  
Pamela W. Jordan ◽  
Bonnie J. Dorr ◽  
John W. Benoit

2014 ◽  
Vol 1 (20) ◽  
pp. 116
Author(s):  
Mikhail Gennadyevich Grif ◽  
Maria Kirillovna Timofeeva

2019 ◽  
Author(s):  
Soichiro Murakami ◽  
Makoto Morishita ◽  
Tsutomu Hirao ◽  
Masaaki Nagata

Sign in / Sign up

Export Citation Format

Share Document