Effective Approach to Joint Training of POS Tagging and Dependency Parsing Models

Author(s):  
Xuan-Dung Doan ◽  
Tu-Anh Tran ◽  
Le-Minh Nguyen
2013 ◽  
Vol 1 ◽  
pp. 301-314 ◽  
Author(s):  
Weiwei Sun ◽  
Xiaojun Wan

We present a comparative study of transition-, graph- and PCFG-based models aimed at illuminating more precisely the likely contribution of CFGs in improving Chinese dependency parsing accuracy, especially by combining heterogeneous models. Inspired by the impact of a constituency grammar on dependency parsing, we propose several strategies to acquire pseudo CFGs only from dependency annotations. Compared to linguistic grammars learned from rich phrase-structure treebanks, well designed pseudo grammars achieve similar parsing accuracy and have equivalent contributions to parser ensemble. Moreover, pseudo grammars increase the diversity of base models; therefore, together with all other models, further improve system combination. Based on automatic POS tagging, our final model achieves a UAS of 87.23%, resulting in a significant improvement of the state of the art.


2015 ◽  
Author(s):  
Yuan Zhang ◽  
Chengtao Li ◽  
Regina Barzilay ◽  
Kareem Darwish

2017 ◽  
Author(s):  
Atreyee Mukherjee ◽  
Sandra Kübler ◽  
Matthias Scheutz

2020 ◽  
Vol 34 (05) ◽  
pp. 9090-9097
Author(s):  
Niels Van der Heijden ◽  
Samira Abnar ◽  
Ekaterina Shutova

The lack of annotated data in many languages is a well-known challenge within the field of multilingual natural language processing (NLP). Therefore, many recent studies focus on zero-shot transfer learning and joint training across languages to overcome data scarcity for low-resource languages. In this work we (i) perform a comprehensive comparison of state-of-the-art multilingual word and sentence encoders on the tasks of named entity recognition (NER) and part of speech (POS) tagging; and (ii) propose a new method for creating multilingual contextualized word embeddings, compare it to multiple baselines and show that it performs at or above state-of-the-art level in zero-shot transfer settings. Finally, we show that our method allows for better knowledge sharing across languages in a joint training setting.


2016 ◽  
Vol E99.D (1) ◽  
pp. 257-264 ◽  
Author(s):  
Zhen GUO ◽  
Yujie ZHANG ◽  
Chen SU ◽  
Jinan XU ◽  
Hitoshi ISAHARA

Sign in / Sign up

Export Citation Format

Share Document