Towards POS Tagging Methods for Bengali Language: A Comparative Analysis

Author(s):  
Fatima Jahara ◽  
Adrita Barua ◽  
MD. Asif Iqbal ◽  
Avishek Das ◽  
Omar Sharif ◽  
...  
Author(s):  
Guozhe Jin ◽  
Zhezhou Yu

Part-of-speech (POS) tagging is a fundamental task in natural language processing. Korean POS tagging consists of two subtasks: morphological analysis and POS tagging. In recent years, scholars have tended to use the seq2seq model to solve this problem. The full context of a sentence is considered in these seq2seq-based Korean POS tagging methods. However, Korean morphological analysis relies more on local contextual information, and in many cases, there exists one-to-one matching between morpheme surface form and base form. To make better use of these characteristics, we propose a hierarchical seq2seq model. In our model, the low-level Bi-LSTM encodes the syllable sequence, whereas the high-level Bi-LSTM models the context information of the whole sentence, and the decoder generates the morpheme base form syllables as well as the POS tags. To improve the accuracy of the morpheme base form recovery, we introduced the convolution layer and the attention mechanism to our model. The experimental results on the Sejong corpus show that our model outperforms strong baseline systems in both morpheme-level F1-score and eojeol-level accuracy, achieving state-of-the-art performance.


2020 ◽  
Vol 8 (3) ◽  
pp. 100-108
Author(s):  
Archita Bhattacharyya

Out of the several modern Indo-Aryan languages that evolved in the eastern part of India, Assamese and Bengali are the two most prominent ones. Though both these two languages reached their respective present existence after passing through different phases of development, yet their roots are the same. Therefore, between both languages, there are many similarities even though both have evolved in distinctly different geographical areas, and there exist distinct differences between them. The differences not only create the distinction between them but also express their individuality too. In both, languages, pronoun and pronominal have occupied an important role in the discussion of morphology. Along with pronoun, the use of various pronominal which have evolved from the same root has flourished in both the languages. In this regard, both similarities and differences could be noticed in these two languages. Therefore, to identify the co-relation as well as the linguistic characteristics of both the languages, the comparative analysis is the only way out. In this study, an attempt is made to focus on how the pronominal of both languages are used to identify the similarities and differences between the two languages.


2007 ◽  
Vol 177 (4S) ◽  
pp. 398-398
Author(s):  
Luis H. Braga ◽  
Joao L. Pippi Salle ◽  
Sumit Dave ◽  
Sean Skeldon ◽  
Armando J. Lorenzo ◽  
...  
Keyword(s):  

Sign in / Sign up

Export Citation Format

Share Document