Research on fine-tuning strategy of sentiment analysis model based on BERT

Author(s):  
Xiaojia Li ◽  
Xiaoxiao Wang ◽  
Hao Liu
2021 ◽  
pp. 170-178
Author(s):  
Gulmira Bekmanova ◽  
Banu Yergesh ◽  
Altynbek Sharipbay

2018 ◽  
Vol 9 (2) ◽  
pp. 54-75 ◽  
Author(s):  
Thien Khai Tran ◽  
Tuoi Thi Phan

Sentiment analysis is an important new field of research that has attracted the attention not only of researchers, but also businesses and organizations. In this article, the authors propose an effective model for aspect-based sentiment analysis for Vietnamese. First, sentiment dictionaries and syntactic dependency rules were combined to extract reliable word pairs (sentiment - aspect). They then relied on ontology to group these aspects and determine the sentiment polarity of each. They introduce two novel approaches in this work: 1) in order to “smooth” the sentiment scaling (rather than using discrete categories of 1, 0, and -1) for fined-grained classification, then extract multi-word sentiment phrases instead of sentiment words, and 2) the focus is not only on adjectives but also nouns and verbs. Initial evaluations of the system using real reviews show promising results.


2018 ◽  
Vol 20 (K7) ◽  
pp. 21-27
Author(s):  
Thien Khai Tran ◽  
Tuoi Thi Phan

In this paper, we propose an effective model for aspect-based sentiment analysis. First, we combined a sentiment dictionary and syntactic dependency rules to extract reliable word pairs (sentiment — aspect). Then, thanks to ontology, we grouped those aspects and determined the sentiment polarity of each. When we conducted experiments on real reviews, the system showed positive results.


2020 ◽  
Vol 29 (07n08) ◽  
pp. 2040018
Author(s):  
Huibing Zhang ◽  
Junchao Dong ◽  
Liang Min ◽  
Peng Bi

Accurate analysis of targeted sentiment in online course reviews helps in understanding emotional changes of learners and improving the course quality. In this paper, we propose a fine-tuned bidirectional encoder representation from transformers (BERT) model for targeted sentiment analysis of course reviews. Specifically, it consists of two parts: binding corporate rules — conditional random field (BCR-CRF) target extraction model and a binding corporate rules — double attention (BCR-DA) target sentiment analysis model. Firstly, based on a large-scale Chinese review corpus, intra-domain unsupervised training of a BERT pre-trained model (BCR) is performed. Then, a Conditional Random Field (CRF) layer is introduced to add grammatical constraints to the output sequence of the semantic representation layer in the BCR model. Finally, a BCR-DA model containing double attention layers is constructed to express the sentiment polarity of the course review targets in a classified manner. Experiments are performed on Chinese online course review datasets of China MOOC. The experimental results show that the F1 score of the BCR-CRF model reaches above 92%, and the accuracy of the BCR-DA model reaches above 72%.


Sign in / Sign up

Export Citation Format

Share Document