scholarly journals Aspect-Level Sentiment Analysis Via Convolution over Dependency Tree

2019 ◽  
Author(s):  
Kai Sun ◽  
Richong Zhang ◽  
Samuel Mensah ◽  
Yongyi Mao ◽  
Xudong Liu
Keyword(s):  
Sentiment Analysis ◽  
Dependency Tree

scholarly journals DIBERT: Dependency Injected Bidirectional Encoder Representations from Transformers

2021 ◽  
Author(s):  
Abdul Wahab ◽  
Rafet Sifa
Keyword(s):  
Natural Language ◽  
Sentiment Analysis ◽  
Semantic Similarity ◽  
Syntactic Structure ◽  
Language Modeling ◽  
Benchmark Dataset ◽  
Fine Tuning ◽  
New Model ◽  
Dependency Tree ◽  
Better Than

<div> <div> <div> <p> </p><div> <div> <div> <p>In this paper, we propose a new model named DIBERT which stands for Dependency Injected Bidirectional Encoder Representations from Transformers. DIBERT is a variation of the BERT and has an additional third objective called Parent Prediction (PP) apart from Masked Language Modeling (MLM) and Next Sentence Prediction (NSP). PP injects the syntactic structure of a dependency tree while pre-training the DIBERT which generates syntax-aware generic representations. We use the WikiText-103 benchmark dataset to pre-train both BERT- Base and DIBERT. After fine-tuning, we observe that DIBERT performs better than BERT-Base on various downstream tasks including Semantic Similarity, Natural Language Inference and Sentiment Analysis. </p> </div> </div> </div> </div> </div> </div>

scholarly journals DIBERT: Dependency Injected Bidirectional Encoder Representations from Transformers

2021 ◽  
Author(s):  
Abdul Wahab ◽  
Rafet Sifa
Keyword(s):  
Natural Language ◽  
Sentiment Analysis ◽  
Semantic Similarity ◽  
Syntactic Structure ◽  
Language Modeling ◽  
Benchmark Dataset ◽  
Fine Tuning ◽  
New Model ◽  
Dependency Tree ◽  
Better Than

<div> <div> <div> <p> </p><div> <div> <div> <p>In this paper, we propose a new model named DIBERT which stands for Dependency Injected Bidirectional Encoder Representations from Transformers. DIBERT is a variation of the BERT and has an additional third objective called Parent Prediction (PP) apart from Masked Language Modeling (MLM) and Next Sentence Prediction (NSP). PP injects the syntactic structure of a dependency tree while pre-training the DIBERT which generates syntax-aware generic representations. We use the WikiText-103 benchmark dataset to pre-train both BERT- Base and DIBERT. After fine-tuning, we observe that DIBERT performs better than BERT-Base on various downstream tasks including Semantic Similarity, Natural Language Inference and Sentiment Analysis. </p> </div> </div> </div> </div> </div> </div>

scholarly journals A Fine-grained Sentiment Analysis Method Based on Dependency Tree and Graph Attention Network

2020 ◽  
Vol 1651 ◽  
pp. 012173
Author(s):  
Yejin Tan ◽  
Wangshu Guo ◽  
Jiawei He ◽  
Jian Liu ◽  
Ming Xian
Keyword(s):  
Sentiment Analysis ◽  
Analysis Method ◽  
Attention Network ◽  
Fine Grained ◽  
Dependency Tree

scholarly journals DIBERT: Dependency Injected Bidirectional Encoder Representations from Transformers

2021 ◽  
Author(s):  
Abdul Wahab ◽  
Rafet Sifa
Keyword(s):  
Natural Language ◽  
Sentiment Analysis ◽  
Semantic Similarity ◽  
Syntactic Structure ◽  
Language Modeling ◽  
Benchmark Dataset ◽  
Fine Tuning ◽  
New Model ◽  
Dependency Tree ◽  
Better Than

<div> <div> <div> <p> </p><div> <div> <div> <p>In this paper, we propose a new model named DIBERT which stands for Dependency Injected Bidirectional Encoder Representations from Transformers. DIBERT is a variation of the BERT and has an additional third objective called Parent Prediction (PP) apart from Masked Language Modeling (MLM) and Next Sentence Prediction (NSP). PP injects the syntactic structure of a dependency tree while pre-training the DIBERT which generates syntax-aware generic representations. We use the WikiText-103 benchmark dataset to pre-train both BERT- Base and DIBERT. After fine-tuning, we observe that DIBERT performs better than BERT-Base on various downstream tasks including Semantic Similarity, Natural Language Inference and Sentiment Analysis. </p> </div> </div> </div> </div> </div> </div>

Study of Sentiment of Governor's Election Opinion in 2018

2018 ◽  
pp. 231-238
Author(s):  
Agung Eddy Suryo Saputro ◽  
Khairil Anwar Notodiputro ◽  
Indahwati A
Keyword(s):  
Sentiment Analysis ◽  
Naive Bayes ◽  
Naïve Bayes ◽  
Addition Method ◽  
Sentiment Mining ◽  
Positive Sentiment ◽  
Trending Topics ◽  
Election News

In 2018, Indonesia implemented a Governor's Election which included 17 provinces. For several months before the Election, news and opinions regarding the Governor's Election were often trending topics on Twitter. This study aims to describe the results of sentiment mining and determine the best method for predicting sentiment classes. Sentiment mining is based on Lexicon. While the methods used for sentiment analysis are Naive Bayes and C5.0. The results showed that the percentage of positive sentiment in 17 provinces was greater than the negative and neutral sentiments. In addition, method C5.0 produces a better prediction than Naive Bayes.

An historical analysis of species references in American English

Corpora ◽  
2019 ◽  
Vol 14 (3) ◽  
pp. 327-349
Author(s):  
Craig Frayne
Keyword(s):  
Environmental Change ◽  
Sentiment Analysis ◽  
Quantitative Methods ◽  
English Language ◽  
Language Use ◽  
American English ◽  
Historical Analysis ◽  
The Past ◽  
Corpus Studies ◽  
Google Books

This study uses the two largest available American English language corpora, Google Books and the Corpus of Historical American English (coha), to investigate relations between ecology and language. The paper introduces ecolinguistics as a promising theme for corpus research. While some previous ecolinguistic research has used corpus approaches, there is a case to be made for quantitative methods that draw on larger datasets. Building on other corpus studies that have made connections between language use and environmental change, this paper investigates whether linguistic references to other species have changed in the past two centuries and, if so, how. The methodology consists of two main parts: an examination of the frequency of common names of species followed by aspect-level sentiment analysis of concordance lines. Results point to both opportunities and challenges associated with applying corpus methods to ecolinguistc research.

Sign in / Sign up

Export Citation Format

Share Document