Weibo Text Sentiment Analysis Based on BERT and Deep Learning

With the rapid increase of public opinion data, the technology of Weibo text sentiment analysis plays a more and more significant role in monitoring network public opinion. Due to the sparseness and high-dimensionality of text data and the complex semantics of natural language, sentiment analysis tasks face tremendous challenges. To solve the above problems, this paper proposes a new model based on BERT and deep learning for Weibo text sentiment analysis. Specifically, first using BERT to represent the text with dynamic word vectors and using the processed sentiment dictionary to enhance the sentiment features of the vectors; then adopting the BiLSTM to extract the contextual features of the text, the processed vector representation is weighted by the attention mechanism. After weighting, using the CNN to extract the important local sentiment features in the text, finally the processed sentiment feature representation is classified. A comparative experiment was conducted on the Weibo text dataset collected during the COVID-19 epidemic; the results showed that the performance of the proposed model was significantly improved compared with other similar models.

Sentiment Weighted Word Embedding for Big Text Data

Sentiment analysis is the practice of eliciting a sentiment orientation of people's opinions (i.e. positive, negative and neutral) toward the specific entity. Word embedding technique like Word2vec is an effective approach to encode text data into real-valued semantic feature vectors. However, it fails to preserve sentiment information that results in performance deterioration for sentiment analysis. Additionally, big sized textual data consisting of large vocabulary and its associated feature vectors demands huge memory and computing power. To overcome these challenges, this research proposed a MapReduce based Sentiment weighted Word2Vec (MSW2V), which learns the sentiment and semantic feature vectors using sentiment dictionary and big textual data in a distributed MapReduce environment, where memory and computing power of multiple computing nodes are integrated to accomplish the huge resource demand. Experimental results demonstrate the outperforming performance of the MSW2V compared to the existing distributed and non-distributed approaches.

Multimodal Blog Sentiment Classification Based on MD-HFCE

In recent years, the rapid growth of multimodal information has become an important factor affecting the results of sentiment analysis. However, a few state-of-the-art works take into account the multimodal features and sentiment fuzziness. To this end, a fuzzy method is proposed for assessing sentiment intensity in this paper. Firstly, based on the visual-text conversion network (CNN-LSTM), as well as sentiment optimization through SentiBank and SentiBridge, the visual features are normalized to the text features. At the same time, the emotional features of the extracted audio will be predicted by the random forest algorithm. Subsequently, the sentiment characteristics are processed by dual hesitant fuzzification to form positive and negative sentiment intensity factors. Finally, a classification method, that is, MD-HFCE (multilayer dual hesitant fuzzy comprehensive evaluation), fuzzy comprehensive evaluation method improved by Mamdani fuzzy reasoning, is proposed to realize the multifeature fuzzy sentiment classification based on the comprehensive sentiment dictionary. The classification results are applicable to the topics of sentiment monitoring. The experimental results show that the proposed algorithm can effectively realize feature integration and improve the average sentiment classification accuracy of multimodal blogs to 82.2%.

Sentiment Classification Algorithm Based on the Cascade of BERT Model and Adaptive Sentiment Dictionary

The mobile social network contains a large amount of information in a form of commentary. Effective analysis of the sentiment in the comments would help improve the recommendations in the mobile network. With the development of well-performing pretrained language models, the performance of sentiment classification task based on deep learning has seen new breakthroughs in the past decade. However, deep learning models suffer from poor interpretability, making it difficult to integrate sentiment knowledge into the model. This paper proposes a sentiment classification model based on the cascade of the BERT model and the adaptive sentiment dictionary. First, the pretrained BERT model is used to fine-tune with the training corpus, and the probability of sentiment classification in different categories is obtained through the softmax layer. Next, to allow a more effective comparison between the probabilities for the two classes, a nonlinearity is introduced in a form of positive-negative probability ratio, using the rule method based on sentiment dictionary to deal with the probability ratio below the threshold. This method of cascading the pretrained model and the semantic rules of the sentiment dictionary allows to utilize the advantages of both models. Different sized Chnsenticorp data sets are used to train the proposed model. Experimental results show that the Dict-BERT model is better than the BERT-only model, especially when the training set is relatively small. The improvement is obvious with the accuracy increase of 0.8%.

When Emotions Rule Knowledge

Although emotions play an important role in human behavior and knowledge studies, knowledge management (KM) research considers them from specific angles and, to date, has lacked a comprehensive understanding of the emotions dominating KM. To offer a holistic view, this study investigates the presence of emotions in KM publications by applying a sentiment analysis. The authors present a sentiment dictionary tailored to KM, apply it to KM publications to determine where and how emotions occur, and categorize them on an emotion scale. The considerable amount of positive and negative emotions expressed in KM studies prove their relevance to and dominance in KM. There is high term diversity but also a need to consolidate terms and emotion categories in KM. This study's results provide new insights into the relevance of emotions in KM research, while practitioners can use this method to detect emotion-laden language and successfully implement KM initiatives.

Toward Integrated CNN-based Sentiment Analysis of Tweets for Scarce-resource Language—Hindi

Linguistic resources for commonly used languages such as English and Mandarin Chinese are available in abundance, hence the existing research in these languages. However, there are languages for which linguistic resources are scarcely available. One of these languages is the Hindi language. Hindi, being the fourth-most popular language, still lacks in richly populated linguistic resources, owing to the challenges involved in dealing with the Hindi language. This article first explores the machine learning-based approaches—Naïve Bayes, Support Vector Machine, Decision Tree, and Logistic Regression—to analyze the sentiment contained in Hindi language text derived from Twitter. Further, the article presents lexicon-based approaches (Hindi Senti-WordNet, NRC Emotion Lexicon) for sentiment analysis in Hindi while also proposing a Domain-specific Sentiment Dictionary. Finally, an integrated convolutional neural network (CNN)—Recurrent Neural Network and Long Short-term Memory—is proposed to analyze sentiment from Hindi language tweets, a total of 23,767 tweets classified into positive, negative, and neutral. The proposed CNN approach gives an accuracy of 85%.

GINS: A Global intensifier-based N-Gram sentiment dictionary

Words are one of the most essential elements of expressing sentiments in context although they are not the only ones. Also, syntactic relationships between words, morphology, punctuation, and linguistic phenomena are influential. Merely considering the concept of words as isolated phenomena causes a lot of mistakes in sentiment analysis systems. So far, a large amount of research has been conducted on generating sentiment dictionaries containing only sentiment words. A number of these dictionaries have addressed the role of combinations of sentiment words, negators, and intensifiers, while almost none of them considered the heterogeneous effect of the occurrence of multiple linguistic phenomena in sentiment compounds. Regarding the weaknesses of the existing sentiment dictionaries, in addressing the heterogeneous effect of the occurrence of multiple intensifiers, this research presents a sentiment dictionary based on the analysis of sentiment compounds including sentiment words, negators, and intensifiers by considering the multiple intensifiers relative to the sentiment word and assigning a location-based coefficient to the intensifier, which increases the covered sentiment phrase in the dictionary, and enhanced efficiency of proposed dictionary-based sentiment analysis methods up to 7% compared to the latest methods.