Novel Approach towards Stock Market Prediction using Sentiment Analysis and Data Mining

2017 ◽  
Vol 5 (1) ◽  
pp. 15-24
Author(s):  
Vivek Rajput ◽  
◽  
Sarika Bobde ◽  
Kybernetes ◽  
2021 ◽  
Vol ahead-of-print (ahead-of-print) ◽  
Author(s):  
Shilpa B L ◽  
Shambhavi B R

PurposeStock market forecasters are focusing to create a positive approach for predicting the stock price. The fundamental principle of an effective stock market prediction is not only to produce the maximum outcomes but also to reduce the unreliable stock price estimate. In the stock market, sentiment analysis enables people for making educated decisions regarding the investment in a business. Moreover, the stock analysis identifies the business of an organization or a company. In fact, the prediction of stock prices is more complex due to high volatile nature that varies a large range of investor sentiment, economic and political factors, changes in leadership and other factors. This prediction often becomes ineffective, while considering only the historical data or textural information. Attempts are made to make the prediction more precise with the news sentiment along with the stock price information.Design/methodology/approachThis paper introduces a prediction framework via sentiment analysis. Thereby, the stock data and news sentiment data are also considered. From the stock data, technical indicator-based features like moving average convergence divergence (MACD), relative strength index (RSI) and moving average (MA) are extracted. At the same time, the news data are processed to determine the sentiments by certain processes like (1) pre-processing, where keyword extraction and sentiment categorization process takes place; (2) keyword extraction, where WordNet and sentiment categorization process is done; (3) feature extraction, where Proposed holoentropy based features is extracted. (4) Classification, deep neural network is used that returns the sentiment output. To make the system more accurate on predicting the sentiment, the training of NN is carried out by self-improved whale optimization algorithm (SIWOA). Finally, optimized deep belief network (DBN) is used to predict the stock that considers the features of stock data and sentiment results from news data. Here, the weights of DBN are tuned by the new SIWOA.FindingsThe performance of the adopted scheme is computed over the existing models in terms of certain measures. The stock dataset includes two companies such as Reliance Communications and Relaxo Footwear. In addition, each company consists of three datasets (a) in daily option, set start day 1-1-2019 and end day 1-12-2020, (b) in monthly option, set start Jan 2000 and end Dec 2020 and (c) in yearly option, set year 2000. Moreover, the adopted NN + DBN + SIWOA model was computed over the traditional classifiers like LSTM, NN + RF, NN + MLP and NN + SVM; also, it was compared over the existing optimization algorithms like NN + DBN + MFO, NN + DBN + CSA, NN + DBN + WOA and NN + DBN + PSO, correspondingly. Further, the performance was calculated based on the learning percentage that ranges from 60, 70, 80 and 90 in terms of certain measures like MAE, MSE and RMSE for six datasets. On observing the graph, the MAE of the adopted NN + DBN + SIWOA model was 91.67, 80, 91.11 and 93.33% superior to the existing classifiers like LSTM, NN + RF, NN + MLP and NN + SVM, respectively for dataset 1. The proposed NN + DBN + SIWOA method holds minimum MAE value of (∼0.21) at learning percentage 80 for dataset 1; whereas, the traditional models holds the value for NN + DBN + CSA (∼1.20), NN + DBN + MFO (∼1.21), NN + DBN + PSO (∼0.23) and NN + DBN + WOA (∼0.25), respectively. From the table, it was clear that the RMSRE of the proposed NN + DBN + SIWOA model was 3.14, 1.08, 1.38 and 15.28% better than the existing classifiers like LSTM, NN + RF, NN + MLP and NN + SVM, respectively, for dataset 6. In addition, he MSE of the adopted NN + DBN + SIWOA method attain lower values (∼54944.41) for dataset 2 than other existing schemes like NN + DBN + CSA(∼9.43), NN + DBN + MFO (∼56728.68), NN + DBN + PSO (∼2.95) and NN + DBN + WOA (∼56767.88), respectively.Originality/valueThis paper has introduced a prediction framework via sentiment analysis. Thereby, along with the stock data and news sentiment data were also considered. From the stock data, technical indicator based features like MACD, RSI and MA are extracted. Therefore, the proposed work was said to be much appropriate for stock market prediction.


Author(s):  
Archana Gupta ◽  
Pranay Bhatia ◽  
Kashyap Dave ◽  
Pritesh Jain

Social media like Face book, Twitter have attracted attention from various sectors of study in recent years. Most of the people share ideas, opinions on various topics such as Stock Market Prediction, Digital marketing, Movie review, Election Results Prediction and Product reviews etc,. Forecasting Financial Market is considered to be one of the significant applications of Sentiment Analysis on Social Data like Face book, Twitter. It is essential to accurately predict the movements in stock trends, as the stock market trends are volatile. In the past few years several researches have been carried out for predicting the future trends of stock market through sentiment analysis on social media comments. This paper gives the survey on the various techniques, tools and methodologies adopted by several researchers on Stock Market Prediction based on sentiment analysis of Social networks


2021 ◽  
Author(s):  
Zhaoxia Wang ◽  
Zhenda HU ◽  
Fang LI ◽  
Seng-Beng HO

Abstract Stock market trending analysis is one of the key research topics in financial analysis. Various theories once highlighted the non-viability of stock market prediction. With the advent of machine learning and Artificial Intelligence (AI), more and more efforts have been devoted to this research area, and predicting the stock market has been demonstrated to be possible. Learning-based methods have been popularly studied for stock price prediction. However, due to the dynamic nature of the stock market and its non-linearity, stock market prediction is still one of the most dificult tasks. With the rise of social networks, huge amount of data is being generated every day and there is a gaining in popularity of incorporating these data into prediction model in the effort to enhance the prediction performance. Therefore, this paper explores the possibilities of the viability of learning-based stock market trending prediction by incorporating social media sentiment analysis. Six machine learning methods including Multi-Layer Perception, Support Vector Machine, Naïve Bayes, Random Forest, Logistic Regression and Extreme Gradient Boosting are selected as the baseline model. The result indicates the possibilities of successful stock market trending prediction and the performance of different learning-based methods is discussed. It is discovered that the distribution of the value of stocks may affect the prediction performance of the methods involved. This research not only demonstrates the merits and weaknesses of different learning-based methods, but also points out that incorporating social opinion is a right direction for improving the performance of stock market trending prediction.


2021 ◽  
Author(s):  
Rajendiran P.Rajendiran ◽  
P.L.K. Priyadarsini

Abstract The procedure of identifying and classifying opinions in a piece of text to find out whether customer reviews towards a particular product or service are positive, negative, or neutral is termed as sentiment analysis. Stock market prediction is one of the most attractive topics in academic and real-life business. Many data mining techniques about sentiment analysis are suffering from the inaccuracy of prediction. The low classification accuracy has a direct effect on the reliability of stock market indicators. Treebank filtering Data Preprocessing based Ochiai-Barkman Relevance Vector Linear Programming Boost Classification (TFDP-ORVLPBC) technique is used for stock market prediction using sentimental analysis with higher prediction accuracy and lesser classification time for enhancing accuracy of stock market based on product review. Initially, the customer reviews and feedback on services or products are collected from the large database. After that, the collected customer reviews are preprocessed by performing the process such as tokenization, stemming, filtering. In order to achieve sentimental analysis through classifying customer reviews as positive and negative, Ochiai-Barkman Relevance Vector Linear Programming Boost Classification algorithm is used. The Linear Programming Boost Classification algorithm constructs with an empty set of weak classifiers as the Ochiai-Barkman Relevance Vector machine. The customer reviews are classified based on the Ochiai-Barkman similarity coefficient. The ensemble technique combines the weak classification results into strong by minimizing the error. In this way, the classification performance gets improved and the prediction of the stock market is carried out in a more accurate manner. Experimental evaluation is carried out on factors such as prediction accuracy, sensitivity, specificity, and prediction time versus amount of customer reviews.


Author(s):  
Padmanayana ◽  
Varsha ◽  
Bhavya K

Stock market prediction is an important topic in ?nancial engineering especially since new techniques and approaches on this matter are gaining value constantly. In this project, we investigate the impact of sentiment expressed through Twitter tweets on stock price prediction. Twitter is the social media platform which provides a free platform for each individual to express their thoughts publicly. Specifically, we fetch the live twitter tweets of the particular company using the API. All the stop words, special characters are extracted from the dataset. The filtered data is used for sentiment analysis using Naïve bayes classifier. Thus, the tweets are classified into positive, negative and neutral tweets. To predict the stock price, the stock dataset is fetched from yahoo finance API. The stock data along with the tweets data are given as input to the machine learning model to obtain the result. XGBoost classifier is used as a model to predict the stock market price. The obtained prediction value is compared with the actual stock market value. The effectiveness of the proposed project on stock price prediction is demonstrated through experiments on several companies like Apple, Amazon, Microsoft using live twitter data and daily stock data. The goal of the project is to use historical stock data in conjunction with sentiment analysis of news headlines and Twitter posts, to predict the future price of a stock of interest. The headlines were obtained by scraping the website, FinViz, while tweets were taken using Tweepy. Both were analyzed using the Vader Sentiment Analyzer.


Sign in / Sign up

Export Citation Format

Share Document