scholarly journals Adaptive Attention with Consumer Sentinel for Movie Box Office Prediction

Complexity ◽  
2020 ◽  
Vol 2020 ◽  
pp. 1-9
Author(s):  
Kaicheng Feng ◽  
Xiaobing Liu
Keyword(s):  
Prediction Model ◽  
Prediction Accuracy ◽  
Prediction Models ◽  
Short Term Memory ◽  
Influence Factors ◽  
Short Term ◽  
Term Memory ◽  
Attention Model ◽  
Box Office ◽  
Long Short Term Memory

To improve the movie box office prediction accuracy, this paper proposes an adaptive attention with consumer sentinel (LSTM-AACS) for movie box office prediction. First, the influencing factors of the movie box office are analyzed. Tackling the problem of ignoring consumer groups in existing prediction models, we add consumer features and then quantitatively analyze and normalize the box office influence factors. Second, we establish an LSTM (Long Short-Term Memory) box office prediction model and inject the attention mechanism to construct an adaptive attention with consumer sentinel for movie box office prediction. Finally, 10,398 pieces of movie box office dataset are used in the Kaggle competition to compare the prediction results with the LSTM-AACS model, LSTM-Attention model, and LSTM model. The results show that the relative error of LSTM-AACS prediction is 6.58%, which is lower than other models used in the experiment.

A Long Short-Term Memory Neural Network for Daily NO2 Concentration Forecasting

2021 ◽  
Vol 16 (4) ◽  
pp. 35-51
Author(s):  
Bingchun Liu ◽  
Xiaogang Yu ◽  
Qingshan Wang ◽  
Shijie Zhao ◽  
Lei Zhang
Keyword(s):  
Neural Network ◽  
Prediction Model ◽  
Prediction Accuracy ◽  
Short Term Memory ◽  
Maximum Temperature ◽  
Optimal Prediction ◽  
Short Term ◽  
Term Memory ◽  
Long Short Term Memory ◽  
Concentration Prediction

NO2 pollution has caused serious impact on people's production and life, and the management task is very difficult. Accurate prediction of NO2 concentration is of great significance for air pollution management. In this paper, a NO2 concentration prediction model based on long short-term memory neural network (LSTM) is constructed with daily NO2 concentration in Beijing as the prediction target and atmospheric pollutants and meteorological factors as the input indicators. Firstly, the parameters and architecture of the model are adjusted to obtain the optimal prediction model. Secondly, three different sets of input indicators are built on the basis of the optimal prediction model to enter the model learning. Finally, the impact of different input indicators on the accuracy of the model is judged. The results show that the LSTM model has high application value in NO2 concentration prediction. The maximum temperature and O3 among the three input indicators improve the prediction accuracy while the NO2 historical low-frequency data reduce the prediction accuracy.

scholarly journals Classification and Prediction of Typhoon Levels by Satellite Cloud Pictures through GC–LSTM Deep Learning Model

Sensors ◽  
2020 ◽  
Vol 20 (18) ◽  
pp. 5132
Author(s):  
Jianyin Zhou ◽  
Jie Xiang ◽  
Sixun Huang
Keyword(s):  
Deep Learning ◽  
Prediction Accuracy ◽  
Prediction Models ◽  
Short Term Memory ◽  
Network Graph ◽  
Short Term ◽  
Convolutional Network ◽  
Term Memory ◽  
Model Stability ◽  
Long Short Term Memory

Typhoons are some of the most serious natural disasters, and the key to disaster prevention and mitigation is typhoon level classification. How to better use data of satellite cloud pictures to achieve accurate classification of typhoon levels has become one of classification the hot issues in current studies. A new framework of deep learning neural network, Graph Convolutional–Long Short-Term Memory Network (GC–LSTM), is proposed, which is based on the data of satellite cloud pictures of the Himawari-8 satellite in 2010–2019. The Graph Convolutional Network (GCN) is used to process the irregular spatial structure of satellite cloud pictures effectively, and the Long Short-Term Memory (LSTM) network is utilized to learn the characteristics of satellite cloud pictures over time. Moreover, to verify the effectiveness and accuracy of the model, the prediction effect and model stability are compared with other models. The results show that: the algorithm performance of this model is better than other prediction models; the prediction accuracy rate of typhoon level classification reaches 92.35%, and the prediction accuracy of typhoons and super typhoons reaches 95.12%. The model can accurately identify typhoon eye and spiral cloud belt, and the prediction results are always kept in the minimum range compared with the actual results, which proves that the GC–LSTM model has stronger stability. The model can accurately identify the levels of different typhoons according to the satellite cloud pictures. In summary, the results can provide a theoretical basis for the related research of typhoon level classification.

scholarly journals Prediction of Head Movement in 360-Degree Videos Using Attention Model

Sensors ◽  
2021 ◽  
Vol 21 (11) ◽  
pp. 3678
Author(s):  
Dongwon Lee ◽  
Minji Choi ◽  
Joohyun Lee
Keyword(s):  
Machine Learning ◽  
Short Term Memory ◽  
Moving Average ◽  
The Other ◽  
Learning Models ◽  
Short Term ◽  
Term Memory ◽  
Attention Model ◽  
Long Short Term Memory ◽  
Machine Learning Models

In this paper, we propose a prediction algorithm, the combination of Long Short-Term Memory (LSTM) and attention model, based on machine learning models to predict the vision coordinates when watching 360-degree videos in a Virtual Reality (VR) or Augmented Reality (AR) system. Predicting the vision coordinates while video streaming is important when the network condition is degraded. However, the traditional prediction models such as Moving Average (MA) and Autoregression Moving Average (ARMA) are linear so they cannot consider the nonlinear relationship. Therefore, machine learning models based on deep learning are recently used for nonlinear predictions. We use the Long Short-Term Memory (LSTM) and Gated Recurrent Unit (GRU) neural network methods, originated in Recurrent Neural Networks (RNN), and predict the head position in the 360-degree videos. Therefore, we adopt the attention model to LSTM to make more accurate results. We also compare the performance of the proposed model with the other machine learning models such as Multi-Layer Perceptron (MLP) and RNN using the root mean squared error (RMSE) of predicted and real coordinates. We demonstrate that our model can predict the vision coordinates more accurately than the other models in various videos.

scholarly journals An AutoEncoder and LSTM-Based Traffic Flow Prediction Method

Sensors ◽  
2019 ◽  
Vol 19 (13) ◽  
pp. 2946 ◽  
Author(s):  
Wangyang Wei ◽  
Honghai Wu ◽  
Huadong Ma
Keyword(s):  
Traffic Flow ◽  
Prediction Accuracy ◽  
Short Term Memory ◽  
Smart Cities ◽  
Prediction Method ◽  
Short Term ◽  
Term Memory ◽  
Traffic Flow Prediction ◽  
Flow Prediction ◽  
Long Short Term Memory

Smart cities can effectively improve the quality of urban life. Intelligent Transportation System (ITS) is an important part of smart cities. The accurate and real-time prediction of traffic flow plays an important role in ITSs. To improve the prediction accuracy, we propose a novel traffic flow prediction method, called AutoEncoder Long Short-Term Memory (AE-LSTM) prediction method. In our method, the AutoEncoder is used to obtain the internal relationship of traffic flow by extracting the characteristics of upstream and downstream traffic flow data. Moreover, the Long Short-Term Memory (LSTM) network utilizes the acquired characteristic data and the historical data to predict complex linear traffic flow data. The experimental results show that the AE-LSTM method had higher prediction accuracy. Specifically, the Mean Relative Error (MRE) of the AE-LSTM was reduced by 0.01 compared with the previous prediction methods. In addition, AE-LSTM method also had good stability. For different stations and different dates, the prediction error and fluctuation of the AE-LSTM method was small. Furthermore, the average MRE of AE-LSTM prediction results was 0.06 for six different days.

scholarly journals Forecasting Day-Ahead Hourly Photovoltaic Power Generation Using Convolutional Self-Attention Based Long Short-Term Memory

Energies ◽  
2020 ◽  
Vol 13 (15) ◽  
pp. 4017 ◽  
Author(s):  
Dukhwan Yu ◽  
Wonik Choi ◽  
Myoungsoo Kim ◽  
Ling Liu
Keyword(s):  
Power Generation ◽  
Deep Learning ◽  
Prediction Accuracy ◽  
Short Term Memory ◽  
Local Context ◽  
Short Term ◽  
Term Memory ◽  
Proposed Model ◽  
Long Short Term Memory ◽  
Pv Power Generation

The problem of Photovoltaic (PV) power generation forecasting is becoming crucial as the penetration level of Distributed Energy Resources (DERs) increases in microgrids and Virtual Power Plants (VPPs). In order to improve the stability of power systems, a fair amount of research has been proposed for increasing prediction performance in practical environments through statistical, machine learning, deep learning, and hybrid approaches. Despite these efforts, the problem of forecasting PV power generation remains to be challenging in power system operations since existing methods show limited accuracy and thus are not sufficiently practical enough to be widely deployed. Many existing methods using long historical data suffer from the long-term dependency problem and are not able to produce high prediction accuracy due to their failure to fully utilize all features of long sequence inputs. To address this problem, we propose a deep learning-based PV power generation forecasting model called Convolutional Self-Attention based Long Short-Term Memory (LSTM). By using the convolutional self-attention mechanism, we can significantly improve prediction accuracy by capturing the local context of the data and generating keys and queries that fit the local context. To validate the applicability of the proposed model, we conduct extensive experiments on both PV power generation forecasting using a real world dataset and power consumption forecasting. The experimental results of power generation forecasting using the real world datasets show that the MAPEs of the proposed model are much lower, in fact by 7.7%, 6%, 3.9% compared to the Deep Neural Network (DNN), LSTM and LSTM with the canonical self-attention, respectively. As for power consumption forecasting, the proposed model exhibits 32%, 17% and 44% lower Mean Absolute Percentage Error (MAPE) than the DNN, LSTM and LSTM with the canonical self-attention, respectively.

scholarly journals DLI: A Deep Learning-Based Granger Causality Inference

Complexity ◽  
2020 ◽  
Vol 2020 ◽  
pp. 1-6 ◽  
Author(s):  
Wei Peng
Keyword(s):  
Deep Learning ◽  
Granger Causality ◽  
Prediction Accuracy ◽  
Short Term Memory ◽  
Target Variable ◽  
Short Term ◽  
Term Memory ◽  
P Index ◽  
Causality Inference ◽  
Long Short Term Memory

Integrating autoencoder (AE), long short-term memory (LSTM), and convolutional neural network (CNN), we propose an interpretable deep learning architecture for Granger causality inference, named deep learning-based Granger causality inference (DLI). Two contributions of the proposed DLI are to reveal the Granger causality between the bitcoin price and S&P index and to forecast the bitcoin price and S&P index with a higher accuracy. Experimental results demonstrate that there is a bidirectional but asymmetric Granger causality between the bitcoin price and S&P index. And the DLI performs a superior prediction accuracy by integrating variables that have causalities with the target variable into the prediction process.

Sign in / Sign up

Export Citation Format

Share Document