A Long Short-Term Memory Neural Network for Daily NO2 Concentration Forecasting

2021 ◽  
Vol 16 (4) ◽  
pp. 35-51
Author(s):  
Bingchun Liu ◽  
Xiaogang Yu ◽  
Qingshan Wang ◽  
Shijie Zhao ◽  
Lei Zhang
Keyword(s):  
Neural Network ◽  
Prediction Model ◽  
Prediction Accuracy ◽  
Short Term Memory ◽  
Maximum Temperature ◽  
Optimal Prediction ◽  
Short Term ◽  
Term Memory ◽  
Long Short Term Memory ◽  
Concentration Prediction

NO2 pollution has caused serious impact on people's production and life, and the management task is very difficult. Accurate prediction of NO2 concentration is of great significance for air pollution management. In this paper, a NO2 concentration prediction model based on long short-term memory neural network (LSTM) is constructed with daily NO2 concentration in Beijing as the prediction target and atmospheric pollutants and meteorological factors as the input indicators. Firstly, the parameters and architecture of the model are adjusted to obtain the optimal prediction model. Secondly, three different sets of input indicators are built on the basis of the optimal prediction model to enter the model learning. Finally, the impact of different input indicators on the accuracy of the model is judged. The results show that the LSTM model has high application value in NO2 concentration prediction. The maximum temperature and O3 among the three input indicators improve the prediction accuracy while the NO2 historical low-frequency data reduce the prediction accuracy.

scholarly journals Temperature Prediction Based on Bidirectional Long Short-Term Memory and Convolutional Neural Network Combining Observed and Numerical Forecast Data

Sensors ◽  
2021 ◽  
Vol 21 (3) ◽  
pp. 941
Author(s):  
Seongyoep Jeong ◽  
Inyoung Park ◽  
Hyun Soo Kim ◽  
Chul Han Song ◽  
Hong Kook Kim
Keyword(s):  
Neural Network ◽  
Time Series ◽  
Prediction Model ◽  
Convolutional Neural Network ◽  
Short Term Memory ◽  
Image Data ◽  
Short Term ◽  
Temperature Prediction ◽  
Term Memory ◽  
Long Short Term Memory

Weather is affected by a complex interplay of factors, including topography, location, and time. For the prediction of temperature in Korea, it is necessary to use data from multiple regions. To this end, we investigate the use of deep neural-network-based temperature prediction model time-series weather data obtained from an automatic weather station and image data from a regional data assimilation and prediction system (RDAPS). To accommodate such different types of data into a single model, a bidirectional long short-term memory (BLSTM) model and a convolutional neural network (CNN) model are chosen to represent the features from the time-series observed data and the RDAPS image data. The two types of features are combined to produce temperature predictions for up to 14 days in the future. The performance of the proposed temperature prediction model is evaluated by objective measures, including the root mean squared error and mean bias error. The experiments demonstrated that the proposed model combining both the observed and RDAPS image data is better in all performance measures for all prediction periods compared with the BLSTM-based model using observed data and the CNN-BLSTM-based model using RDAPS image data alone.

scholarly journals Attention-Based Long Short-Term Memory Recurrent Neural Network for Capacity Degradation of Lithium-Ion Batteries

Batteries ◽  
2021 ◽  
Vol 7 (4) ◽  
pp. 66
Author(s):  
Tadele Mamo ◽  
Fu-Kwun Wang
Keyword(s):  
Neural Network ◽  
Recurrent Neural Network ◽  
Prediction Accuracy ◽  
Short Term Memory ◽  
Lithium Ion ◽  
Short Term ◽  
Term Memory ◽  
Proposed Model ◽  
Capacity Degradation ◽  
Long Short Term Memory

Monitoring cycle life can provide a prediction of the remaining battery life. To improve the prediction accuracy of lithium-ion battery capacity degradation, we propose a hybrid long short-term memory recurrent neural network model with an attention mechanism. The hyper-parameters of the proposed model are also optimized by a differential evolution algorithm. Using public battery datasets, the proposed model is compared to some published models, and it gives better prediction performance in terms of mean absolute percentage error and root mean square error. In addition, the proposed model can achieve higher prediction accuracy of battery end of life.

scholarly journals Bridge Temperature Prediction Model Based on Long-Short Term Memory Neural Network

2021 ◽  
Vol 1966 (1) ◽  
pp. 012013
Author(s):  
Jingxiao Shu ◽  
Dongyue Zhao ◽  
Xuda Zheng ◽  
Yiwen Li ◽  
Yufeng Zhang
Keyword(s):  
Neural Network ◽  
Prediction Model ◽  
Short Term Memory ◽  
Short Term ◽  
Temperature Prediction ◽  
Term Memory ◽  
Model Based ◽  
Long Short Term Memory

scholarly journals Application of long short-term memory neural network technique for predicting monthly pan evaporation

2021 ◽  
Vol 11 (1) ◽  
Author(s):  
Mustafa Abed ◽  
Monzur Alam Imteaz ◽  
Ali Najah Ahmed ◽  
Yuk Feng Huang
Keyword(s):  
Neural Network ◽  
Machine Learning ◽  
Short Term Memory ◽  
Maximum Temperature ◽  
Gradient Boosting ◽  
Short Term ◽  
Term Memory ◽  
Statistical Measures ◽  
Extreme Gradient Boosting ◽  
Long Short Term Memory

AbstractEvaporation is a key element for water resource management, hydrological modelling, and irrigation system designing. Monthly evaporation (Ep) was projected by deploying three machine learning (ML) models included Extreme Gradient Boosting, ElasticNet Linear Regression, and Long Short-Term Memory; and two empirical techniques namely Stephens-Stewart and Thornthwaite. The aim of this study is to develop a reliable generalised model to predict evaporation throughout Malaysia. In this context, monthly meteorological statistics from two weather stations in Malaysia were utilised for training and testing the models on the basis of climatic aspects such as maximum temperature, mean temperature, minimum temperature, wind speed, relative humidity, and solar radiation for the period of 2000–2019. For every approach, multiple models were formulated by utilising various combinations of input parameters and other model factors. The performance of models was assessed by utilising standard statistical measures. The outcomes indicated that the three machine learning models formulated outclassed empirical models and could considerably enhance the precision of monthly Ep estimate even with the same combinations of inputs. In addition, the performance assessment showed that Long Short-Term Memory Neural Network (LSTM) offered the most precise monthly Ep estimations from all the studied models for both stations. The LSTM-10 model performance measures were (R2 = 0.970, MAE = 0.135, MSE = 0.027, RMSE = 0.166, RAE = 0.173, RSE = 0.029) for Alor Setar and (R2 = 0.986, MAE = 0.058, MSE = 0.005, RMSE = 0.074, RAE = 0.120, RSE = 0.013) for Kota Bharu.

scholarly journals A Convolutional Long Short-Term Memory Neural Network Based Prediction Model

2020 ◽  
Vol 15 (5) ◽  
Author(s):  
Yonghong Tian ◽  
Qi Wu ◽  
Yue Zhang
Keyword(s):  
Neural Network ◽  
Prediction Model ◽  
Short Term Memory ◽  
Supply And Demand ◽  
Original Data ◽  
Market Demand ◽  
Short Term ◽  
Term Memory ◽  
Demand Prediction ◽  
Long Short Term Memory

In recent years, the market demand for online car-hailing service has expanded dramatically. To satisfy the daily travel needs, it is important to predict the supply and demand of online car-hailing in an accurate manner, and make active scheduling based on the predicted gap between supply and demand. This paper puts forward a novel supply and demand prediction model for online carhailing, which combines the merits of convolutional neural network (CNN) and long short-term memory (LSTM). The proposed model was named convolutional LSTM (C-LSTM). Next, the original data on online car-hailing were processed, and the key features that affect the supply and demand prediction were extracted. After that, the C-LSTM was optimized by the AdaBound algorithm during the training process. Finally, the superiority of the C-LSTM in predicting online car-hailing supply and demand was proved through contrastive experiments.

scholarly journals Failure Mechanism and Long Short-Term Memory Neural Network Model for Landslide Risk Prediction

2021 ◽  
Vol 14 (1) ◽  
pp. 166
Author(s):  
Xuan Zhang ◽  
Chun Zhu ◽  
Manchao He ◽  
Menglong Dong ◽  
Guangcheng Zhang ◽  
...  
Keyword(s):  
Neural Network ◽  
Prediction Model ◽  
Short Term Memory ◽  
Three Dimensional ◽  
Discrete Element ◽  
Slope Instability ◽  
Monitoring Data ◽  
Short Term ◽  
Term Memory ◽  
Long Short Term Memory

Rockslides along a stepped failure surface have characteristics of stepped deformation characteristic and it is difficult to predict the failure time. In this study, the deformation characteristics and disaster prediction model of the Fengning granite rockslide were analyzed based on field surveys and monitoring data. To evaluate the stability, the shear strength parameters of the sliding surface were determined based on the back-propagation neural network and three-dimensional discrete element numerical method. Through the correlation analysis of deformation monitoring results with rainfall and blasting, it is shown that the landslide was triggered by excavation, rainfall, and blasting vibrations. The landslide displacement prediction model was established by using long short-term memory neural network (LSTM) based on the monitoring data, and the prediction results are compared with those using the BP model, SVM model and ARMA model. Results show that the LSTM model has strong advantages and good reliability for the stepped landslide deformation with short-term influence, and the predicted LSTM values were very consistent with the measured values, with a correlation coefficient of 0.977. Combined with the distribution characteristics of joints, the damage influence scope of the landslide was simulated by three-dimensional discrete element, which provides decision-making basis for disaster warning after slope instability. The method proposed in this paper can provide references for early warning and treatment of geological disasters.

scholarly journals Temperature Prediction Using the Missing Data Refinement Model Based on a Long Short-Term Memory Neural Network

Atmosphere ◽  
2019 ◽  
Vol 10 (11) ◽  
pp. 718 ◽  
Author(s):  
Park ◽  
Kim ◽  
Lee ◽  
Kim ◽  
Song ◽  
...  
Keyword(s):  
Neural Network ◽  
Missing Data ◽  
Prediction Model ◽  
Short Term Memory ◽  
Weather Data ◽  
Short Term ◽  
Temperature Prediction ◽  
Term Memory ◽  
Proposed Model ◽  
Long Short Term Memory

In this paper, we propose a new temperature prediction model based on deep learning by using real observed weather data. To this end, a huge amount of model training data is needed, but these data should not be defective. However, there is a limitation in collecting weather data since it is not possible to measure data that have been missed. Thus, the collected data are apt to be incomplete, with random or extended gaps. Therefore, the proposed temperature prediction model is used to refine missing data in order to restore missed weather data. In addition, since temperature is seasonal, the proposed model utilizes a long short-term memory (LSTM) neural network, which is a kind of recurrent neural network known to be suitable for time-series data modeling. Furthermore, different configurations of LSTMs are investigated so that the proposed LSTM-based model can reflect the time-series traits of the temperature data. In particular, when a part of the data is detected as missing, it is restored by using the proposed model’s refinement function. After all the missing data are refined, the LSTM-based model is retrained using the refined data. Finally, the proposed LSTM-based temperature prediction model can predict the temperature through three time steps: 6, 12, and 24 h. Furthermore, the model is extended to predict 7 and 14 day future temperatures. The performance of the proposed model is measured by its root-mean-squared error (RMSE) and compared with the RMSEs of a feedforward deep neural network, a conventional LSTM neural network without any refinement function, and a mathematical model currently used by the meteorological office in Korea. Consequently, it is shown that the proposed LSTM-based model employing LSTM-refinement achieves the lowest RMSEs for 6, 12, and 24 h temperature prediction as well as for 7 and 14 day temperature prediction, compared to other DNN-based and LSTM-based models with either no refinement or linear interpolation. Moreover, the prediction accuracy of the proposed model is higher than that of the Unified Model (UM) Local Data Assimilation and Prediction System (LDAPS) for 24 h temperature predictions.

Sign in / Sign up

Export Citation Format

Share Document