scholarly journals GIS Partial Discharge Pattern Recognition Based on a Novel Convolutional Neural Networks and Long Short-Term Memory

Entropy ◽  
2021 ◽  
Vol 23 (6) ◽  
pp. 774
Author(s):  
Tingliang Liu ◽  
Jing Yan ◽  
Yanxin Wang ◽  
Yifan Xu ◽  
Yiming Zhao
Keyword(s):  
Neural Network ◽  
Pattern Recognition ◽  
Short Term Memory ◽  
Partial Discharge ◽  
Series Data ◽  
Short Term ◽  
Term Memory ◽  
Analysis Methods ◽  
Voltage Signal ◽  
Long Short Term Memory

Distinguishing the types of partial discharge (PD) caused by different insulation defects in gas-insulated switchgear (GIS) is a great challenge in the power industry, and improving the recognition accuracy of the relevant models is one of the key problems. In this paper, a convolutional neural network and long short-term memory (CNN-LSTM) model is proposed, which can effectively extract and utilize the spatiotemporal characteristics of PD input signals. First, the spatial characteristics of higher-level PD signals can be obtained through the CNN network, but because CNN is a deep feedforward neural network, it does not have the ability to process time-series data. The PD voltage signal is related to the time dimension, so LSTM saves and analyzes the previous voltage signal information, realizes the modeling of the time dependence of the data, and improves the accuracy of the PD signal pattern recognition. Finally, the pattern recognition results based on CNN-LSTM are given and compared with those based on other traditional analysis methods. The results show that the pattern recognition rate of this method is the highest, with an average of 97.9%, and its overall accuracy is better than that of other traditional analysis methods. The CNN-LSTM model provides a reliable reference for GIS PD diagnosis.

scholarly journals PREDICTING DAILY PM2.5 USING WEIGHTED LONG SHORT-TERM MEMORY NEURAL NETWORK MODEL

2020 ◽  
Vol XLIII-B3-2020 ◽  
pp. 1451-1455
Author(s):  
H. Fan ◽  
M. Yang ◽  
F. Xiao ◽  
K. Zhao
Keyword(s):  
Neural Network ◽  
Air Pollution ◽  
Short Term Memory ◽  
Meteorological Data ◽  
Series Data ◽  
Wind Condition ◽  
Short Term ◽  
Term Memory ◽  
Long Short Term Memory ◽  
Pm2.5 Concentration

Abstract. Over the past few decades, air pollution has caused serious damage on public health, thus making accurate predictions of PM2.5 crucial. Due to the transportation of air pollutants among areas, the PM2.5 concentration is strongly spatiotemporal correlated. However, the distribution of air pollution monitoring sites is not even, making the spatiotemporal correlation between the central site and surrounding sites varies with different density of sites, and this was neglected by most existing methods. To tackle this problem, this study proposed a weighted long short-term memory neural network extended model (WLSTME), which addressed the issue that how to consider the effect of the density of sites and wind condition on the spatiotemporal correlation of air pollution concentration. First, several the nearest surrounding sites were chosen as the neighbour sites to the central station, and their distance as well as their air pollution concentration and wind condition were input to multi-layer perception (MLP) to generate weighted historical PM2.5 time series data. Second, historical PM2.5 concentration of the central site and weighted PM2.5 series data of neighbour sites were input into LSTM to address spatiotemporal dependency simultaneously and extract spatiotemporal features. Finally, another MLP was utilized to integrate spatiotemporal features extracted above with the meteorological data of central site to generate the forecasts future PM_2.5 concentration of the central site. Daily PM_2.5 concentration and meteorological data on Beijing–Tianjin–Hebei from 2015 to 2017 were collected to train models and evaluate the performance. Experimental results with 3 other methods showed that the proposed WLSTME model has the lowest RMSE (40.67) and MAE (26.10) and the highest p (0.59). This finding confirms that WLSTME can significantly improve the PM2.5 prediction accuracy.

scholarly journals Long Short Term Memory Recurrent Network for Standard and Poor’s 500 Index Modelling

2018 ◽  
Vol 7 (4.15) ◽  
pp. 25 ◽  
Author(s):  
Said Jadid Abdulkadir ◽  
Hitham Alhussian ◽  
Muhammad Nazmi ◽  
Asim A Elsheikh
Keyword(s):  
Neural Network ◽  
Time Series ◽  
Recurrent Neural Network ◽  
Time Series Data ◽  
Short Term Memory ◽  
Series Data ◽  
Short Term ◽  
Term Memory ◽  
Long Short Term Memory

Forecasting time-series data are imperative especially when planning is required through modelling using uncertain knowledge of future events. Recurrent neural network models have been applied in the industry and outperform standard artificial neural networks in forecasting, but fail in long term time-series forecasting due to the vanishing gradient problem. This study offers a robust solution that can be implemented for long-term forecasting using a special architecture of recurrent neural network known as Long Short Term Memory (LSTM) model to overcome the vanishing gradient problem. LSTM is specially designed to avoid the long-term dependency problem as their default behavior. Empirical analysis is performed using quantitative forecasting metrics and comparative model performance on the forecasted outputs. An evaluation analysis is performed to validate that the LSTM model provides better forecasted outputs on Standard & Poor’s 500 Index (S&P 500) in terms of error metrics as compared to other forecasting models.  

scholarly journals Prediction of Rainfall Using Intensified LSTM Based Recurrent Neural Network with Weighted Linear Units

Atmosphere ◽  
2019 ◽  
Vol 10 (11) ◽  
pp. 668 ◽  
Author(s):  
S. Poornima ◽  
M. Pushpalatha
Keyword(s):  
Neural Network ◽  
Recurrent Neural Network ◽  
Time Series Data ◽  
Short Term Memory ◽  
Moving Average ◽  
Series Data ◽  
Short Term ◽  
Term Memory ◽  
Rainfall Prediction ◽  
Long Short Term Memory

Prediction of rainfall is one of the major concerns in the domain of meteorology. Several techniques have been formerly proposed to predict rainfall based on statistical analysis, machine learning and deep learning techniques. Prediction of time series data in meteorology can assist in decision-making processes carried out by organizations responsible for the prevention of disasters. This paper presents Intensified Long Short-Term Memory (Intensified LSTM) based Recurrent Neural Network (RNN) to predict rainfall. The neural network is trained and tested using a standard dataset of rainfall. The trained network will produce predicted attribute of rainfall. The parameters considered for the evaluation of the performance and the efficiency of the proposed rainfall prediction model are Root Mean Square Error (RMSE), accuracy, number of epochs, loss, and learning rate of the network. The results obtained are compared with Holt–Winters, Extreme Learning Machine (ELM), Autoregressive Integrated Moving Average (ARIMA), Recurrent Neural Network and Long Short-Term Memory models in order to exemplify the improvement in the ability to predict rainfall.

scholarly journals A Hybrid Model for Power Consumption Forecasting Using VMD-Based the Long Short-Term Memory Neural Network

2022 ◽  
Vol 9 ◽  
Author(s):  
Yingjun Ruan ◽  
Gang Wang ◽  
Hua Meng ◽  
Fanyue Qian
Keyword(s):  
Neural Network ◽  
Energy Consumption ◽  
Power Consumption ◽  
Hybrid Model ◽  
Short Term Memory ◽  
Series Data ◽  
Short Term ◽  
Term Memory ◽  
Long Short Term Memory ◽  
Individual Features

Energy consumption prediction is a popular research field in computational intelligence. However, it is difficult for general machine learning models to handle complex time series data such as building energy consumption data, and the results are often unsatisfactory. To address this difficulty, a hybrid prediction model based on modal decomposition was proposed in this paper. For data preprocessing, the variational mode decomposition (VMD) technique was used to used to decompose the original sequence into more robust subsequences. In the feature selection, the maximum relevance minimum redundancy (mRMR) algorithm was chosen to analyse the correlation between each component and the individual features while eliminating the redundancy between individual features. In the forecasting module, the long short-term memory (LSTM) neural network model was used to predict power consumption. In order to verify the performance of the proposed model, three categories of contrast methods were applied: 1) Comparing the hybrid model to a single predictive model, 2) Comparing the hybrid model with the backpropagation neural network (BPNN) to the hybrid model with the LSTM and 3) Comparing the hybrid model using mRMR and the hybrid model using mutual information maximization (MIM). The experimental results on the measured data of an office building in Qingdao show that the proposed hybrid model can improve the prediction accuracy and has better robustness compared to VMD-MIM-LSTM. In the three control groups mentioned above, the R2 value of the hybrid model improved by 10, 3 and 3%, respectively, the values of the mean absolute error (MAE) decreased by 48.9, 41.4 and 35.6%, respectively, and the root mean square error (RMSE) decreased by 54.7, 35.5 and 34.1%, respectively.

scholarly journals Simulation of Dynamic Urban Expansion under Ecological Constraints Using a Long Short Term Memory Network Model and Cellular Automata

2021 ◽  
Vol 13 (8) ◽  
pp. 1499
Author(s):  
Jiamin Liu ◽  
Bin Xiao ◽  
Yueshi Li ◽  
Xiaoyun Wang ◽  
Qiang Bie ◽  
...  
Keyword(s):  
Neural Network ◽  
Cellular Automata ◽  
Short Term Memory ◽  
Urban Expansion ◽  
Sustainable Urban Development ◽  
Effective Control ◽  
Series Data ◽  
Short Term ◽  
Term Memory ◽  
Long Short Term Memory

Rapid urban expansion has seriously threatened ecological security and the natural environment on a global scale, thus, the simulation of dynamic urban expansion is a hot topic in current research. Existing urban expansion simulation models focus on the mining of spatial neighborhood features among driving factors, however, they ignore the over-fitting, gradient explosion, and vanishing problems caused by the long-term dependence of time series data, which results in limited model accuracy. In this study, we proposed a new dynamic urban expansion simulation model. Considering the long-time dependence issue, long short term memory (LSTM) was employed to automatically extract the transformation rules through memory units and provide the optimal attribute features for cellular automata (CA). This study selected Lanzhou, which is a semi-arid region in Northwest China, as an example to confirm the validity of the model performance using data from 2000 to 2020. The results revealed that the overall accuracy of the model was 91.01%, which was higher than that of the traditional artificial neural network (ANN)-CA and recurrent neural network (RNN)-CA models. The LSTM-CA framework resolved existing problems with the traditional algorithm, while it significantly reduced complexity and improved simulation accuracy. In addition, we predicted urban expansion to 2030 based on natural expansion (NE) and ecological constraint (EC) scenarios, and found that EC was an effective control strategy. This study provides a certain theoretical basis and reference value toward the realization of new urbanization and ecologically sound civil construction, in the context of territorial spatial planning and healthy/sustainable urban development.

scholarly journals Designing Time Series Crime Prediction Model using Long Short-Term Memory Recurrent Neural Network

2020 ◽  
Vol 9 (4) ◽  
pp. 402-405
Keyword(s):  
Neural Network ◽  
Time Series ◽  
Recurrent Neural Network ◽  
Short Term Memory ◽  
Series Data ◽  
Short Term ◽  
Term Memory ◽  
Long Short Term Memory ◽  
Crime Incidence ◽  
The Relationship

Crime influences people in many ways. Prior studies have shown the relationship between time and crime incidence behavior. This research attempts to determine and examine the relationship between time, crime incidences types and locations by using one of the neural network models for time series data that is, Long Short-Term Memory network. The collected data is pre-processed, analyzed and tested using Long Short-Term Memory recurrent neural network model. R-square score is also used to test the accuracy. The study results show that applying Long Short-Term Memory Recurrent Neural Network (LSTM RNN) enables to come up with more accurate prediction about crime incidence occurrence with respect to time. Predicting crimes accurately helps to improve crime prevention and decision and advance the justice system.

scholarly journals A Robust Terrain Aided Navigation Using the Rao-Blackwellized Particle Filter Trained by Long Short-Term Memory Networks

Sensors ◽  
2018 ◽  
Vol 18 (9) ◽  
pp. 2886 ◽  
Author(s):  
Jungshin Lee ◽  
Hyochoong Bang
Keyword(s):  
Neural Network ◽  
Particle Filter ◽  
Time Series Data ◽  
Short Term Memory ◽  
Measurement Model ◽  
Series Data ◽  
Short Term ◽  
Term Memory ◽  
Long Short Term Memory ◽  
Elevation Model

Terrain-aided navigation (TAN) is a technology that estimates the position of the vehicle by comparing the altitude measured by an altimeter and height from the digital elevation model (DEM). The particle filter (PF)-based TAN has been commonly used to obtain stable real-time navigation solutions in cases where the unmanned aerial vehicle (UAV) operates at a high altitude. Even though TAN performs well on rough and unique terrains, its performance degrades in flat and repetitive terrains. In particular, in the case of PF-based TAN, there has been no verified technique for deciding its terrain validity. Therefore, this study designed a Rao-Blackwellized PF (RBPF)-based TAN, used long short-term memory (LSTM) networks to endure flat and repetitive terrains, and trained the noise covariances and measurement model of RBPF. LSTM is a modified recurrent neural network (RNN), which is an artificial neural network that recognizes patterns from time series data. Using this, this study tuned the noise covariances and measurement model of RBPF to minimize the navigation errors in various flight trajectories. This paper designed a TAN algorithm based on combining RBPF and LSTM and confirmed that it can enable a more precise navigation performance than conventional RBPF based TAN through simulations.

Sign in / Sign up

Export Citation Format

Share Document