scholarly journals Short-Term Load Forecasting Based on the Transformer Model

Information ◽  
2021 ◽  
Vol 12 (12) ◽  
pp. 516
Author(s):  
Zezheng Zhao ◽  
Chunqiu Xia ◽  
Lian Chi ◽  
Xiaomin Chang ◽  
Wei Li ◽  
...  
Keyword(s):  
Load Forecasting ◽  
Percentage Error ◽  
Short Term ◽  
Proposed Model ◽  
Consumption Data ◽  
Short Term Load Forecasting ◽  
Distribution Process ◽  
Set Up ◽  
Transformer Model ◽  
Similar Day

From the perspective of energy providers, accurate short-term load forecasting plays a significant role in the energy generation plan, efficient energy distribution process and electricity price strategy optimisation. However, it is hard to achieve a satisfactory result because the historical data is irregular, non-smooth, non-linear and noisy. To handle these challenges, in this work, we introduce a novel model based on the Transformer network to provide an accurate day-ahead load forecasting service. Our model contains a similar day selection approach involving the LightGBM and k-means algorithms. Compared to the traditional RNN-based model, our proposed model can avoid falling into the local minimum and outperforming the global search. To evaluate the performance of our proposed model, we set up a series of simulation experiments based on the energy consumption data in Australia. The performance of our model has an average MAPE (mean absolute percentage error) of 1.13, where RNN is 4.18, and LSTM is 1.93.

scholarly journals Online SARIMA applied for short-term electricity load forecasting

2021 ◽  
Author(s):  
Quang Dat Nguyen ◽  
Nhat Anh Nguyen ◽  
Ngoc Thang Tran ◽  
Vijender Kumar Solanki ◽  
Rubén González Crespo ◽  
...  
Keyword(s):  
Power Systems ◽  
Moving Average ◽  
Supply And Demand ◽  
Load Forecasting ◽  
Percentage Error ◽  
Short Term ◽  
Autoregressive Integrated Moving Average ◽  
Proposed Model ◽  
Short Term Load Forecasting ◽  
Electricity Load

Abstract Short-term Load Forecasting (STLF) plays a crucial role in balancing supply and demand of load dispatching operation, ensures stability for the power system. With the advancement of real-time smart sensors in power systems, it is of great significance to develop techniques to handle data streams on-the-fly to improve operational efficiency. In this paper, we propose an online variant of Seasonal Autoregressive Integrated Moving Average (SARIMA) to forecast electricity load sequentially. The proposed model is utilized to forecast hourly electricity load of northern Vietnam and achieves a mean absolute percentage error (MAPE) of 4.57%.

scholarly journals Short-Term Load Forecasting Algorithm Using a Similar Day Selection Method Based on Reinforcement Learning

Energies ◽  
2020 ◽  
Vol 13 (10) ◽  
pp. 2640 ◽  
Author(s):  
Rae-Jun Park ◽  
Kyung-Bin Song ◽  
Bo-Sung Kwon
Keyword(s):  
Reinforcement Learning ◽  
Predictive Accuracy ◽  
Learning Algorithm ◽  
Load Forecasting ◽  
Selection Method ◽  
Selection Model ◽  
Short Term ◽  
Short Term Load Forecasting ◽  
Similar Day ◽  
Reinforcement Learning Algorithm

Short-term load forecasting (STLF) is very important for planning and operating power systems and markets. Various algorithms have been developed for STLF. However, numerous utilities still apply additional correction processes, which depend on experienced professionals. In this study, an STLF algorithm that uses a similar day selection method based on reinforcement learning is proposed to substitute the dependence on an expert’s experience. The proposed algorithm consists of the selection of similar days, which is based on the reinforcement algorithm, and the STLF, which is based on an artificial neural network. The proposed similar day selection model based on the reinforcement learning algorithm is developed based on the Deep Q-Network technique, which is a value-based reinforcement learning algorithm. The proposed similar day selection model and load forecasting model are tested using the measured load and meteorological data for Korea. The proposed algorithm shows an improvement accuracy of load forecasting over previous algorithms. The proposed STLF algorithm is expected to improve the predictive accuracy of STLF because it can be applied in a complementary manner along with other load forecasting algorithms.

scholarly journals A Short-Term Load Forecasting Method Based on GRU-CNN Hybrid Neural Network Model

2020 ◽  
Vol 2020 ◽  
pp. 1-10 ◽  
Author(s):  
Lizhen Wu ◽  
Chun Kong ◽  
Xiaohong Hao ◽  
Wei Chen
Keyword(s):  
Neural Network ◽  
Power System ◽  
Network Model ◽  
Neural Network Model ◽  
Feature Vector ◽  
Load Forecasting ◽  
Percentage Error ◽  
Short Term ◽  
Hybrid Neural Network ◽  
Short Term Load Forecasting

Short-term load forecasting (STLF) plays a very important role in improving the economy and stability of the power system operation. With the smart meters and smart sensors widely deployed in the power system, a large amount of data was generated but not fully utilized, these data are complex and diverse, and most of the STLF methods cannot well handle such a huge, complex, and diverse data. For better accuracy of STLF, a GRU-CNN hybrid neural network model which combines the gated recurrent unit (GRU) and convolutional neural networks (CNN) was proposed; the feature vector of time sequence data is extracted by the GRU module, and the feature vector of other high-dimensional data is extracted by the CNN module. The proposed model was tested in a real-world experiment, and the mean absolute percentage error (MAPE) and the root mean square error (RMSE) of the GRU-CNN model are the lowest among BPNN, GRU, and CNN forecasting methods; the proposed GRU-CNN model can more fully use data and achieve more accurate short-term load forecasting.

Short-Term Load Forecasting: Similar Day-Based Wavelet Neural Networks

2010 ◽  
Vol 25 (1) ◽  
pp. 322-330 ◽  
Author(s):  
Ying Chen ◽  
P.B. Luh ◽  
Che Guan ◽  
Yige Zhao ◽  
L.D. Michel ◽  
...  
Keyword(s):  
Neural Networks ◽  
Load Forecasting ◽  
Wavelet Neural Networks ◽  
Short Term ◽  
Short Term Load Forecasting ◽  
Similar Day

scholarly journals ANN based Short-Term Load Curve Forecasting

2018 ◽  
Vol 13 (6) ◽  
pp. 938-955
Author(s):  
Violeta Eugenia Chis ◽  
Constantin Barbulescu ◽  
Stefan Kilyeni ◽  
Simona Dzitac
Keyword(s):  
Distribution System ◽  
Load Forecasting ◽  
Software Tool ◽  
Regression Curve ◽  
Short Term ◽  
Load Curve ◽  
Consumption Data ◽  
Short Term Load Forecasting ◽  
System Operator ◽  
Linear Regression Curve

A software tool developed in Matlab for short-term load forecasting (STLF) is presented. Different forecasting methods such as artificial neural networks, multiple linear regression, curve fitting have been integrated into a stand-alone application with a graphical user interface. Real power consumption data have been used. They have been provided by the branches of the distribution system operator from the Southern-Western part of the Romanian Power System. This paper is an extended variant of [4].

scholarly journals A Two-Stage Short-Term Load Forecasting Method Using Long Short-Term Memory and Multilayer Perceptron

Energies ◽  
2021 ◽  
Vol 14 (18) ◽  
pp. 5873
Author(s):  
Yuhong Xie ◽  
Yuzuru Ueda ◽  
Masakazu Sugiyama
Keyword(s):  
Neural Networks ◽  
Multilayer Perceptron ◽  
Short Term Memory ◽  
Historical Data ◽  
Load Forecasting ◽  
Short Term ◽  
Term Memory ◽  
Proposed Model ◽  
Short Term Load Forecasting ◽  
Long Short Term Memory

Load forecasting is an essential task in the operation management of a power system. Electric power companies utilize short-term load forecasting (STLF) technology to make reasonable power generation plans. A forecasting model with low prediction errors helps reduce operating costs and risks for the operators. In recent years, machine learning has become one of the most popular technologies for load forecasting. In this paper, a two-stage STLF model based on long short-term memory (LSTM) and multilayer perceptron (MLP), which improves the forecasting accuracy over the entire time horizon, is proposed. In the first stage, a sequence-to-sequence (seq2seq) architecture, which can handle a multi-sequence of input to extract more features of historical data than that of single sequence, is used to make multistep predictions. In the second stage, the MLP is used for residual modification by perceiving other information that the LSTM cannot. To construct the model, we collected the electrical load, calendar, and meteorological records of Kanto region in Japan for four years. Unlike other LSTM-based hybrid architectures, the proposed model uses two independent neural networks instead of making the neural network deeper by concatenating a series of LSTM cells and convolutional neural networks (CNNs). Therefore, the proposed model is easy to be trained and more interpretable. The seq2seq module performs well in the first few hours of the predictions. The MLP inherits the advantage of the seq2seq module and improves the results by feeding artificially selected features both from historical data and information of the target day. Compared to the LSTM-AM model and single MLP model, the mean absolute percentage error (MAPE) of the proposed model decreases from 2.82% and 2.65% to 2%, respectively. The results demonstrate that the MLP helps improve the prediction accuracy of seq2seq module and the proposed model achieves better performance than other popular models. In addition, this paper also reveals the reason why the MLP achieves the improvement.

scholarly journals Performance Evaluation of Different Membership Function in Fuzzy Logic Based Short-Term Load Forecasting

2021 ◽  
Vol 29 (2) ◽  
Author(s):  
Oladimeji Ibrahim ◽  
Waheed Olaide Owonikoko ◽  
Abubakar Abdulkarim ◽  
Abdulrahman Okino Otuoze ◽  
Mubarak Akorede Afolayan ◽  
...  
Keyword(s):  
Fuzzy Logic ◽  
Membership Function ◽  
Load Forecasting ◽  
Percentage Error ◽  
Short Term ◽  
Load Forecast ◽  
Utility Company ◽  
Load Demand ◽  
Short Term Load Forecasting ◽  
Fuzzy Logic Technique

A mismatch between utility-scale electricity generation and demand often results in resources and energy wastage that needed to be minimized. Therefore, the utility company needs to be able to accurately forecast load demand as a guide for the planned generation. Short-term load forecast assists the utility company in projecting the future energy demand. The predicted load demand is used to plan ahead for the power to be generated, transmitted, and distributed and which is crucial to power system reliability and economics. Recently, various methods from statistical, artificial intelligence, and hybrid methods have been widely used for load forecasts with each having their merits and drawbacks. This paper investigates the application of the fuzzy logic technique for short-term load forecast of a day ahead load. The developed fuzzy logic model used time, temperature, and historical load data to forecast 24 hours load demand. The fuzzy models were based on both the trapezoidal and triangular membership function (MF) to investigate their accuracy and effectiveness for the load forecast. The obtained low Mean Absolute Percentage Error (MAPE), Mean Forecast Error (MFE), and Mean Absolute Deviation (MAD) values from the forecasted load results showed that both models are suitable for short-term load forecasting, however the trapezoidal MF showed better performance than the triangular MF.

scholarly journals A Hybrid Short-Term Load Forecasting Framework with an Attention-Based Encoder–Decoder Network Based on Seasonal and Trend Adjustment

Energies ◽  
2019 ◽  
Vol 12 (24) ◽  
pp. 4612 ◽  
Author(s):  
Zhaorui Meng ◽  
Xianze Xu
Keyword(s):  
Power System ◽  
Load Forecasting ◽  
The United States ◽  
Attention Mechanism ◽  
Gradient Boosting ◽  
Percentage Error ◽  
Electrical Load ◽  
Short Term ◽  
Short Term Load Forecasting ◽  
Gated Recurrent Units

Accurate electrical load forecasting plays an important role in power system operation. An effective load forecasting approach can improve the operation efficiency of a power system. This paper proposes the seasonal and trend adjustment attention encoder–decoder (STA–AED), a hybrid short-term load forecasting approach based on a multi-head attention encoder–decoder module with seasonal and trend adjustment. A seasonal and trend decomposing technique is used to preprocess the original electrical load data. Each decomposed datum is regressed to predict the future electric load value by utilizing the encoder–decoder network with the multi-head attention mechanism. With the multi-head attention mechanism, STA–AED can interpret the prediction results more effectively. A large number of experiments and extensive comparisons have been carried out with a load forecasting dataset from the United States. The proposed hybrid STA–AED model is superior to the other five counterpart models such as random forest, gradient boosting decision tree (GBDT), gated recurrent units (GRUs), Encoder–Decoder, and Encoder–Decoder with multi-head attention. The proposed hybrid model shows the best prediction accuracy in 14 out of 15 zones in terms of both root mean square error (RMSE) and mean absolute percentage error (MAPE).

Sign in / Sign up

Export Citation Format

Share Document