Imaging time-series with features to enable visual recognition of regional energy consumption by bio-inspired optimization of deep learning

Energy ◽  
2021 ◽  
Vol 224 ◽  
pp. 120100
Author(s):  
Jui-Sheng Chou ◽  
Dinh-Nhat Truong ◽  
Ching-Chiun Kuo
2021 ◽  
Author(s):  
Μαρία Κασελίμη

The analysis of experimental data that have been observed at different points in time leads to new and unique problems in statistical modeling and inference. The obvious correlation introduced by the sampling of adjacent points in time can severely restrict the applicability of the many conventional statistical methods traditionally dependent on the assumption that these adjacent observations are independent andidentically distributed. The systematic approach by which one goes about answering the mathematical and statistical questions posed by these time correlations is commonly referred to as time series analysis (TSA).Time series modeling (TSM) plays a key role in a wide range of real-life problems that have a temporal component. Modern time series problems often pose significant challenges for the existing techniques both in terms of their complexity, structure and size. While traditional methods have focused on parametric models informed by domain expertise, modern machine learning (ML) methods provide a means to learn temporal dynamics in a purely data-driven manner. With the increasing data availability and computing power in recent times, machine learning has become a vital part of the next generation of time series models. Thus, there is both a great need and an exciting opportunity for the machine learning community to develop theory, models and algorithms specifically for the purpose of processing and analyzing time series data.The impact of time series modelling and analysis on scientific applications can be partially documented by analysing problems of various diverse fields in which important time series problems may arise. Modern time series problems are characterized by complexity. Also, since real-world systems often evolve under transient conditions, the signals/time series tend to exhibit various forms of non-stationarity. As far as mathematical models are concerned, they can be categorized in many different ways. They can be linear or non-linear, static or dynamic, continuous distinct in time, deterministic or contemplative. The proper model selection to accurately describe a system depends on the system under study, on whether the operation of the system is a-priory known or not, as well as on the purpose of the implementation. This dissertation presents developments in nonlinear and non-static time series models under a machine learning framework, comparing their performance in real-life application scenarios related to geoinformatics as well as environmental applications.In this dissertation is provided a comparative analysis that evaluates the performance of several deep learning (DL) architectures on a large number of time series datasets of different nature and for different applications. Two main fruitful research fields are discussed here which were strategically chosen in order to address current cross-disciplinary research priorities attracting the interest of geoinformatics communities. The first problem is related to ionospheric Total Electron Content (TEC) modeling which is an important issue in many real-time Global Navigation System Satellites (GNSS) applications. Reliable and fast knowledge about ionospheric variations becomes increasingly important. GNSS users of single-frequency receivers and satellite navigation systems need accurate corrections to remove signal degradation effects caused by the ionosphere. Ionospheric modeling using signal-processing techniques is the subject of discussion in the present contribution. The next problem under discussion is energy disaggregation which is an important issue for energy efficiency and energy consumption awareness. Reliable and fast knowledge about residential energy consumption at appliance level becomes increasingly important nowadays and it is an important mitigation measure to prevent energy wastage. Energy disaggregation or Non-intrusive load monitoring (NILM) is a single channel blind source separation problem where the task is to estimate the consumption of each electrical appliance given the total energy consumption. For both problems various deep learning models (DL) are proposed that cover various aspects of the problem under study, whereas experimental results indicate the proposed methods' superiority compared to the current state of the art.


2021 ◽  
Vol 4 (1) ◽  
pp. 90-95
Author(s):  
Sasmitoh Rahmad Riady ◽  
◽  
Tjong Wan Sen ◽  

Electrical energy is an important foundation in world economic growth, therefore it requires an accurate prediction in predicting energy consumption in the future. The methods that are often used in previous research are the Time Series and Machine Learning methods, but recently there has been a new method that can predict energy consumption using the Deep Learning Method which can process data quickly for training and testing. In this research, the researcher proposes a model and algorithm which contained in Deep Learning, that is Multivariate Time Series Model with LSTM Algorithm and using Teacher Forcing Technique for predicting electrical energy consumption in the future. Because Multivariate Time Series Model and LSTM Algorithm can receive input with various conditions or seasons of electrical energy consumption. Teacher Forcing Technique is able lighten up the computation so that it can training and testing data quickly. The method used in this study is to compare Teacher Forcing LSTM with Non-Teacher Forcing LSTM in Multivariate Time Series model using several activation functions that produce significant differences. TF value of RMSE 0.006, MAE 0.070 and Non-TF has RMSE and MAE values of 0.117 and 0.246. The value of the two models is obtained from Sigmoid Activation and the worst value of the two models is in the Softmax activation function, with TF values is RMSE 0.423, MAE 0.485 and Non-TF RMSE 0.520, MAE 0.519.


Energies ◽  
2020 ◽  
Vol 13 (18) ◽  
pp. 4722
Author(s):  
Seok-Jun Bu ◽  
Sung-Bae Cho

Predicting residential energy consumption is tantamount to forecasting a multivariate time series. A specific window for several sensor signals can induce various features extracted to forecast the energy consumption by using a prediction model. However, it is still a challenging task because of irregular patterns inside including hidden correlations between power attributes. In order to extract the complicated irregular energy patterns and selectively learn the spatiotemporal features to reduce the translational variance between energy attributes, we propose a deep learning model based on the multi-headed attention with the convolutional recurrent neural network. It exploits the attention scores calculated with softmax and dot product operation in the network to model the transient and impulsive nature of energy demand. Experiments with the dataset of University of California, Irvine (UCI) household electric power consumption consisting of a total 2,075,259 time-series show that the proposed model reduces the prediction error by 31.01% compared to the state-of-the-art deep learning model. Especially, the multi-headed attention improves the prediction performance even more by up to 27.91% than the single-attention.


2020 ◽  
Author(s):  
Pathikkumar Patel ◽  
Bhargav Lad ◽  
Jinan Fiaidhi

During the last few years, RNN models have been extensively used and they have proven to be better for sequence and text data. RNNs have achieved state-of-the-art performance levels in several applications such as text classification, sequence to sequence modelling and time series forecasting. In this article we will review different Machine Learning and Deep Learning based approaches for text data and look at the results obtained from these methods. This work also explores the use of transfer learning in NLP and how it affects the performance of models on a specific application of sentiment analysis.


2015 ◽  
Vol 8 (1) ◽  
pp. 38-42
Author(s):  
Pengfei Si ◽  
Xiangyang Rong ◽  
Angui Li ◽  
Xiaodan Min ◽  
Zhengwu Yang ◽  
...  

As a realization of the energy cascade utilization, the regional energy system has the significant potential of energy saving. As a kind of renewable energy, river water source heat pump also can greatly reduce the energy consumption of refrigeration and heating system. Combining the regional energy and water source heat pump technology, to achieve cooling, heating and power supply for a plurality of block building is of great significance to reduce building energy consumption. This paper introduces a practical engineering case which combines the regional energy system of complex river water source heat pump, which provides a detailed analysis of the hydrology and water quality conditions of the river water source heat pump applications, and discusses the design methods of water intake and drainage system. The results show that the average temperature of cold season is about 23.5 °C, the heating season is about 13.2 °C; the abundant regional water flow can meet the water requirement of water source heat pump unit; the sediment concentration index cannot meet the requirement of river water source heat pump if the water enters the unit directly; the river water chemistry indicators (pH, Cl-, SO42-, total hardness, total iron) can meet the requirement of river water source heat pump, and it is not required to take special measures to solve the problem. However, the problem of sediment concentration of water must be solved.


2019 ◽  
Vol 33 (3) ◽  
pp. 89-109 ◽  
Author(s):  
Ting (Sophia) Sun

SYNOPSIS This paper aims to promote the application of deep learning to audit procedures by illustrating how the capabilities of deep learning for text understanding, speech recognition, visual recognition, and structured data analysis fit into the audit environment. Based on these four capabilities, deep learning serves two major functions in supporting audit decision making: information identification and judgment support. The paper proposes a framework for applying these two deep learning functions to a variety of audit procedures in different audit phases. An audit data warehouse of historical data can be used to construct prediction models, providing suggested actions for various audit procedures. The data warehouse will be updated and enriched with new data instances through the application of deep learning and a human auditor's corrections. Finally, the paper discusses the challenges faced by the accounting profession, regulators, and educators when it comes to applying deep learning.


Sign in / Sign up

Export Citation Format

Share Document