scholarly journals Convolutional neural networks for modeling and forecasting nonlinear nonstationary processes

ScienceRise ◽  
2021 ◽  
pp. 12-20
Author(s):  
Andrii Belas ◽  
Petro Bidyuk
Keyword(s):  
Neural Networks ◽  
Time Series ◽  
Convolutional Neural Networks ◽  
Recurrent Neural Networks ◽  
Time Series Data ◽  
Autoregressive Models ◽  
Series Data ◽  
Nonstationary Processes ◽  
Modeling And Forecasting ◽  
Technological Product

The object of research. The object of research is modeling and forecasting nonlinear nonstationary processes presented in the form of time-series data. Investigated problem. There are several popular approaches to solving the problems of adequate model constructing and forecasting nonlinear nonstationary processes, such as autoregressive models and recurrent neural networks. However, each of them has its advantages and drawbacks. Autoregressive models cannot deal with the nonlinear or combined influence of previous states or external factors. Recurrent neural networks are computationally expensive and cannot work with sequences of high length or frequency. The main scientific result. The model for forecasting nonlinear nonstationary processes presented in the form of the time series data was built using convolutional neural networks. The current study shows results in which convolutional networks are superior to recurrent ones in terms of both accuracy and complexity. It was possible to build a more accurate model with a much fewer number of parameters. It indicates that one-dimensional convolutional neural networks can be a quite reasonable choice for solving time series forecasting problems. The area of practical use of the research results. Forecasting dynamics of processes in economy, finances, ecology, healthcare, technical systems and other areas exhibiting the types of nonlinear nonstationary processes. Innovative technological product. Methodology of using convolutional neural networks for modeling and forecasting nonlinear nonstationary processes presented in the form of time-series data. Scope of the innovative technological product. Nonlinear nonstationary processes presented in the form of time-series data.

A review of irregular time series data handling with gated recurrent neural networks

2021 ◽  
Vol 441 ◽  
pp. 161-178
Author(s):  
Philip B. Weerakody ◽  
Kok Wai Wong ◽  
Guanjin Wang ◽  
Wendell Ela
Keyword(s):  
Neural Networks ◽  
Time Series ◽  
Recurrent Neural Networks ◽  
Time Series Data ◽  
Series Data ◽  
Data Handling

scholarly journals Observation error covariance specification in dynamical systems for data assimilation using recurrent neural networks

2021 ◽  
Author(s):  
Sibo Cheng ◽  
Mingming Qiu
Keyword(s):  
Neural Networks ◽  
Time Series ◽  
Dynamical Systems ◽  
Data Assimilation ◽  
Recurrent Neural Networks ◽  
Time Series Data ◽  
Series Data ◽  
Observation Data ◽  
Observation Error ◽  
Error Covariance

AbstractData assimilation techniques are widely used to predict complex dynamical systems with uncertainties, based on time-series observation data. Error covariance matrices modeling is an important element in data assimilation algorithms which can considerably impact the forecasting accuracy. The estimation of these covariances, which usually relies on empirical assumptions and physical constraints, is often imprecise and computationally expensive, especially for systems of large dimensions. In this work, we propose a data-driven approach based on long short term memory (LSTM) recurrent neural networks (RNN) to improve both the accuracy and the efficiency of observation covariance specification in data assimilation for dynamical systems. Learning the covariance matrix from observed/simulated time-series data, the proposed approach does not require any knowledge or assumption about prior error distribution, unlike classical posterior tuning methods. We have compared the novel approach with two state-of-the-art covariance tuning algorithms, namely DI01 and D05, first in a Lorenz dynamical system and then in a 2D shallow water twin experiments framework with different covariance parameterization using ensemble assimilation. This novel method shows significant advantages in observation covariance specification, assimilation accuracy, and computational efficiency.

Bayesian Recurrent Neural Networks for Monitoring Rotorcraft Icing from Aeroacoustics Time-Series Data

2022 ◽  
Author(s):  
Hua Tong ◽  
Jeremiah M. Hauth ◽  
Xun Huan ◽  
Beckett Yx Zhou ◽  
Nicolas R. Gauger ◽  
...  
Keyword(s):  
Neural Networks ◽  
Time Series ◽  
Recurrent Neural Networks ◽  
Time Series Data ◽  
Series Data

scholarly journals A New Method of Mixed Gas Identification Based on a Convolutional Neural Network for Time Series Classification

Sensors ◽  
2019 ◽  
Vol 19 (9) ◽  
pp. 1960 ◽  
Author(s):  
Lu Han ◽  
Chongchong Yu ◽  
Kaitai Xiao ◽  
Xia Zhao
Keyword(s):  
Neural Network ◽  
Neural Networks ◽  
Time Series ◽  
Convolutional Neural Networks ◽  
Time Series Data ◽  
Series Data ◽  
Time Series Classification ◽  
Mixed Gas ◽  
Gas Identification ◽  
Mixed Gases

This paper proposes a new method of mixed gas identification based on a convolutional neural network for time series classification. In view of the superiority of convolutional neural networks in the field of computer vision, we applied the concept to the classification of five mixed gas time series data collected by an array of eight MOX gas sensors. Existing convolutional neural networks are mostly used for processing visual data, and are rarely used in gas data classification and have great limitations. Therefore, the idea of mapping time series data into an analogous-image matrix data is proposed. Then, five kinds of convolutional neural networks—VGG-16, VGG-19, ResNet18, ResNet34 and ResNet50—were used to classify and compare five kinds of mixed gases. By adjusting the parameters of the convolutional neural networks, the final gas recognition rate is 96.67%. The experimental results show that the method can classify the gas data quickly and effectively, and effectively combine the gas time series data with classical convolutional neural networks, which provides a new idea for the identification of mixed gases.

Sign in / Sign up

Export Citation Format

Share Document