scholarly journals Discriminating chaotic and stochastic time series using permutation entropy and artificial neural networks

2021 ◽  
Vol 11 (1) ◽  
Author(s):  
B. R. R. Boaretto ◽  
R. C. Budzinski ◽  
K. L. Rossi ◽  
T. L. Prado ◽  
S. R. Lopes ◽  
...  

AbstractExtracting relevant properties of empirical signals generated by nonlinear, stochastic, and high-dimensional systems is a challenge of complex systems research. Open questions are how to differentiate chaotic signals from stochastic ones, and how to quantify nonlinear and/or high-order temporal correlations. Here we propose a new technique to reliably address both problems. Our approach follows two steps: first, we train an artificial neural network (ANN) with flicker (colored) noise to predict the value of the parameter, $$\alpha$$ α , that determines the strength of the correlation of the noise. To predict $$\alpha$$ α the ANN input features are a set of probabilities that are extracted from the time series by using symbolic ordinal analysis. Then, we input to the trained ANN the probabilities extracted from the time series of interest, and analyze the ANN output. We find that the $$\alpha$$ α value returned by the ANN is informative of the temporal correlations present in the time series. To distinguish between stochastic and chaotic signals, we exploit the fact that the difference between the permutation entropy (PE) of a given time series and the PE of flicker noise with the same $$\alpha$$ α parameter is small when the time series is stochastic, but it is large when the time series is chaotic. We validate our technique by analysing synthetic and empirical time series whose nature is well established. We also demonstrate the robustness of our approach with respect to the length of the time series and to the level of noise. We expect that our algorithm, which is freely available, will be very useful to the community.

Entropy ◽  
2021 ◽  
Vol 23 (8) ◽  
pp. 1025
Author(s):  
Bruno R. R. Boaretto ◽  
Roberto C. Budzinski ◽  
Kalel L. Rossi ◽  
Thiago L. Prado ◽  
Sergio R. Lopes ◽  
...  

Time series analysis comprises a wide repertoire of methods for extracting information from data sets. Despite great advances in time series analysis, identifying and quantifying the strength of nonlinear temporal correlations remain a challenge. We have recently proposed a new method based on training a machine learning algorithm to predict the temporal correlation parameter, α, of flicker noise (FN) time series. The algorithm is trained using as input features the probabilities of ordinal patterns computed from FN time series, xαFN(t), generated with different values of α. Then, the ordinal probabilities computed from the time series of interest, x(t), are used as input features to the trained algorithm and that returns a value, αe, that contains meaningful information about the temporal correlations present in x(t). We have also shown that the difference, Ω, of the permutation entropy (PE) of the time series of interest, x(t), and the PE of a FN time series generated with α=αe, xαeFN(t), allows the identification of the underlying determinism in x(t). Here, we apply our methodology to different datasets and analyze how αe and Ω correlate with well-known quantifiers of chaos and complexity. We also discuss the limitations for identifying determinism in highly chaotic time series and in periodic time series contaminated by noise. The open source algorithm is available on Github.


2012 ◽  
pp. 1-16 ◽  
Author(s):  
Norhisham Bakhary ◽  
Khairulzan Yahya ◽  
Chin Nam Ng

Kebelakangan ini ramai penyelidik mendapati ‘Artificial Neural Network’ (ANN) untuk digunakan dalam berbagai bidang kejuruteraan awam. Banyak aplikasi ANN dalam proses peramalan menghasilkan kejayaan. Kajian ini memfokuskan kepada penggunaan siri masa ‘Univariate Neural Network’ untuk meramalkan permintaan rumah kos rendah di daerah Petaling Jaya, Selangor. Dalam kajian ini, beberapa kes bagi sesi latihan dan ramalan telah dibuat untuk mendapatkan model terbaik bagi meramalkan permintaan rumah. Nilai RMSE yang paling rendah yang diperolehi bagi tahap validasi adalah 0.560 dan nilai MAPE yang diperolehi adalah 8.880%. Hasil kajian ini menunjukkan kaedah ini memberikan keputusan yang boleh diterima dalam peramalan permintaan rumah berdasarkan data masa lalu. Kata kunci: Univariate Neural Network, permintaan rumah kos rendah, RMSE, MAPE Recently researchers have found the potential applications of Artificial Neural Network (ANN) in various fields in civil engineering. Many attempts to apply ANN as a forecasting tool has been successful. This paper highlighted the application of Time Series Univariate Neural Network in forecasting the demand of low cost house in Petaling Jaya district, Selangor, using historical data ranging from February 1996 to Appril 2000. Several cases of training and testing were conducted to obtain the best neural network model. The lowest Root Mean Square Error (RMSE) obtained for validation step is 0.560 and Mean Absolute Percentage Error (MAPE) is 8.880%. These results show that ANN is able to provide reliable result in term of forecasting the housing demand based on previous housing demand record. Key words: Time Series Univariate Neural Network, low cost housing demand, RMSE, MAPE


2007 ◽  
Vol 10 ◽  
pp. 67-76 ◽  
Author(s):  
P. S. Lucio ◽  
F. C. Conde ◽  
I. F. A. Cavalcanti ◽  
A. I. Serrano ◽  
A. M. Ramos ◽  
...  

Abstract. Climatological records users, frequently, request time series for geographical locations where there is no observed meteorological attributes. Climatological conditions of the areas or points of interest have to be calculated interpolating observations in the time of neighboring stations and climate proxy. The aim of the present work is the application of reliable and robust procedures for monthly reconstruction of precipitation time series. Time series is a special case of symbolic regression and we can use Artificial Neural Network (ANN) to explore the spatiotemporal dependence of meteorological attributes. The ANN seems to be an important tool for the propagation of the related weather information to provide practical solution of uncertainties associated with interpolation, capturing the spatiotemporal structure of the data. In practice, one determines the embedding dimension of the time series attractor (delay time that determine how data are processed) and uses these numbers to define the network's architecture. Meteorological attributes can be accurately predicted by the ANN model architecture: designing, training, validation and testing; the best generalization of new data is obtained when the mapping represents the systematic aspects of the data, rather capturing the specific details of the particular training set. As illustration one takes monthly total rainfall series recorded in the period 1961–2005 in the Rio Grande do Sul – Brazil. This reliable and robust reconstruction method has good performance and in particular, they were able to capture the intrinsic dynamic of atmospheric activities. The regional rainfall has been related to high-frequency atmospheric phenomena, such as El Niño and La Niña events, and low frequency phenomena, such as the Pacific Decadal Oscillation.


2021 ◽  
Author(s):  
Jean-François Verne

Abstract In this paper, we propose to analyze the motion of the Lebanese GDP over the period 1950-2019. This macroeconomic aggregate reveals large fluctuations notably during the civil war period (1975-1990). By estimating the Lyapunov exponents with the Artificial Neural Network (ANN) procedure, we show that this series exhibits a strange attractor generated by a chaotic dynamic and we use the embedding procedure to shed in light the bizarre structure of such a series. Thus, the ANN method gives better results regarding prediction than other linear regression models and allows to fit with accuracy the chaotic motion followed by the Lebanese GDP in the phase space.


Sensors ◽  
2019 ◽  
Vol 19 (11) ◽  
pp. 2499 ◽  
Author(s):  
Yue Gu ◽  
Zhenhu Liang ◽  
Satoshi Hagihira

The electroencephalogram (EEG) can reflect brain activity and contains abundant information of different anesthetic states of the brain. It has been widely used for monitoring depth of anesthesia (DoA). In this study, we propose a method that combines multiple EEG-based features with artificial neural network (ANN) to assess the DoA. Multiple EEG-based features can express the states of the brain more comprehensively during anesthesia. First, four parameters including permutation entropy, 95% spectral edge frequency, BetaRatio and SynchFastSlow were extracted from the EEG signal. Then, the four parameters were set as the inputs to an ANN which used bispectral index (BIS) as the reference output. 16 patient datasets during propofol anesthesia were used to evaluate this method. The results indicated that the accuracies of detecting each state were 86.4% (awake), 73.6% (light anesthesia), 84.4% (general anesthesia), and 14% (deep anesthesia). The correlation coefficient between BIS and the index of this method was 0.892 ( p < 0.001 ). The results showed that the proposed method could well distinguish between awake and other anesthesia states. This method is promising and feasible for a monitoring system to assess the DoA.


2021 ◽  
Vol 11 (19) ◽  
pp. 8943
Author(s):  
Rudy Alexis Guejia Burbano ◽  
Giovanni Petrone ◽  
Patrizio Manganiello

In this paper, an artificial neural network (ANN) is used for isolating faults and degradation phenomena occurring in photovoltaic (PV) panels. In the literature, it is well known that the values of the single diode model (SDM) associated to the PV source are strictly related to degradation phenomena and their variation is an indicator of panel degradation. On the other hand, the values of parameters that allow to identify the degraded conditions are not known a priori because they can be different from panel to panel and are strongly dependent on environmental conditions, PV technology and the manufacturing process. For these reasons, to correctly detect the presence of degradation, the effect of environmental conditions and fabrication processes must be properly filtered out. The approach proposed in this paper exploits the intrinsic capability of ANN to map in its architecture two effects: (1) the non-linear relations existing among the SDM parameters and the environmental conditions, and (2) the effect of the degradation phenomena on the I-V curves and, consequently, on the SDM parameters. The ANN architecture is composed of two stages that are trained separately: one for predicting the SDM parameters under the hypothesis of healthy operation and the other one for degraded condition. The variation of each parameter, calculated as the difference of the output of the two ANN stages, will give a direct identification of the type of degradation that is occurring on the PV panel. The method was initially tested by using the experimental I-V curves provided by the NREL database, where the degradation was introduced artificially, later tested by using some degraded experimental I-V curves.


Author(s):  
Sulistyarini Sulistyarini

This paper discusses wedding ceremony in Central Lombok village of Plambik, which is potential to be a cultural attraction that supports the development of tourism. Marriage ceremony in Plambik has a number of stages, which are not necessarily similar to those customly practiced by other groups of Sasak people. in order to hold a wedding ceremony. This paper aimed to explore merariq tradition which is uniquely held by Sasak community in Plambik.  Data of this research were collected through library research and interviews with Plambik natives. The data were then analyzed by comparing the documentary notes with the actual practices of merariq by Plambik villagers. The finding indicated unique features of merariq stages in Plambik.


Author(s):  
Pradeep Mishra ◽  
Chellai Fatih ◽  
Deepa Rawat ◽  
Saswati Sahu ◽  
Sagar Anand Pandey ◽  
...  

Due to the impact of Corona virus (COVID-19) pandemic that exists today, all countries, national and international organizations are in a continuous effort to find efficient and accurate statistical models for forecasting the future pattern of COVID infection. Accurate forecasting should help governments to take decisive decisions to master the pandemic spread.  In this article, we explored the COVID-19 database of India between 17th March to 1st July 2020, then we estimated two nonlinear time series models: Artificial Neural Network (ANN) and Fuzzy Time Series (FTS) by comparing them with ARIMA model. In terms of model adequacy, the FTS model out performs the ANN for the new cases and new deaths time series in India. We observed a short-term virus spread trend according to three forecasting models.Such findings help in more efficient preparation for the Indian health system.


Entropy ◽  
2021 ◽  
Vol 24 (1) ◽  
pp. 54
Author(s):  
Leonardo Ricci ◽  
Antonio Politi

We analyze the permutation entropy of deterministic chaotic signals affected by a weak observational noise. We investigate the scaling dependence of the entropy increase on both the noise amplitude and the window length used to encode the time series. In order to shed light on the scenario, we perform a multifractal analysis, which allows highlighting the emergence of many poorly populated symbolic sequences generated by the stochastic fluctuations. We finally make use of this information to reconstruct the noiseless permutation entropy. While this approach works quite well for Hénon and tent maps, it is much less effective in the case of hyperchaos. We argue about the underlying motivations.


Author(s):  
Lei Zhang

Electroencephalogram (EEG) signals captured from brain activities demonstrate chaotic features, and can be simulated by nonlinear dynamic time series outputs of chaotic systems. This article presents the research work of chaotic system generator design based on artificial neural network (ANN), for studying the chaotic features of human brain dynamics. The ANN training performances of Nonlinear Auto-Regressive (NAR) model are evaluated for the generation and prediction of chaotic system time series outputs, based on varying the ANN architecture and the precision of the generated training data. The NAR model is trained in open loop form with 1,000 training samples generated using Lorenz system equations and the forward Euler method. The close loop NAR model is used for the generation and prediction of Lorenz chaotic time series outputs. The training results show that better training performance can be achieved by increasing the number of feedback delays and the number of hidden neurons, at the cost of increasing the computational load.


Sign in / Sign up

Export Citation Format

Share Document