scholarly journals Basic unit; as a common module of neural networks

2021 ◽  
Vol 3 (1) ◽  
Author(s):  
Seisuke Yanagawa
Keyword(s):  
Neural Network ◽  
Neural Networks ◽  
Time Series ◽  
Pattern Recognition ◽  
Time Series Data ◽  
Basic Unit ◽  
Series Data ◽  
Learned Behavior ◽  
Learning Function ◽  
The Brain

In this paper,  the logic is developed assuming that all parts of the brain are composed of a combination of modules that basically have the same structure. The feeding behavior of searching for food while avoiding the dangers of animals in the early stages of evolution is regarded as the basis of time series data processing. The module that performs the processing is presented by a neural network equipped with a learning function based on Hebb's rule, and is called a basic unit. The basic units are arranged in layers, and the information between the layers is bidirectional. This new neural network is an extension of the traditional neural network that has evolved from pattern recognition. The biggest feature is that in the processing of time series data, the activated part changes according to the context structure inherent in the data, and can be mathematically expressed the method of predicting events from the context of learned behavior and utilizing it in best action. 

Neural Network Techniques for Time Series Prediction: A Review

2019 ◽  
Vol 3 (3) ◽  
Author(s):  
Muhammad Faheem Mushtaq ◽  
Urooj Akram ◽  
Muhammad Aamir ◽  
Haseeb Ali ◽  
Muhammad Zulqarnain
Keyword(s):  
Neural Network ◽  
Neural Networks ◽  
Time Series ◽  
Time Series Data ◽  
Weather Prediction ◽  
Time Series Prediction ◽  
Series Data ◽  
Prediction Problem ◽  
Neural Network Models ◽  
Physical Time

It is important to predict a time series because many problems that are related to prediction such as health prediction problem, climate change prediction problem and weather prediction problem include a time component. To solve the time series prediction problem various techniques have been developed over many years to enhance the accuracy of forecasting. This paper presents a review of the prediction of physical time series applications using the neural network models. Neural Networks (NN) have appeared as an effective tool for forecasting of time series.  Moreover, to resolve the problems related to time series data, there is a need of network with single layer trainable weights that is Higher Order Neural Network (HONN) which can perform nonlinearity mapping of input-output. So, the developers are focusing on HONN that has been recently considered to develop the input representation spaces broadly. The HONN model has the ability of functional mapping which determined through some time series problems and it shows the more benefits as compared to conventional Artificial Neural Networks (ANN). The goal of this research is to present the reader awareness about HONN for physical time series prediction, to highlight some benefits and challenges using HONN.

Fusion Process Neural Networks Classifier Oriented Time Series

2019 ◽  
Vol 16 (10) ◽  
pp. 4059-4063
Author(s):  
Ge Li ◽  
Hu Jing ◽  
Chen Guangsheng
Keyword(s):  
Neural Network ◽  
Neural Networks ◽  
Time Series ◽  
Feature Extraction ◽  
Time Series Data ◽  
Learning Algorithm ◽  
Series Data ◽  
Time Varying ◽  
Synthetic Control ◽  
Classification Feature

Based on the consideration of complementary advantages, different wavelet, fractal and statistical methods are integrated to complete the classification feature extraction of time series. Combined with the advantage of process neural networks that processing time-varying information, we propose a fusion classifier with process neural network oriented time series. Be taking advantage of the multi-fractal processing nonlinear feature of time series data classification, the strong adaptability of the wavelet technique for time series data and the effect of statistical features on the classification of time series data, we can achieve the classification feature extraction of time series. Additionally, using time-varying input characteristics of process neural networks, the pattern matching of timevarying input information and space-time aggregation operation is realized. The feature extraction of time series with the above three methods is fused to the distance calculation between time-varying inputs and cluster space in process neural networks. We provide the process neural network fusion to the learning algorithm and optimize the calculation process of the time series classifier. Finally, we report the performance of our classification method using Synthetic Control Charts data from the UCI dataset and illustrate the advantage and validity of the proposed method.

scholarly journals A New Method of Mixed Gas Identification Based on a Convolutional Neural Network for Time Series Classification

Sensors ◽  
2019 ◽  
Vol 19 (9) ◽  
pp. 1960 ◽  
Author(s):  
Lu Han ◽  
Chongchong Yu ◽  
Kaitai Xiao ◽  
Xia Zhao
Keyword(s):  
Neural Network ◽  
Neural Networks ◽  
Time Series ◽  
Convolutional Neural Networks ◽  
Time Series Data ◽  
Series Data ◽  
Time Series Classification ◽  
Mixed Gas ◽  
Gas Identification ◽  
Mixed Gases

This paper proposes a new method of mixed gas identification based on a convolutional neural network for time series classification. In view of the superiority of convolutional neural networks in the field of computer vision, we applied the concept to the classification of five mixed gas time series data collected by an array of eight MOX gas sensors. Existing convolutional neural networks are mostly used for processing visual data, and are rarely used in gas data classification and have great limitations. Therefore, the idea of mapping time series data into an analogous-image matrix data is proposed. Then, five kinds of convolutional neural networks—VGG-16, VGG-19, ResNet18, ResNet34 and ResNet50—were used to classify and compare five kinds of mixed gases. By adjusting the parameters of the convolutional neural networks, the final gas recognition rate is 96.67%. The experimental results show that the method can classify the gas data quickly and effectively, and effectively combine the gas time series data with classical convolutional neural networks, which provides a new idea for the identification of mixed gases.

Ultra High Frequency Trigonometric Higher Order Neural Networks for Time Series Data Analysis

2009 ◽  
pp. 133-163 ◽  
Author(s):  
Ming Zhang
Keyword(s):  
Neural Network ◽  
Neural Networks ◽  
Time Series ◽  
Data Analysis ◽  
Exchange Rates ◽  
Time Series Data ◽  
Higher Order ◽  
Series Data ◽  
Higher Order Neural Networks ◽  
Time Series Data Analysis

This chapter develops a new nonlinear model, Ultra high frequency Trigonometric Higher Order Neural Networks (UTHONN), for time series data analysis. Results show that UTHONN models are 3 to 12% better than Equilibrium Real Exchange Rates (ERER) model, and 4 – 9% better than other Polynomial Higher Order Neural Network (PHONN) and Trigonometric Higher Order Neural Network (THONN) models. This study also uses UTHONN models to simulate foreign exchange rates and consumer price index with error approaching 0.0000%.

Discriminating Ambulation Using a Smart Sensing Plate

2009 ◽  
Author(s):  
Mark T. Elliott ◽  
Xianghong Ma ◽  
Peter N. Brett
Keyword(s):  
Neural Network ◽  
Time Series ◽  
Pattern Recognition ◽  
Early Diagnosis ◽  
Time Series Data ◽  
Recognition Algorithm ◽  
Response To Therapy ◽  
Series Data ◽  
Pattern Recognition Algorithm ◽  
Gait Patterns

The automated sensing scheme described in this paper has the potential to automatically capture, discriminate and classify transients in gait. The mechanical simplicity of the walking platform offers advantages over standard force plates. There is less restriction on dimensions offering the opportunity for multi-contact and multiple steps. This addresses the challenge of patient targeting and the evaluation of patients in a variety of ambulatory applications. In this work the sensitivity of the distributive tactile sensing method has been investigated experimentally. Using coupled time series data from a small number of sensors, gait patterns are compared with stored templates using a pattern recognition algorithm. By using a neural network these patterns were interpreted classifying normal and affected walking events with an accuracy of just under 90%. This system has potential in gait analysis and rehabilitation as a tool for early diagnosis in walking disorders, for determining response to therapy and for identifying changes between pre and post operative gait.

Bayesian Analysis of Nonlinear Autoregression Models Based on Neural Networks

2005 ◽  
Vol 17 (2) ◽  
pp. 453-485 ◽  
Author(s):  
A. Menchero ◽  
R. Montes Diez ◽  
D. Ríos Insua ◽  
P. Müller
Keyword(s):  
Neural Network ◽  
Neural Networks ◽  
Time Series ◽  
Model Building ◽  
Time Series Data ◽  
Series Data ◽  
Model Identifiability ◽  
Nonlinear Features ◽  
Identifiability Problems ◽  
Block Based

We show how Bayesian neural networks can be used for time-series analysis. We consider a block-based model building strategy to model linear and nonlinear features within the time series: a linear combination of a linear autoregression term and a feedforward neural network (FFNN) with an unknown number of hidden nodes. To allow for simpler models, we also consider these terms separately as competing models to select from. Model identifiability problems arise when FFNN sigmoidal activation functions exhibit almost linear behavior or when there are almost duplicate or irrelevant neural network nodes. New reversible-jump moves are proposed to facilitate model selection, mitigating model identifiability problems. We illustrate this methodology analyzing several time-series data examples.

scholarly journals Hybrid Neural Networks for Learning the Trend in Time Series

2017 ◽  
Author(s):  
Tao Lin ◽  
Tian Guo ◽  
Karl Aberer
Keyword(s):  
Neural Network ◽  
Neural Networks ◽  
Time Series ◽  
Time Series Data ◽  
Short Term Memory ◽  
Feature Fusion ◽  
Series Data ◽  
Hybrid Neural Network ◽  
Load Schedule ◽  
Hybrid Neural Networks

The trend of time series characterizes the intermediate upward and downward behaviour of time series. Learning and forecasting the trend in time series data play an important role in many real applications, ranging from resource allocation in data centers, load schedule in smart grid, and so on. Inspired by the recent successes of neural networks, in this paper we propose TreNet, a novel end-to-end hybrid neural network to learn local and global contextual features for predicting the trend of time series. TreNet leverages convolutional neural networks (CNNs) to extract salient features from local raw data of time series. Meanwhile, considering the long-range dependency existing in the sequence of historical trends of time series, TreNet uses a long-short term memory recurrent neural network (LSTM) to capture such dependency. Then, a feature fusion layer is to learn joint representation for predicting the trend. TreNet demonstrates its effectiveness by outperforming CNN, LSTM, the cascade of CNN and LSTM, Hidden Markov Model based method and various kernel based baselines on real datasets.

Neural networks approached for modelling river suspended sediment concentration due to tropical storms

2013 ◽  
Vol 11 (4) ◽  
pp. 457-466
Keyword(s):  
Neural Network ◽  
Neural Networks ◽  
Suspended Sediment ◽  
Suspended Sediment Concentration ◽  
Time Series Data ◽  
Water Discharge ◽  
Sediment Concentration ◽  
Series Data ◽  
Generalized Regression Neural Network ◽  
Event Based

Artificial neural networks are one of the advanced technologies employed in hydrology modelling. This paper investigates the potential of two algorithm networks, the feed forward backpropagation (BP) and generalized regression neural network (GRNN) in comparison with the classical regression for modelling the event-based suspended sediment concentration at Jiasian diversion weir in Southern Taiwan. For this study, the hourly time series data comprised of water discharge, turbidity and suspended sediment concentration during the storm events in the year of 2002 are taken into account in the models. The statistical performances comparison showed that both BP and GRNN are superior to the classical regression in the weir sediment modelling. Additionally, the turbidity was found to be a dominant input variable over the water discharge for suspended sediment concentration estimation. Statistically, both neural network models can be successfully applied for the event-based suspended sediment concentration modelling in the weir studied herein when few data are available.

A review of irregular time series data handling with gated recurrent neural networks

2021 ◽  
Vol 441 ◽  
pp. 161-178
Author(s):  
Philip B. Weerakody ◽  
Kok Wai Wong ◽  
Guanjin Wang ◽  
Wendell Ela
Keyword(s):  
Neural Networks ◽  
Time Series ◽  
Recurrent Neural Networks ◽  
Time Series Data ◽  
Series Data ◽  
Data Handling

scholarly journals Remaining Useful Life Prediction Using Temporal Convolution with Attention

AI ◽  
2021 ◽  
Vol 2 (1) ◽  
pp. 48-70
Author(s):  
Wei Ming Tan ◽  
T. Hui Teo
Keyword(s):  
Neural Network ◽  
Time Series ◽  
Time Series Data ◽  
Remaining Useful Life ◽  
Sensor Data ◽  
Series Data ◽  
Multiple Time ◽  
Data Set ◽  
Form Complex ◽  
Useful Life

Prognostic techniques attempt to predict the Remaining Useful Life (RUL) of a subsystem or a component. Such techniques often use sensor data which are periodically measured and recorded into a time series data set. Such multivariate data sets form complex and non-linear inter-dependencies through recorded time steps and between sensors. Many current existing algorithms for prognostic purposes starts to explore Deep Neural Network (DNN) and its effectiveness in the field. Although Deep Learning (DL) techniques outperform the traditional prognostic algorithms, the networks are generally complex to deploy or train. This paper proposes a Multi-variable Time Series (MTS) focused approach to prognostics that implements a lightweight Convolutional Neural Network (CNN) with attention mechanism. The convolution filters work to extract the abstract temporal patterns from the multiple time series, while the attention mechanisms review the information across the time axis and select the relevant information. The results suggest that the proposed method not only produces a superior accuracy of RUL estimation but it also trains many folds faster than the reported works. The superiority of deploying the network is also demonstrated on a lightweight hardware platform by not just being much compact, but also more efficient for the resource restricted environment.

Sign in / Sign up

Export Citation Format

Share Document