NEW METHOD OF NEURON DESIGN BASED ON DISCRETE Z-FUNCTION TO ADAPT THE CHANGE OF INTEGRATED VEHICLE STABILITY CONTROL ORDER

2009 ◽  
Vol 08 (03) ◽  
pp. 253-285 ◽  
Author(s):  
M. HARLY ◽  
I. N. SUTANTRA ◽  
H. P. MAURIDHI
Keyword(s):  
Neural Network ◽  
Neural Networks ◽  
Back Propagation ◽  
Activation Function ◽  
Zero Order ◽  
Vehicle Stability ◽  
Adaptive Control System ◽  
Control Performance ◽  
Fixed Order ◽  
Hidden Layer

Fixed order neural networks (FONN), such as high order neural network (HONN), in which its architecture is developed from zero order of activation function and joint weight, regulates only the number of weight and their value. As a result, this network only produces a fixed order model or control level. These obstacles, which affect preceeding architectures, have been performing finite ability to adapt uncertainty character of real world plant, such as driving dynamics and its desired control performance. This paper introduces a new concept of neural network neuron. In this matter, exploiting discrete z-function builds new neuron activation. Instead of zero order joint weight matrices, the discrete z-function weight matrix will be provided to realize uncertainty or undetermined real word plant and desired adaptive control system that their order has probably been changing. Instead of using bias, an initial condition value is developed. Neural networks using new neurons is called Varied Order Neural Network (VONN). For optimization process, updating order, coefficient and initial value of node activation function uses GA; while updating joint weight, it applies both back propagation (combined LSE-gauss Newton) and NPSO. To estimate the number of hidden layer, constructive back propagation (CBP) was also applied. Thorough simulation was conducted to compare the control performance between FONN and MONN. In order to control, vehicle stability was equipped by electronics stability program (ESP), electronics four wheel steering (4-EWS), and active suspension (AS). 2000, 4000, 6000, 8000 data that are from TODS, a hidden layer, 3 input nodes, 3 output nodes were provided to train and test the network of both the uncertainty model and its adaptive control system. The result of simulation, therefore, shows that stability parameter such as yaw rate error, vehicle side slip error, and rolling angle error produces better performance control in the form of smaller performance index using FDNN than those using MONN.

Evaluation of Parameter Settings for Training Neural Networks Using Backpropagation Algorithms

2022 ◽  
pp. 202-226
Author(s):  
Leema N. ◽  
Khanna H. Nehemiah ◽  
Elgin Christo V. R. ◽  
Kannan A.
Keyword(s):  
Neural Network ◽  
Neural Networks ◽  
Activation Function ◽  
Neural Network Training ◽  
Network Parameter ◽  
Network Parameters ◽  
Network Training ◽  
Rate Minimum ◽  
Hidden Layer ◽  
Function Number

Artificial neural networks (ANN) are widely used for classification, and the training algorithm commonly used is the backpropagation (BP) algorithm. The major bottleneck faced in the backpropagation neural network training is in fixing the appropriate values for network parameters. The network parameters are initial weights, biases, activation function, number of hidden layers and the number of neurons per hidden layer, number of training epochs, learning rate, minimum error, and momentum term for the classification task. The objective of this work is to investigate the performance of 12 different BP algorithms with the impact of variations in network parameter values for the neural network training. The algorithms were evaluated with different training and testing samples taken from the three benchmark clinical datasets, namely, Pima Indian Diabetes (PID), Hepatitis, and Wisconsin Breast Cancer (WBC) dataset obtained from the University of California Irvine (UCI) machine learning repository.

scholarly journals New Method for Locker Door with Face Security System Using Backpropagation Algorithm

2018 ◽  
Vol 7 (2.13) ◽  
pp. 402
Author(s):  
Y Yusmartato ◽  
Zulkarnain Lubis ◽  
Solly Arza ◽  
Zulfadli Pelawi ◽  
A Armansah ◽  
...  
Keyword(s):  
Neural Network ◽  
Neural Networks ◽  
Pattern Recognition ◽  
Artificial Neural Network ◽  
Artificial Neural Networks ◽  
Human Brain ◽  
Back Propagation ◽  
The Face ◽  
Artificial Neural ◽  
Hidden Layer

Lockers are one of the facilities that people use to store stuff. Artificial neural networks are computational systems where architecture and operations are inspired by the knowledge of biological neurons in the brain, which is one of the artificial representations of the human brain that always tries to stimulate the learning process of the human brain. One of the utilization of artificial neural network is for pattern recognition. The face of a person must be different but sometimes has a shape similar to the face of others, because the facial pattern is a good pattern to try to be recognized by using artificial neural networks. Pattern recognition on artificial neural network can be done by back propagation method. Back propagation method consists of input layer, hidden layer and output layer.  

scholarly journals Evaluation of Parameter Settings for Training Neural Networks Using Backpropagation Algorithms

2020 ◽  
Vol 11 (4) ◽  
pp. 62-85
Author(s):  
Leema N. ◽  
Khanna H. Nehemiah ◽  
Elgin Christo V. R. ◽  
Kannan A.
Keyword(s):  
Neural Network ◽  
Neural Networks ◽  
Activation Function ◽  
Neural Network Training ◽  
Network Parameter ◽  
Network Parameters ◽  
Network Training ◽  
Hidden Layer ◽  
Function Number ◽  
The Impact

Artificial neural networks (ANN) are widely used for classification, and the training algorithm commonly used is the backpropagation (BP) algorithm. The major bottleneck faced in the backpropagation neural network training is in fixing the appropriate values for network parameters. The network parameters are initial weights, biases, activation function, number of hidden layers and the number of neurons per hidden layer, number of training epochs, learning rate, minimum error, and momentum term for the classification task. The objective of this work is to investigate the performance of 12 different BP algorithms with the impact of variations in network parameter values for the neural network training. The algorithms were evaluated with different training and testing samples taken from the three benchmark clinical datasets, namely, Pima Indian Diabetes (PID), Hepatitis, and Wisconsin Breast Cancer (WBC) dataset obtained from the University of California Irvine (UCI) machine learning repository.

Structure Impact Localization Using Emerging Artificial Intelligence Algorithms

2015 ◽  
pp. 103-123
Author(s):  
Qingsong Xu
Keyword(s):  
Neural Network ◽  
Neural Networks ◽  
Learning Algorithm ◽  
Experimental Studies ◽  
Back Propagation ◽  
Damage Localization ◽  
Localization Accuracy ◽  
Fast Learning ◽  
Learning Machine ◽  
Hidden Layer

Extreme learning machine (ELM) is a learning algorithm for single-hidden layer feedforward neural networks. In theory, this algorithm is able to provide good generalization capability at extremely fast learning speed. Comparative studies of benchmark function approximation problems revealed that ELM can learn thousands of times faster than conventional neural network (NN) and can produce good generalization performance in most cases. Unfortunately, the research on damage localization using ELM is limited in the literature. In this chapter, the ELM is extended to the domain of damage localization of plate structures. Its effectiveness in comparison with typical neural networks such as back-propagation neural network (BPNN) and least squares support vector machine (LSSVM) is illustrated through experimental studies. Comparative investigations in terms of learning time and localization accuracy are carried out in detail. It is shown that ELM paves a new way in the domain of plate structure health monitoring. Both advantages and disadvantages of using ELM are discussed.

Selecting the architecture of a class of back-propagation neural networks used as approximators

1997 ◽  
Vol 11 (1) ◽  
pp. 33-44 ◽  
Author(s):  
William C. Carpenter ◽  
Margery E. Hoffman
Keyword(s):  
Neural Network ◽  
Neural Networks ◽  
Network Architecture ◽  
Back Propagation ◽  
Region Of Interest ◽  
Input Output ◽  
Advantages And Disadvantages ◽  
Back Propagation Neural Networks ◽  
Input Layer ◽  
Hidden Layer

AbstractThis paper examines the architecture of back-propagation neural networks used as approximators by addressing the interrelationship between the number of training pairs and the number of input, output, and hidden layer nodes required for a good approximation. It concentrates on nets with an input layer, one hidden layer, and one output layer. It shows that many of the currently proposed schemes for selecting network architecture for such nets are deficient. It demonstrates in numerous examples that overdetermined neural networks tend to give good approximations over a region of interest, while underdetermined networks give approximations which can satisfy the training pairs but may give poor approximations over that region of interest. A scheme is presented that adjusts the number of hidden layer nodes in a neural network so as to give an overdetermined approximation. The advantages and disadvantages of using multiple output nodes are discussed. Guidelines for selecting the number of output nodes are presented.

scholarly journals Multidimensional wavelet neural networks Based on polynomial powers of sigmoid

DAT Journal ◽  
2016 ◽  
Vol 1 (2) ◽  
pp. 106-123
Author(s):  
João Fernando Marar ◽  
Aron Bordin
Keyword(s):  
Neural Network ◽  
Neural Networks ◽  
Back Propagation ◽  
Activation Function ◽  
Wavelet Neural Network ◽  
Back Propagation Algorithm ◽  
Wavelet Neural Networks ◽  
Low Dimensionality ◽  
Feed Forward Neural Networks ◽  
Sigmoid Functions

Wavelet functions have been used as the activation function in feed forward neural networks. An abundance of R&D has been produced on wavelet neural network area. Some successful algorithms and applications in wavelet neural network have been developed and reported in the literature. However, most of the aforementioned reports impose many restrictions in the classical back propagation algorithm, such as low dimensionality, tensor product of wavelets, parameters initialization, and, in general, the output is one dimensional, etc. In order to remove some of these restrictions, a family of polynomial wavelets generated from powers of sigmoid functions is presented. We described how a multidimensional wavelet neural networks based on these functions can be constructed, trained and applied in pattern recognition tasks. As examples of applications for the method proposed a framework for face verfication is presented.

scholarly journals Simulation design of an Intelligent system for Automotive transmission Gearbox Based on FPGA

2018 ◽  
Vol 6 (2) ◽  
pp. 395-411
Author(s):  
Azzad Bader SAEED
Keyword(s):  
Neural Network ◽  
Intelligent System ◽  
Back Propagation ◽  
Activation Function ◽  
Back Propagation Neural Network ◽  
Speed Ratio ◽  
Simulation Design ◽  
Automotive Transmission ◽  
Field Programmable ◽  
Hidden Layer

In this paper, an artificial  intelligent system has been designed, realized, and downloaded into  FPGA (Field Programmable Gate Array), which is used to control five speed ratio steps ( 1,2,3,4,5) of an electrically controlled type of  automotive transmission gearbox of a vehicle, the first speed ratio step (1) is characterized by the  highest torque, a lowest velocity, while, the  fifth step is characterized by the lowest torque, and highest velocity.The Back-propagation neural network has been used as the intelligent system for the proposed system. The proposed neural network is composed from   eight neurons in the input layer, five neurons in the hidden layer, and five neurons in the output layer. For real downloading into the FPGA, Satlins and Satlin linear activation function has been used for the hidden and output layers respectively. The training function Trainlm ( Levenberg-Marqurdt training) has been used as a learning method for the proposed neural network, which it has a powerful algorithm. The proposed simulation system has been designed and downloaded into the FPGA using MATLAB and ISE Design Suit software packages.

scholarly journals Perancangan Model Jaringan Syaraf Tiruan Propagasi Balik Untuk Mengestimasi Curah Hujan

2012 ◽  
Vol 9 (2) ◽  
Author(s):  
Elohansen Padang
Keyword(s):  
Neural Network ◽  
Gradient Descent ◽  
Back Propagation ◽  
Activation Function ◽  
Back Propagation Neural Network ◽  
Rainfall Data ◽  
Training Method ◽  
Output Layer ◽  
Input Layer ◽  
Hidden Layer

This research was conducted to investigate the ability of backpropagation artificial neural network in estimating rainfall. Neural network used consists of input layer, 2 hidden layers and output layer. Input layer consists of 12 neurons that represent each input; first hidden layer consists of 12 neurons with activation function tansig, while the second hidden layer consists of 24 neurons with activation function logsig. Output layer consists of 1 neuron with activation function purelin. Training method used is the method of gradient descent with momentum. Training method used is the method of gradient descent with momentum. Learning rate and momentum parameters defined respectively by 0.1 and 0.5. To evaluate the performance of the network model to recognize patterns of rainfall data is used in Biak city rainfall data from January 1997 - December 2008 (12 years). This data is divided into 2 parts, namely training and testing data using rainfall data from January 1997-December 2005 and data estimation using rainfall data from January 2006-December 2008. From the results of this study concluded that rainfall patterns Biak town can be recognized quite well by the model of back propagation neural network. The test results and estimates of the model results testing the value of R = 0.8119, R estimate = 0.53801, MAPE test = 0.1629, and MAPE estimate = 0.6813.

scholarly journals Application of Artificial Neural Networks for estimating index floods

2012 ◽  
Vol 42 (4) ◽  
pp. 295-311 ◽  
Author(s):  
Viliam Šimor ◽  
Kamila Hlavčová ◽  
Silvia Kohnová ◽  
Ján Szolgay
Keyword(s):  
Neural Networks ◽  
Artificial Neural Networks ◽  
Multiple Regression ◽  
Regression Models ◽  
Learning Algorithm ◽  
Back Propagation ◽  
Activation Function ◽  
Multiple Regression Models ◽  
Artificial Neural ◽  
Hidden Layer

Abstract This article presents an application of Artificial Neural Networks (ANNs) and multiple regression models for estimating mean annual maximum discharge (index flood) at ungauged sites. Both approaches were tested for 145 small basins in Slovakia in areas ranging from 20 to 300 km2. Using the objective clustering method, the catchments were divided into ten homogeneous pooling groups; for each pooling group, mutually independent predictors (catchment characteristics) were selected for both models. The neural network was applied as a simple multilayer perceptron with one hidden layer and with a back propagation learning algorithm. Hyperbolic tangents were used as an activation function in the hidden layer. Estimating index floods by the multiple regression models were based on deriving relationships between the index floods and catchment predictors. The efficiencies of both approaches were tested by the Nash-Sutcliffe and a correlation coefficients. The results showed the comparative applicability of both models with slightly better results for the index floods achieved using the ANNs methodology.

Intelligent Classification and Measurement of Drill Wear

1994 ◽  
Vol 116 (3) ◽  
pp. 392-397 ◽  
Author(s):  
T. I. Liu ◽  
K. S. Anantharaman
Keyword(s):  
Neural Network ◽  
Neural Networks ◽  
Flank Wear ◽  
Estimation Error ◽  
Back Propagation ◽  
Activation Function ◽  
The Neural Network ◽  
On Line ◽  
Thrust And Torque ◽  
Line Classification

Artificial neural networks are used for on-line classification and measurement of drill wear. The input vector of the neural network is obtained by processing the thrust and torque signals. Outputs are the wear states and flank wear measurements. The learning process can be performed by back propagation along with adaptive activation-function slope. The results of neural networks with and without adaptive activation-function slope, as well as various neural network architectures are compared. On-line classification of drill wear using neural networks has 100 percent reliability. The average flank wear estimation error using neural networks can be as low as 7.73 percent.

Sign in / Sign up

Export Citation Format

Share Document