EFFECTS OF NONSINGULAR PREPROCESSING ON FEEDFORWARD NETWORK TRAINING

2005 ◽  
Vol 19 (02) ◽  
pp. 217-247 ◽  
Author(s):  
CHANGHUA YU ◽  
MICHAEL T. MANRY ◽  
JIANG LI
Keyword(s):  
Back Propagation ◽  
Original Data ◽  
Data Sets ◽  
Training Algorithm ◽  
Feedforward Network ◽  
Data Set ◽  
Network Training ◽  
The Neural Network ◽  
Hidden Layer ◽  
Theoretical Analyses

In the neural network literature, many preprocessing techniques, such as feature de-correlation, input unbiasing and normalization, are suggested to accelerate multilayer perceptron training. In this paper, we show that a network trained with an original data set and one trained with a linear transformation of the original data will go through the same training dynamics, as long as they start from equivalent states. Thus preprocessing techniques may not be helpful and are merely equivalent to using a different weight set to initialize the network. Theoretical analyses of such preprocessing approaches are given for conjugate gradient, back propagation and the Newton method. In addition, an efficient Newton-like training algorithm is proposed for hidden layer training. Experiments on various data sets confirm the theoretical analyses and verify the improvement of the new algorithm.

System Identification of UAV Alap-Alap Using Back Propagation Neural Network

2013 ◽  
Vol 373-375 ◽  
pp. 1212-1219
Author(s):  
Afrias Sarotama ◽  
Benyamin Kusumoputro
Keyword(s):  
Neural Network ◽  
Back Propagation ◽  
Back Propagation Neural Network ◽  
Training Data ◽  
Data Sets ◽  
Input Output ◽  
Data Set ◽  
Flight Data ◽  
The Neural Network ◽  
Aerial Vehicle

A good model is necessary in order to design a controller of a system off-line. It is especially beneficial in the implementation of new advanced control schemes in Unmanned Aerial Vehicle (UAV). Considering the safety and benefit of an off-line tuning of the UAV controllers, this paper identifies a dynamic MIMO UAV nonlinear system which is derived based on the collection of input-output data taken from a test flights (36250 samples data). These input-output sample flight data are grouped into two flight data sets. The first flight data set, a chirp signal, is used for training the neural network in order to determine parameters (weights) for the network. Validation of the network is performed using the second data set, which is not used for training, and is a representation of UAV circular flight movement. An artificial neural network is trained using the training data set and thereafter the network is excited by the second set input data set. The predicted outputs based on our proposed Neural Network model is similar to the desired outputs (roll, pitch and yaw) which has been produced by real UAV system.

scholarly journals The effect of Z-Score standardization (normalization) on binary input due the speed of learning in back-propagation neural network

2019 ◽  
Vol 1 (3) ◽  
pp. 42-48
Author(s):  
Mohammed Z. Al-Faiz ◽  
Ali A. Ibrahim ◽  
Sarmad M. Hadi
Keyword(s):  
Neural Network ◽  
Input Data ◽  
Back Propagation ◽  
Large Data ◽  
Back Propagation Neural Network ◽  
Data Sets ◽  
Z Score ◽  
Data Set ◽  
The Neural Network ◽  
Time Required

The speed of learning in neural network environment is considered as the most effective parameter spatially in large data sets. This paper tries to minimize the time required for the neural network to fully understand and learn about the data by standardize input data. The paper showed that the Z-Score standardization of input data significantly decreased the number of epoochs required for the network to learn. This paper also proved that the binary dataset is a serious limitation for the convergence of neural network, so the standardization is a must in such case where the 0’s inputs simply neglect the connections in the neural network. The data set used in this paper are features extracted from gel electrophoresis images and that open the door for using artificial intelligence in such areas.

scholarly journals SURFACE DEFECT DETECTION WITH NEURAL NETWORKS

2020 ◽  
Vol 1 (126) ◽  
pp. 96-103
Author(s):  
Nataliya Matveeva ◽  
Alexander Gurtovoy
Keyword(s):  
Neural Networks ◽  
Back Propagation ◽  
Optimal Number ◽  
Signal Recognition ◽  
Destructive Testing ◽  
Network Training ◽  
The Neural Network ◽  
Surface Defect Detection ◽  
Hidden Layer ◽  
Non Destructive

The research results of signal recognition using neural networks are presented. A multilayer perceptron with back-propagation error is implemented on Java. The optimal number of neurons in the hidden layer is selected for building an effective architecture of the neural network. Training network on different sets of signals with noise allowed teaching her to work with distorted information, which is typical for non-destructive testing in real conditions. Experiments were performed to analyze MSE values and accuracy.

scholarly journals Construction of neural network classification of Fisher irises based on JavaScript

2019 ◽  
Author(s):  
A.М. Заяц ◽  
С.П. Хабаров
Keyword(s):  
Neural Network ◽  
Neural Networks ◽  
Back Propagation ◽  
Data Set ◽  
Test Dataset ◽  
Neural Network Classification ◽  
The Neural Network ◽  
Multilayer Neural Networks ◽  
Hidden Layer

Рассматривается процедура выбора структуры и параметров нейронной сети для классификации набора данных, известного как Ирисы Фишера, который включает в себя данные о 150 экземплярах растений трех различных видов. Предложен подход к решению данной задачи без использования дополнительных программных средств и мощных нейросетевых пакетов с использованием только средств стандартного браузера ОС. Это потребовало реализации ряда процедур на JavaScript c их подгрузкой в разработанную интерфейсную HTML-страницу. Исследование большого числа различных структур многослойных нейронных сетей, обучаемых на основе алгоритма обратного распространения ошибки, позволило выбрать для тестового набора данных структуру нейронной сети всего с одним скрытым слоем из трех нейронов. Это существенно упрощает реализацию классификатора Ирисов Фишера, позволяя его оформить в виде загружаемой с сервера HTML-страницы. The procedure for selecting the structure and parameters of the neural network for the classification of a data set known as Iris Fisher, which includes data on 150 plant specimens of three different species, is considered. An approach to solving this problem without using additional software and powerful neural network packages using only the tools of the standard OS browser is proposed. This required the implementation of a number of JavaScript procedures with their loading into the developed HTML interface page. The study of a large number of different structures of multilayer neural networks, trained on the basis of the back-propagation error algorithm, made it possible to choose the structure of a neural network with only one hidden layer of three neurons for a test dataset. This greatly simplifies the implementation of the Fisher Iris classifier, allowing it to be formatted as an HTML page downloaded from the server.

Bayesian Classifier for Sparsity-Promoting Feature Selection

2015 ◽  
Vol 29 (06) ◽  
pp. 1550022 ◽  
Author(s):  
Danlei Xu ◽  
Lan Du ◽  
Hongwei Liu ◽  
Penghui Wang
Keyword(s):  
Feature Selection ◽  
Synthetic Data ◽  
Original Data ◽  
Radar Data ◽  
Bayesian Classifier ◽  
Classification Model ◽  
Data Sets ◽  
Data Set ◽  
Classification Boundary ◽  
Nonlinear Mappings

A Bayesian classifier for sparsity-promoting feature selection is developed in this paper, where a set of nonlinear mappings for the original data is performed as a pre-processing step. The linear classification model with such mappings from the original input space to a nonlinear transformation space can not only construct the nonlinear classification boundary, but also realize the feature selection for the original data. A zero-mean Gaussian prior with Gamma precision and a finite approximation of Beta process prior are used to promote sparsity in the utilization of features and nonlinear mappings in our model, respectively. We derive the Variational Bayesian (VB) inference algorithm for the proposed linear classifier. Experimental results based on the synthetic data set, measured radar data set, high-dimensional gene expression data set, and several benchmark data sets demonstrate the aggressive and robust feature selection capability and comparable classification accuracy of our method comparing with some other existing classifiers.

scholarly journals Key Parts of Transmission Line Detection Using Improved YOLO v3

2021 ◽  
Vol 18 (6) ◽  
Author(s):  
Tu Renwei ◽  
Zhu Zhongjie ◽  
Bai Yongqiang ◽  
Gao Ming ◽  
Ge Zhifeng
Keyword(s):  
Transmission Line ◽  
Detection Accuracy ◽  
Data Sets ◽  
Feature Maps ◽  
Data Set ◽  
Detection Model ◽  
The Neural Network ◽  
Low Efficiency ◽  
The One ◽  
Detection Speed

Unmanned Aerial Vehicle (UAV) inspection has become one of main methods for current transmission line inspection, but there are still some shortcomings such as slow detection speed, low efficiency, and inability for low light environment. To address these issues, this paper proposes a deep learning detection model based on You Only Look Once (YOLO) v3. On the one hand, the neural network structure is simplified, that is the three feature maps of YOLO v3 are pruned into two to meet specific detection requirements. Meanwhile, the K-means++ clustering method is used to calculate the anchor value of the data set to improve the detection accuracy. On the other hand, 1000 sets of power tower and insulator data sets are collected, which are inverted and scaled to expand the data set, and are fully optimized by adding different illumination and viewing angles. The experimental results show that this model using improved YOLO v3 can effectively improve the detection accuracy by 6.0%, flops by 8.4%, and the detection speed by about 6.0%.

scholarly journals NEURAL NETWORK ANALYSIS FOR TUMOR INVESTIGATION AND CANCER PREDICTION

2019 ◽  
Vol 2019 (02) ◽  
pp. 89-98
Author(s):  
Vijayakumar T
Keyword(s):  
Neural Network ◽  
Neural Networks ◽  
Early Stage ◽  
Original Data ◽  
Data Set ◽  
Cancer Prediction ◽  
The Neural Network ◽  
Feed Forward Neural Networks ◽  
The Neural Networks ◽  
Human Nervous System

Predicting the category of tumors and the types of the cancer in its early stage remains as a very essential process to identify depth of the disease and treatment available for it. The neural network that functions similar to the human nervous system is widely utilized in the tumor investigation and the cancer prediction. The paper presents the analysis of the performance of the neural networks such as the, FNN (Feed Forward Neural Networks), RNN (Recurrent Neural Networks) and the CNN (Convolutional Neural Network) investigating the tumors and predicting the cancer. The results obtained by evaluating the neural networks on the breast cancer Wisconsin original data set shows that the CNN provides 43 % better prediction than the FNN and 25% better prediction than the RNN.

Research on the Optimized Algorithms on Neural Network

2012 ◽  
Vol 605-607 ◽  
pp. 2175-2178
Author(s):  
Xiao Qin Wu
Keyword(s):  
Neural Network ◽  
Bp Neural Network ◽  
Simulated Annealing Algorithm ◽  
Fitness Function ◽  
Strong Stability ◽  
Training Algorithm ◽  
Network Training ◽  
The Neural Network ◽  
Annealing Algorithm ◽  
Proper Operation

In order to overcome the disadvantage of neural networks that their structure and parameters were decided stochastically or by one’s experience, an improved BP neural network training algorithm based on genetic algorithm was proposed.In this paper,genetic algorithms and simulated annealing algorithm that optimizes neural network is proposed which is used to scale the fitness function and select the proper operation according to the expected value in the course of optimization,and the weights and thresholds of the neural network is optimized. This method is applied to the stock prediction system.The experimental results show that the proposed approach have high accuracy,strong stability and improved confidence.

The Application of Probabilistic Neural Network in Speech Recognition Based on Partition Clustering

2012 ◽  
Vol 263-266 ◽  
pp. 2173-2178
Author(s):  
Xin Guang Li ◽  
Min Feng Yao ◽  
Li Rui Jian ◽  
Zhen Jiang Li
Keyword(s):  
Neural Network ◽  
Speech Recognition ◽  
Clustering Algorithm ◽  
Probabilistic Neural Network ◽  
Back Propagation ◽  
Back Propagation Neural Network ◽  
Data Sets ◽  
Data Set ◽  
Proposed Model ◽  
Partition Clustering

A probabilistic neural network (PNN) speech recognition model based on the partition clustering algorithm is proposed in this paper. The most important advantage of PNN is that training is easy and instantaneous. Therefore, PNN is capable of dealing with real time speech recognition. Besides, in order to increase the performance of PNN, the selection of data set is one of the most important issues. In this paper, using the partition clustering algorithm to select data is proposed. The proposed model is tested on two data sets from the field of spoken Arabic numbers, with promising results. The performance of the proposed model is compared to single back propagation neural network and integrated back propagation neural network. The final comparison result shows that the proposed model performs better than the other two neural networks, and has an accuracy rate of 92.41%.

Sign in / Sign up

Export Citation Format

Share Document