HIERARCHICAL GENETIC ALGORITHM FOR NEAR-OPTIMAL FEEDFORWARD NEURAL NETWORK DESIGN

2002 ◽  
Vol 12 (01) ◽  
pp. 31-43 ◽  
Author(s):  
GARY YEN ◽  
HAIMING LU
Keyword(s):  
Neural Network ◽  
Genetic Algorithm ◽  
Neural Networks ◽  
Cost Function ◽  
Design Procedure ◽  
Optimal Solution ◽  
Traditional Learning ◽  
Feed Forward Neural Network ◽  
Optimal Solution Set ◽  
Hierarchical Genetic Algorithm

In this paper, we propose a genetic algorithm based design procedure for a multi-layer feed-forward neural network. A hierarchical genetic algorithm is used to evolve both the neural network's topology and weighting parameters. Compared with traditional genetic algorithm based designs for neural networks, the hierarchical approach addresses several deficiencies, including a feasibility check highlighted in literature. A multi-objective cost function is used herein to optimize the performance and topology of the evolved neural network simultaneously. In the prediction of Mackey–Glass chaotic time series, the networks designed by the proposed approach prove to be competitive, or even superior, to traditional learning algorithms for the multi-layer Perceptron networks and radial-basis function networks. Based upon the chosen cost function, a linear weight combination decision-making approach has been applied to derive an approximated Pareto-optimal solution set. Therefore, designing a set of neural networks can be considered as solving a two-objective optimization problem.

Hierarchical Rank Density Genetic Algorithm for Radial-Basis Function Neural Network Design

2003 ◽  
Vol 03 (03) ◽  
pp. 213-232 ◽  
Author(s):  
Gary G. Yen ◽  
Haiming Lu
Keyword(s):  
Neural Network ◽  
Genetic Algorithm ◽  
Neural Networks ◽  
Radial Basis Function ◽  
Basis Function ◽  
Design Procedure ◽  
Optimal Solution ◽  
Final Decision ◽  
Training Performance ◽  
Radial Basis

In this paper, we propose a genetic algorithm based design procedure for a radial-basis function neural network. A Hierarchical Rank Density Genetic Algorithm (HRDGA) is used to evolve the neural network's topology and parameters simultaneously. Compared with traditional genetic algorithm based designs for neural networks, the hierarchical approach addresses several deficiencies highlighted in literature. In addition, the rank-density based fitness assignment technique is used to optimize the performance and topology of the evolved neural network to deal with the confliction between the training performance and network complexity. Instead of producing a single optimal solution, HRDGA provides a set of near-optimal neural networks to the designers so that they can have more flexibility for the final decision-making based on certain preferences. In terms of searching for a near-complete set of candidate networks with high performances, the networks designed by the proposed algorithm prove to be competitive, or even superior, to three other traditional radial-basis function networks for predicting Mackey–Glass chaotic time series.

scholarly journals ELMAN-RECURRENT NEURAL NETWORK FOR LOAD SHEDDING OPTIMIZATION

SINERGI ◽  
2020 ◽  
Vol 24 (1) ◽  
pp. 29
Author(s):  
Widi Aribowo
Keyword(s):  
Neural Network ◽  
Genetic Algorithm ◽  
Neural Networks ◽  
Power System ◽  
Recurrent Neural Networks ◽  
Load Shedding ◽  
Feed Forward Neural Network ◽  
Linear Problems ◽  
Elman Recurrent Neural Network ◽  
And Control

Load shedding plays a key part in the avoidance of the power system outage. The frequency and voltage fluidity leads to the spread of a power system into sub-systems and leads to the outage as well as the severe breakdown of the system utility.  In recent years, Neural networks have been very victorious in several signal processing and control applications.  Recurrent Neural networks are capable of handling complex and non-linear problems. This paper provides an algorithm for load shedding using ELMAN Recurrent Neural Networks (RNN). Elman has proposed a partially RNN, where the feedforward connections are modifiable and the recurrent connections are fixed. The research is implemented in MATLAB and the performance is tested with a 6 bus system. The results are compared with the Genetic Algorithm (GA), Combining Genetic Algorithm with Feed Forward Neural Network (hybrid) and RNN. The proposed method is capable of assigning load releases needed and more efficient than other methods. 

scholarly journals Nonlinear Time-Series Analysis of Pulsation of Post-AGB Stars by Genetic Algorithm/Neural Network Hybrid Systems

2000 ◽  
Vol 176 ◽  
pp. 135-136
Author(s):  
Toshiki Aikawa
Keyword(s):  
Neural Network ◽  
Genetic Algorithm ◽  
Neural Networks ◽  
Time Series ◽  
Artificial Neural Networks ◽  
Hybrid System ◽  
Nonlinear Time Series ◽  
Photometric Data ◽  
Nonlinear Time Series Analysis ◽  
Agb Stars

AbstractSome pulsating post-AGB stars have been observed with an Automatic Photometry Telescope (APT) and a considerable amount of precise photometric data has been accumulated for these stars. The datasets, however, are still sparse, and this is a problem for applying nonlinear time series: for instance, modeling of attractors by the artificial neural networks (NN) to the datasets. We propose the optimization of data interpolations with the genetic algorithm (GA) and the hybrid system combined with NN. We apply this system to the Mackey–Glass equation, and attempt an analysis of the photometric data of post-AGB variables.

scholarly journals Part-of-Speech Tagging via Deep Neural Networks for Northern-Ethiopic Languages

2020 ◽  
Vol 49 (4) ◽  
pp. 482-494
Author(s):  
Jurgita Kapočiūtė-Dzikienė ◽  
Senait Gebremichael Tesfagergish
Keyword(s):  
Neural Network ◽  
Neural Networks ◽  
Language Processing ◽  
Deep Neural Networks ◽  
Short Term Memory ◽  
Parameter Tuning ◽  
Feed Forward Neural Network ◽  
Pos Tagging ◽  
Part Of Speech ◽  
Pos Tagger

Deep Neural Networks (DNNs) have proven to be especially successful in the area of Natural Language Processing (NLP) and Part-Of-Speech (POS) tagging—which is the process of mapping words to their corresponding POS labels depending on the context. Despite recent development of language technologies, low-resourced languages (such as an East African Tigrinya language), have received too little attention. We investigate the effectiveness of Deep Learning (DL) solutions for the low-resourced Tigrinya language of the Northern-Ethiopic branch. We have selected Tigrinya as the testbed example and have tested state-of-the-art DL approaches seeking to build the most accurate POS tagger. We have evaluated DNN classifiers (Feed Forward Neural Network – FFNN, Long Short-Term Memory method – LSTM, Bidirectional LSTM, and Convolutional Neural Network – CNN) on a top of neural word2vec word embeddings with a small training corpus known as Nagaoka Tigrinya Corpus. To determine the best DNN classifier type, its architecture and hyper-parameter set both manual and automatic hyper-parameter tuning has been performed. BiLSTM method was proved to be the most suitable for our solving task: it achieved the highest accuracy equal to 92% that is 65% above the random baseline.

Contributions to Predict the Malfunction Probability of the Human-Machine-Environment System, Using Artificial Neural Networks

2015 ◽  
Vol 760 ◽  
pp. 771-776
Author(s):  
Daniel Constantin Anghel ◽  
Nadia Belu
Keyword(s):  
Neural Network ◽  
Neural Networks ◽  
Artificial Neural Networks ◽  
Design Experiment ◽  
Manufacturing Processes ◽  
Feed Forward Neural Network ◽  
Feed Forward ◽  
Linear Relationships ◽  
The Neural Network ◽  
Artificial Neural

This paper presents the application of Artificial Neural Networks to predict the malfunction probability of the human-machine-environment system, in order to provide some guidance to designers of manufacturing processes. Artificial Neural Networks excel in gathering difficult non-linear relationships between the inputs and outputs of a system. We used, in this work, a feed forward neural network in order to predict the malfunction probability. The neural network is simulated with Matlab. The design experiment presented in this paper was realized at University of Pitesti, at the Faculty of Mechanics and Technology, Technology and Management Department.

A Genetic Algorithm to Improve a Neural Network to Predict a Patient’s Response to Warfarin

1993 ◽  
Vol 32 (01) ◽  
pp. 55-58 ◽  
Author(s):  
M. N. Narayanan ◽  
S. B. Lucas
Keyword(s):  
Neural Network ◽  
Genetic Algorithm ◽  
Neural Networks ◽  
Predictive Ability ◽  
Predictor Variables ◽  
Optimal Subset ◽  
The Neural Network ◽  
International Normalised Ratio ◽  
The Mean ◽  
Paired T Test

Abstract:The ability of neural networks to predict the international normalised ratio (INR) for patients treated with Warfarin was investigated. Neural networks were obtained by using all the predictor variables in the neural network, or by using a genetic algorithm to select an optimal subset of predictor variables in a neural network. The use of a genetic algorithm gave a marked and significant improvement in the prediction of the INR in two of the three cases investigated. The mean error in these cases, typically, reduced from 1.02 ± 0.29 to 0.28 ± 0.25 (paired t-test, t = −4.71, p <0.001, n = 30). The use of a genetic algorithm with Warfarin data offers a significant enhancement of the predictive ability of a neural network with Warfarin data, identifies significant predictor variables, reduces the size of the neural network and thus the speed at which the reduced network can be trained, and reduces the sensitivity of a network to over-training.

Missing Data Approaches to Classification

2010 ◽  
pp. 187-209
Author(s):  
Tshilidzi Marwala
Keyword(s):  
Neural Network ◽  
Neural Networks ◽  
Missing Data ◽  
Network Model ◽  
Network Models ◽  
Feed Forward Neural Network ◽  
Neural Network Models ◽  
Feed Forward ◽  
Missing Data Problem ◽  
Feed Forward Neural Networks

In this chapter, a classifier technique that is based on a missing data estimation framework that uses autoassociative multi-layer perceptron neural networks and genetic algorithms is proposed. The proposed method is tested on a set of demographic properties of individuals obtained from the South African antenatal survey and compared to conventional feed-forward neural networks. The missing data approach based on the autoassociative network model proposed gives an accuracy of 92%, when compared to the accuracy of 84% obtained from the conventional feed-forward neural network models. The area under the receiver operating characteristics curve for the proposed autoassociative network model is 0.86 compared to 0.80 for the conventional feed-forward neural network model. The autoassociative network model proposed in this chapter, therefore, outperforms the conventional feed-forward neural network models and is an improved classifier. The reasons for this are: (1) the propagation of errors in the autoassociative network model is more distributed while for a conventional feed-forward network is more concentrated; and (2) there is no causality between the demographic properties and the HIV and, therefore, the HIV status does change the demographic properties and vice versa. Therefore, it is better to treat the problem as a missing data problem rather than a feed-forward problem.

scholarly journals The Use of Neural Networks and Genetic Algorithms for Design of Groundwater Remediation Schemes

1997 ◽  
Vol 1 (2) ◽  
pp. 345-356 ◽  
Author(s):  
Z. Rao ◽  
D. G. Jamieson
Keyword(s):  
Neural Network ◽  
Genetic Algorithm ◽  
Neural Networks ◽  
Artificial Neural Network ◽  
Genetic Algorithms ◽  
Hybrid Algorithm ◽  
Large Scale ◽  
Groundwater Remediation ◽  
Injection Wells ◽  
Representative Problem

Abstract. The increasing incidence of groundwater pollution has led to recognition of a need to develop objective techniques for designing reniediation schemes. This paper outlines one such possibility for determining how many abstraction/injection wells are required, where they should be located etc., having regard to minimising the overall cost. To that end, an artificial neural network is used in association with a 2-D or 3-D groundwater simulation model to determine the performance of different combinations of abstraction/injection wells. Thereafter, a genetic algorithm is used to identify which of these combinations offers the least-cost solution to achieve the prescribed residual levels of pollutant within whatever timescale is specified. The resultant hybrid algorithm has been shown to be effective for a simplified but nevertheless representative problem; based on the results presented, it is expected the methodology developed will be equally applicable to large-scale, real-world situations.

Sign in / Sign up

Export Citation Format

Share Document