Efficient kernel functions for the general regression and modified probabilistic neural networks

Author(s):  
A. Zaknich
Author(s):  
WEN-BO ZHAO ◽  
DE-SHUANG HUANG ◽  
JI-YAN DU ◽  
LI-MING WANG

This paper discusses using genetic algorithms (GA) to optimize the structure of radial basis probabilistic neural networks (RBPNN), including how to select hidden centers of the first hidden layer and to determine the controlling parameter of Gaussian kernel functions. In the process of constructing the genetic algorithm, a novel encoding method is proposed for optimizing the RBPNN structure. This encoding method can not only make the selected hidden centers sufficiently reflect the key distribution characteristic in the space of training samples set and reduce the hidden centers number as few as possible, but also simultaneously determine the optimum controlling parameters of Gaussian kernel functions matching the selected hidden centers. Additionally, we also constructively propose a new fitness function so as to make the designed RBPNN as simple as possible in the network structure in the case of not losing the network performance. Finally, we take the two benchmark problems of discriminating two-spiral problem and classifying the iris data, for example, to test and evaluate this designed GA. The experimental results illustrate that our designed GA can significantly reduce the required hidden centers number, compared with the recursive orthogonal least square algorithm (ROLSA) and the modified K-means algorithm (MKA). In particular, by means of statistical experiments it was proved that the optimized RBPNN by our designed GA, have still a better generalization performance with respect to the ones by the ROLSA and the MKA, in spite of the network scale having been greatly reduced. Additionally, our experimental results also demonstrate that our designed GA is also suitable for optimizing the radial basis function neural networks (RBFNN).


Author(s):  
Sumit Saroha ◽  
Sanjeev K. Aggarwal

Objective: The estimation accuracy of wind power is an important subject of concern for reliable grid operations and taking part in open access. So, with an objective to improve the wind power forecasting accuracy. Methods: This article presents Wavelet Transform (WT) based General Regression Neural Network (GRNN) with statistical time series input selection technique. Results: The results of the proposed model are compared with four different models namely naïve benchmark model, feed forward neural networks, recurrent neural networks and GRNN on the basis of Mean Absolute Error (MAE) and Mean Absolute Percentage Error (MAPE) performance metric. Conclusion: The historical data used by the presented models has been collected from the Ontario Electricity Market for the year 2011 to 2015 and tested for a long time period of more than two years (28 months) from November 2012 to February 2015 with one month estimation moving window.


2004 ◽  
Vol 34 (1) ◽  
pp. 37-52
Author(s):  
Wiktor Jassem ◽  
Waldemar Grygiel

The mid-frequencies and bandwidths of formants 1–5 were measured at targets, at plus 0.01 s and at minus 0.01 s off the targets of vowels in a 100-word list read by five male and five female speakers, for a total of 3390 10-variable spectrum specifications. Each of the six Polish vowel phonemes was represented approximately the same number of times. The 3390* 10 original-data matrix was processed by probabilistic neural networks to produce a classification of the spectra with respect to (a) vowel phoneme, (b) identity of the speaker, and (c) speaker gender. For (a) and (b), networks with added input information from another independent variable were also used, as well as matrices of the numerical data appropriately normalized. Mean scores for classification with respect to phonemes in a multi-speaker design in the testing sets were around 95%, and mean speaker-dependent scores for the phonemes varied between 86% and 100%, with two speakers scoring 100% correct. The individual voices were identified between 95% and 96% of the time, and classifications of the spectra for speaker gender were practically 100% correct.


Sign in / Sign up

Export Citation Format

Share Document