Comparison of Multi-Layer Perceptron and Cascade Feed-Forward Neural Network for Head-Related Transfer Function Interpolation

Author(s):  
Mantas Tamulionis ◽  
Arturas Serackis
Author(s):  
Belete Biazen Bezabeh ◽  
Abrham Debasu Mengistu

In the area of machine learning performance analysis is the major task in order to get a better performance both in training and testing model. In addition, performance analysis of machine learning techniques helps to identify how the machine is performing on the given input and also to find any improvements needed to make on the learning model. Feed-forward neural network (FFNN) has different area of applications, but the epoch convergences of the network differs from the usage of transfer function. In this study, to build the model for classification and moisture prediction of soil, rectified linear units (ReLU), Sigmoid, hyperbolic tangent (Tanh) and Gaussian transfer function of feed-forward neural network had been analyzed to identify an appropriate transfer function. Color, texture, shape and brisk local feature descriptor are used as a feature vector of FFNN in the input layer and 4 hidden layers were considered in this study. In each hidden layer 26 neurons are used. From the experiment, Gaussian transfer function outperforms than ReLU, sigmoid and tanh transfer function. But the convergence rate of Gaussian transfer function took more epoch than ReLU, Sigmoid and tanh.


2002 ◽  
Vol 6 (4) ◽  
pp. 671-684 ◽  
Author(s):  
A. Y. Shamseldin ◽  
A. E. Nasr ◽  
K. M. O’Connor

Abstract. The Multi-Layer Feed-Forward Neural Network (MLFFNN) is applied in the context of river flow forecast combination, where a number of rainfall-runoff models are used simultaneously to produce an overall combined river flow forecast. The operation of the MLFFNN depends not only on its neuron configuration but also on the choice of neuron transfer function adopted, which is non-linear for the hidden and output layers. These models, each having a different structure to simulate the perceived mechanisms of the runoff process, utilise the information carrying capacity of the model calibration data in different ways. Hence, in a discharge forecast combination procedure, the discharge forecasts of each model provide a source of information different from that of the other models used in the combination. In the present work, the significance of the choice of the transfer function type in the overall performance of the MLFFNN, when used in the river flow forecast combination context, is investigated critically. Five neuron transfer functions are used in this investigation, namely, the logistic function, the bipolar function, the hyperbolic tangent function, the arctan function and the scaled arctan function. The results indicate that the logistic function yields the best model forecast combination performance. Keywords: River flow forecast combination, multi-layer feed-forward neural network, neuron transfer functions, rainfall-runoff models


2021 ◽  
Vol 118 ◽  
pp. 103766
Author(s):  
Ahmed J. Aljaaf ◽  
Thakir M. Mohsin ◽  
Dhiya Al-Jumeily ◽  
Mohamed Alloghani

Sign in / Sign up

Export Citation Format

Share Document