scholarly journals A Non-Polynomial, Non-Sigmoidal, Bounded and Symmetric Activation Function for Feed – Forward Artificial Neural Networks

2019 ◽  
Vol 8 (12) ◽  
pp. 405-410
Keyword(s):  
Neural Networks ◽  
Artificial Neural Networks ◽  
Function Approximation ◽  
Activation Function ◽  
Continuous Functions ◽  
Feed Forward ◽  
Learning Tasks ◽  
Non Linear ◽  
Artificial Neural ◽  
Hidden Layer

Feed-forward artificial neural networks are universal approximators of continuous functions. This property enables the use of these networks to solve learning tasks. Learning tasks in this paradigm are cast as function approximation problems. The universal approximation results for these networks require at least one hidden layer with non-linear nodes, and also require that the non-linearities be non-polynomial in nature. In this paper a non-polynomial and non-sigmoidal non-linear function is proposed as a suitable activation function for these networks. The usefulness of the proposed activation function is shown on 12 function approximation task. The obtained results demonstrate that the proposed activation function outperforms the logistic / log-sigmoid and the hyperbolic tangent activation functions.

scholarly journals A Novel Multimean Particle Swarm Optimization Algorithm for Nonlinear Continuous Optimization: Application to Feed-Forward Neural Network Training

2018 ◽  
Vol 2018 ◽  
pp. 1-9 ◽  
Author(s):  
Mehmet Hacibeyoglu ◽  
Mohammed H. Ibrahim
Keyword(s):  
Neural Networks ◽  
Particle Swarm Optimization ◽  
Artificial Neural Networks ◽  
Optimization Algorithm ◽  
Particle Swarm Optimization Algorithm ◽  
Particle Swarm ◽  
Continuous Optimization ◽  
Swarm Optimization ◽  
Feed Forward ◽  
Artificial Neural

Multilayer feed-forward artificial neural networks are one of the most frequently used data mining methods for classification, recognition, and prediction problems. The classification accuracy of a multilayer feed-forward artificial neural networks is proportional to training. A well-trained multilayer feed-forward artificial neural networks can predict the class value of an unseen sample correctly if provided with the optimum weights. Determining the optimum weights is a nonlinear continuous optimization problem that can be solved with metaheuristic algorithms. In this paper, we propose a novel multimean particle swarm optimization algorithm for multilayer feed-forward artificial neural networks training. The proposed multimean particle swarm optimization algorithm searches the solution space more efficiently with multiple swarms and finds better solutions than particle swarm optimization. To evaluate the performance of the proposed multimean particle swarm optimization algorithm, experiments are conducted on ten benchmark datasets from the UCI repository and the obtained results are compared to the results of particle swarm optimization and other previous research in the literature. The analysis of the results demonstrated that the proposed multimean particle swarm optimization algorithm performed well and it can be adopted as a novel algorithm for multilayer feed-forward artificial neural networks training.

Contributions to Predict the Malfunction Probability of the Human-Machine-Environment System, Using Artificial Neural Networks

2015 ◽  
Vol 760 ◽  
pp. 771-776
Author(s):  
Daniel Constantin Anghel ◽  
Nadia Belu
Keyword(s):  
Neural Network ◽  
Neural Networks ◽  
Artificial Neural Networks ◽  
Design Experiment ◽  
Manufacturing Processes ◽  
Feed Forward Neural Network ◽  
Feed Forward ◽  
Linear Relationships ◽  
The Neural Network ◽  
Artificial Neural

This paper presents the application of Artificial Neural Networks to predict the malfunction probability of the human-machine-environment system, in order to provide some guidance to designers of manufacturing processes. Artificial Neural Networks excel in gathering difficult non-linear relationships between the inputs and outputs of a system. We used, in this work, a feed forward neural network in order to predict the malfunction probability. The neural network is simulated with Matlab. The design experiment presented in this paper was realized at University of Pitesti, at the Faculty of Mechanics and Technology, Technology and Management Department.

Sign in / Sign up

Export Citation Format

Share Document