scholarly journals Agent-based Modeling for Activation Function in Enhancement Logic Programming in Hopfield Neural Network

2020 ◽  
Vol 9 (4) ◽  
pp. 1872-1879
Keyword(s):  
Neural Network ◽  
Artificial Neural Network ◽  
Logic Programming ◽  
Hamming Distance ◽  
Hopfield Neural Network ◽  
Activation Function ◽  
Agent Based Modeling ◽  
Activation Functions ◽  
Agent Based ◽  
Artificial Neural

Artificial Neural Network (ANN) uses many activation functions to update the state on neuron. The research and engineering have been used activation functions in the artificial neural network as the transfer functions. The most common reasons for using this transfer function were its unit interval boundaries, the functions and quick computability of its derivative, and several useful mathematical properties in the approximation of theory realm. Aim of this study is to figure out the best robust activation functions to accelerate HornSAT logic in the Hopfield Neural Network's context. In this paper we had developed Agent-based Modelling (ABM) assessed the performance of the Zeng Martinez Activation Function (ZMAF) and the Hyperbolic Tangent Activation Function (HTAF) beside the Wan Abdullah method to do Logic Programming (LP) in Hopfield Neural Network (HNN). These assessments are carried out on the basis of hamming distance (HD), the global minima ratio (zM), and CPU time. NETLOGO 5.3.1 software has been used for developing Agent-based Modeling (ABM) to test the proposed comparison of the efficaecy of these two activation functions HTAF and ZMAF.

scholarly journals Agent-based Modeling in doing Logic Programming in Fuzzy Hopfield Neural Network

2021 ◽  
Vol 13 (2) ◽  
pp. 23-32
Author(s):  
Shehab Abdulhabib Saeed Alzaeemi ◽  
◽  
Saratha Sathasivam ◽  
Muraly Velavan
Keyword(s):  
Neural Network ◽  
Logic Programming ◽  
Hopfield Neural Network ◽  
Agent Based Modeling ◽  
Agent Based

scholarly journals Prediction of Stress in Power Transformer Winding Conductors Using Artificial Neural Networks: Hyperparameter Analysis

Energies ◽  
2021 ◽  
Vol 14 (14) ◽  
pp. 4242
Author(s):  
Fausto Valencia ◽  
Hugo Arcos ◽  
Franklin Quilumba
Keyword(s):  
Neural Network ◽  
Artificial Neural Network ◽  
Finite Element ◽  
Power Transformer ◽  
Network Models ◽  
Activation Function ◽  
Neural Network Models ◽  
Transformer Winding ◽  
Artificial Neural ◽  
Femm Software

The purpose of this research is the evaluation of artificial neural network models in the prediction of stresses in a 400 MVA power transformer winding conductor caused by the circulation of fault currents. The models were compared considering the training, validation, and test data errors’ behavior. Different combinations of hyperparameters were analyzed based on the variation of architectures, optimizers, and activation functions. The data for the process was created from finite element simulations performed in the FEMM software. The design of the Artificial Neural Network was performed using the Keras framework. As a result, a model with one hidden layer was the best suited architecture for the problem at hand, with the optimizer Adam and the activation function ReLU. The final Artificial Neural Network model predictions were compared with the Finite Element Method results, showing good agreement but with a much shorter solution time.

Power Forecasting from Solar Panels Using Artificial Neural Network in UTHM Parit Raja

2021 ◽  
Vol 02 (01) ◽  
Author(s):  
Natasha Munirah Mohd Fahmi ◽  
◽  
Nor Aira Zambri ◽  
Norhafiz Salim ◽  
Sim Sy Yi ◽  
...  
Keyword(s):  
Neural Network ◽  
Artificial Neural Network ◽  
Climatic Factors ◽  
Activation Function ◽  
Solar Panels ◽  
Ann Model ◽  
Power Characteristics ◽  
Step Procedure ◽  
Artificial Neural ◽  
Artificial Neural Network Ann

This paper presents a step-by-step procedure for the simulation of photovoltaic modules with numerical values, using MALTAB/Simulink software. The proposed model is developed based on the mathematical model of PV module, which based on PV solar cell employing one-diode equivalent circuit. The output current and power characteristics curves highly depend on some climatic factors such as radiation and temperature, are obtained by simulation of the selected module. The collected data are used in developing Artificial Neural Network (ANN) model. Multilayer Perceptron (MLP) and Radial Basis Function (RBF) are the techniques used to forecast the outputs of the PV. Various types of activation function will be applied such as Linear, Logistic Sigmoid, Hyperbolic Tangent Sigmoid and Gaussian. The simulation results show that the Logistic Sigmoid is the best technique which produce minimal root mean square error for the system.

scholarly journals One-time learning in a biologically-inspired Salience-affected Artificial Neural Network (SANN)

2019 ◽  
Author(s):  
Leendert A Remmelzwaal ◽  
George F R Ellis ◽  
Jonathan Tapson
Keyword(s):  
Neural Network ◽  
Artificial Neural Network ◽  
Neural Dynamics ◽  
Proof Of Concept ◽  
Activation Functions ◽  
Learning Networks ◽  
Biologically Inspired ◽  
Artificial Neural ◽  
Validation Testing ◽  
And Robotics

AbstractIn this paper we introduce a novel Salience Affected Artificial Neural Network (SANN) that models the way neuromodulators such as dopamine and noradrenaline affect neural dynamics in the human brain by being distributed diffusely through neocortical regions. This allows one-time learning to take place through strengthening entire patterns of activation at one go. We present a model that accepts a salience signal, and returns a reverse salience signal. We demonstrate that we can tag an image with salience with only a single training iteration, and that the same image will then produces the highest reverse salience signal during classification. We explore the effects of salience on learning via its effect on the activation functions of each node, as well as on the strength of weights in the network. We demonstrate that a salience signal improves classification accuracy of the specific image that was tagged with salience, as well as all images in the same class, while penalizing images in other classes. Results are validated using 5-fold validation testing on MNIST and Fashion MNIST datasets. This research serves as a proof of concept, and could be the first step towards introducing salience tagging into Deep Learning Networks and robotics.

scholarly journals Improvement of methods of hydrological forecasting using geoinformation technologies

2021 ◽  
Vol 2131 (3) ◽  
pp. 032069
Author(s):  
A Zueva ◽  
V Shamova ◽  
T Pilipenko
Keyword(s):  
Neural Network ◽  
Artificial Neural Network ◽  
Activation Function ◽  
Water Levels ◽  
Electronic Map ◽  
Hydrological Forecasting ◽  
Ob River ◽  
Network Methods ◽  
One Step ◽  
Artificial Neural

Abstract This article discusses the possibility of improving hydrological forecasting methods based on a neural network. The hydrological series, its importance and forecasting features are considered. For hydrological forecasting using the MapInfoProfessional geoinformation system, an electronic map has been developed containing information about the rivers of Russia, as well as gauging stations on the Ob River. The electronic map is the basis for creating a module for short-term hydrological forecasting based on an artificial neural network. The features of a neural network, methods of its training and implementation are considered. The developed artificial neural network is a layer of neurons with a linear activation function and a delay line at the input. To predict the levels of hydrological series, real water levels at gauging stations of the Ob River in the Novosibirsk region will be used. The developed module and its capabilities have been tested. The study was carried out on the basis of models of hydrological series, as well as on the basis of levels of real hydrological series. Based on the study, dependence of the root-mean-square error on the number of previous values of series was revealed. The study also shows that it is possible to use a neural network for the current one-step forecasting of levels of hydrological series in conditions of insufficient information about the runoff region and its characteristics.

scholarly journals Initial Optimal Parameters of Artificial Neural Network and Support Vector Regression

2018 ◽  
Vol 8 (5) ◽  
pp. 3341 ◽  
Author(s):  
Edy Fradinata ◽  
Sakesun Suthummanon ◽  
Wannarat Suntiamorntut
Keyword(s):  
Neural Network ◽  
Artificial Neural Network ◽  
Support Vector Regression ◽  
Kernel Function ◽  
Activation Function ◽  
Support Vector ◽  
Optimal Parameters ◽  
Artificial Neural ◽  
Hidden Layer ◽  
Linear Loss

This paper presents architecture of backpropagation Artificial Neural Network (ANN) and Support Vector Regression (SVR) models in supervised learning process for cement demand dataset. This study aims to identify the effectiveness of each parameter of mean square error (MSE) indicators for time series dataset. The study varies different random sample in each demand parameter in the network of ANN and support vector function as well. The variations of percent datasets from activation function, learning rate of sigmoid and purelin, hidden layer, neurons, and training function should be applied for ANN. Furthermore, SVR is varied in kernel function, lost function and insensitivity to obtain the best result from its simulation. The best results of this study for ANN activation function is Sigmoid. The amount of data input is 100% or 96 of data, 150 learning rates, one hidden layer, trinlm training function, 15 neurons and 3 total layers. The best results for SVR are six variables that run in optimal condition, kernel function is linear, loss function is ౬-insensitive, and insensitivity was 1. The better results for both methods are six variables. The contribution of this study is to obtain the optimal parameters for specific variables of ANN and SVR.

scholarly journals Thermal field prediction in DED manufacturing process using Artificial Neural Network

2021 ◽  
Author(s):  
Seifallah Fetni ◽  
Quy Duc Thinh Pham ◽  
Van Xuan Tran ◽  
Laurent Duchêne ◽  
Hoang Son Tran ◽  
...  
Keyword(s):  
Neural Network ◽  
Machine Learning ◽  
Artificial Neural Network ◽  
Finite Element ◽  
Manufacturing Process ◽  
Thermal Field ◽  
Activation Function ◽  
Tungsten Carbides ◽  
Artificial Neural ◽  
The Impact

In the last decade, machine learning is increasingly attracting researchers in several scientific areas and, in particular, in the additive manufacturing field. Meanwhile, this technique remains as a black box technique for many researchers. Indeed, it allows obtaining novel insights to overcome the limitation of classical methods, such as the finite element method, and to take into account multi-physical complex phenomena occurring during the manufacturing process. This work presents a comprehensive study for implementing a machine learning technique (artificial neural network) to predict the thermal field evolution during the direct energy deposition of 316L stainless steel and tungsten carbides. The framework consists of a finite element thermal model and a neural network. The influence of the number of hidden layers and the number of nodes in each layer was also investigated. The results showed that an architecture based on 3 or 4 hidden layers and the rectified linear unit as the activation function lead to obtaining a high fidelity prediction with an accuracy exceeding 99%. The impact of the chosen architecture on the model accuracy and CPU usage was also highlighted. The proposed framework can be used to predict the thermal field when simulating multi-layer deposition.

scholarly journals An Artificial Neural Network Model to Predict the Thermal Properties of Concrete Using Different Neurons and Activation Functions

2019 ◽  
Vol 2019 ◽  
pp. 1-13 ◽  
Author(s):  
Sehmus Fidan ◽  
Hasan Oktay ◽  
Suleyman Polat ◽  
Sarper Ozturk
Keyword(s):  
Neural Network ◽  
Artificial Neural Network ◽  
Thermal Properties ◽  
Thermal Property ◽  
Building Materials ◽  
Performance Indicator ◽  
Mechanical And Thermal Properties ◽  
Activation Functions ◽  
Marquardt Algorithm ◽  
Artificial Neural

Growing concerns on energy consumption of buildings by heating and cooling applications have led to a demand for improved insulating performances of building materials. The establishment of thermal property for a building structure is the key performance indicator for energy efficiency, whereas high accuracy and precision tests are required for its determination which increases time and experimental costs. The main scope of this study is to develop a model based on artificial neural network (ANN) in order to predict the thermal properties of concrete through its mechanical characteristics. Initially, different concrete samples were prepared, and their both mechanical and thermal properties were tested in accordance with ASTM and EN standards. Then, the Levenberg–Marquardt algorithm was used for training the neural network in the single hidden layer using 5, 10, 15, 20, and 25 neurons, respectively. For each thermal property, various activation functions such as tangent sigmoid functions and triangular basis functions were used to examine the best solution performance. Moreover, a cross-validation technique was used to ensure good generalization and to avoid overtraining. ANN results showed that the best overall R2 performances for the prediction of thermal conductivity, specific heat, and thermal diffusivity were obtained as 0.996, 0.983, and 0.995 for tansig activation functions with 25, 25, and 20 neurons, respectively. The performance results showed that there was a great consistency between the predicted and tested results, demonstrating the feasibility and practicability of the proposed ANN models for predicting the thermal property of a concrete.

Use of Binary Sigmoid Function And Linear Identity In Artificial Neural Networks For Forecasting Population Density

2017 ◽  
Vol 1 (1) ◽  
pp. 43 ◽  
Author(s):  
Anjar Wanto ◽  
Agus Perdana Windarto ◽  
Dedy Hartama ◽  
Iin Parlina
Keyword(s):  
Neural Network ◽  
Neural Networks ◽  
Artificial Neural Network ◽  
Population Density ◽  
Network Architecture ◽  
Activation Function ◽  
Sigmoid Function ◽  
Backpropagation Algorithm ◽  
Architecture Model ◽  
Artificial Neural

Artificial Neural Network (ANN) is often used to solve forecasting cases. As in this study. The artificial neural network used is with backpropagation algorithm. The study focused on cases concerning overcrowding forecasting based District in Simalungun in Indonesia in 2010-2015. The data source comes from the Central Bureau of Statistics of Simalungun Regency. The population density forecasting its future will be processed using backpropagation algorithm focused on binary sigmoid function (logsig) and a linear function of identity (purelin) with 5 network architecture model used the 3-5-1, 3-10-1, 3-5 -10-1, 3-5-15-1 and 3-10-15-1. Results from 5 to architectural models using Neural Networks Backpropagation with binary sigmoid function and identity functions vary greatly, but the best is 3-5-1 models with an accuracy of 94%, MSE, and the epoch 0.0025448 6843 iterations. Thus, the use of binary sigmoid activation function (logsig) and the identity function (purelin) on Backpropagation Neural Networks for forecasting the population density is very good, as evidenced by the high accuracy results achieved.

SIMPLEX: An Activation Function with Improved Loss Function Results in Validation

2020 ◽  
Vol 17 (1) ◽  
pp. 147-153
Author(s):  
Sarfaraz Masoood ◽  
Nida Safdar Jan
Keyword(s):  
Neural Network ◽  
Activation Function ◽  
Mathematical Function ◽  
Training Phase ◽  
Complex Relationship ◽  
Activation Functions ◽  
Testing Phase ◽  
Experimental Problem ◽  
Overall Performance ◽  
Artificial Neural

An activation function is a mathematical function used for squashing purposes in artificial neural networks, whose domain and the range are two important most features to judge its potency. Overfitting of a neural network, is an issue that has gained considerable importance. This is a consequence of a function developing some complex relationship during the training phase and then these do not show up during the testing phase due to which these relationships aren’t actually relations, but are merely a consequence of sampling noise that arises during the training phase and is absent during testing phase. This creates a significant gap in accuracy which if minimized could result in better results in terms of overall performance of an ANN (Artificial Neural Network). The activation function proposed in this work is called SIMPLEX. Over a set of experiments, it was observed, to have the least overfitting issue among the rest of the analyzed activation functions over the MNIST dataset, selected as the experimental problem.

Sign in / Sign up

Export Citation Format

Share Document