scholarly journals Crude Palm Oil Prediction Based on Backpropagation Neural Network Approach

2019 ◽  
Vol 2 (1) ◽  
pp. 1
Author(s):  
Hijratul Aini ◽  
Haviluddin Haviluddin
Keyword(s):  
Neural Network ◽  
Palm Oil ◽  
Good Accuracy ◽  
Activation Function ◽  
Crude Palm Oil ◽  
Backpropagation Neural Network ◽  
Neural Network Approach ◽  
Learning Function ◽  
Hidden Layer ◽  
Accuracy Of Prediction

Crude palm oil (CPO) production at PT. Perkebunan Nusantara (PTPN) XIII from January 2015 to January 2018 have been treated. This paper aims to predict CPO production using intelligent algorithms called Backpropagation Neural Network (BPNN). The accuracy of prediction algorithms have been measured by mean square error (MSE). The experiment showed that the best hidden layer architecture (HLA) is 5-10-11-12-13-1 with learning function (LF) of trainlm, activation function (AF) of logsig and purelin, and learning rate (LR) of 0.5. This architecture has a good accuracy with MSE of 0.0643. The results showed that this model can predict CPO production in 2019.

Breast cancer diagnosis using multiple activation deep neural network

2021 ◽  
pp. 1063293X2110251
Author(s):  
K Vijayakumar ◽  
Vinod J Kadam ◽  
Sudhir Kumar Sharma
Keyword(s):  
Breast Cancer ◽  
Neural Network ◽  
Deep Neural Network ◽  
Breast Cancer Diagnosis ◽  
Activation Function ◽  
Linear Functions ◽  
Cancer Data ◽  
Final Layer ◽  
Improved Performance ◽  
Hidden Layer

Deep Neural Network (DNN) stands for multilayered Neural Network (NN) that is capable of progressively learn the more abstract and composite representations of the raw features of the input data received, with no need for any feature engineering. They are advanced NNs having repetitious hidden layers between the initial input and the final layer. The working principle of such a standard deep classifier is based on a hierarchy formed by the composition of linear functions and a defined nonlinear Activation Function (AF). It remains uncertain (not clear) how the DNN classifier can function so well. But it is clear from many studies that within DNN, the AF choice has a notable impact on the kinetics of training and the success of tasks. In the past few years, different AFs have been formulated. The choice of AF is still an area of active study. Hence, in this study, a novel deep Feed forward NN model with four AFs has been proposed for breast cancer classification: hidden layer 1: Swish, hidden layer, 2:-LeakyReLU, hidden layer 3: ReLU, and final output layer: naturally Sigmoidal. The purpose of the study is twofold. Firstly, this study is a step toward a more profound understanding of DNN with layer-wise different AFs. Secondly, research is also aimed to explore better DNN-based systems to build predictive models for breast cancer data with improved accuracy. Therefore, the benchmark UCI dataset WDBC was used for the validation of the framework and evaluated using a ten-fold CV method and various performance indicators. Multiple simulations and outcomes of the experimentations have shown that the proposed solution performs in a better way than the Sigmoid, ReLU, and LeakyReLU and Swish activation DNN in terms of different parameters. This analysis contributes to producing an expert and precise clinical dataset classification method for breast cancer. Furthermore, the model also achieved improved performance compared to many established state-of-the-art algorithms/models.

Bio-inspired neural network with application to license plate recognition: hysteretic ELM approach

2016 ◽  
Vol 36 (2) ◽  
pp. 172-178 ◽  
Author(s):  
Liang Chen ◽  
Leitao Cui ◽  
Rong Huang ◽  
Zhengyun Ren
Keyword(s):  
Neural Network ◽  
Activation Function ◽  
Neural System ◽  
Learning System ◽  
License Plate ◽  
Sigmoid Function ◽  
License Plate Recognition ◽  
Content Type ◽  
Hidden Layer ◽  
Automatic License Plate Recognition

Purpose This paper aims to present a bio-inspired neural network for improvement of information processing capability of the existing artificial neural networks. Design/methodology/approach In the network, the authors introduce a property often found in biological neural system – hysteresis – as the neuron activation function and a bionic algorithm – extreme learning machine (ELM) – as the learning scheme. The authors give the gradient descent procedure to optimize parameters of the hysteretic function and develop an algorithm to online select ELM parameters, including number of the hidden-layer nodes and hidden-layer parameters. The algorithm combines the idea of the cross validation and random assignment in original ELM. Finally, the authors demonstrate the advantages of the hysteretic ELM neural network by applying it to automatic license plate recognition. Findings Experiments on automatic license plate recognition show that the bio-inspired learning system has better classification accuracy and generalization capability with consideration to efficiency. Originality/value Comparing with the conventional sigmoid function, hysteresis as the activation function enables has two advantages: the neuron’s output not only depends on its input but also on derivative information, which provides the neuron with memory; the hysteretic function can switch between the two segments, thus avoiding the neuron falling into local minima and having a quicker learning rate. The improved ELM algorithm in some extent makes up for declining performance because of original ELM’s complete randomness with the cost of a litter slower than before.

Evaluation of Parameter Settings for Training Neural Networks Using Backpropagation Algorithms

2022 ◽  
pp. 202-226
Author(s):  
Leema N. ◽  
Khanna H. Nehemiah ◽  
Elgin Christo V. R. ◽  
Kannan A.
Keyword(s):  
Neural Network ◽  
Neural Networks ◽  
Activation Function ◽  
Neural Network Training ◽  
Network Parameter ◽  
Network Parameters ◽  
Network Training ◽  
Rate Minimum ◽  
Hidden Layer ◽  
Function Number

Artificial neural networks (ANN) are widely used for classification, and the training algorithm commonly used is the backpropagation (BP) algorithm. The major bottleneck faced in the backpropagation neural network training is in fixing the appropriate values for network parameters. The network parameters are initial weights, biases, activation function, number of hidden layers and the number of neurons per hidden layer, number of training epochs, learning rate, minimum error, and momentum term for the classification task. The objective of this work is to investigate the performance of 12 different BP algorithms with the impact of variations in network parameter values for the neural network training. The algorithms were evaluated with different training and testing samples taken from the three benchmark clinical datasets, namely, Pima Indian Diabetes (PID), Hepatitis, and Wisconsin Breast Cancer (WBC) dataset obtained from the University of California Irvine (UCI) machine learning repository.

Approximations by multivariate perturbed neural network operators

2017 ◽  
Vol 15 (03) ◽  
pp. 413-432 ◽  
Author(s):  
George A. Anastassiou
Keyword(s):  
Neural Network ◽  
Rate Of Convergence ◽  
Activation Function ◽  
Jackson Type ◽  
Partial Derivatives ◽  
Right Hand ◽  
Hidden Layer ◽  
The Right ◽  
Derivatives Of

This article deals with the determination of the rate of convergence to the unit of each of three newly introduced here multivariate perturbed normalized neural network operators of one hidden layer. These are given through the multivariate modulus of continuity of the involved multivariate function or its high-order partial derivatives and that appears in the right-hand side of the associated multivariate Jackson type inequalities. The multivariate activation function is very general, especially it can derive from any multivariate sigmoid or multivariate bell-shaped function. The right-hand sides of our convergence inequalities do not depend on the activation function. The sample functionals are of multivariate Stancu, Kantorovich and quadrature types. We give applications for the first partial derivatives of the involved function.

A Hybrid Master-Slave Genetic Algorithm-Neural Network Approach for Modeling a Piezoelectric Actuator

2012 ◽  
Author(s):  
Mohamed B. Trabia ◽  
Mohammad Y. Saadeh
Keyword(s):  
Neural Network ◽  
Genetic Algorithm ◽  
Input Voltage ◽  
Hysteresis Model ◽  
Neural Network Approach ◽  
Operational Conditions ◽  
Damping Matrix ◽  
Sinusoidal Input ◽  
Actuator System ◽  
Hidden Layer

This work presents an approach for developing the model of a smart fin dynamics that is activated by a fully-enclosed piezoelectric (PZT) bimorph actuator, which is created by bonding two Macro Fiber Composites (MFCs). Observing the dynamics of the fin indicates that the use of a linear dynamic model does not adequately describe its behavior. An earlier work proposed incorporating a proportional damping matrix as well as Bouc-Wen hysteresis model and backlash operators to create a more accurate model. However, the number of parameters describing the expanded model is large, which limits its use. Therefore, there is a need for a different approach for developing an alternative model of the fin. In this work, a hybrid master-slave Genetic Algorithm (GA)-Neural Network (NN) model is proposed to identify the optimal set of parameters for the damping matrix constants, the Bouc-Wen hysteresis model and the backlash operators. A total of nine sinusoidal input voltage cases that resemble a grid of three different amplitudes excited at three different frequencies are used to train and validate the model. Three input cases are considered for training the NN architecture, connection weights, bias weights and learning rules using GA. The NN consists of three layers: an input layer that has two nodes for the amplitude and the frequency of the input voltage, an output layer that has seven nodes for the backlash, hysteresis, and damping operators, and a hidden layer that is free to have any number of nodes between two and nine. The GA constantly performs natural selection of chromosomes that propagate best compilation of NN parameters. Simulation results show that the proposed model can predict the damping, hysteresis and backlash of the smart fin–actuator system under various operational conditions.

Price forecast of Yunnan Pu’er tea based on the MLP neural network

2020 ◽  
Vol 20 (3) ◽  
pp. 807-815
Author(s):  
Zhiwu Dou ◽  
Mingxin Ji ◽  
Zhihui Yuan ◽  
Haibo Li
Keyword(s):  
Neural Network ◽  
Yunnan Province ◽  
Quantitative Methods ◽  
Decisive Role ◽  
Activation Function ◽  
Mlp Neural Network ◽  
Price Forecast ◽  
Qualitative And Quantitative ◽  
Qualitative And Quantitative Methods ◽  
Hidden Layer

Pu’er tea as the landmark product of Yunnan province, which plays a decisive role in the national tea industry and the economic development of Yunnan province. At present, the qualitative and quantitative methods cannot be accurately predicted the price of Pu’er tea. In order to solve this problem, this paper tries to use MLP neural network to forecast Pu’er tea price. Firstly, determine the influencing factors of Pu’er tea price, then established the MLP neural network model, selection activation function and design the number of neurons and the hidden layer size, finally compare the method between MLP and random forest to verify the feasibility and effectiveness of the MLP method.

Neuronet-Based Approach for Assessing Liquefaction Potential of Soils

1998 ◽  
Vol 1633 (1) ◽  
pp. 3-8 ◽  
Author(s):  
Hossam Eldin Ali ◽  
Yacoub M. Najjar
Keyword(s):  
Neural Network ◽  
Numerical Approach ◽  
Soil Liquefaction ◽  
Data Sets ◽  
Ann Model ◽  
Neural Network Approach ◽  
Liquefaction Potential ◽  
Network Training ◽  
Artificial Neural Network Ann ◽  
Hidden Layer

A backpropagation artificial neural network (ANN) algorithm with one hidden layer was used as a new numerical approach to characterize the soil liquefaction potential. For this purpose, 61 field data sets representing various earthquake sites from around the world were used. To develop the most accurate prediction model for liquefaction potential, alternating combinations of input parameters were used during the training and testing phases of the developed network. The accuracy of the designed network was validated against an additional 44 records not used previously in either the network training or testing stages. The prediction accuracy of the neural network approach–based model is compared with predictions obtained by using fuzzy logic and statistically based approaches. Overall, the ANN model outperformed all other investigated approaches.

NEW METHOD OF NEURON DESIGN BASED ON DISCRETE Z-FUNCTION TO ADAPT THE CHANGE OF INTEGRATED VEHICLE STABILITY CONTROL ORDER

2009 ◽  
Vol 08 (03) ◽  
pp. 253-285 ◽  
Author(s):  
M. HARLY ◽  
I. N. SUTANTRA ◽  
H. P. MAURIDHI
Keyword(s):  
Neural Network ◽  
Neural Networks ◽  
Back Propagation ◽  
Activation Function ◽  
Zero Order ◽  
Vehicle Stability ◽  
Adaptive Control System ◽  
Control Performance ◽  
Fixed Order ◽  
Hidden Layer

Fixed order neural networks (FONN), such as high order neural network (HONN), in which its architecture is developed from zero order of activation function and joint weight, regulates only the number of weight and their value. As a result, this network only produces a fixed order model or control level. These obstacles, which affect preceeding architectures, have been performing finite ability to adapt uncertainty character of real world plant, such as driving dynamics and its desired control performance. This paper introduces a new concept of neural network neuron. In this matter, exploiting discrete z-function builds new neuron activation. Instead of zero order joint weight matrices, the discrete z-function weight matrix will be provided to realize uncertainty or undetermined real word plant and desired adaptive control system that their order has probably been changing. Instead of using bias, an initial condition value is developed. Neural networks using new neurons is called Varied Order Neural Network (VONN). For optimization process, updating order, coefficient and initial value of node activation function uses GA; while updating joint weight, it applies both back propagation (combined LSE-gauss Newton) and NPSO. To estimate the number of hidden layer, constructive back propagation (CBP) was also applied. Thorough simulation was conducted to compare the control performance between FONN and MONN. In order to control, vehicle stability was equipped by electronics stability program (ESP), electronics four wheel steering (4-EWS), and active suspension (AS). 2000, 4000, 6000, 8000 data that are from TODS, a hidden layer, 3 input nodes, 3 output nodes were provided to train and test the network of both the uncertainty model and its adaptive control system. The result of simulation, therefore, shows that stability parameter such as yaw rate error, vehicle side slip error, and rolling angle error produces better performance control in the form of smaller performance index using FDNN than those using MONN.

A Clustering Method for Pruning Fully Connected Neural Network

2011 ◽  
Vol 204-210 ◽  
pp. 600-603
Author(s):  
Gang Li ◽  
Xing San Qian ◽  
Chun Ming Ye ◽  
Lin Zhao
Keyword(s):  
Neural Network ◽  
Data Mining ◽  
Submersible Pump ◽  
Clustering Method ◽  
Backpropagation Neural Network ◽  
Data Set ◽  
Initial Network ◽  
Sample Data ◽  
Hidden Layer ◽  
Fully Connected

This paper focuses mainly on a clustering method for pruning Fully Connected Backpropagation Neural Network (FCBP). The initial neural network is fully connected, after training with sample data, a clustering method is employed to cluster weights between input to hidden layer and from hidden to output layer, and connections that are relatively unnecessary are deleted, thus the initial network becomes a PCBP (Partially Connected Backpropagation) Neural Network. PCBP can be used in prediction or data mining more efficiently than FCBP. At the end of this paper, An experiment is conducted to illustrate the effects of PCBP using the submersible pump repair data set.

Sign in / Sign up

Export Citation Format

Share Document