Development of the Enhanced Piece-Wise Linear Neural Network Algorithm

2022 ◽  
pp. 283-305
Author(s):  
Veronica K. Chan ◽  
Christine W. Chan

This chapter discusses development, application, and enhancement of a decomposition neural network rule extraction algorithm for nonlinear regression problems. The dual objectives of developing the algorithms are (1) to generate good predictive models comparable in performance to the original artificial neural network (ANN) models and (2) to “open up” the black box of a neural network model and provide explicit information in the form of rules that are expressed as linear equations. The enhanced PWL-ANN algorithm improves upon the PWL-ANN algorithm because it can locate more than two breakpoints and better approximate the hidden sigmoid activation functions of the ANN. Comparison of the results produced by the two versions of the PWL-ANN algorithm showed that the enhanced PWL-ANN models provide higher predictive accuracies and improved fidelities compared to the originally trained ANN models than the PWL-ANN models.

Author(s):  
Veronica K. Chan ◽  
Christine W. Chan

This chapter discusses development, application, and enhancement of a decomposition neural network rule extraction algorithm for nonlinear regression problems. The dual objectives of developing the algorithms are (1) to generate good predictive models comparable in performance to the original artificial neural network (ANN) models and (2) to “open up” the black box of a neural network model and provide explicit information in the form of rules that are expressed as linear equations. The enhanced PWL-ANN algorithm improves upon the PWL-ANN algorithm because it can locate more than two breakpoints and better approximate the hidden sigmoid activation functions of the ANN. Comparison of the results produced by the two versions of the PWL-ANN algorithm showed that the enhanced PWL-ANN models provide higher predictive accuracies and improved fidelities compared to the originally trained ANN models than the PWL-ANN models.


2020 ◽  
pp. 1632-1649
Author(s):  
Veronica Chan ◽  
Christine W. Chan

This paper discusses development and application of a decomposition neural network rule extraction algorithm for nonlinear regression problems. The algorithm is called the piece-wise linear artificial neural network or PWL-ANN algorithm. The objective of the algorithm is to “open up” the black box of a neural network model so that rules in the form of linear equations are generated by approximating the sigmoid activation functions of the hidden neurons in an artificial neural network (ANN). The preliminary results showed that the algorithm gives high fidelity and satisfactory results on sixteen of the nineteen tested datasets. By analyzing the values of R2 given by the PWL approximation on the hidden neurons and the overall output, it is evident that in addition to accurate approximation of each individual node of a given ANN model, there are more factors affecting the fidelity of the PWL-ANN algorithm Nevertheless, the algorithm shows promising potential for domains when better understanding about the problem is needed.


Author(s):  
Veronica Chan ◽  
Christine Chan

This paper discusses development and application of a decomposition neural network rule extraction algorithm for nonlinear regression problems. The algorithm is called the piece-wise linear artificial neural network or PWL-ANN algorithm. The objective of the algorithm is to “open up” the black box of a neural network model so that rules in the form of linear equations are generated by approximating the sigmoid activation functions of the hidden neurons in an artificial neural network (ANN). The preliminary results showed that the algorithm gives high fidelity and satisfactory results on sixteen of the nineteen tested datasets. By analyzing the values of R2 given by the PWL approximation on the hidden neurons and the overall output, it is evident that in addition to accurate approximation of each individual node of a given ANN model, there are more factors affecting the fidelity of the PWL-ANN algorithm Nevertheless, the algorithm shows promising potential for domains when better understanding about the problem is needed.


2021 ◽  
Author(s):  
DEVIN NIELSEN ◽  
TYLER LOTT ◽  
SOM DUTTA ◽  
JUHYEONG LEE

In this study, three artificial neural network (ANN) models are developed with back propagation (BP) optimization algorithms to predict various lightning damage modes in carbon/epoxy laminates. The proposed ANN models use three input variables associated with lightning waveform parameters (i.e., the peak current amplitude, rising time, and decaying time) to predict fiber damage, matrix damage, and through-thickness damage in the composites. The data used for training and testing the networks was actual lightning damage data collected from peer-reviewed published literature. Various BP training algorithms and network architecture configurations (i.e., data splitting, the number of neurons in a hidden layer, and the number of hidden layers) have been tested to improve the performance of the neural networks. Among the various BP algorithms considered, the Bayesian regularization back propagation (BRBP) showed the overall best performance in lightning damage prediction. When using the BRBP algorithm, as expected, the greater the fraction of the collected data that is allocated to the training dataset, the better the network is trained. In addition, the optimal ANN architecture was found to have a single hidden layer with 20 neurons. The ANN models proposed in this work may prove useful in preliminary assessments of lightning damage and reduce the number of expensive experimental lightning tests.


2016 ◽  
pp. 368-395
Author(s):  
Eliano Pessa

The Artificial Neural Network (ANN) models gained a wide popularity owing to a number of claimed advantages such as biological plausibility, tolerance with respect to errors or noise in the input data, learning ability allowing an adaptability to environmental constraints. Notwithstanding the fact that most of these advantages are not typical only of ANNs, engineers, psychologists and neuroscientists made an extended use of ANN models in a large number of scientific investigations. In most cases, however, these models have been introduced in order to provide optimization tools more useful than the ones commonly used by traditional Optimization Theory. Unfortunately, just the successful performance of ANN models in optimization tasks produced a widespread neglect of the true – and important – objectives pursued by the first promoters of these models. These objectives can be shortly summarized by the manifesto of connectionist psychology, stating that mental processes are nothing but macroscopic phenomena, emergent from the cooperative interaction of a large number of microscopic knowledge units. This statement – wholly in line with the goal of statistical mechanics – can be readily extended to other processes, beyond the mental ones, including social, economic, and, in general, organizational ones. Therefore this chapter has been designed in order to answer a number of related questions, such as: are the ANN models able to grant for the occurrence of this sort of emergence? How can the occurrence of this emergence be empirically detected? How can the emergence produced by ANN models be controlled? In which sense the ANN emergence could offer a new paradigm for the explanation of macroscopic phenomena? Answering these questions induces to focus the chapter on less popular ANNs, such as the recurrent ones, while neglecting more popular models, such as perceptrons, and on less used units, such as spiking neurons, rather than on McCulloch-Pitts neurons. Moreover, the chapter must mention a number of strategies of emergence detection, useful for researchers performing computer simulations of ANN behaviours. Among these strategies it is possible to quote the reduction of ANN models to continuous models, such as the neural field models or the neural mass models, the recourse to the methods of Network Theory and the employment of techniques borrowed by Statistical Physics, like the one based on the Renormalization Group. Of course, owing to space (and mathematical expertise) requirements, most mathematical details of the proposed arguments are neglected, and, to gain more information, the reader is deferred to the quoted literature.


2012 ◽  
Author(s):  
Khairiyah Mohd. Yusof ◽  
Fakhri Karray ◽  
Peter L. Douglas

This paper discusses the development of artificial neural network (ANN) models for a crude oil distillation column. Since the model is developed for real time optimisation (RTO) applications they are steady state, multivariable models. Training and testing data used to develop the models were generated from a reconciled steady-state model simulated in a process simulator. The radial basis function networks (RBFN), a type of feedforward ANN model, were able to model the crude tower very well, with the root mean square error for the prediction of each variable less than 1%. Grouping related output variables in a network model was found to give better predictions than lumping all the variables in a single model; this also allowed the overall complex, multivariable model to be simplified into smaller models that are more manageable. In addition, the RBFN models were also able to satisfactorily perform range and dimensional extrapolation, which is necessary for models that are used in RTO.


2022 ◽  
pp. 1287-1300
Author(s):  
Balaji Prabhu B. V. ◽  
M. Dakshayini

Demand forecasting plays an important role in the field of agriculture, where a farmer can plan for the crop production according to the demand in future and make a profitable crop business. There exist a various statistical and machine learning methods for forecasting the demand, selecting the best forecasting model is desirable. In this work, a multiple linear regression (MLR) and an artificial neural network (ANN) model have been implemented for forecasting an optimum societal demand for various food crops that are commonly used in day to day life. The models are implemented using R toll, linear model and neuralnet packages for training and optimization of the MLR and ANN models. Then, the results obtained by the ANN were compared with the results obtained with MLR models. The results obtained indicated that the designed models are useful, reliable, and quite an effective tool for optimizing the effects of demand prediction in controlling the supply of food harvests to match the societal needs satisfactorily.


2020 ◽  
Vol 12 (4) ◽  
pp. 35-47
Author(s):  
Balaji Prabhu B. V. ◽  
M. Dakshayini

Demand forecasting plays an important role in the field of agriculture, where a farmer can plan for the crop production according to the demand in future and make a profitable crop business. There exist a various statistical and machine learning methods for forecasting the demand, selecting the best forecasting model is desirable. In this work, a multiple linear regression (MLR) and an artificial neural network (ANN) model have been implemented for forecasting an optimum societal demand for various food crops that are commonly used in day to day life. The models are implemented using R toll, linear model and neuralnet packages for training and optimization of the MLR and ANN models. Then, the results obtained by the ANN were compared with the results obtained with MLR models. The results obtained indicated that the designed models are useful, reliable, and quite an effective tool for optimizing the effects of demand prediction in controlling the supply of food harvests to match the societal needs satisfactorily.


Author(s):  
Meryeme Boumahdi ◽  
Chaker El Amrani ◽  
Siegfried Denys

In the present work, multiphysics modeling was used to investigate the feasibility of a photocatalysis-based outdoor air purifying solution that could be used in high polluted streets, especially street canyons. The article focuses on the use of a semi-active photocatalysis in the surfaces of the street as a solution to remove anthropogenic pollutants from the air. The solution is based on lamellae arranged horizontally on the wall of the street, coated with a photocatalyst (TiO2), lightened with UV light, with a dimension of 8 cm × 48 cm × 1 m. Fans were used in the system to create airflow. A high purification percentage was obtained. An artificial neural network (ANN) was used to predict the optimal purification method based on previous simulations, to design purification strategies considering the energy cost. The ANN was used to forecast the amount of purified with a feed-forward neural network and a backpropagation algorithm to train the model.


Sign in / Sign up

Export Citation Format

Share Document