scholarly journals Methodology for Knowledge Extraction from Trained Artificial Neural Networks

2018 ◽  
Vol 21 ◽  
pp. 6-14
Author(s):  
Andrey Bondarenko ◽  
Ludmila Aleksejeva
Keyword(s):  
Neural Network ◽  
Neural Networks ◽  
Artificial Neural Networks ◽  
Decision Tree ◽  
Binary Classification ◽  
Knowledge Extraction ◽  
Classification Problems ◽  
Critical Areas ◽  
Artificial Neural ◽  
Fully Connected

Artificial neural networks are widely spread models that outperform more basic, but explainable machine learning models like classification decision tree. Although their lack of explainability severely limits their area of application. All mission critical areas or law regulated areas (like European GDPR) require model to be explained. Explainability allows model validation for correctness and lack of bias. Thus methods for knowledge extraction from artificial neural networks have gained attention and development efforts. Current paper addresses this problem and describes knowledge extraction methodology which can be applied to classification problems. It is based on previous research and allows knowledge to be extracted from trained fully connected feed-forward artificial neural network, from radial basis function neural network and from hyper-polytope based classifier in the form of binary classification decision tree, elliptical rules and If-Then rules.

scholarly journals KLASIFIKASI BATIK RIAU DENGAN MENGGUNAKAN CONVOLUTIONAL NEURAL NETWORKS (CNN)

2020 ◽  
Vol 9 (1) ◽  
pp. 7-10
Author(s):  
Hendry Fonda
Keyword(s):  
Neural Network ◽  
Neural Networks ◽  
Artificial Neural Networks ◽  
Deep Learning ◽  
Convolutional Neural Networks ◽  
18Th Century ◽  
The Public ◽  
Artificial Neural ◽  
The Difference ◽  
Fully Connected

ABSTRACT Riau batik is known since the 18th century and is used by royal kings. Riau Batik is made by using a stamp that is mixed with coloring and then printed on fabric. The fabric used is usually silk. As its development, comparing Javanese  batik with riau batik Riau is very slowly accepted by the public. Convolutional Neural Networks (CNN) is a combination of artificial neural networks and deeplearning methods. CNN consists of one or more convolutional layers, often with a subsampling layer followed by one or more fully connected layers as a standard neural network. In the process, CNN will conduct training and testing of Riau batik so that a collection of batik models that have been classified based on the characteristics that exist in Riau batik can be determined so that images are Riau batik and non-Riau batik. Classification using CNN produces Riau batik and not Riau batik with an accuracy of 65%. Accuracy of 65% is due to basically many of the same motifs between batik and other batik with the difference lies in the color of the absorption in the batik riau. Kata kunci: Batik; Batik Riau; CNN; Image; Deep Learning   ABSTRAK   Batik Riau dikenal sejak abad ke 18 dan digunakan oleh bangsawan raja. Batik Riau dibuat dengan menggunakan cap yang dicampur dengan pewarna kemudian dicetak di kain. Kain yang digunakan biasanya sutra. Seiring perkembangannya, dibandingkan batik Jawa maka batik Riau sangat lambat diterima oleh masyarakat. Convolutional Neural Networks (CNN) merupakan kombinasi dari jaringan syaraf tiruan dan metode deeplearning. CNN terdiri dari satu atau lebih lapisan konvolutional, seringnya dengan suatu lapisan subsampling yang diikuti oleh satu atau lebih lapisan yang terhubung penuh sebagai standar jaringan syaraf. Dalam prosesnya CNN akan melakukan training dan testing terhadap batik Riau sehingga didapat kumpulan model batik yang telah terklasi    fikasi berdasarkan ciri khas yang ada pada batik Riau sehingga dapat ditentukan gambar (image) yang merupakan batik Riau dan yang bukan merupakan batik Riau. Klasifikasi menggunakan CNN menghasilkan batik riau dan bukan batik riau dengan akurasi 65%. Akurasi 65% disebabkan pada dasarnya banyak motif yang sama antara batik riau dengan batik lainnya dengan perbedaan terletak pada warna cerap pada batik riau. Kata kunci: Batik; Batik Riau; CNN; Image; Deep Learning

scholarly journals PREDICTION OF FINANCIAL DISTRESS: CASE OF MINING ENTERPRISES IN CZECH REPUBLIC

2020 ◽  
Vol 15 (1) ◽  
pp. 1-14
Author(s):  
Zuzana Rowland ◽  
Alla Kasych ◽  
Petr Suler
Keyword(s):  
Neural Network ◽  
Neural Networks ◽  
Artificial Neural Networks ◽  
Czech Republic ◽  
Financial Stability ◽  
Grey Zone ◽  
Financial Health ◽  
Classification Problems ◽  
Mining Companies ◽  
Artificial Neural

The ability to predict a company's financial health is a challenge for many researchers and scientists. It is also a distracting topic, as many other new approaches to financial health predictions have emerged in recent years. In this paper, we focused on identifying the financial health of mining companies in the Czech Republic. We chose the neural network method because, based on various instances of related research, neural networks represent a more reliable financial forecast than mathematical-statistical methods such as discriminant analysis and logistic regression. The concept of a neural network emerged with the first artificial neural networks, inspired by biological systems. The existence of prediction and classification problems directly predetermines artificial neural networks with respect to a given issue. We used the Amadeus database for processing, including financial indicators, SPSS, and Visual Gene Developer software. In total, we analyzed sixty-four mining companies. Complete data on financial stability were available for fifty-three companies, which we explored, and based on these results, identified financial situations for the other thirteen. Based on the available information, we processed a neural network and regression analysis. We managed to classify thirteen companies as solvent, insolvent, and in the grey zone, with the help of prediction.

scholarly journals MASKS: A Multi-Artificial Neural Networks System's verification approach

2020 ◽  
Author(s):  
Amirhoshang Hoseinpour Dehkordi ◽  
Majid Alizadeh ◽  
Ebrahim Ardeshir-Larijani ◽  
Ali Movaghar
Keyword(s):  
Neural Network ◽  
Neural Networks ◽  
Artificial Neural Network ◽  
Artificial Neural Networks ◽  
Special Property ◽  
External Information ◽  
Multi Agent Systems ◽  
Classification Problems ◽  
Multi Agent ◽  
Artificial Neural

<div>Artificial Neural networks are one of the most widely applied approaches for classification problems. However, developing an errorless artificial neural network is in practice impossible, due to the statistical nature of such networks. The employment of artificial neural networks in critical applications has rendered any such emerging errors, in these systems, incredibly more significant. Nevertheless, the real consequences of such errors have not been addressed, especially due to lacking verification approaches. This study aims to develop a verification method that eliminates errors through the integration of multiple artificial neural networks. In order to do this, first of all, a special property has been defined, by the authors, to extract the knowledge of these artificial neural networks. </div><div>Furthermore, a multi-agent system has been designed, itself comprised of multiple artificial neural networks, in order to check whether the aforementioned special property has been satisfied, or not. Also, in order to help examine the reasoning concerning the aggregation of the distributed knowledge, itself gained through the combined effort of separate artificial neural networks and acquired external information sources, a dynamic epistemic logic-based method has been proposed.</div><div>Finally, we believe aggregated knowledge may lead to self-awareness for the system. As a result, our model shall be capable of verifying specific inputs, if the cumulative knowledge of the entire system proves its correctness. </div><div>In conclusion, and formulated for multi-agent systems, a knowledge-sharing algorithm (Abbr. MASKS) has been developed. Which after being applied on the MNIST dataset successfully reduced the error rate to roughly one-eighth of previous runs on individual artificial neural network in the same model. </div>

scholarly journals Relationship between training database size and structural connectivity in artificial neural networks: Do specific local connections improve prediction accuracy?

2021 ◽  
Author(s):  
Min Sik Park
Keyword(s):  
Neural Network ◽  
Neural Networks ◽  
Artificial Neural Networks ◽  
Prediction Accuracy ◽  
Structural Connectivity ◽  
Large Size ◽  
Artificial Neural ◽  
Neuronal Systems ◽  
Similar Accuracy ◽  
Fully Connected

Abstract Training of artificial neural networks is very expensive, as a large-size database is necessary. Moreover, it is usually difficult to find such large-size training databases. Hence, it will be interesting to design artificial neural networks that can be used for training with a small-size database, while maintaining a similar accuracy for prediction compared to fully connected neural networks. We studied neural networks with partial disconnections, additional bypass connections, and negative activation nodes, which are found in the neuronal systems of the human brain. By combining the fully connected neural network and the above three brain-like elements, we found that the modified neural network showed improved prediction accuracy of 13% compared to the fully connected one despite the small size of the training database. To analyze the improved neural network, the contribution of each node in the hidden layers affecting the total prediction accuracy of the neural networks was studied. We also found important local connections that improve the prediction accuracy, and discussed the design of a neural network with a small-size training database without reduction in prediction accuracy.

scholarly journals MASKS: A Multi-Artificial Neural Networks System's verification approach

2020 ◽  
Author(s):  
Amirhoshang Hoseinpour Dehkordi ◽  
Majid Alizadeh ◽  
Ebrahim Ardeshir-Larijani ◽  
Ali Movaghar
Keyword(s):  
Neural Network ◽  
Neural Networks ◽  
Artificial Neural Network ◽  
Artificial Neural Networks ◽  
Special Property ◽  
External Information ◽  
Multi Agent Systems ◽  
Classification Problems ◽  
Multi Agent ◽  
Artificial Neural

<div>Artificial Neural networks are one of the most widely applied approaches for classification problems. However, developing an errorless artificial neural network is in practice impossible, due to the statistical nature of such networks. The employment of artificial neural networks in critical applications has rendered any such emerging errors, in these systems, incredibly more significant. Nevertheless, the real consequences of such errors have not been addressed, especially due to lacking verification approaches. This study aims to develop a verification method that eliminates errors through the integration of multiple artificial neural networks. In order to do this, first of all, a special property has been defined, by the authors, to extract the knowledge of these artificial neural networks. </div><div>Furthermore, a multi-agent system has been designed, itself comprised of multiple artificial neural networks, in order to check whether the aforementioned special property has been satisfied, or not. Also, in order to help examine the reasoning concerning the aggregation of the distributed knowledge, itself gained through the combined effort of separate artificial neural networks and acquired external information sources, a dynamic epistemic logic-based method has been proposed.</div><div>Finally, we believe aggregated knowledge may lead to self-awareness for the system. As a result, our model shall be capable of verifying specific inputs, if the cumulative knowledge of the entire system proves its correctness. </div><div>In conclusion, and formulated for multi-agent systems, a knowledge-sharing algorithm (Abbr. MASKS) has been developed. Which after being applied on the MNIST dataset successfully reduced the error rate to roughly one-eighth of previous runs on individual artificial neural network in the same model. </div>

scholarly journals The Budapest Amyloid Predictor and Its Applications

Biomolecules ◽  
2021 ◽  
Vol 11 (4) ◽  
pp. 500
Author(s):  
László Keresztes ◽  
Evelin Szögi ◽  
Bálint Varga ◽  
Viktor Farkas ◽  
András Perczel ◽  
...  
Keyword(s):  
Neural Network ◽  
Neural Networks ◽  
Artificial Neural Networks ◽  
Support Vector ◽  
User Needs ◽  
Computational Technique ◽  
Linear Support Vector Machine ◽  
Β Sheets ◽  
Artificial Neural ◽  
Amorphous Aggregation

The amyloid state of proteins is widely studied with relevance to neurology, biochemistry, and biotechnology. In contrast with nearly amorphous aggregation, the amyloid state has a well-defined structure, consisting of parallel and antiparallel β-sheets in a periodically repeated formation. The understanding of the amyloid state is growing with the development of novel molecular imaging tools, like cryogenic electron microscopy. Sequence-based amyloid predictors were developed, mainly using artificial neural networks (ANNs) as the underlying computational technique. From a good neural-network-based predictor, it is a very difficult task to identify the attributes of the input amino acid sequence, which imply the decision of the network. Here, we present a linear Support Vector Machine (SVM)-based predictor for hexapeptides with correctness higher than 84%, i.e., it is at least as good as the best published ANN-based tools. Unlike artificial neural networks, the decisions of the linear SVMs are much easier to analyze and, from a good predictor, we can infer rich biochemical knowledge. In the Budapest Amyloid Predictor webserver the user needs to input a hexapeptide, and the server outputs a prediction for the input plus the 6 × 19 = 114 distance-1 neighbors of the input hexapeptide.

scholarly journals Non-Destructive Micromagnetic Determination of Hardness and Case Hardening Depth Using Linear Regression Analysis and Artificial Neural Networks

Metals ◽  
2020 ◽  
Vol 11 (1) ◽  
pp. 18
Author(s):  
Rahel Jedamski ◽  
Jérémy Epp
Keyword(s):  
Neural Network ◽  
Neural Networks ◽  
Regression Analysis ◽  
Artificial Neural Networks ◽  
Linear Regression ◽  
Linear Regression Analysis ◽  
Case Hardening ◽  
Artificial Neural ◽  
Non Destructive

Non-destructive determination of workpiece properties after heat treatment is of great interest in the context of quality control in production but also for prevention of damage in subsequent grinding process. Micromagnetic methods offer good possibilities, but must first be calibrated with reference analyses on known states. This work compares the accuracy and reliability of different calibration methods for non-destructive evaluation of carburizing depth and surface hardness of carburized steel. Linear regression analysis is used in comparison with new methods based on artificial neural networks. The comparison shows a slight advantage of neural network method and potential for further optimization of both approaches. The quality of the results can be influenced, among others, by the number of teaching steps for the neural network, whereas more teaching steps does not always lead to an improvement of accuracy for conditions not included in the initial calibration.

scholarly journals Optimal Artificial Neural Network Type Selection Method for Usage in Smart House Systems

Sensors ◽  
2020 ◽  
Vol 21 (1) ◽  
pp. 47
Author(s):  
Vasyl Teslyuk ◽  
Artem Kazarian ◽  
Natalia Kryvinska ◽  
Ivan Tsmots
Keyword(s):  
Neural Network ◽  
Neural Networks ◽  
Artificial Neural Network ◽  
Artificial Neural Networks ◽  
Input Data ◽  
Optimization Criterion ◽  
Fuzzy Input ◽  
Different Types ◽  
Smart House ◽  
Artificial Neural

In the process of the “smart” house systems work, there is a need to process fuzzy input data. The models based on the artificial neural networks are used to process fuzzy input data from the sensors. However, each artificial neural network has a certain advantage and, with a different accuracy, allows one to process different types of data and generate control signals. To solve this problem, a method of choosing the optimal type of artificial neural network has been proposed. It is based on solving an optimization problem, where the optimization criterion is an error of a certain type of artificial neural network determined to control the corresponding subsystem of a “smart” house. In the process of learning different types of artificial neural networks, the same historical input data are used. The research presents the dependencies between the types of neural networks, the number of inner layers of the artificial neural network, the number of neurons on each inner layer, the error of the settings parameters calculation of the relative expected results.

Performance Estimation of Direct Methanol Fuel Cell Using Artificial Neural Network

2015 ◽  
Author(s):  
M. A. Rafe Biswas ◽  
Melvin D. Robinson
Keyword(s):  
Neural Network ◽  
Neural Networks ◽  
Artificial Neural Networks ◽  
Fuel Cell ◽  
Direct Methanol Fuel Cell ◽  
Cell Voltage ◽  
Operating Conditions ◽  
Direct Methanol ◽  
Artificial Neural ◽  
Methanol Fuel Cell

A direct methanol fuel cell can convert chemical energy in the form of a liquid fuel into electrical energy to power devices, while simultaneously operating at low temperatures and producing virtually no greenhouse gases. Since the direct methanol fuel cell performance characteristics are inherently nonlinear and complex, it can be postulated that artificial neural networks represent a marked improvement in performance prediction capabilities. Artificial neural networks have long been used as a tool in predictive modeling. In this work, an artificial neural network is employed to predict the performance of a direct methanol fuel cell under various operating conditions. This work on the experimental analysis of a uniquely designed fuel cell and the computational modeling of a unique algorithm has not been found in prior literature outside of the authors and their affiliations. The fuel cell input variables for the performance analysis consist not only of the methanol concentration, fuel cell temperature, and current density, but also the number of cells and anode flow rate. The addition of the two typically unconventional variables allows for a more distinctive model when compared to prior neural network models. The key performance indicator of our neural network model is the cell voltage, which is an average voltage across the stack and ranges from 0 to 0:8V. Experimental studies were carried out using DMFC stacks custom-fabricated, with a membrane electrode assembly consisting of an additional unique liquid barrier layer to minimize water loss through the cathode side to the atmosphere. To determine the best fit of the model to the experimental cell voltage data, the model is trained using two different second order training algorithms: OWO-Newton and Levenberg-Marquardt (LM). The OWO-Newton algorithm has a topology that is slightly different from the topology of the LM algorithm by the employment of bypass weights. It can be concluded that the application of artificial neural networks can rapidly construct a predictive model of the cell voltage for a wide range of operating conditions with an accuracy of 10−3 to 10−4. The results were comparable with existing literature. The added dimensionality of the number of cells provided insight into scalability where the coefficient of the determination of the results for the two multi-cell stacks using LM algorithm were up to 0:9998. The model was also evaluated with empirical data of a single-cell stack.

Sign in / Sign up

Export Citation Format

Share Document