scholarly journals Take a Ramble into Solution Spaces for Classification Problems in Neural Networks

2019 ◽  
pp. 345-355 ◽  
Author(s):  
Enzo Tartaglione ◽  
Marco Grangetto
Keyword(s):  
Neural Networks ◽  
Classification Problems

scholarly journals Comparison of the efficiency of neural network algorithms in recognition and classification problems

2020 ◽  
Vol 224 ◽  
pp. 01025
Author(s):  
Alexey Beskopylny ◽  
Alexandr Lyapin ◽  
Nikita Beskopylny ◽  
Elena Kadomtseva
Keyword(s):  
Neural Network ◽  
Neural Networks ◽  
Computation Time ◽  
Classification Problems ◽  
Handwritten Digit Recognition ◽  
Network Algorithms ◽  
Digit Recognition ◽  
Labour Intensity ◽  
Handwritten Digit ◽  
Accuracy Of Results

The article is devoted to the problem of comparing the effectiveness of feedforward (FF) and convolutional neural networks (CNN) algorithms in the problems of handwritten digit recognition and classification. In recent years, the attention of many researchers to the FF and CNN algorithms has given rise to many hybrid models focused on solving specific problems. At the same time, the efficiency of each algorithm in terms of accuracy and labour intensity remains unclear. It is shown that in classical problems, FFs can have advantages over CNN in terms of labour intensity with the same accuracy of results. Using the handwritten digits data from the MNIST database as an example, it is shown that FF algorithms provide greater accuracy and require less computation time than CNN.

scholarly journals PREDICTION OF FINANCIAL DISTRESS: CASE OF MINING ENTERPRISES IN CZECH REPUBLIC

2020 ◽  
Vol 15 (1) ◽  
pp. 1-14
Author(s):  
Zuzana Rowland ◽  
Alla Kasych ◽  
Petr Suler
Keyword(s):  
Neural Network ◽  
Neural Networks ◽  
Artificial Neural Networks ◽  
Czech Republic ◽  
Financial Stability ◽  
Grey Zone ◽  
Financial Health ◽  
Classification Problems ◽  
Mining Companies ◽  
Artificial Neural

The ability to predict a company's financial health is a challenge for many researchers and scientists. It is also a distracting topic, as many other new approaches to financial health predictions have emerged in recent years. In this paper, we focused on identifying the financial health of mining companies in the Czech Republic. We chose the neural network method because, based on various instances of related research, neural networks represent a more reliable financial forecast than mathematical-statistical methods such as discriminant analysis and logistic regression. The concept of a neural network emerged with the first artificial neural networks, inspired by biological systems. The existence of prediction and classification problems directly predetermines artificial neural networks with respect to a given issue. We used the Amadeus database for processing, including financial indicators, SPSS, and Visual Gene Developer software. In total, we analyzed sixty-four mining companies. Complete data on financial stability were available for fifty-three companies, which we explored, and based on these results, identified financial situations for the other thirteen. Based on the available information, we processed a neural network and regression analysis. We managed to classify thirteen companies as solvent, insolvent, and in the grey zone, with the help of prediction.

Convolutional Neural Networks for the Classification of the Microstructure of Tight Sandstone

2021 ◽  
Author(s):  
Ana Gabriela Reyna Flores ◽  
Quentin Fisher ◽  
Piroska Lorinczi
Keyword(s):  
Electron Microscopy ◽  
Neural Networks ◽  
Convolutional Neural Networks ◽  
Model Performance ◽  
Area Under The Curve ◽  
Tight Gas ◽  
Classification Problems ◽  
Tight Sandstone ◽  
Permeability Prediction ◽  
Rock Microstructure

Abstract Tight gas sandstone reservoirs vary widely in terms of rock type, depositional environment, mineralogy and petrophysical properties. For this reason, estimating their permeability is a challenge when core is not available because it is a property that cannot be measured directly from wire-line logs. The aim of this work is to create an automatic tool for rock microstructure classification as a first step for future permeability prediction. Permeability can be estimated from porosity measured using wire-line data such as derived from density-neutron tools. However, without additional information this is highly inaccurate because porosity-permeability relationships are controlled by the microstructure of samples and permeability can vary by over five orders of magnitude. Experts can broadly estimate porosity-permeability relationships by analysing the microstructure of rocks using Scanning Electron Microscopy (SEM) or optical microscopy. Such estimates are, however, subjective and require many years of experience. A Machine Learning model for the automation of rock microstructure determination on tight gas sandstones has been built using Convolutional Neural Networks (CNNs) and trained on backscattered images from cuttings. Current results were obtained by training the model on around 24,000 Back Scattering Electron Microscopy (BSEM) images from 25 different rock samples. The obtained model performance for the current dataset are 97% of average of both validation and test categorical accuracy. Also, loss of 0.09 and 0.089 were obtained for validation and test correspondingly. Such high accuracy and low loss indicate an overall great model performance. Other metrics and debugging techniques such Gradient-weighted Class Activation Mapping (Grad-CAM), Receiver Operator Characteristics (ROC) and Area Under the Curve (AUC) were considered for the model performance evaluation obtaining positive results. Nevertheless, this can be improved by obtaining images from new already available samples and make the model generalizes better. Current results indicate that CNNs are a powerful tool and their application over thin section images is an answer for image analysis and classification problems. The use of this classifier removes the subjectivity of estimating porosity-permeability relationships from microstructure and can be used by non-experts. The current results also open the possibility of a data driven permeability prediction based on rock microstructure and porosity from well logs.

Meta-Heuristic Parameter Optimization for ANN and Real-Time Applications of ANN

2022 ◽  
pp. 166-201
Author(s):  
Asha Gowda Karegowda ◽  
Devika G.
Keyword(s):  
Neural Networks ◽  
Real Time ◽  
Parameter Optimization ◽  
Heuristic Algorithms ◽  
Search Space ◽  
Optimization Method ◽  
Classification Problems ◽  
Local Optima ◽  
Consistent Solution ◽  
Real Time Applications

Artificial neural networks (ANN) are often more suitable for classification problems. Even then, training of ANN is a surviving challenge task for large and high dimensional natured search space problems. These hitches are more for applications that involves process of fine tuning of ANN control parameters: weights and bias. There is no single search and optimization method that suits the weights and bias of ANN for all the problems. The traditional heuristic approach fails because of their poorer convergence speed and chances of ending up with local optima. In this connection, the meta-heuristic algorithms prove to provide consistent solution for optimizing ANN training parameters. This chapter will provide critics on both heuristics and meta-heuristic existing literature for training neural networks algorithms, applicability, and reliability on parameter optimization. In addition, the real-time applications of ANN will be presented. Finally, future directions to be explored in the field of ANN are presented which will of potential interest for upcoming researchers.

scholarly journals Utilizing Information Bottleneck to Evaluate the Capability of Deep Neural Networks for Image Classification

Entropy ◽  
2019 ◽  
Vol 21 (5) ◽  
pp. 456 ◽  
Author(s):  
Hao Cheng ◽  
Dongze Lian ◽  
Shenghua Gao ◽  
Yanlin Geng
Keyword(s):  
Neural Networks ◽  
Deep Learning ◽  
Model Selection ◽  
Image Classification ◽  
Transfer Learning ◽  
Deep Neural Networks ◽  
Classification Problem ◽  
Distribution Model ◽  
Classification Problems ◽  
Information Bottleneck

Inspired by the pioneering work of the information bottleneck (IB) principle for Deep Neural Networks’ (DNNs) analysis, we thoroughly study the relationship among the model accuracy, I ( X ; T ) and I ( T ; Y ) , where I ( X ; T ) and I ( T ; Y ) are the mutual information of DNN’s output T with input X and label Y. Then, we design an information plane-based framework to evaluate the capability of DNNs (including CNNs) for image classification. Instead of each hidden layer’s output, our framework focuses on the model output T. We successfully apply our framework to many application scenarios arising in deep learning and image classification problems, such as image classification with unbalanced data distribution, model selection, and transfer learning. The experimental results verify the effectiveness of the information plane-based framework: Our framework may facilitate a quick model selection and determine the number of samples needed for each class in the unbalanced classification problem. Furthermore, the framework explains the efficiency of transfer learning in the deep learning area.

scholarly journals Forecasting Economy-Related Data Utilizing Weight-Constrained Recurrent Neural Networks

Algorithms ◽  
2019 ◽  
Vol 12 (4) ◽  
pp. 85 ◽  
Author(s):  
Ioannis E. Livieris
Keyword(s):  
Neural Networks ◽  
Recurrent Neural Networks ◽  
Training Algorithm ◽  
Economic Data ◽  
Classification Problems ◽  
Useful Knowledge ◽  
Related Data ◽  
Limited Memory ◽  
Proposed Model ◽  
Projection Strategy

During the last few decades, machine learning has constituted a significant tool in extracting useful knowledge from economic data for assisting decision-making. In this work, we evaluate the performance of weight-constrained recurrent neural networks in forecasting economic classification problems. These networks are efficiently trained with a recently-proposed training algorithm, which has two major advantages. Firstly, it exploits the numerical efficiency and very low memory requirements of the limited memory BFGS matrices; secondly, it utilizes a gradient-projection strategy for handling the bounds on the weights. The reported numerical experiments present the classification accuracy of the proposed model, providing empirical evidence that the application of the bounds on the weights of the recurrent neural network provides more stable and reliable learning.

scholarly journals A procedure for meaningful unsupervised clustering and its application for solvent classification

2014 ◽  
Vol 12 (5) ◽  
pp. 594-603 ◽  
Author(s):  
Yaroslava Pushkarova ◽  
Yuriy Kholin
Keyword(s):  
Neural Networks ◽  
A Priori ◽  
Initial Distribution ◽  
C60 Fullerene ◽  
Classification Problems ◽  
Probabilistic Networks ◽  
Reliable Classification ◽  
Priori Information ◽  
Number Of Classes

AbstractArtificial neural networks have proven to be a powerful tool for solving classification problems. Some difficulties still need to be overcome for their successful application to chemical data. The use of supervised neural networks implies the initial distribution of patterns between the pre-determined classes, while attribution of objects to the classes may be uncertain. Unsupervised neural networks are free from this problem, but do not always reveal the real structure of data. Classification algorithms which do not require a priori information about the distribution of patterns between the pre-determined classes and provide meaningful results are of special interest. This paper presents an approach based on the combination of Kohonen and probabilistic networks which enables the determination of the number of classes and the reliable classification of objects. This is illustrated for a set of 76 solvents based on nine characteristics. The resulting classification is chemically interpretable. The approach proved to be also applicable in a different field, namely in examining the solubility of C60 fullerene. The solvents belonging to the same group demonstrate similar abilities to dissolve C60. This makes it possible to estimate the solubility of fullerenes in solvents for which there are no experimental data

Sign in / Sign up

Export Citation Format

Share Document