scholarly journals Development of software and algorithms of parallel learning of artificial neural networks using CUDA technologies

2021 ◽  
Vol 5 (2(61)) ◽  
pp. 21-25
Author(s):  
Yaroslav Sokolovskyy ◽  
Denys Manokhin ◽  
Yaroslav Kaplunsky ◽  
Olha Mokrytska
Keyword(s):  
Neural Network ◽  
Neural Networks ◽  
Artificial Neural Networks ◽  
Medical Image Analysis ◽  
Cloud Services ◽  
Small Data ◽  
Central Processor ◽  
Cuda Technology ◽  
Artificial Neural ◽  
Cloud Technologies

The object of research is to parallelize the learning process of artificial neural networks to automate the procedure of medical image analysis using the Python programming language, PyTorch framework and Compute Unified Device Architecture (CUDA) technology. The operation of this framework is based on the Define-by-Run model. The analysis of the available cloud technologies for realization of the task and the analysis of algorithms of learning of artificial neural networks is carried out. A modified U-Net architecture from the MedicalTorch library was used. The purpose of its application was the need for a network that can effectively learn with small data sets, as in the field of medicine one of the most problematic places is the availability of large datasets, due to the requirements for data confidentiality of this nature. The resulting information system is able to implement the tasks set before it, contains the most user-friendly interface and all the necessary tools to simplify and automate the process of visualization and analysis of data. The efficiency of neural network learning with the help of the central processor (CPU) and with the help of the graphic processor (GPU) with the use of CUDA technologies is compared. Cloud technology was used in the study. Google Colab and Microsoft Azure were considered among cloud services. Colab was first used to build a prototype. Therefore, the Azure service was used to effectively teach the finished architecture of the artificial neural network. Measurements were performed using cloud technologies in both services. The Adam optimizer was used to learn the model. CPU duration measurements were also measured to assess the acceleration of CUDA technology. An estimate of the acceleration obtained through the use of GPU computing and cloud technologies was implemented. CPU duration measurements were also measured to assess the acceleration of CUDA technology. The model developed during the research showed satisfactory results according to the metrics of Jaccard and Dyce in solving the problem. A key factor in the success of this study was cloud computing services.

scholarly journals The Budapest Amyloid Predictor and Its Applications

Biomolecules ◽  
2021 ◽  
Vol 11 (4) ◽  
pp. 500
Author(s):  
László Keresztes ◽  
Evelin Szögi ◽  
Bálint Varga ◽  
Viktor Farkas ◽  
András Perczel ◽  
...  
Keyword(s):  
Neural Network ◽  
Neural Networks ◽  
Artificial Neural Networks ◽  
Support Vector ◽  
User Needs ◽  
Computational Technique ◽  
Linear Support Vector Machine ◽  
Β Sheets ◽  
Artificial Neural ◽  
Amorphous Aggregation

The amyloid state of proteins is widely studied with relevance to neurology, biochemistry, and biotechnology. In contrast with nearly amorphous aggregation, the amyloid state has a well-defined structure, consisting of parallel and antiparallel β-sheets in a periodically repeated formation. The understanding of the amyloid state is growing with the development of novel molecular imaging tools, like cryogenic electron microscopy. Sequence-based amyloid predictors were developed, mainly using artificial neural networks (ANNs) as the underlying computational technique. From a good neural-network-based predictor, it is a very difficult task to identify the attributes of the input amino acid sequence, which imply the decision of the network. Here, we present a linear Support Vector Machine (SVM)-based predictor for hexapeptides with correctness higher than 84%, i.e., it is at least as good as the best published ANN-based tools. Unlike artificial neural networks, the decisions of the linear SVMs are much easier to analyze and, from a good predictor, we can infer rich biochemical knowledge. In the Budapest Amyloid Predictor webserver the user needs to input a hexapeptide, and the server outputs a prediction for the input plus the 6 × 19 = 114 distance-1 neighbors of the input hexapeptide.

scholarly journals Non-Destructive Micromagnetic Determination of Hardness and Case Hardening Depth Using Linear Regression Analysis and Artificial Neural Networks

Metals ◽  
2020 ◽  
Vol 11 (1) ◽  
pp. 18
Author(s):  
Rahel Jedamski ◽  
Jérémy Epp
Keyword(s):  
Neural Network ◽  
Neural Networks ◽  
Regression Analysis ◽  
Artificial Neural Networks ◽  
Linear Regression ◽  
Linear Regression Analysis ◽  
Case Hardening ◽  
Artificial Neural ◽  
Non Destructive

Non-destructive determination of workpiece properties after heat treatment is of great interest in the context of quality control in production but also for prevention of damage in subsequent grinding process. Micromagnetic methods offer good possibilities, but must first be calibrated with reference analyses on known states. This work compares the accuracy and reliability of different calibration methods for non-destructive evaluation of carburizing depth and surface hardness of carburized steel. Linear regression analysis is used in comparison with new methods based on artificial neural networks. The comparison shows a slight advantage of neural network method and potential for further optimization of both approaches. The quality of the results can be influenced, among others, by the number of teaching steps for the neural network, whereas more teaching steps does not always lead to an improvement of accuracy for conditions not included in the initial calibration.

scholarly journals Optimal Artificial Neural Network Type Selection Method for Usage in Smart House Systems

Sensors ◽  
2020 ◽  
Vol 21 (1) ◽  
pp. 47
Author(s):  
Vasyl Teslyuk ◽  
Artem Kazarian ◽  
Natalia Kryvinska ◽  
Ivan Tsmots
Keyword(s):  
Neural Network ◽  
Neural Networks ◽  
Artificial Neural Network ◽  
Artificial Neural Networks ◽  
Input Data ◽  
Optimization Criterion ◽  
Fuzzy Input ◽  
Different Types ◽  
Smart House ◽  
Artificial Neural

In the process of the “smart” house systems work, there is a need to process fuzzy input data. The models based on the artificial neural networks are used to process fuzzy input data from the sensors. However, each artificial neural network has a certain advantage and, with a different accuracy, allows one to process different types of data and generate control signals. To solve this problem, a method of choosing the optimal type of artificial neural network has been proposed. It is based on solving an optimization problem, where the optimization criterion is an error of a certain type of artificial neural network determined to control the corresponding subsystem of a “smart” house. In the process of learning different types of artificial neural networks, the same historical input data are used. The research presents the dependencies between the types of neural networks, the number of inner layers of the artificial neural network, the number of neurons on each inner layer, the error of the settings parameters calculation of the relative expected results.

Performance Estimation of Direct Methanol Fuel Cell Using Artificial Neural Network

2015 ◽  
Author(s):  
M. A. Rafe Biswas ◽  
Melvin D. Robinson
Keyword(s):  
Neural Network ◽  
Neural Networks ◽  
Artificial Neural Networks ◽  
Fuel Cell ◽  
Direct Methanol Fuel Cell ◽  
Cell Voltage ◽  
Operating Conditions ◽  
Direct Methanol ◽  
Artificial Neural ◽  
Methanol Fuel Cell

A direct methanol fuel cell can convert chemical energy in the form of a liquid fuel into electrical energy to power devices, while simultaneously operating at low temperatures and producing virtually no greenhouse gases. Since the direct methanol fuel cell performance characteristics are inherently nonlinear and complex, it can be postulated that artificial neural networks represent a marked improvement in performance prediction capabilities. Artificial neural networks have long been used as a tool in predictive modeling. In this work, an artificial neural network is employed to predict the performance of a direct methanol fuel cell under various operating conditions. This work on the experimental analysis of a uniquely designed fuel cell and the computational modeling of a unique algorithm has not been found in prior literature outside of the authors and their affiliations. The fuel cell input variables for the performance analysis consist not only of the methanol concentration, fuel cell temperature, and current density, but also the number of cells and anode flow rate. The addition of the two typically unconventional variables allows for a more distinctive model when compared to prior neural network models. The key performance indicator of our neural network model is the cell voltage, which is an average voltage across the stack and ranges from 0 to 0:8V. Experimental studies were carried out using DMFC stacks custom-fabricated, with a membrane electrode assembly consisting of an additional unique liquid barrier layer to minimize water loss through the cathode side to the atmosphere. To determine the best fit of the model to the experimental cell voltage data, the model is trained using two different second order training algorithms: OWO-Newton and Levenberg-Marquardt (LM). The OWO-Newton algorithm has a topology that is slightly different from the topology of the LM algorithm by the employment of bypass weights. It can be concluded that the application of artificial neural networks can rapidly construct a predictive model of the cell voltage for a wide range of operating conditions with an accuracy of 10−3 to 10−4. The results were comparable with existing literature. The added dimensionality of the number of cells provided insight into scalability where the coefficient of the determination of the results for the two multi-cell stacks using LM algorithm were up to 0:9998. The model was also evaluated with empirical data of a single-cell stack.

scholarly journals Artificial neural networks applied for soil class prediction in mountainous landscape of the Serra do Mar¹

2014 ◽  
Vol 38 (6) ◽  
pp. 1681-1693 ◽  
Author(s):  
Braz Calderano Filho ◽  
Helena Polivanov ◽  
César da Silva Chagas ◽  
Waldir de Carvalho Júnior ◽  
Emílio Velloso Barroso ◽  
...  
Keyword(s):  
Neural Network ◽  
Neural Networks ◽  
Artificial Neural Networks ◽  
Kappa Index ◽  
Class Prediction ◽  
Soil Class ◽  
Serra Do Mar ◽  
The Neural Network ◽  
Artificial Neural ◽  
Local Geology

Soil information is needed for managing the agricultural environment. The aim of this study was to apply artificial neural networks (ANNs) for the prediction of soil classes using orbital remote sensing products, terrain attributes derived from a digital elevation model and local geology information as data sources. This approach to digital soil mapping was evaluated in an area with a high degree of lithologic diversity in the Serra do Mar. The neural network simulator used in this study was JavaNNS and the backpropagation learning algorithm. For soil class prediction, different combinations of the selected discriminant variables were tested: elevation, declivity, aspect, curvature, curvature plan, curvature profile, topographic index, solar radiation, LS topographic factor, local geology information, and clay mineral indices, iron oxides and the normalized difference vegetation index (NDVI) derived from an image of a Landsat-7 Enhanced Thematic Mapper Plus (ETM+) sensor. With the tested sets, best results were obtained when all discriminant variables were associated with geological information (overall accuracy 93.2 - 95.6 %, Kappa index 0.924 - 0.951, for set 13). Excluding the variable profile curvature (set 12), overall accuracy ranged from 93.9 to 95.4 % and the Kappa index from 0.932 to 0.948. The maps based on the neural network classifier were consistent and similar to conventional soil maps drawn for the study area, although with more spatial details. The results show the potential of ANNs for soil class prediction in mountainous areas with lithological diversity.

Optimization Artificial Neural Network Using Artificial Bee Colony in Letter Recognition Classification

2020 ◽  
Vol 8 (4) ◽  
pp. 469
Author(s):  
I Gusti Ngurah Alit Indrawan ◽  
I Made Widiartha
Keyword(s):  
Neural Network ◽  
Neural Networks ◽  
Artificial Neural Networks ◽  
Classification Accuracy ◽  
Artificial Bee Colony Algorithm ◽  
Artificial Bee Colony ◽  
Letter Recognition ◽  
Bee Colony ◽  
Artificial Neural ◽  
Hidden Layer

Artificial Neural Networks or commonly abbreviated as ANN is one branch of science from the field of artificial intelligence which is often used to solve various problems in fields that involve grouping and pattern recognition. This research aims to classify Letter Recognition datasets using Artificial Neural Networks which are weighted optimally using the Artificial Bee Colony algorithm. The best classification accuracy results from this study were 92.85% using a combination of 4 hidden layers with each hidden layer containing 10 neurons.

Improving Pin-Fin Heat Transfer Predictions Using Artificial Neural Networks

2013 ◽  
Author(s):  
Jason K. Ostanek
Keyword(s):  
Neural Network ◽  
Heat Transfer ◽  
Neural Networks ◽  
Reynolds Number ◽  
Artificial Neural Networks ◽  
Power Law ◽  
Transfer Data ◽  
Pin Fin ◽  
The Neural Network ◽  
Artificial Neural

In much of the public literature on pin-fin heat transfer, Nusselt number is presented as a function of Reynolds number using a power-law correlation. Power-law correlations typically have an accuracy of 20% while the experimental uncertainty of such measurements is typically between 5% and 10%. Additionally, the use of power-law correlations may require many sets of empirical constants to fully characterize heat transfer for different geometrical arrangements. In the present work, artificial neural networks were used to predict heat transfer as a function of streamwise spacing, spanwise spacing, pin-fin height, Reynolds number, and row position. When predicting experimental heat transfer data, the neural network was able to predict 73% of array-averaged heat transfer data to within 10% accuracy while published power-law correlations predicted 48% of the data to within 10% accuracy. Similarly, the neural network predicted 81% of row-averaged data to within 10% accuracy while 52% of the data was predicted to within 10% accuracy using power-law correlations. The present work shows that first-order heat transfer predictions may be simplified by using a single neural network model rather than combining or interpolating between power-law correlations. Furthermore, the neural network may be expanded to include additional pin-fin features of interest such as fillets, duct rotation, pin shape, pin inclination angle, and more making neural networks expandable and adaptable models for predicting pin-fin heat transfer.

scholarly journals FEATURES OF DIAGNOSTIC ARTIFICIAL NEURAL NETWORKS FOR HYBRID EXPERT SYSTEMS

2019 ◽  
Vol 26 ◽  
pp. 36-46
Author(s):  
S. KONOVALOV ◽  
Keyword(s):  
Neural Network ◽  
Neural Networks ◽  
Artificial Neural Network ◽  
Artificial Neural Networks ◽  
Expert Systems ◽  
Technical System ◽  
Bulletin Board ◽  
Confidence Factor ◽  
Complex Technical System ◽  
Artificial Neural

In the proposed article, various methods of constructing an artificial neural network as one of the components of a hybrid expert system for diagnosis were investigated. A review of foreign literature in recent years was conducted, where hybrid expert systems were considered as an integral part of complex technical systems in the field of security. The advantages and disadvantages of artificial neural networks are listed, and the main problems in creating hybrid expert systems for diagnostics are indicated, proving the relevance of further development of artificial neural networks for hybrid expert systems. The approaches to the analysis of natural language sentences, which are used for the work of hybrid expert systems with artificial neural networks, are considered. A bulletin board is shown, its structure and principle of operation are described. The structure of the bulletin board is divided into levels and sublevels. At sublevels, a confidence factor is applied. The dependence of the values of the confidence factor on the fulfillment of a particular condition is shown. The links between the levels and sublevels of the bulletin board are also described. As an artificial neural network architecture, the «key-threshold» model is used, the rule of neuron operation is shown. In addition, an artificial neural network has the property of training, based on the application of the penalty property, which is able to calculate depending on the accident situation. The behavior of a complex technical system, as well as its faulty states, are modeled using a model that describes the structure and behavior of a given system. To optimize the data of a complex technical system, an evolutionary algorithm is used to minimize the objective function. Solutions to the optimization problem consist of Pareto solution vectors. Optimization and training tasks are solved by using the Hopfield network. In general, a hybrid expert system is described using semantic networks, which consist of vertices and edges. The reference model of a complex technical system is stored in the knowledge base and updated during the acquisition of new knowledge. In an emergency, or about its premise, with the help of neural networks, a search is made for the cause and the control action necessary to eliminate the accident. The considered approaches, interacting with each other, can improve the operation of diagnostic artificial neural networks in the case of emergency management, showing more accurate data in a short time. In addition, the use of such a network for analyzing the state of health, as well as forecasting based on diagnostic data using the example of a complex technical system, is presented.

scholarly journals KLASIFIKASI BATIK RIAU DENGAN MENGGUNAKAN CONVOLUTIONAL NEURAL NETWORKS (CNN)

2020 ◽  
Vol 9 (1) ◽  
pp. 7-10
Author(s):  
Hendry Fonda
Keyword(s):  
Neural Network ◽  
Neural Networks ◽  
Artificial Neural Networks ◽  
Deep Learning ◽  
Convolutional Neural Networks ◽  
18Th Century ◽  
The Public ◽  
Artificial Neural ◽  
The Difference ◽  
Fully Connected

ABSTRACT Riau batik is known since the 18th century and is used by royal kings. Riau Batik is made by using a stamp that is mixed with coloring and then printed on fabric. The fabric used is usually silk. As its development, comparing Javanese  batik with riau batik Riau is very slowly accepted by the public. Convolutional Neural Networks (CNN) is a combination of artificial neural networks and deeplearning methods. CNN consists of one or more convolutional layers, often with a subsampling layer followed by one or more fully connected layers as a standard neural network. In the process, CNN will conduct training and testing of Riau batik so that a collection of batik models that have been classified based on the characteristics that exist in Riau batik can be determined so that images are Riau batik and non-Riau batik. Classification using CNN produces Riau batik and not Riau batik with an accuracy of 65%. Accuracy of 65% is due to basically many of the same motifs between batik and other batik with the difference lies in the color of the absorption in the batik riau. Kata kunci: Batik; Batik Riau; CNN; Image; Deep Learning   ABSTRAK   Batik Riau dikenal sejak abad ke 18 dan digunakan oleh bangsawan raja. Batik Riau dibuat dengan menggunakan cap yang dicampur dengan pewarna kemudian dicetak di kain. Kain yang digunakan biasanya sutra. Seiring perkembangannya, dibandingkan batik Jawa maka batik Riau sangat lambat diterima oleh masyarakat. Convolutional Neural Networks (CNN) merupakan kombinasi dari jaringan syaraf tiruan dan metode deeplearning. CNN terdiri dari satu atau lebih lapisan konvolutional, seringnya dengan suatu lapisan subsampling yang diikuti oleh satu atau lebih lapisan yang terhubung penuh sebagai standar jaringan syaraf. Dalam prosesnya CNN akan melakukan training dan testing terhadap batik Riau sehingga didapat kumpulan model batik yang telah terklasi    fikasi berdasarkan ciri khas yang ada pada batik Riau sehingga dapat ditentukan gambar (image) yang merupakan batik Riau dan yang bukan merupakan batik Riau. Klasifikasi menggunakan CNN menghasilkan batik riau dan bukan batik riau dengan akurasi 65%. Akurasi 65% disebabkan pada dasarnya banyak motif yang sama antara batik riau dengan batik lainnya dengan perbedaan terletak pada warna cerap pada batik riau. Kata kunci: Batik; Batik Riau; CNN; Image; Deep Learning

Sign in / Sign up

Export Citation Format

Share Document