scholarly journals A Two-Step Rule-Extraction Technique for a CNN

Electronics ◽  
2020 ◽  
Vol 9 (6) ◽  
pp. 990
Author(s):  
Guido Bologna ◽  
Silvio Fossati
Keyword(s):  
Neural Networks ◽  
Deep Learning ◽  
Skin Cancer ◽  
Convolutional Neural Networks ◽  
Cancer Diagnosis ◽  
Medical Diagnosis ◽  
Rule Extraction ◽  
High Fidelity ◽  
Max Pooling ◽  
Fully Connected

The explanation of the decisions provided by a model are crucial in a domain such as medical diagnosis. With the advent of deep learning, it is very important to explain why a classification is reached by a model. This work tackles the transparency problem of convolutional neural networks(CNNs). We propose to generate propositional rules from CNNs, because they are intuitive to the way humans reason. Our method considers that a CNN is the union of two subnetworks: a multi-layer erceptron (MLP) in the fully connected layers; and a subnetwork including several 2D convolutional layers and max-pooling layers. Rule extraction exhibits two main steps, with each step generating rules from each subnetwork of the CNN. In practice, we approximate the two subnetworks by two particular MLP models that makes it possible to generate propositional rules. We performed the experiments with two datasets involving images: MNISTdigit recognition; and skin-cancer diagnosis. With high fidelity, the extracted rules designated the location of discriminant pixels, as well as the conditions that had to be met to achieve the classification. We illustrated several examples of rules by their centroids and their discriminant pixels.

scholarly journals KLASIFIKASI BATIK RIAU DENGAN MENGGUNAKAN CONVOLUTIONAL NEURAL NETWORKS (CNN)

2020 ◽  
Vol 9 (1) ◽  
pp. 7-10
Author(s):  
Hendry Fonda
Keyword(s):  
Neural Network ◽  
Neural Networks ◽  
Artificial Neural Networks ◽  
Deep Learning ◽  
Convolutional Neural Networks ◽  
18Th Century ◽  
The Public ◽  
Artificial Neural ◽  
The Difference ◽  
Fully Connected

ABSTRACT Riau batik is known since the 18th century and is used by royal kings. Riau Batik is made by using a stamp that is mixed with coloring and then printed on fabric. The fabric used is usually silk. As its development, comparing Javanese  batik with riau batik Riau is very slowly accepted by the public. Convolutional Neural Networks (CNN) is a combination of artificial neural networks and deeplearning methods. CNN consists of one or more convolutional layers, often with a subsampling layer followed by one or more fully connected layers as a standard neural network. In the process, CNN will conduct training and testing of Riau batik so that a collection of batik models that have been classified based on the characteristics that exist in Riau batik can be determined so that images are Riau batik and non-Riau batik. Classification using CNN produces Riau batik and not Riau batik with an accuracy of 65%. Accuracy of 65% is due to basically many of the same motifs between batik and other batik with the difference lies in the color of the absorption in the batik riau. Kata kunci: Batik; Batik Riau; CNN; Image; Deep Learning   ABSTRAK   Batik Riau dikenal sejak abad ke 18 dan digunakan oleh bangsawan raja. Batik Riau dibuat dengan menggunakan cap yang dicampur dengan pewarna kemudian dicetak di kain. Kain yang digunakan biasanya sutra. Seiring perkembangannya, dibandingkan batik Jawa maka batik Riau sangat lambat diterima oleh masyarakat. Convolutional Neural Networks (CNN) merupakan kombinasi dari jaringan syaraf tiruan dan metode deeplearning. CNN terdiri dari satu atau lebih lapisan konvolutional, seringnya dengan suatu lapisan subsampling yang diikuti oleh satu atau lebih lapisan yang terhubung penuh sebagai standar jaringan syaraf. Dalam prosesnya CNN akan melakukan training dan testing terhadap batik Riau sehingga didapat kumpulan model batik yang telah terklasi    fikasi berdasarkan ciri khas yang ada pada batik Riau sehingga dapat ditentukan gambar (image) yang merupakan batik Riau dan yang bukan merupakan batik Riau. Klasifikasi menggunakan CNN menghasilkan batik riau dan bukan batik riau dengan akurasi 65%. Akurasi 65% disebabkan pada dasarnya banyak motif yang sama antara batik riau dengan batik lainnya dengan perbedaan terletak pada warna cerap pada batik riau. Kata kunci: Batik; Batik Riau; CNN; Image; Deep Learning

scholarly journals A primer on deep learning and convolutional neural networks for clinicians

2021 ◽  
Vol 12 (1) ◽  
Author(s):  
Lara Lloret Iglesias ◽  
Pablo Sanz Bellón ◽  
Amaia Pérez del Barrio ◽  
Pablo Menéndez Fernández-Miranda ◽  
David Rodríguez González ◽  
...  
Keyword(s):  
Artificial Intelligence ◽  
Machine Learning ◽  
Neural Networks ◽  
Deep Learning ◽  
Convolutional Neural Networks ◽  
Learning Capabilities ◽  
Computer Vision Applications ◽  
Fully Connected ◽  
Imaging Perspective ◽  
Adaptive Momentum

AbstractDeep learning is nowadays at the forefront of artificial intelligence. More precisely, the use of convolutional neural networks has drastically improved the learning capabilities of computer vision applications, being able to directly consider raw data without any prior feature extraction. Advanced methods in the machine learning field, such as adaptive momentum algorithms or dropout regularization, have dramatically improved the convolutional neural networks predicting ability, outperforming that of conventional fully connected neural networks. This work summarizes, in an intended didactic way, the main aspects of these cutting-edge techniques from a medical imaging perspective.

scholarly journals Using local convolutional neural networks for genomic prediction

2020 ◽  
Author(s):  
Torsten Pook ◽  
Jan Freudenthal ◽  
Arthur Korte ◽  
Henner Simianer
Keyword(s):  
Neural Network ◽  
Neural Networks ◽  
Deep Learning ◽  
Convolutional Neural Network ◽  
Convolutional Neural Networks ◽  
Genomic Prediction ◽  
Linear Models ◽  
Predictive Ability ◽  
High Heritability ◽  
Fully Connected

ABSTRACTThe prediction of breeding values and phenotypes is of central importance for both livestock and crop breeding. With increasing computational power and more and more data to potentially utilize, Machine Learning and especially Deep Learning have risen in popularity over the last few years. In this study, we are proposing the use of local convolutional neural networks for genomic prediction, as a region specific filter corresponds much better with our prior genetic knowledge of traits than traditional convolutional neural networks. Model performances are evaluated on a simulated maize data panel (n = 10,000) and real Arabidopsis data (n = 2,039) for a variety of traits with the local convolutional neural network outperforming both multi layer perceptrons and convolutional neural networks for basically all considered traits. Linear models like the genomic best linear unbiased prediction that are often used for genomic prediction are outperformed by up to 24%. Highest gains in predictive ability was obtained in cases of medium trait complexity with high heritability and large training populations. However, for small dataset with 100 or 250 individuals for the training of the models, the local convolutional neural network is performing slightly worse than the linear models. Nonetheless, this is still 15% better than a traditional convolutional neural network, indicating a better performance and robustness of our proposed model architecture for small training populations. In addition to the baseline model, various other architectures with different windows size and stride in the local convolutional layer, as well as different number of nodes in subsequent fully connected layers are compared against each other. Finally, the usefulness of Deep Learning and in particular local convolutional neural networks in practice is critically discussed, in regard to multi dimensional inputs and outputs, computing times and other potential hazards.

scholarly journals Optimization of the Convolutional Neural Networks for Automatic Detection of Skin Cancer

Open Medicine ◽  
2020 ◽  
Vol 15 (1) ◽  
pp. 27-37 ◽  
Author(s):  
Long Zhang ◽  
Hong Jie Gao ◽  
Jianhua Zhang ◽  
Benjamin Badami
Keyword(s):  
Neural Networks ◽  
Deep Learning ◽  
Skin Cancer ◽  
Convolutional Neural Networks ◽  
Network Models ◽  
Reduce Mortality Rate ◽  
System Diagnosis ◽  
Digital Database ◽  
Whale Optimization ◽  
Diagnosis Accuracy

AbstractConvolutional neural networks (CNNs) are a branch of deep learning which have been turned into one of the popular methods in different applications, especially medical imaging. One of the significant applications in this category is to help specialists make an early detection of skin cancer in dermoscopy and can reduce mortality rate. However, there are a lot of reasons that affect system diagnosis accuracy. In recent years, the utilization of computer-aided technology for this purpose has been turned into an interesting category for scientists. In this research, a meta-heuristic optimized CNN classifier is applied for pre-trained network models for visual datasets with the purpose of classifying skin cancer images. However there are different methods about optimizing the learning step of neural networks, and there are few studies about the deep learning based neural networks and their applications. In the present work, a new approach based on whale optimization algorithm is utilized for optimizing the weight and biases in the CNN models. The new method is then compared with 10 popular classifiers on two skin cancer datasets including DermIS Digital Database Dermquest Database. Experimental results show that the use of this optimized method performs with better accuracy than other classification methods.

Deep distributed convolutional neural networks: Universality

2018 ◽  
Vol 16 (06) ◽  
pp. 895-919 ◽  
Author(s):  
Ding-Xuan Zhou
Keyword(s):  
Neural Network ◽  
Neural Networks ◽  
Deep Learning ◽  
Convolutional Neural Networks ◽  
Deep Neural Network ◽  
Deep Neural Networks ◽  
Mathematical Foundation ◽  
Deep Convolutional Neural Networks ◽  
The Family ◽  
Fully Connected

Deep learning based on structured deep neural networks has provided powerful applications in various fields. The structures imposed on the deep neural networks are crucial, which makes deep learning essentially different from classical schemes based on fully connected neural networks. One of the commonly used deep neural network structures is generated by convolutions. The produced deep learning algorithms form the family of deep convolutional neural networks. Despite of their power in some practical domains, little is known about the mathematical foundation of deep convolutional neural networks such as universality of approximation. In this paper, we propose a family of new structured deep neural networks: deep distributed convolutional neural networks. We show that these deep neural networks have the same order of computational complexity as the deep convolutional neural networks, and we prove their universality of approximation. Some ideas of our analysis are from ridge approximation, wavelets, and learning theory.

scholarly journals A Spectrogram Based Novel Approach for Arrhythmia Detection with Convolutional Neural Networks

2021 ◽  
Author(s):  
Sneha Rao ◽  
Vishwa Mohan Singh ◽  
Siddhivinayak Kulkarni ◽  
Vibhor Saran
Keyword(s):  
Artificial Intelligence ◽  
Neural Networks ◽  
Deep Learning ◽  
Convolutional Neural Networks ◽  
Medical Diagnosis ◽  
Light Weight ◽  
Arrhythmia Detection ◽  
Ecg Signals ◽  
Novel Approach ◽  
Convolution Model

Abstract ECG is one of the most important medical scans which is used for diagnosis of various heart related conditions and diseases. One of the most common of these is arrhythmia, which is caused by the irregularity of the heart beats. Artificial Intelligence has had a major impact in the field of vital monitoring and autonomous medical diagnosis. Therefore, a lot of work has demonstrated its effectiveness in arrhythmia detection. In this paper, we propose a method that tries to improve upon the accuracy of such models with the help of a light weight deep learning architecture that utilized 2D Separable CNN with a group of graphical representations of the ECG signals like the STFT, CWT and MFCC. Our model has achieved an accuracy of 97.41 and an F1 score of 88.20 on a processed version of the MIT-BIH dataset and takes on an average 7.93 times less calculations compared to a simple 2D Convolution model.

scholarly journals Classification of Skin cancer using deep learning, Convolutional Neural Networks - Opportunities and vulnerabilities- A systematic Review

2020 ◽  
Vol 6 (11) ◽  
pp. 101-108
Author(s):  
Ravi Manne, Snigdha Kantheti and Sneha Kantheti
Keyword(s):  
Machine Learning ◽  
Neural Networks ◽  
Deep Learning ◽  
Skin Cancer ◽  
Convolutional Neural Networks ◽  
Skin Lesions ◽  
Misclassification Rate ◽  
Research Articles ◽  
Original Research ◽  
Cancer Type

Background: Skin cancer classificationusing convolutional neural networks (CNNs) proved better results in classifying skin lesions compared with dermatologists which is lifesaving in terms of diagnosing. This will help people diagnosetheir cancer on their own by just installing app on mobile devices. It is estimated that 6.3 billion people will use the subscriptions by the end of year 2021[28] for diagnosing their skin cancer. Objective: This study represents review of many research articles on classifying skin lesions using CNNs. With the recent enhancement in machine learning algorithms, misclassification rate of skin lesions has reduced compared to a dermatologist classifying them.In this article we discuss how using CNNs has evolved in successfully classifying skin cancer type, and methods implemented, and the success rate. Even though Deep learning using CNN has advantages compared to a dermatologist, it also has some vulnerabilities, in terms of misclassifying images under some Criteria, and situations. We also discuss about those Vulnerabilities in this review study. Methods: We searched theScienceDirect, PubMed,Elsevier, Web of Science databases and Google Scholar for original research articles that are published. We selected papers that have sufficient data and information regarding their research, and we created a review on their approaches and methods they have used. From the articles we searched online So far no review paper has discussed both opportunities and vulnerabilities that existed in skin cancer classification using deep learning. Conclusions: The improvements in machine learning, Deep learning techniques, can avoid human mistakes that could be possible in misclassifying and diagnosing the disease. We will discuss, how Deep learning using CNN helped us and its vulnerabilities.

scholarly journals Deep convolutional neural networks for cardiovascular vulnerable plaque detection

2019 ◽  
Vol 277 ◽  
pp. 02024 ◽  
Author(s):  
Lincan Li ◽  
Tong Jia ◽  
Tianqi Meng ◽  
Yizhe Liu
Keyword(s):  
Neural Networks ◽  
Deep Learning ◽  
Convolutional Neural Networks ◽  
Vulnerable Plaque ◽  
Recall Rate ◽  
Superior Performance ◽  
Learning Approaches ◽  
Deep Convolutional Neural Networks ◽  
Vulnerable Plaques ◽  
Plaque Detection

In this paper, an accurate two-stage deep learning method is proposed to detect vulnerable plaques in ultrasonic images of cardiovascular. Firstly, a Fully Convonutional Neural Network (FCN) named U-Net is used to segment the original Intravascular Optical Coherence Tomography (IVOCT) cardiovascular images. We experiment on different threshold values to find the best threshold for removing noise and background in the original images. Secondly, a modified Faster RCNN is adopted to do precise detection. The modified Faster R-CNN utilize six-scale anchors (122,162,322,642,1282,2562) instead of the conventional one scale or three scale approaches. First, we present three problems in cardiovascular vulnerable plaque diagnosis, then we demonstrate how our method solve these problems. The proposed method in this paper apply deep convolutional neural networks to the whole diagnostic procedure. Test results show the Recall rate, Precision rate, IoU (Intersection-over-Union) rate and Total score are 0.94, 0.885, 0.913 and 0.913 respectively, higher than the 1st team of CCCV2017 Cardiovascular OCT Vulnerable Plaque Detection Challenge. AP of the designed Faster RCNN is 83.4%, higher than conventional approaches which use one-scale or three-scale anchors. These results demonstrate the superior performance of our proposed method and the power of deep learning approaches in diagnose cardiovascular vulnerable plaques.

Sign in / Sign up

Export Citation Format

Share Document