scholarly journals Dense Tissue Pattern Characterization Using Deep Neural Network

2022 ◽  
Author(s):  
Indrajeet Kumar ◽  
Abhishek Kumar ◽  
V D Ambeth Kumar ◽  
Ramani Kannan ◽  
Vrince Vimal ◽  
...  
Keyword(s):  
Neural Network ◽  
Deep Neural Network ◽  
Data Augmentation ◽  
Breast Tumors ◽  
Activation Function ◽  
Kappa Coefficient ◽  
Proposed Model ◽  
Proper Training ◽  
Kappa Value ◽  
Dense Tissue

AbstractBreast tumors are from the common infections among women around the world. Classifying the various types of breast tumors contribute to treating breast tumors more efficiently. However, this classification task is often hindered by dense tissue patterns captured in mammograms. The present study has been proposed a dense tissue pattern characterization framework using deep neural network. A total of 322 mammograms belonging to the mini-MIAS dataset and 4880 mammograms from DDSM dataset have been taken, and an ROI of fixed size 224 × 224 pixels from each mammogram has been extracted. In this work, tedious experimentation has been executed using different combinations of training and testing sets using different activation function with AlexNet, ResNet-18 model. Data augmentation has been used to create a similar type of virtual image for proper training of the DL model. After that, the testing set is applied on the trained model to validate the proposed model. During experiments, four different activation functions ‘sigmoid’, ‘tanh’, ‘ReLu’, and ‘leakyReLu’ are used, and the outcome for each function has been reported. It has been found that activation function ‘ReLu’ perform always outstanding with respect to others. For each experiment, classification accuracy and kappa coefficient have been computed. The obtained accuracy and kappa value for MIAS dataset using ResNet-18 model is 91.3% and 0.803, respectively. For DDSM dataset, the accuracy of 92.3% and kappa coefficient value of 0.846 are achieved. After the combination of both dataset images, the achieved accuracy is 91.9%, and kappa coefficient value is 0.839 using ResNet-18 model. Finally, it has been concluded that the ResNet-18 model and ReLu activation function yield outstanding performance for the task.

scholarly journals An efficient technique for CT scan images classification of COVID-19

2020 ◽  
pp. 1-14
Author(s):  
Esraa Hassan ◽  
Noha A. Hikal ◽  
Samir Elmuogy
Keyword(s):  
Neural Network ◽  
Diagnostic Tool ◽  
Deep Neural Network ◽  
Data Augmentation ◽  
Performance Metrics ◽  
Classification Model ◽  
Data Set ◽  
Training Models ◽  
The Earth ◽  
Diagnostic Time

Nowadays, Coronavirus (COVID-19) considered one of the most critical pandemics in the earth. This is due its ability to spread rapidly between humans as well as animals. COVID_19 expected to outbreak around the world, around 70 % of the earth population might infected with COVID-19 in the incoming years. Therefore, an accurate and efficient diagnostic tool is highly required, which the main objective of our study. Manual classification was mainly used to detect different diseases, but it took too much time in addition to the probability of human errors. Automatic image classification reduces doctors diagnostic time, which could save human’s life. We propose an automatic classification architecture based on deep neural network called Worried Deep Neural Network (WDNN) model with transfer learning. Comparative analysis reveals that the proposed WDNN model outperforms by using three pre-training models: InceptionV3, ResNet50, and VGG19 in terms of various performance metrics. Due to the shortage of COVID-19 data set, data augmentation was used to increase the number of images in the positive class, then normalization used to make all images have the same size. Experimentation is done on COVID-19 dataset collected from different cases with total 2623 where (1573 training,524 validation,524 test). Our proposed model achieved 99,046, 98,684, 99,119, 98,90 In terms of Accuracy, precision, Recall, F-score, respectively. The results are compared with both the traditional machine learning methods and those using Convolutional Neural Networks (CNNs). The results demonstrate the ability of our classification model to use as an alternative of the current diagnostic tool.

Breast cancer diagnosis using multiple activation deep neural network

2021 ◽  
pp. 1063293X2110251
Author(s):  
K Vijayakumar ◽  
Vinod J Kadam ◽  
Sudhir Kumar Sharma
Keyword(s):  
Breast Cancer ◽  
Neural Network ◽  
Deep Neural Network ◽  
Breast Cancer Diagnosis ◽  
Activation Function ◽  
Linear Functions ◽  
Cancer Data ◽  
Final Layer ◽  
Improved Performance ◽  
Hidden Layer

Deep Neural Network (DNN) stands for multilayered Neural Network (NN) that is capable of progressively learn the more abstract and composite representations of the raw features of the input data received, with no need for any feature engineering. They are advanced NNs having repetitious hidden layers between the initial input and the final layer. The working principle of such a standard deep classifier is based on a hierarchy formed by the composition of linear functions and a defined nonlinear Activation Function (AF). It remains uncertain (not clear) how the DNN classifier can function so well. But it is clear from many studies that within DNN, the AF choice has a notable impact on the kinetics of training and the success of tasks. In the past few years, different AFs have been formulated. The choice of AF is still an area of active study. Hence, in this study, a novel deep Feed forward NN model with four AFs has been proposed for breast cancer classification: hidden layer 1: Swish, hidden layer, 2:-LeakyReLU, hidden layer 3: ReLU, and final output layer: naturally Sigmoidal. The purpose of the study is twofold. Firstly, this study is a step toward a more profound understanding of DNN with layer-wise different AFs. Secondly, research is also aimed to explore better DNN-based systems to build predictive models for breast cancer data with improved accuracy. Therefore, the benchmark UCI dataset WDBC was used for the validation of the framework and evaluated using a ten-fold CV method and various performance indicators. Multiple simulations and outcomes of the experimentations have shown that the proposed solution performs in a better way than the Sigmoid, ReLU, and LeakyReLU and Swish activation DNN in terms of different parameters. This analysis contributes to producing an expert and precise clinical dataset classification method for breast cancer. Furthermore, the model also achieved improved performance compared to many established state-of-the-art algorithms/models.

scholarly journals Robust Approach to Supervised Deep Neural Network Training for Real-Time Object Classification in Cluttered Indoor Environment

2021 ◽  
Vol 11 (15) ◽  
pp. 7148
Author(s):  
Bedada Endale ◽  
Abera Tullu ◽  
Hayoung Shi ◽  
Beom-Soo Kang
Keyword(s):  
Neural Network ◽  
Deep Learning ◽  
Real Time ◽  
Network Architecture ◽  
Input Data ◽  
Deep Neural Network ◽  
Data Augmentation ◽  
Object Classification ◽  
Training Data ◽  
Gradient Descent Algorithm

Unmanned aerial vehicles (UAVs) are being widely utilized for various missions: in both civilian and military sectors. Many of these missions demand UAVs to acquire artificial intelligence about the environments they are navigating in. This perception can be realized by training a computing machine to classify objects in the environment. One of the well known machine training approaches is supervised deep learning, which enables a machine to classify objects. However, supervised deep learning comes with huge sacrifice in terms of time and computational resources. Collecting big input data, pre-training processes, such as labeling training data, and the need for a high performance computer for training are some of the challenges that supervised deep learning poses. To address these setbacks, this study proposes mission specific input data augmentation techniques and the design of light-weight deep neural network architecture that is capable of real-time object classification. Semi-direct visual odometry (SVO) data of augmented images are used to train the network for object classification. Ten classes of 10,000 different images in each class were used as input data where 80% were for training the network and the remaining 20% were used for network validation. For the optimization of the designed deep neural network, a sequential gradient descent algorithm was implemented. This algorithm has the advantage of handling redundancy in the data more efficiently than other algorithms.

scholarly journals Deep Neural Network for Predicting Diabetic Retinopathy from Risk Factors

Mathematics ◽  
2020 ◽  
Vol 8 (9) ◽  
pp. 1620 ◽  
Author(s):  
Ganjar Alfian ◽  
Muhammad Syafrudin ◽  
Norma Latif Fitriyani ◽  
Muhammad Anshari ◽  
Pavel Stasa ◽  
...  
Keyword(s):  
Neural Network ◽  
Machine Learning ◽  
Risk Factors ◽  
Diabetic Retinopathy ◽  
Prediction Model ◽  
Deep Neural Network ◽  
Early Stage ◽  
Individual Risk ◽  
Proposed Model ◽  
Individual Risk Factors

Extracting information from individual risk factors provides an effective way to identify diabetes risk and associated complications, such as retinopathy, at an early stage. Deep learning and machine learning algorithms are being utilized to extract information from individual risk factors to improve early-stage diagnosis. This study proposes a deep neural network (DNN) combined with recursive feature elimination (RFE) to provide early prediction of diabetic retinopathy (DR) based on individual risk factors. The proposed model uses RFE to remove irrelevant features and DNN to classify the diseases. A publicly available dataset was utilized to predict DR during initial stages, for the proposed and several current best-practice models. The proposed model achieved 82.033% prediction accuracy, which was a significantly better performance than the current models. Thus, important risk factors for retinopathy can be successfully extracted using RFE. In addition, to evaluate the proposed prediction model robustness and generalization, we compared it with other machine learning models and datasets (nephropathy and hypertension–diabetes). The proposed prediction model will help improve early-stage retinopathy diagnosis based on individual risk factors.

Challenging the Recognition of Facial Expression via Deep Learning

2014 ◽  
Vol 571-572 ◽  
pp. 717-720
Author(s):  
De Kun Hu ◽  
Yong Hong Liu ◽  
Li Zhang ◽  
Gui Duo Duan
Keyword(s):  
Neural Network ◽  
Facial Expression ◽  
Gradient Descent ◽  
Deep Neural Network ◽  
Back Propagation ◽  
Stochastic Gradient Descent ◽  
Excellent Performance ◽  
Proposed Model ◽  
Input Layer ◽  
Fully Connected

A deep Neural Network model was trained to classify the facial expression in unconstrained images, which comprises nine layers, including input layer, convolutional layer, pooling layer, fully connected layers and output layer. In order to optimize the model, rectified linear units for the nonlinear transformation, weights sharing for reducing the complexity, “mean” and “max” pooling for subsample, “dropout” for sparsity are applied in the forward processing. With large amounts of hard training faces, the model was trained via back propagation method with stochastic gradient descent. The results of shows the proposed model achieves excellent performance.

scholarly journals Polytechnic Students’ Academic Performance Prediction Based On Using Deep Neural Network

2021 ◽  
pp. 1-11
Author(s):  
S. M. Abdullah Al Shuaeb ◽  
Shamsul Alam ◽  
Md. Mizanur Rahman ◽  
Md. Abdul Matin
Keyword(s):  
Neural Network ◽  
Academic Performance ◽  
Performance Prediction ◽  
Deep Neural Network ◽  
Huge Amount ◽  
Novel Technique ◽  
Student Academic Performance ◽  
Academic Activities ◽  
Proposed Model ◽  
Prediction Systems

Students’ academic achievement plays a significant role in the polytechnic institute. It is an important task for the technical student to achieve good results. It becomes more challenging by virtue of the huge amount of data in the polytechnic student databases. Recently, the lack of monitoring of academic activities and their performance has not been harnessed. This is not a good way to evaluate the academic performance of polytechnic students in Bangladesh at present. The study on existing academic prediction systems is still not enough for the polytechnic institutions. Consequently, we have proposed a novel technique to improve student academic performance. In this study, we have used the deep neural network for predicting students' academic final marks. The main objective of this paper is to improve students' results. This paper also explains how the prediction deep neural network model can be used to recognize the most vital attributes in a student's academic data namely midterm_marks, class_ test, attendance, assignment, and target_ marks. By using the proposed model, we can more effectively improve polytechnic student achievement and success.

scholarly journals SIMULATION-BASED DATA AUGMENTATION USING PHYSICAL PRIORS FOR NOISE FILTERING DEEP NEURAL NETWORK

2020 ◽  
Vol XLIII-B2-2020 ◽  
pp. 247-254
Author(s):  
M. Jameela ◽  
L. Chen ◽  
A. Sit ◽  
J. Yoo ◽  
C. Verheggen ◽  
...  
Keyword(s):  
Neural Network ◽  
Deep Neural Network ◽  
Data Augmentation ◽  
Pulse Repetition Frequency ◽  
Single Pulse ◽  
Airborne Lidar ◽  
Noise Filtering ◽  
Learning Networks ◽  
Simulation Based ◽  
Multiple Pulses

Abstract. LiDAR (Light Detection and Ranging) mounted with static and mobile vehicles has been rapidly adopted as a primary sensor for mapping natural and built environments for a range of civil and military applications. Recently, technology advancement in electro-optical engineering enables acquiring laser returns at high pulse repetition frequency (PRF) from 100Hz to 2MHz for airborne LiDAR, which leads to an increase in the density of 3D point cloud significantly. Traditional systems with lower PRF had a single pulse-in-air zone (PIA) big enough to avoid a mismatch between pulse pair at the receiver. Modern multiple pulses-in-air (MPIA) technology ensures multiple windows of operational ranges for single flight line and no blind-zones; downside of the technology is projection of atmospheric returns closer to same PIA zone of neighbouring ground points and more likely to be overlapping with objects of interest. These characteristics of noise compromise the quality of the scene and encourage usage of noise filtering neural network as existing filters are not effective. A noise filtering deep neural network requires a considerable volume of the diverse annotated dataset, which is expensive. We developed simulation for data augmentation based on physical priors and Gaussian generative function. Our study compares deep learning networks for noise filtering and shows performance gain on 3D U-Net. Then, we evaluate 3D U-Net for simulation-based data augmentation, which shows an increase in precision and F1-score. We also provide an analysis of the underline spatial distribution of points and their impact on data augmentation, and noise filtering.

Sign in / Sign up

Export Citation Format

Share Document