scholarly journals Clinical Validation of Saliency Maps for Understanding Deep Neural Networks in Ophthalmology

2021 ◽  
Author(s):  
Murat Seckin Ayhan ◽  
Louis Benedikt Kuemmerle ◽  
Laura Kuehlewein ◽  
Werner Inhoffen ◽  
Gulnar Aliyeva ◽  
...  
Keyword(s):  
Neural Networks ◽  
Deep Neural Networks ◽  
Age Related Macular Degeneration ◽  
Retinal Images ◽  
Saliency Maps ◽  
Age Related ◽  
Starting Point ◽  
Medical Diagnostic ◽  
Decision Mechanisms

Deep neural networks (DNNs) have achieved physician-level accuracy on many imaging-based medical diagnostic tasks, for example classification of retinal images in ophthalmology. However, their decision mechanisms are often considered impenetrable leading to a lack of trust by clinicians and patients. To alleviate this issue, a range of explanation methods have been proposed to expose the inner workings of DNNs leading to their decisions. For imaging-based tasks, this is often achieved via saliency maps. The quality of these maps are typically evaluated via perturbation analysis without experts involved. To facilitate the adoption and success of such automated systems, however, it is crucial to validate saliency maps against clinicians. In this study, we used two different network architectures and developed ensembles of DNNs to detect diabetic retinopathy and neovascular age-related macular degeneration from retinal fundus images and optical coherence tomography scans, respectively. We used a variety of explanation methods and obtained a comprehensive set of saliency maps for explaining the ensemble-based diagnostic decisions. Then, we systematically validated saliency maps against clinicians through two main analyses --- a direct comparison of saliency maps with the expert annotations of disease-specific pathologies and perturbation analyses using also expert annotations as saliency maps. We found the choice of DNN architecture and explanation method to significantly influence the quality of saliency maps. Guided Backprop showed consistently good performance across disease scenarios and DNN architectures, suggesting that it provides a suitable starting point for explaining the decisions of DNNs on retinal images.

A novel deep learning technique for analysis and detection of ARMD using OCT scan images

2021 ◽  
Vol 25 (3) ◽  
pp. 335-342
Author(s):  
P.V.G.D. Prasad Reddy
Keyword(s):  
Neural Network ◽  
Neural Networks ◽  
Deep Learning ◽  
Visual Imagery ◽  
Active Contour ◽  
Deep Neural Networks ◽  
Age Related Macular Degeneration ◽  
Age Related ◽  
Learning Technique ◽  
Medical Situation

Age-Related Macular Degeneration (ARMD) is a medical situation resulting in blurred or no vision in the middle of the eye view. Though this disease doesn’t make the person completely blind, it makes it very difficult for the person to perform day to day activities like reading, driving, recognizing people etc. This paper aims to detect ARMD though Optical Coherence Tomography (OCT) scans where the drusen in the macula is detected and identify the infected. The images are first passed though Directional Total Variation (DTV) Denoising followed by Active contour algorithm to mark the boundaries of the layers in macula. In deep learning, a convolutional neural network is a class of deep neural networks, most commonly applied to analyzing visual imagery. Then these images categorized as healthy and infected using Convolution Neural Network. Different CNN variant algorithms like Alexnet, VggNet and GoogleNet have been compared in the experiments and the results obtained are better compared to traditional methods.

scholarly journals Development of a Fundus Image-Based Deep Learning Diagnostic Tool for Various Retinal Diseases

2021 ◽  
Vol 11 (5) ◽  
pp. 321
Author(s):  
Kyoung Min Kim ◽  
Tae-Young Heo ◽  
Aesul Kim ◽  
Joohee Kim ◽  
Kyu Jin Han ◽  
...  
Keyword(s):  
Network Models ◽  
Retinal Disease ◽  
Age Related Macular Degeneration ◽  
Diagnostic Tools ◽  
Retinal Images ◽  
Dense Layer ◽  
Retinal Diseases ◽  
Fundus Image ◽  
Neural Network Models ◽  
Age Related

Artificial intelligence (AI)-based diagnostic tools have been accepted in ophthalmology. The use of retinal images, such as fundus photographs, is a promising approach for the development of AI-based diagnostic platforms. Retinal pathologies usually occur in a broad spectrum of eye diseases, including neovascular or dry age-related macular degeneration, epiretinal membrane, rhegmatogenous retinal detachment, retinitis pigmentosa, macular hole, retinal vein occlusions, and diabetic retinopathy. Here, we report a fundus image-based AI model for differential diagnosis of retinal diseases. We classified retinal images with three convolutional neural network models: ResNet50, VGG19, and Inception v3. Furthermore, the performance of several dense (fully connected) layers was compared. The prediction accuracy for diagnosis of nine classes of eight retinal diseases and normal control was 87.42% in the ResNet50 model, which added a dense layer with 128 nodes. Furthermore, our AI tool augments ophthalmologist’s performance in the diagnosis of retinal disease. These results suggested that the fundus image-based AI tool is applicable for the medical diagnosis process of retinal diseases.

scholarly journals Semiotic Aggregation in Deep Learning

Entropy ◽  
2020 ◽  
Vol 22 (12) ◽  
pp. 1365
Author(s):  
Bogdan Muşat ◽  
Răzvan Andonie
Keyword(s):  
Neural Network ◽  
Neural Networks ◽  
Deep Learning ◽  
Decision Model ◽  
Deep Neural Networks ◽  
Neural Model ◽  
Network Layers ◽  
Saliency Maps ◽  
Spatial Entropy ◽  
Insight Into

Convolutional neural networks utilize a hierarchy of neural network layers. The statistical aspects of information concentration in successive layers can bring an insight into the feature abstraction process. We analyze the saliency maps of these layers from the perspective of semiotics, also known as the study of signs and sign-using behavior. In computational semiotics, this aggregation operation (known as superization) is accompanied by a decrease of spatial entropy: signs are aggregated into supersign. Using spatial entropy, we compute the information content of the saliency maps and study the superization processes which take place between successive layers of the network. In our experiments, we visualize the superization process and show how the obtained knowledge can be used to explain the neural decision model. In addition, we attempt to optimize the architecture of the neural model employing a semiotic greedy technique. To the extent of our knowledge, this is the first application of computational semiotics in the analysis and interpretation of deep neural networks.

scholarly journals Improving Efficiency in Separating Blood Vessels from Retinal Images with Deep Learning Techniques

2019 ◽  
Vol 8 (2S11) ◽  
pp. 3637-3640
Keyword(s):  
Diabetic Retinopathy ◽  
Deep Learning ◽  
Macular Degeneration ◽  
Blood Vessels ◽  
Age Related Macular Degeneration ◽  
Retinal Images ◽  
Retinal Vessels ◽  
Age Related ◽  
Learning Techniques ◽  
Retinal Pathologies

Retinal vessels ID means to isolate the distinctive retinal configuration issues, either wide or restricted from fundus picture foundation, for example, optic circle, macula, and unusual sores. Retinal vessels recognizable proof investigations are drawing in increasingly more consideration today because of pivotal data contained in structure which is helpful for the identification and analysis of an assortment of retinal pathologies included yet not restricted to: Diabetic Retinopathy (DR), glaucoma, hypertension, and Age-related Macular Degeneration (AMD). With the advancement of right around two decades, the inventive methodologies applying PC supported systems for portioning retinal vessels winding up increasingly significant and coming nearer. Various kinds of retinal vessels segmentation strategies discussed by using Deep Learning methods. At that point, the pre-processing activities and the best in class strategies for retinal vessels distinguishing proof are presented.

scholarly journals Label Distribution for Learning with Noisy Labels

2020 ◽  
Author(s):  
Yun-Peng Liu ◽  
Ning Xu ◽  
Yu Zhang ◽  
Xin Geng
Keyword(s):  
Neural Networks ◽  
Deep Neural Networks ◽  
Learning Algorithm ◽  
State Of The Art ◽  
Confidence Estimation ◽  
Novel Method ◽  
Real World Datasets ◽  
Label Distribution ◽  
Noisy Labels

The performances of deep neural networks (DNNs) crucially rely on the quality of labeling. In some situations, labels are easily corrupted, and therefore some labels become noisy labels. Thus, designing algorithms that deal with noisy labels is of great importance for learning robust DNNs. However, it is difficult to distinguish between clean labels and noisy labels, which becomes the bottleneck of many methods. To address the problem, this paper proposes a novel method named Label Distribution based Confidence Estimation (LDCE). LDCE estimates the confidence of the observed labels based on label distribution. Then, the boundary between clean labels and noisy labels becomes clear according to confidence scores. To verify the effectiveness of the method, LDCE is combined with the existing learning algorithm to train robust DNNs. Experiments on both synthetic and real-world datasets substantiate the superiority of the proposed algorithm against state-of-the-art methods.

Sign in / Sign up

Export Citation Format

Share Document