scholarly journals Pre-trained deep learning models in automatic COVID-19 diagnosis

2021 ◽  
Vol 22 (3) ◽  
pp. 1540
Author(s):  
Ahmed Wasif Reza ◽  
Md Mahamudul Hasan ◽  
Nazla Nowrin ◽  
Mir Moynuddin Ahmed Shibly
Keyword(s):  
Deep Learning ◽  
Open Source ◽  
Healthcare Professionals ◽  
Automated System ◽  
Primary Concern ◽  
X Rays ◽  
Learning Models ◽  
Efficient System ◽  
Empirical Results ◽  
History Of

Coronavirus Disease (COVID-19) is a devastating pandemic in the history of mankind. It is a highly contagious flu that can spread from human to human without revealing any symptoms. For being so contagious, detecting patients with it and isolating them has become the primary concern for healthcare professionals. This study presented an alternative way to identify COVID-19 patients by doing an automatic examination of chest X-rays of the patients. To develop such an efficient system, six pre-trained deep learning models were used. Those models were: VGG16, InceptionV3, Xception, DenseNet201, InceptionResNetV2, and EfficientNetB4. Those models were developed on two open-source datasets that have chest X-rays of patients diagnosed with COVID-19. Among the models, EfficientNetB4 achieved better performances on both datasets with 96% and 97% of accuracies. The empirical results were also exemplary. This type of automated system can help us fight this dangerous virus outbreak.

scholarly journals KeyNet: An Asymmetric Key-Style Framework for Watermarking Deep Learning Models

2021 ◽  
Vol 11 (3) ◽  
pp. 999
Author(s):  
Najeeb Moharram Jebreel ◽  
Josep Domingo-Ferrer ◽  
David Sánchez ◽  
Alberto Blanco-Justicia
Keyword(s):  
Deep Learning ◽  
Intellectual Property ◽  
High Fidelity ◽  
Data Sets ◽  
Learning Models ◽  
Robust Watermarking ◽  
Empirical Results ◽  
Private Key ◽  
Extensive Evaluation ◽  
Original Classification

Many organizations devote significant resources to building high-fidelity deep learning (DL) models. Therefore, they have a great interest in making sure the models they have trained are not appropriated by others. Embedding watermarks (WMs) in DL models is a useful means to protect the intellectual property (IP) of their owners. In this paper, we propose KeyNet, a novel watermarking framework that satisfies the main requirements for an effective and robust watermarking. In KeyNet, any sample in a WM carrier set can take more than one label based on where the owner signs it. The signature is the hashed value of the owner’s information and her model. We leverage multi-task learning (MTL) to learn the original classification task and the watermarking task together. Another model (called the private model) is added to the original one, so that it acts as a private key. The two models are trained together to embed the WM while preserving the accuracy of the original task. To extract a WM from a marked model, we pass the predictions of the marked model on a signed sample to the private model. Then, the private model can provide the position of the signature. We perform an extensive evaluation of KeyNet’s performance on the CIFAR10 and FMNIST5 data sets and prove its effectiveness and robustness. Empirical results show that KeyNet preserves the utility of the original task and embeds a robust WM.

Open-source deep learning models for acoustic detection and classification of orcas

2021 ◽  
Vol 150 (4) ◽  
pp. A286-A286
Author(s):  
Sadman Sakib ◽  
Steven Bergner ◽  
Dave Campbell ◽  
Mike Dowd ◽  
Fabio Frazao ◽  
...  
Keyword(s):  
Deep Learning ◽  
Open Source ◽  
Acoustic Detection ◽  
Learning Models

scholarly journals Advancements in Deep Learning Theory and Applications: Perspective in 2020 and beyond

2020 ◽  
Author(s):  
Md Nazmus Saadat ◽  
Muhammad Shuaib
Keyword(s):  
Deep Learning ◽  
Open Source ◽  
Language Processing ◽  
Future Research ◽  
Learning In Context ◽  
Postgraduate Students ◽  
History Of ◽  
Learning Platforms ◽  
Future Research Directions ◽  
Learning Machine

The aim of this chapter is to introduce newcomers to deep learning, deep learning platforms, algorithms, applications, and open-source datasets. This chapter will give you a broad overview of the term deep learning, in context to deep learning machine learning, and Artificial Intelligence (AI) is also introduced. In Introduction, there is a brief overview of the research achievements of deep learning. After Introduction, a brief history of deep learning has been also discussed. The history started from a famous scientist called Allen Turing (1951) to 2020. In the start of a chapter after Introduction, there are some commonly used terminologies, which are used in deep learning. The main focus is on the most recent applications, the most commonly used algorithms, modern platforms, and relevant open-source databases or datasets available online. While discussing the most recent applications and platforms of deep learning, their scope in future is also discussed. Future research directions are discussed in applications and platforms. The natural language processing and auto-pilot vehicles were considered the state-of-the-art application, and these applications still need a good portion of further research. Any reader from undergraduate and postgraduate students, data scientist, and researchers would be benefitted from this.

scholarly journals Detecting Coronavirus from Chest X-rays Using Transfer Learning

COVID ◽  
2021 ◽  
Vol 1 (1) ◽  
pp. 403-415
Author(s):  
Abeer Badawi ◽  
Khalid Elgazzar
Keyword(s):  
Deep Learning ◽  
Binary Classification ◽  
Healthcare Providers ◽  
Large Set ◽  
X Rays ◽  
Learning Models ◽  
X Ray ◽  
Chest X Ray ◽  
Multi Class Classification ◽  
Novel Coronavirus

Coronavirus disease (COVID-19) is an illness caused by a novel coronavirus family. One of the practical examinations for COVID-19 is chest radiography. COVID-19 infected patients show abnormalities in chest X-ray images. However, examining the chest X-rays requires a specialist with high experience. Hence, using deep learning techniques in detecting abnormalities in the X-ray images is presented commonly as a potential solution to help diagnose the disease. Numerous research has been reported on COVID-19 chest X-ray classification, but most of the previous studies have been conducted on a small set of COVID-19 X-ray images, which created an imbalanced dataset and affected the performance of the deep learning models. In this paper, we propose several image processing techniques to augment COVID-19 X-ray images to generate a large and diverse dataset to boost the performance of deep learning algorithms in detecting the virus from chest X-rays. We also propose innovative and robust deep learning models, based on DenseNet201, VGG16, and VGG19, to detect COVID-19 from a large set of chest X-ray images. A performance evaluation shows that the proposed models outperform all existing techniques to date. Our models achieved 99.62% on the binary classification and 95.48% on the multi-class classification. Based on these findings, we provide a pathway for researchers to develop enhanced models with a balanced dataset that includes the highest available COVID-19 chest X-ray images. This work is of high interest to healthcare providers, as it helps to better diagnose COVID-19 from chest X-rays in less time with higher accuracy.

scholarly journals Automated Analysis of Three-dimensional CBCT Images Taken in Natural Head Position That Combines Facial Profile Processing and Multiple Deep-learning Models

2021 ◽  
Author(s):  
Janghoon Ahn ◽  
Thong Phi Nguyen ◽  
Yoon-Ji Kim ◽  
Taeyong Kim ◽  
Jonghun Yoon
Keyword(s):  
Deep Learning ◽  
Profile Analysis ◽  
Traditional Approach ◽  
Three Dimensional ◽  
Image Data ◽  
Automated Analysis ◽  
Head Position ◽  
X Rays ◽  
Learning Models ◽  
Facial Profile

Abstract Analysing cephalometric X-rays, which is mostly performed by orthodontists or dentists, is an indispensable procedure for diagnosis and treatment planning with orthodontic patients. Artificial intelligence, especially deep-learning techniques for analysing image data, shows great potential for medical and dental image analysis and diagnosis. To explore the feasibility of automating measurement of 13 geometric parameters from three-dimensional cone beam computed tomography (CBCT) images taken in a natural head position, we here describe a smart system that combines a facial profile analysis algorithm with deep-learning models. Using multiple views extracted from the CBCT data as the dataset, our proposed method partitions and detects regions of interest by extracting the facial profile and applying Mask-RCNN, a trained decentralized convolutional neural network (CNN) that positions the key parameters. All the techniques are integrated into a software application with a graphical user interface designed for user convenience. To demonstrate the system’s ability to replace human experts, we validated the performance of the proposed method by comparing it with measurements made by two orthodontists and one advanced general dentist using a commercial dental program. The time savings compared with the traditional approach was remarkable, reducing the processing time from about 30 minutes to about 30 seconds.

scholarly journals Efficient Pneumonia Detection in Chest Xray Images Using Deep Transfer Learning

Diagnostics ◽  
2020 ◽  
Vol 10 (6) ◽  
pp. 417 ◽  
Author(s):  
Mohammad Farukh Hashmi ◽  
Satyarth Katiyar ◽  
Avinash G Keskar ◽  
Neeraj Dhanraj Bokde ◽  
Zong Woo Geem
Keyword(s):  
Deep Learning ◽  
Transfer Learning ◽  
Data Augmentation ◽  
Medical Center ◽  
Training Dataset ◽  
Test Accuracy ◽  
X Rays ◽  
Learning Models ◽  
Novel Approach ◽  
Unseen Data

Pneumonia causes the death of around 700,000 children every year and affects 7% of the global population. Chest X-rays are primarily used for the diagnosis of this disease. However, even for a trained radiologist, it is a challenging task to examine chest X-rays. There is a need to improve the diagnosis accuracy. In this work, an efficient model for the detection of pneumonia trained on digital chest X-ray images is proposed, which could aid the radiologists in their decision making process. A novel approach based on a weighted classifier is introduced, which combines the weighted predictions from the state-of-the-art deep learning models such as ResNet18, Xception, InceptionV3, DenseNet121, and MobileNetV3 in an optimal way. This approach is a supervised learning approach in which the network predicts the result based on the quality of the dataset used. Transfer learning is used to fine-tune the deep learning models to obtain higher training and validation accuracy. Partial data augmentation techniques are employed to increase the training dataset in a balanced way. The proposed weighted classifier is able to outperform all the individual models. Finally, the model is evaluated, not only in terms of test accuracy, but also in the AUC score. The final proposed weighted classifier model is able to achieve a test accuracy of 98.43% and an AUC score of 99.76 on the unseen data from the Guangzhou Women and Children’s Medical Center pneumonia dataset. Hence, the proposed model can be used for a quick diagnosis of pneumonia and can aid the radiologists in the diagnosis process.

scholarly journals CReM: chemically reasonable mutations framework for structure generation

2020 ◽  
Author(s):  
Pavel Polishchuk
Keyword(s):  
Deep Learning ◽  
Open Source ◽  
De Novo ◽  
De Novo Design ◽  
Learning Models ◽  
Structure Generation ◽  
Design Studies ◽  
Flexible Control

Abstract Structure generators are widely used in de novo design studies and their performance substantially influences an outcome. Approaches based on deep learning models and conventional atom-based approaches may result in invalid structures and did not address their synthetic feasibility issues. Conventional reaction-based approaches result in synthetically feasible compounds but novelty and diversity of generated compounds may be limited. Fragment-based approaches can provide better novelty and diversity of generated compounds but the issue of synthetic complexity of generated structure was not explicitly addressed before. Here, we developed a new fragment-based approach which results in chemically valid structures by design and gives flexible control over diversity, novelty, synthetic complexity and chemotypes of generated compounds. The approach was implemented as an open-source Python module.

scholarly journals A study of code change patterns for adaptive maintenance with AST analysis

2020 ◽  
Vol 10 (3) ◽  
pp. 2719
Author(s):  
Omar Meqdadi ◽  
Shadi Aljawarneh
Keyword(s):  
Open Source ◽  
Software Evolution ◽  
Source Code ◽  
Transformation Rule ◽  
Primary Concern ◽  
Adaptive Changes ◽  
Code Change ◽  
History Of ◽  
Code Changes ◽  
Open Source Systems

Example-based transformational approaches to automate adaptive maintenance changes plays an important role in software research. One primary concern of those approaches is that a set of good qualified real examples of adaptive changes previously made in the history must be identified, or otherwise the adoption of such approaches will be put in question. Unfortunately, there is rarely enough detail to clearly direct transformation rule developers to overcome the barrier of finding qualified examples for adaptive changes. This work explores the histories of several open source systems to study the repetitiveness of adaptive changes in software evolution, and hence recognizing the source code change patterns that are strongly related with the adaptive maintenance. We collected the adaptive commits from the history of numerous open source systems, then we obtained the repetitiveness frequencies of source code changes based on the analysis of Abstract Syntax Tree (AST) edit actions within an adaptive commit. Using the prevalence of the most common adaptive changes, we suggested a set of change patterns that seem correlated with adaptive maintenance. It is observed that 76.93% of the undertaken adaptive changes were represented by 12 AST code differences. Moreover, only 9 change patterns covered 64.69% to 76.58% of the total adaptive change hunks in the examined projects. The most common individual patterns are related to initializing objects and method calls changes. A correlation analysis on examined projects shows that they have very similar frequencies of the patterns correlated with adaptive changes. The observed repeated adaptive changes could be useful examples for the construction of transformation approaches

scholarly journals Shallow Convolutional Neural Network for COVID-19 Outbreak Screening using Chest X-rays

2020 ◽  
Author(s):  
Himadri Mukherjee ◽  
Subhankar Ghosh ◽  
Ankita Dhar ◽  
Sk. Md. Obaidullah ◽  
KC Santosh ◽  
...  
Keyword(s):  
Neural Network ◽  
Deep Learning ◽  
Convolutional Neural Network ◽  
Mass Screening ◽  
False Positive ◽  
False Positive Rate ◽  
Experimental Tests ◽  
X Rays ◽  
Imaging Data ◽  
Learning Models

<div><div><div><p>Among radiological imaging data, chest X-rays are of great use in observing COVID-19 mani- festations. For mass screening, using chest X-rays, a computationally efficient AI-driven tool is the must to detect COVID-19 positive cases from non-COVID ones. For this purpose, we proposed a light-weight Convolutional Neural Network (CNN)-tailored shallow architecture that can automatically detect COVID-19 positive cases using chest X-rays, with no false positive. The shallow CNN-tailored architecture was designed with fewer parameters as compared to other deep learning models, which was validated using 130 COVID-19 positive chest X-rays. In this study, in addition to COVID-19 positive cases, another set of non-COVID-19 cases (exactly similar to the size of COVID-19 set) was taken into account, where MERS, SARS, Pneumonia, and healthy chest X-rays were used. In experimental tests, to avoid possible bias, 5-fold cross validation was followed. Using 260 chest X-rays, the proposed model achieved an accuracy of an accuracy of 96.92%, sensitivity of 0.942, where AUC was 0.9869. Further, the reported false positive rate was 0 for 130 COVID-19 positive cases. This stated that proposed tool could possibly be used for mass screening. Note to be confused, it does not include any clinical implications. Using the exact same set of chest X-rays collection, the current results were better than other deep learning models and state-of-the-art works.</p></div></div></div>

Sign in / Sign up

Export Citation Format

Share Document