Assessment of Ankle Fractures using Deep Learning Algorithms and Convolutional Neural Network

Early and accurate detection of ankle fractures is crucial for reducing future complications. Radiographs are the most abundant imaging techniques for assessing fractures. We believe deep learning (DL) methods, through adequately trained deep convolutional neural networks (DCNNs), can assess radiographic images fast and accurate without human intervention. Herein, we aimed to assess the performance of two different DCNNs in detecting ankle fractures using radiographs compared to the ground truth. In this retrospective study, our DCNNs were trained using radiographs obtained from 1050 patients with ankle fracture and the same number of individuals with otherwise healthy ankles. Inception V3 and Renet50 pretrained models were used in our algorithms. Danis-Weber classification method was used. Out of 1050, 72 individuals were labeled as occult fractures as they were not detected in the primary radiographic assessment. Using single-view radiographs was compared with 3-views (anteroposterior, mortise, lateral) for training the DCNNs. Our DCNNs showed a better performance using 3-views images versus single-view based on greater values for accuracy, F-score, and area under the curve (AUC). The sensitivity and specificity in detection of ankle fractures using 3-views were 97.5% and 93.9% using Resnet50 compared to 98.7% and 98.6 using inception V3, respectively. Resnet50 missed 3 occult fractures while Inception V3 missed only one case. Clinical Significance: The performance of our DCNNs showed a promising potential that can be considered in developing the currently used image interpretation programs or as a separate assistant to the clinicians to detect ankle fractures faster and more precisely.

Download Full-text

Multi-Task Deep Learning Model for Classification of Dental Implant Brand and Treatment Stage Using Dental Panoramic Radiograph Images

Biomolecules ◽

10.3390/biom11060815 ◽

2021 ◽

Vol 11 (6) ◽

pp. 815

Author(s):

Shintaro Sukegawa ◽

Kazumasa Yoshii ◽

Takeshi Hara ◽

Tamamo Matsuyama ◽

Katsusuke Yamashita ◽

...

Keyword(s):

Deep Learning ◽

Dental Implant ◽

Area Under The Curve ◽

Treatment Phase ◽

Panoramic Radiograph ◽

Radiographic Images ◽

Treatment Stage ◽

Prefectural Central Hospital ◽

Dental Panoramic Radiograph

It is necessary to accurately identify dental implant brands and the stage of treatment to ensure efficient care. Thus, the purpose of this study was to use multi-task deep learning to investigate a classifier that categorizes implant brands and treatment stages from dental panoramic radiographic images. For objective labeling, 9767 dental implant images of 12 implant brands and treatment stages were obtained from the digital panoramic radiographs of patients who underwent procedures at Kagawa Prefectural Central Hospital, Japan, between 2005 and 2020. Five deep convolutional neural network (CNN) models (ResNet18, 34, 50, 101 and 152) were evaluated. The accuracy, precision, recall, specificity, F1 score, and area under the curve score were calculated for each CNN. We also compared the multi-task and single-task accuracies of brand classification and implant treatment stage classification. Our analysis revealed that the larger the number of parameters and the deeper the network, the better the performance for both classifications. Multi-tasking significantly improved brand classification on all performance indicators, except recall, and significantly improved all metrics in treatment phase classification. Using CNNs conferred high validity in the classification of dental implant brands and treatment stages. Furthermore, multi-task learning facilitated analysis accuracy.

Download Full-text

Ground-truth uncertainty-aware metrics for machine learning applications on seismic image interpretation: Application to faults and horizon extraction

The Leading Edge ◽

10.1190/tle39100734.1 ◽

2020 ◽

Vol 39 (10) ◽

pp. 734-741

Author(s):

Sébastien Guillon ◽

Frédéric Joncour ◽

Pierre-Emmanuel Barrallon ◽

Laurent Castanié

Keyword(s):

Deep Learning ◽

Image Interpretation ◽

Ground Truth ◽

Learning Model ◽

Seismic Interpretation ◽

Data Set ◽

Seismic Image ◽

Machine Learning Applications ◽

Deep Learning Model

We propose new metrics to measure the performance of a deep learning model applied to seismic interpretation tasks such as fault and horizon extraction. Faults and horizons are thin geologic boundaries (1 pixel thick on the image) for which a small prediction error could lead to inappropriately large variations in common metrics (precision, recall, and intersection over union). Through two examples, we show how classical metrics could fail to indicate the true quality of fault or horizon extraction. Measuring the accuracy of reconstruction of thin objects or boundaries requires introducing a tolerance distance between ground truth and prediction images to manage the uncertainties inherent in their delineation. We therefore adapt our metrics by introducing a tolerance function and illustrate their ability to manage uncertainties in seismic interpretation. We compare classical and new metrics through different examples and demonstrate the robustness of our metrics. Finally, we show on a 3D West African data set how our metrics are used to tune an optimal deep learning model.

Download Full-text

Fusion High-Resolution Network for Diagnosing ChestX-ray Images

Electronics ◽

10.3390/electronics9010190 ◽

2020 ◽

Vol 9 (1) ◽

pp. 190 ◽

Cited By ~ 3

Author(s):

Zhiwei Huang ◽

Jinzhao Lin ◽

Liming Xu ◽

Huiqian Wang ◽

Tong Bai ◽

...

Keyword(s):

Neural Networks ◽

Deep Learning ◽

High Resolution ◽

Convolutional Neural Networks ◽

Characteristic Curve ◽

Area Under The Curve ◽

Disease Classification ◽

Deep Convolutional Neural Networks ◽

Learning Methods ◽

Global And Local

The application of deep convolutional neural networks (CNN) in the field of medical image processing has attracted extensive attention and demonstrated remarkable progress. An increasing number of deep learning methods have been devoted to classifying ChestX-ray (CXR) images, and most of the existing deep learning methods are based on classic pretrained models, trained by global ChestX-ray images. In this paper, we are interested in diagnosing ChestX-ray images using our proposed Fusion High-Resolution Network (FHRNet). The FHRNet concatenates the global average pooling layers of the global and local feature extractors—it consists of three branch convolutional neural networks and is fine-tuned for thorax disease classification. Compared with the results of other available methods, our experimental results showed that the proposed model yields a better disease classification performance for the ChestX-ray 14 dataset, according to the receiver operating characteristic curve and area-under-the-curve score. An ablation study further confirmed the effectiveness of the global and local branch networks in improving the classification accuracy of thorax diseases.

Download Full-text

Deep Learning for Component Fault Detection in Electricity Transmission Lines.

10.21203/rs.3.rs-1028973/v1 ◽

2021 ◽

Author(s):

Iyke Maduako ◽

Chukwuemeka Fortune Igwe ◽

James Edebo Abah ◽

Obianuju Esther Onwuasoanya ◽

Grace Amarachi Chukwu ◽

...

Keyword(s):

Deep Learning ◽

Transmission Lines ◽

Ground Truth ◽

Recall Rate ◽

Aerial Image ◽

Small Scale ◽

Single Shot ◽

Deep Convolutional Neural Networks ◽

Electricity Transmission ◽

Human Cost

Abstract Fault identification is one of the most significant bottlenecks faced by electricity transmission and distribution utilities in developing countries to deliver efficient services to the customers and ensure proper asset audit and management for network optimization and load forecasting. This is due to data scarcity, asset inaccessibility and insecurity, ground-surveys complexity, untimeliness, and general human cost. In view of this, we exploited the use of oblique UAV imagery with a high spatial resolution and a fine-tuned and deep Convolutional Neural Networks (CNNs) to monitor four major Electric power transmission network (EPTN) components. This study explored the capability of the Single Shot Multibox Detector (SSD), a one-stage object detection model on the electric transmission power line imagery to localize, detect and classify faults. The fault considered in this study include the broken insulator plate, missing insulator plate, missing knob, and rusty clamp. Our adapted neural network is a CNN based on a multiscale layer feature pyramid network (FPN) using aerial image patches and ground truth to localise and detect faults via a one-phase procedure. The SSD Rest50 architecture variation performed the best with a mean Average Precision (mAP) of 89.61%. All the developed SSD based models achieve a high precision rate and low recall rate in detecting the faulty components, thus achieving acceptable balance levels of F1-score and representation. Finally, comparable to other works in literature within this same domain, deep-learning will boost timeliness of EPTN inspection and their component fault mapping in the long - run if these deep learning architectures are widely understood, adequate training samples exist to represent multiple fault characteristics; and the effects of augmenting available datasets, balancing intra-class heterogeneity, and small-scale datasets are clearly understood.

Download Full-text

Synergic Deep Learning for Smart Health Diagnosis of COVID-19 for Connected Living and Smart Cities

ACM Transactions on Internet Technology ◽

10.1145/3453168 ◽

2022 ◽

Vol 22 (3) ◽

pp. 1-14

Author(s):

K. Shankar ◽

Eswaran Perumal ◽

Mohamed Elhoseny ◽

Fatma Taher ◽

B. B. Gupta ◽

...

Keyword(s):

Deep Learning ◽

Smart Cities ◽

Imaging Techniques ◽

Input Image ◽

Significant Loss ◽

Deep Convolutional Neural Networks ◽

Smart Health ◽

And Control ◽

Health Diagnosis

COVID-19 pandemic has led to a significant loss of global deaths, economical status, and so on. To prevent and control COVID-19, a range of smart, complex, spatially heterogeneous, control solutions, and strategies have been conducted. Earlier classification of 2019 novel coronavirus disease (COVID-19) is needed to cure and control the disease. It results in a requirement of secondary diagnosis models, since no precise automated toolkits exist. The latest finding attained using radiological imaging techniques highlighted that the images hold noticeable details regarding the COVID-19 virus. The application of recent artificial intelligence (AI) and deep learning (DL) approaches integrated to radiological images finds useful to accurately detect the disease. This article introduces a new synergic deep learning (SDL)-based smart health diagnosis of COVID-19 using Chest X-Ray Images. The SDL makes use of dual deep convolutional neural networks (DCNNs) and involves a mutual learning process from one another. Particularly, the representation of images learned by both DCNNs is provided as the input of a synergic network, which has a fully connected structure and predicts whether the pair of input images come under the identical class. Besides, the proposed SDL model involves a fuzzy bilateral filtering (FBF) model to pre-process the input image. The integration of FBL and SDL resulted in the effective classification of COVID-19. To investigate the classifier outcome of the SDL model, a detailed set of simulations takes place and ensures the effective performance of the FBF-SDL model over the compared methods.

Download Full-text

Deep Learning for Diagnosis of Paranasal Sinusitis Using Multi-View Radiographs

Diagnostics ◽

10.3390/diagnostics11020250 ◽

2021 ◽

Vol 11 (2) ◽

pp. 250

Author(s):

Yejin Jeon ◽

Kyeorye Lee ◽

Leonard Sunwoo ◽

Dongjun Choi ◽

Dong Yul Oh ◽

...

Keyword(s):

Deep Learning ◽

Learning Algorithm ◽

Imaging Modality ◽

Maxillary Sinusitis ◽

Image Interpretation ◽

Area Under The Curve ◽

Temporal Separation ◽

Deep Learning Algorithm ◽

Line Imaging ◽

The One

Accurate image interpretation of Waters’ and Caldwell view radiographs used for sinusitis screening is challenging. Therefore, we developed a deep learning algorithm for diagnosing frontal, ethmoid, and maxillary sinusitis on both Waters’ and Caldwell views. The datasets were selected for the training and validation set (n = 1403, sinusitis% = 34.3%) and the test set (n = 132, sinusitis% = 29.5%) by temporal separation. The algorithm can simultaneously detect and classify each paranasal sinus using both Waters’ and Caldwell views without manual cropping. Single- and multi-view models were compared. Our proposed algorithm satisfactorily diagnosed frontal, ethmoid, and maxillary sinusitis on both Waters’ and Caldwell views (area under the curve (AUC), 0.71 (95% confidence interval, 0.62–0.80), 0.78 (0.72–0.85), and 0.88 (0.84–0.92), respectively). The one-sided DeLong’s test was used to compare the AUCs, and the Obuchowski–Rockette model was used to pool the AUCs of the radiologists. The algorithm yielded a higher AUC than radiologists for ethmoid and maxillary sinusitis (p = 0.012 and 0.013, respectively). The multi-view model also exhibited a higher AUC than the single Waters’ view model for maxillary sinusitis (p = 0.038). Therefore, our algorithm showed diagnostic performances comparable to radiologists and enhanced the value of radiography as a first-line imaging modality in assessing multiple sinusitis.

Download Full-text

Classification of Breast Cancer in Mammograms with Deep Learning Adding a Fifth Class

Applied Sciences ◽

10.3390/app112311398 ◽

2021 ◽

Vol 11 (23) ◽

pp. 11398

Author(s):

Salvador Castro-Tapia ◽

Celina Lizeth Castañeda-Miranda ◽

Carlos Alberto Olvera-Olvera ◽

Héctor A. Guerrero-Osuna ◽

José Manuel Ortiz-Rodriguez ◽

...

Keyword(s):

Breast Cancer ◽

Deep Learning ◽

Imaging Techniques ◽

False Positive Rate ◽

Area Under The Curve ◽

Fine Tuning ◽

Cad System ◽

Leading Role ◽

Operational Characteristics ◽

Positive Rate

Breast cancer is one of the diseases of most profound concern, with the most prevalence worldwide, where early detections and diagnoses play the leading role against this disease achieved through imaging techniques such as mammography. Radiologists tend to have a high false positive rate for mammography diagnoses and an accuracy of around 82%. Currently, deep learning (DL) techniques have shown promising results in the early detection of breast cancer by generating computer-aided diagnosis (CAD) systems implementing convolutional neural networks (CNNs). This work focuses on applying, evaluating, and comparing the architectures: AlexNet, GoogLeNet, Resnet50, and Vgg19 to classify breast lesions after using transfer learning with fine-tuning and training the CNN with regions extracted from the MIAS and INbreast databases. We analyzed 14 classifiers, involving 4 classes as several researches have done it before, corresponding to benign and malignant microcalcifications and masses, and as our main contribution, we also added a 5th class for the normal tissue of the mammary parenchyma increasing the correct detection; in order to evaluate the architectures with a statistical analysis based on the received operational characteristics (ROC), the area under the curve (AUC), F1 Score, accuracy, precision, sensitivity, and specificity. We generate the best results with the CNN GoogLeNet trained with five classes on a balanced database with an AUC of 99.29%, F1 Score of 91.92%, the accuracy of 91.92%, precision of 92.15%, sensitivity of 91.70%, and specificity of 97.66%, concluding that GoogLeNet is optimal as a classifier in a CAD system to deal with breast cancer.

Download Full-text

Deep Learning-Based Prediction of Paresthesia after Third Molar Extraction: A Preliminary Study

Diagnostics ◽

10.3390/diagnostics11091572 ◽

2021 ◽

Vol 11 (9) ◽

pp. 1572

Author(s):

Byung Su Kim ◽

Han Gyeol Yeom ◽

Jong Hyun Lee ◽

Woo Sang Shin ◽

Jong Pil Yun ◽

...

Keyword(s):

Deep Learning ◽

Inferior Alveolar Nerve ◽

Third Molar ◽

Area Under The Curve ◽

Radiographic Images ◽

Third Molar Extraction ◽

Mandibular Third Molar ◽

Group 2 ◽

Sensitivity Specificity ◽

Molar Extraction

The purpose of this study was to determine whether convolutional neural networks (CNNs) can predict paresthesia of the inferior alveolar nerve using panoramic radiographic images before extraction of the mandibular third molar. The dataset consisted of a total of 300 preoperative panoramic radiographic images of patients who had planned mandibular third molar extraction. A total of 100 images taken of patients who had paresthesia after tooth extraction were classified as Group 1, and 200 images taken of patients without paresthesia were classified as Group 2. The dataset was randomly divided into a training and validation set (n = 150 [50%]), and a test set (n = 150 [50%]). CNNs of SSD300 and ResNet-18 were used for deep learning. The average accuracy, sensitivity, specificity, and area under the curve were 0.827, 0.84, 0.82, and 0.917, respectively. This study revealed that CNNs can assist in the prediction of paresthesia of the inferior alveolar nerve after third molar extraction using panoramic radiographic images.

Download Full-text

Deep-learning algorithms for the interpretation of chest radiographs to aid in the triage of COVID-19 patients: A multicenter retrospective study

PLoS ONE ◽

10.1371/journal.pone.0242759 ◽

2020 ◽

Vol 15 (11) ◽

pp. e0242759

Author(s):

Se Bum Jang ◽

Suk Hee Lee ◽

Dong Eun Lee ◽

Sin-Youl Park ◽

Jong Kun Kim ◽

...

Keyword(s):

Deep Learning ◽

Retrospective Study ◽

Image Interpretation ◽

Area Under The Curve ◽

Ground Glass Opacity ◽

Community Treatment ◽

Ct Scans ◽

Treatment Center ◽

Automatic Interpretation ◽

Radiology Reports

The recent medical applications of deep-learning (DL) algorithms have demonstrated their clinical efficacy in improving speed and accuracy of image interpretation. If the DL algorithm achieves a performance equivalent to that achieved by physicians in chest radiography (CR) diagnoses with Coronavirus disease 2019 (COVID-19) pneumonia, the automatic interpretation of the CR with DL algorithms can significantly reduce the burden on clinicians and radiologists in sudden surges of suspected COVID-19 patients. The aim of this study was to evaluate the efficacy of the DL algorithm for detecting COVID-19 pneumonia on CR compared with formal radiology reports. This is a retrospective study of adult patients that were diagnosed as positive COVID-19 cases based on the reverse transcription polymerase chain reaction among all the patients who were admitted to five emergency departments and one community treatment center in Korea from February 18, 2020 to May 1, 2020. The CR images were evaluated with a publicly available DL algorithm. For reference, CR images without chest computed tomography (CT) scans classified as positive for COVID-19 pneumonia were used given that the radiologist identified ground-glass opacity, consolidation, or other infiltration in retrospectively reviewed CR images. Patients with evidence of pneumonia on chest CT scans were also classified as COVID-19 pneumonia positive outcomes. The overall sensitivity and specificity of the DL algorithm for detecting COVID-19 pneumonia on CR were 95.6%, and 88.7%, respectively. The area under the curve value of the DL algorithm for the detection of COVID-19 with pneumonia was 0.921. The DL algorithm demonstrated a satisfactory diagnostic performance comparable with that of formal radiology reports in the CR-based diagnosis of pneumonia in COVID-19 patients. The DL algorithm may offer fast and reliable examinations that can facilitate patient screening and isolation decisions, which can reduce the medical staff workload during COVID-19 pandemic situations.

Download Full-text

Assessment of Digital Pathology Imaging Biomarkers Associated with Breast Cancer Histologic Grade

Current Oncology ◽

10.3390/curroncol28060366 ◽

2021 ◽

Vol 28 (6) ◽

pp. 4298-4316

Author(s):

Andrew Lagree ◽

Audrey Shiner ◽

Marie Angeli Alera ◽

Lauren Fleshner ◽

Ethan Law ◽

...

Keyword(s):

Breast Cancer ◽

Digital Pathology ◽

Area Under The Curve ◽

Ground Truth ◽

Classification Performance ◽

Regions Of Interest ◽

Histologic Grade ◽

Imaging Biomarkers ◽

Deep Convolutional Neural Networks ◽

Microscopic Evaluation

Background: Evaluating histologic grade for breast cancer diagnosis is standard and associated with prognostic outcomes. Current challenges include the time required for manual microscopic evaluation and interobserver variability. This study proposes a computer-aided diagnostic (CAD) pipeline for grading tumors using artificial intelligence. Methods: There were 138 patients included in this retrospective study. Breast core biopsy slides were prepared using standard laboratory techniques, digitized, and pre-processed for analysis. Deep convolutional neural networks (CNNs) were developed to identify the regions of interest containing malignant cells and to segment tumor nuclei. Imaging-based features associated with spatial parameters were extracted from the segmented regions of interest (ROIs). Clinical datasets and pathologic biomarkers (estrogen receptor, progesterone receptor, and human epidermal growth factor 2) were collected from all study subjects. Pathologic, clinical, and imaging-based features were input into machine learning (ML) models to classify histologic grade, and model performances were tested against ground-truth labels at the patient-level. Classification performances were evaluated using receiver-operating characteristic (ROC) analysis. Results: Multiparametric feature sets, containing both clinical and imaging-based features, demonstrated high classification performance. Using imaging-derived markers alone, the classification performance demonstrated an area under the curve (AUC) of 0.745, while modeling these features with other pathologic biomarkers yielded an AUC of 0.836. Conclusion: These results demonstrate an association between tumor nuclear spatial features and tumor grade. If further validated, these systems may be implemented into pathology CADs and can assist pathologists to expeditiously grade tumors at the time of diagnosis and to help guide clinical decisions.

Download Full-text