Carpal Bone Segmentation Using Fully Convolutional Neural Network

2019 ◽  
Vol 15 (10) ◽  
pp. 983-989
Author(s):  
Liang Kim Meng ◽  
Azira Khalil ◽  
Muhamad Hanif Ahmad Nizar ◽  
Maryam Kamarun Nisham ◽  
Belinda Pingguan-Murphy ◽  
...  
Keyword(s):  
Neural Network ◽  
Convolutional Neural Network ◽  
Automatic Segmentation ◽  
Ground Truth ◽  
Bone Age ◽  
Image Feature ◽  
Qualitative Assessment ◽  
Carpal Bone ◽  
Radiographic Images ◽  
Accurate Quantitative Analysis

Background: Bone Age Assessment (BAA) refers to a clinical procedure that aims to identify a discrepancy between biological and chronological age of an individual by assessing the bone age growth. Currently, there are two main methods of executing BAA which are known as Greulich-Pyle and Tanner-Whitehouse techniques. Both techniques involve a manual and qualitative assessment of hand and wrist radiographs, resulting in intra and inter-operator variability accuracy and time-consuming. An automatic segmentation can be applied to the radiographs, providing the physician with more accurate delineation of the carpal bone and accurate quantitative analysis. Methods: In this study, we proposed an image feature extraction technique based on image segmentation with the fully convolutional neural network with eight stride pixel (FCN-8). A total of 290 radiographic images including both female and the male subject of age ranging from 0 to 18 were manually segmented and trained using FCN-8. Results and Conclusion: The results exhibit a high training accuracy value of 99.68% and a loss rate of 0.008619 for 50 epochs of training. The experiments compared 58 images against the gold standard ground truth images. The accuracy of our fully automated segmentation technique is 0.78 ± 0.06, 1.56 ±0.30 mm and 98.02% in terms of Dice Coefficient, Hausdorff Distance, and overall qualitative carpal recognition accuracy, respectively.

scholarly journals Convolutional neural network for automated mass segmentation in mammography

2020 ◽  
Vol 21 (S1) ◽  
Author(s):  
Dina Abdelhafiz ◽  
Jinbo Bi ◽  
Reda Ammar ◽  
Clifford Yang ◽  
Sheida Nabavi
Keyword(s):  
Neural Network ◽  
Convolutional Neural Network ◽  
Data Augmentation ◽  
Contextual Information ◽  
Automatic Segmentation ◽  
Ground Truth ◽  
Test Accuracy ◽  
Convolutional Network ◽  
Proposed Model ◽  
The Mean

Abstract Background Automatic segmentation and localization of lesions in mammogram (MG) images are challenging even with employing advanced methods such as deep learning (DL) methods. We developed a new model based on the architecture of the semantic segmentation U-Net model to precisely segment mass lesions in MG images. The proposed end-to-end convolutional neural network (CNN) based model extracts contextual information by combining low-level and high-level features. We trained the proposed model using huge publicly available databases, (CBIS-DDSM, BCDR-01, and INbreast), and a private database from the University of Connecticut Health Center (UCHC). Results We compared the performance of the proposed model with those of the state-of-the-art DL models including the fully convolutional network (FCN), SegNet, Dilated-Net, original U-Net, and Faster R-CNN models and the conventional region growing (RG) method. The proposed Vanilla U-Net model outperforms the Faster R-CNN model significantly in terms of the runtime and the Intersection over Union metric (IOU). Training with digitized film-based and fully digitized MG images, the proposed Vanilla U-Net model achieves a mean test accuracy of 92.6%. The proposed model achieves a mean Dice coefficient index (DI) of 0.951 and a mean IOU of 0.909 that show how close the output segments are to the corresponding lesions in the ground truth maps. Data augmentation has been very effective in our experiments resulting in an increase in the mean DI and the mean IOU from 0.922 to 0.951 and 0.856 to 0.909, respectively. Conclusions The proposed Vanilla U-Net based model can be used for precise segmentation of masses in MG images. This is because the segmentation process incorporates more multi-scale spatial context, and captures more local and global context to predict a precise pixel-wise segmentation map of an input full MG image. These detected maps can help radiologists in differentiating benign and malignant lesions depend on the lesion shapes. We show that using transfer learning, introducing augmentation, and modifying the architecture of the original model results in better performance in terms of the mean accuracy, the mean DI, and the mean IOU in detecting mass lesion compared to the other DL and the conventional models.

scholarly journals Convolutional neural network for automated mass segmentation in mammography

2020 ◽  
Author(s):  
Dina Abdelhafiz ◽  
Jinbo Bi ◽  
Reda Ammar ◽  
Clifford Yang ◽  
Sheida Nabavi
Keyword(s):  
Neural Network ◽  
Convolutional Neural Network ◽  
Data Augmentation ◽  
Contextual Information ◽  
Automatic Segmentation ◽  
Ground Truth ◽  
Test Accuracy ◽  
Convolutional Network ◽  
Proposed Model ◽  
The Mean

AbstractBackgroundAutomatic segmentation and localization of lesions in mammogram (MG) images are challenging even with employing advanced methods such as deep learning (DL) methods. We developed a new model based on the architecture of the semantic segmentation U-Net model to precisely segment mass lesions in MG images. The proposed end-to-end convolutional neural network (CNN) based model extracts contextual information by combining low-level and high-level features. We trained the proposed model using huge publicly available databases, (CBIS-DDSM, BCDR-01, and INbreast), and a private database from the University of Connecticut Health Center (UCHC).ResultsWe compared the performance of the proposed model with those of the state-of-the-art DL models including the fully convolutional network (FCN), SegNet, Dilated-Net, original U-Net, and Faster R-CNN models and the conventional region growing (RG) method. The proposed Vanilla U-Net model outperforms the Faster R-CNN model significantly in terms of the runtime and the Intersection over Union metric (IOU). Training with digitized film-based and fully digitized MG images, the proposed Vanilla U-Net model achieves a mean test accuracy of 92.6%. The proposed model achieves a mean Dice coefficient index (DI) of 0.951 and a mean IOU of 0.909 that show how close the output segments are to the corresponding lesions in the ground truth maps. Data augmentation has been very effective in our experiments resulting in an increase in the mean DI and the mean IOU from 0.922 to 0.951 and 0.856 to 0.909, respectively.ConclusionsThe proposed Vanilla U-Net based model can be used for precise segmentation of masses in MG images. This is because the segmentation process incorporates more multi-scale spatial context, and captures more local and global context to predict a precise pixel-wise segmentation map of an input full MG image. These detected maps can help radiologists in differentiating benign and malignant lesions depend on the lesion shapes. We show that using transfer learning, introducing augmentation, and modifying the architecture of the original model results in better performance in terms of the mean accuracy, the mean DI, and the mean IOU in detecting mass lesion compared to the other DL and the conventional models.

Quantitative weld defect sizing using convolutional neural network-aided processing of RT images

2021 ◽  
Vol 63 (3) ◽  
pp. 141-145
Author(s):  
M Mirzapour ◽  
A Movafeghi ◽  
E Yahaghi
Keyword(s):  
Neural Network ◽  
Image Quality ◽  
Convolutional Neural Network ◽  
Flaw Detection ◽  
Flaw Size ◽  
Image Feature ◽  
Image Processing Technique ◽  
Radiographic Images ◽  
Weld Defect ◽  
Image Contrast Enhancement

Non-destructive confirmation of seamless welding is of critical importance in most applications and digital industrial radiography (DIR) is often the method of choice for internal flaw detection. DIR images often suffer from fogginess, limiting the inspection of flawed regions in online and quantitative applications. Much focus has therefore been put on denoising and image fog removal to yield better outcomes. One of the methods most widely used to improve the image is the fast and flexible denoising convolutional neural network (FFCN). This method has been shown to offer excellent image quality performance combined with fast execution and computing efficiency. In this study, the FFCN image processing technique is implemented and applied to radiographic images of welded objects. Enhancement of defect detection is achieved through sharpening of the image feature edges, leading to improved quantification in weld flaw sizing. The method is applied to the radiographic images using the weighted subtraction method. Experienced radiographers find that the weld defect detail is better visualised with output images from the FFCN algorithm compared to the original radiographs. Improvement in weld flaw size quantification is evaluated using test objects and the distance between the first two lines of the image quality indicator (IQI). The results show that the applied algorithm enhances the visualisation of internal defects and increases the detectability of fine fractures in the welded region. It is also found that, by selective image contrast enhancement near the flaw edges, flaw size quantification is improved significantly. The algorithm is found to be efficient, enabling online automated implementation on standard personal computers.

scholarly journals Geometric property-based convolutional neural network for indoor object detection

2021 ◽  
Vol 18 (1) ◽  
pp. 172988142199332
Author(s):  
Xintao Ding ◽  
Boquan Li ◽  
Jinbao Wang
Keyword(s):  
Neural Network ◽  
Object Detection ◽  
Convolutional Neural Network ◽  
Geometric Property ◽  
Ground Truth ◽  
Geometric Constraints ◽  
Depth Information ◽  
Training Set ◽  
Object Knowledge ◽  
The Mean

Indoor object detection is a very demanding and important task for robot applications. Object knowledge, such as two-dimensional (2D) shape and depth information, may be helpful for detection. In this article, we focus on region-based convolutional neural network (CNN) detector and propose a geometric property-based Faster R-CNN method (GP-Faster) for indoor object detection. GP-Faster incorporates geometric property in Faster R-CNN to improve the detection performance. In detail, we first use mesh grids that are the intersections of direct and inverse proportion functions to generate appropriate anchors for indoor objects. After the anchors are regressed to the regions of interest produced by a region proposal network (RPN-RoIs), we then use 2D geometric constraints to refine the RPN-RoIs, in which the 2D constraint of every classification is a convex hull region enclosing the width and height coordinates of the ground-truth boxes on the training set. Comparison experiments are implemented on two indoor datasets SUN2012 and NYUv2. Since the depth information is available in NYUv2, we involve depth constraints in GP-Faster and propose 3D geometric property-based Faster R-CNN (DGP-Faster) on NYUv2. The experimental results show that both GP-Faster and DGP-Faster increase the performance of the mean average precision.

scholarly journals Unraveling the deep learning gearbox in optical coherence tomography image segmentation towards explainable artificial intelligence

2021 ◽  
Vol 4 (1) ◽  
Author(s):  
Peter M. Maloca ◽  
Philipp L. Müller ◽  
Aaron Y. Lee ◽  
Adnan Tufail ◽  
Konstantinos Balaskas ◽  
...  
Keyword(s):  
Neural Network ◽  
Machine Learning ◽  
Optical Coherence Tomography ◽  
Image Segmentation ◽  
Convolutional Neural Network ◽  
Learning Algorithm ◽  
Ground Truth ◽  
Optical Coherence Tomography Image ◽  
Optical Coherence ◽  
Tomography Image

AbstractMachine learning has greatly facilitated the analysis of medical data, while the internal operations usually remain intransparent. To better comprehend these opaque procedures, a convolutional neural network for optical coherence tomography image segmentation was enhanced with a Traceable Relevance Explainability (T-REX) technique. The proposed application was based on three components: ground truth generation by multiple graders, calculation of Hamming distances among graders and the machine learning algorithm, as well as a smart data visualization (‘neural recording’). An overall average variability of 1.75% between the human graders and the algorithm was found, slightly minor to 2.02% among human graders. The ambiguity in ground truth had noteworthy impact on machine learning results, which could be visualized. The convolutional neural network balanced between graders and allowed for modifiable predictions dependent on the compartment. Using the proposed T-REX setup, machine learning processes could be rendered more transparent and understandable, possibly leading to optimized applications.

scholarly journals Algorithm of Strawberry Disease Recognition Based on Deep Convolutional Neural Network

Complexity ◽  
2021 ◽  
Vol 2021 ◽  
pp. 1-10
Author(s):  
Li Ma ◽  
Xueliang Guo ◽  
Shuke Zhao ◽  
Doudou Yin ◽  
Yiyi Fu ◽  
...  
Keyword(s):  
Neural Network ◽  
Convolutional Neural Network ◽  
Abiotic Factors ◽  
Convolution Neural Network ◽  
Image Feature ◽  
Identification Methods ◽  
Yield And Quality ◽  
Disease Identification ◽  
Deep Convolution Neural Network ◽  
And Control

The growth of strawberry will be stressed by biological or abiotic factors, which will cause a great threat to the yield and quality of strawberry, in which various strawberry diseased. However, the traditional identification methods have high misjudgment rate and poor real-time performance. In today's era of increasing demand for strawberry yield and quality, it is obvious that the traditional strawberry disease identification methods mainly rely on personal experience and naked eye observation and cannot meet the needs of people for strawberry disease identification and control. Therefore, it is necessary to find a more effective method to identify strawberry diseases efficiently and provide corresponding disease description and control methods. In this paper, based on the deep convolution neural network technology, the recognition of strawberry common diseases was studied, as well as a new method based on deep convolution neural network (DCNN) strawberry disease recognition algorithm, through the normal training of strawberry image feature representation in different scenes, and then through the application of transfer learning method, the strawberry disease image features are added to the training set, and finally the features are classified and recognized to achieve the goal of disease recognition. Moreover, attention mechanism and central damage function are introduced into the classical convolutional neural network to solve the problem that the information loss of key feature areas in the existing classification methods of convolutional neural network affects the classification effect, and further improves the accuracy of convolutional neural network in image classification.

scholarly journals Automatic differentiation of thyroid scintigram by deep convolutional neural network: a dual center study

2021 ◽  
Vol 21 (1) ◽  
Author(s):  
Pei Yang ◽  
Yong Pi ◽  
Tao He ◽  
Jiangming Sun ◽  
Jianan Wei ◽  
...  
Keyword(s):  
Neural Network ◽  
Neural Networks ◽  
Convolutional Neural Network ◽  
Predictive Value ◽  
Automatic Differentiation ◽  
External Validation ◽  
Deep Convolutional Neural Network ◽  
Image Feature ◽  
Training Dataset ◽  
Internal Validation

Abstract Background 99mTc-pertechnetate thyroid scintigraphy is a valid complementary avenue for evaluating thyroid disease in the clinic, the image feature of thyroid scintigram is relatively simple but the interpretation still has a moderate consistency among physicians. Thus, we aimed to develop an artificial intelligence (AI) system to automatically classify the four patterns of thyroid scintigram. Methods We collected 3087 thyroid scintigrams from center 1 to construct the training dataset (n = 2468) and internal validating dataset (n = 619), and another 302 cases from center 2 as external validating datasets. Four pre-trained neural networks that included ResNet50, DenseNet169, InceptionV3, and InceptionResNetV2 were implemented to construct AI models. The models were trained separately with transfer learning. We evaluated each model’s performance with metrics as following: accuracy, sensitivity, specificity, positive predictive value (PPV), negative predictive value (NPV), recall, precision, and F1-score. Results The overall accuracy of four pre-trained neural networks in classifying four common uptake patterns of thyroid scintigrams all exceeded 90%, and the InceptionV3 stands out from others. It reached the highest performance with an overall accuracy of 92.73% for internal validation and 87.75% for external validation, respectively. As for each category of thyroid scintigrams, the area under the receiver operator characteristic curve (AUC) was 0.986 for ‘diffusely increased,’ 0.997 for ‘diffusely decreased,’ 0.998 for ‘focal increased,’ and 0.945 for ‘heterogeneous uptake’ in internal validation, respectively. Accordingly, the corresponding performances also obtained an ideal result of 0.939, 1.000, 0.974, and 0.915 in external validation, respectively. Conclusions Deep convolutional neural network-based AI model represented considerable performance in the classification of thyroid scintigrams, which may help physicians improve the interpretation of thyroid scintigrams more consistently and efficiently.

Sign in / Sign up

Export Citation Format

Share Document