Automatic segmentation of lung tumors on CT images based on a 2D & 3D hybrid convolutional neural network

2021 ◽  
pp. 20210038
Author(s):  
Wutian Gan ◽  
Hao Wang ◽  
Hengle Gu ◽  
Yanhua Duan ◽  
Yan Shao ◽  
...  
Keyword(s):  
Neural Network ◽  
Lung Cancer ◽  
Lung Tumor ◽  
Ct Images ◽  
Hybrid Network ◽  
Evaluation Metrics ◽  
Tumor Segmentation ◽  
Tumor Delineation ◽  
3D Cnn ◽  
The Individual

Objective: A stable and accurate automatic tumor delineation method has been developed to facilitate the intelligent design of lung cancer radiotherapy process. The purpose of this paper is to introduce an automatic tumor segmentation network for lung cancer on CT images based on deep learning. Methods: In this paper, a hybrid convolution neural network (CNN) combining 2D CNN and 3D CNN was implemented for the automatic lung tumor delineation using CT images. 3D CNN used V-Net model for the extraction of tumor context information from CT sequence images. 2D CNN used an encoder–decoder structure based on dense connection scheme, which could expand information flow and promote feature propagation. Next, 2D features and 3D features were fused through a hybrid module. Meanwhile, the hybrid CNN was compared with the individual 3D CNN and 2D CNN, and three evaluation metrics, Dice, Jaccard and Hausdorff distance (HD), were used for quantitative evaluation. The relationship between the segmentation performance of hybrid network and the GTV volume size was also explored. Results: The newly introduced hybrid CNN was trained and tested on a dataset of 260 cases, and could achieve a median value of 0.73, with mean and stand deviation of 0.72 ± 0.10 for the Dice metric, 0.58 ± 0.13 and 21.73 ± 13.30 mm for the Jaccard and HD metrics, respectively. The hybrid network significantly outperformed the individual 3D CNN and 2D CNN in the three examined evaluation metrics (p < 0.001). A larger GTV present a higher value for the Dice metric, but its delineation at the tumor boundary is unstable. Conclusions: The implemented hybrid CNN was able to achieve good lung tumor segmentation performance on CT images. Advances in knowledge: The hybrid CNN has valuable prospect with the ability to segment lung tumor.

A Novel Approach of Lung Tumor Segmentation Using a 3D Deep Convolutional Neural Network

2022 ◽  
pp. 1-16
Author(s):  
Shweta Tyagi ◽  
Sanjay N. Talbar ◽  
Abhishek Mahajan
Keyword(s):  
Neural Network ◽  
Lung Cancer ◽  
Convolutional Neural Network ◽  
Lung Tumor ◽  
Early Stage ◽  
Tumor Segmentation ◽  
Lung Tumour ◽  
Dice Coefficient ◽  
Tumour Segmentation ◽  
Diagnosis Of Lung Cancer

Cancer is one of the most life-threatening diseases in the world, and lung cancer is the leading cause of death worldwide. If not detected at an early stage, the survival rate of lung cancer patients can be very low. To treat patients in later stages, one needs to analyze the tumour region. For accurate diagnosis of lung cancer, the first step is to detect and segment the tumor. In this chapter, an approach for segmentation of a lung tumour is presented. For pre-processing of lung CT images, simple image processing like morphological operations is used, and for tumour segmentation task, a 3D convolutional neural network (CNN) is used. The CNN architecture consists of a 3D encoder block followed by 3D decoder block just like U-Net but with deformable convolution blocks. For this study, two datasets have been used; one is the online-available NSCLC Radiomics dataset, and the other is collected from an Indian local hospital. The approach proposed in this chapter is evaluated in terms of dice coefficient. This approach is able to give significant results with a dice coefficient of 77.23%.

scholarly journals Classification of Pulmonary CT Images by Using Hybrid 3D-Deep Convolutional Neural Network Architecture

2019 ◽  
Vol 9 (5) ◽  
pp. 940 ◽  
Author(s):  
Huseyin Polat ◽  
Homay Danaei Mehr
Keyword(s):  
Neural Network ◽  
Machine Learning ◽  
Lung Cancer ◽  
Feature Extraction ◽  
Extraction Methods ◽  
Ct Images ◽  
Learning Methods ◽  
Machine Learning Methods ◽  
Diagnosis Of Lung Cancer ◽  
3D Cnn

Lung cancer is the most common cause of cancer-related deaths worldwide. Hence, the survival rate of patients can be increased by early diagnosis. Recently, machine learning methods on Computed Tomography (CT) images have been used in the diagnosis of lung cancer to accelerate the diagnosis process and assist physicians. However, in conventional machine learning techniques, using handcrafted feature extraction methods on CT images are complicated processes. Hence, deep learning as an effective area of machine learning methods by using automatic feature extraction methods could minimize the process of feature extraction. In this study, two Convolutional Neural Network (CNN)-based models were proposed as deep learning methods to diagnose lung cancer on lung CT images. To investigate the performance of the two proposed models (Straight 3D-CNN with conventional softmax and hybrid 3D-CNN with Radial Basis Function (RBF)-based SVM), the altered models of two-well known CNN architectures (3D-AlexNet and 3D-GoogleNet) were considered. Experimental results showed that the performance of the two proposed models surpassed 3D-AlexNet and 3D-GoogleNet. Furthermore, the proposed hybrid 3D-CNN with SVM achieved more satisfying results (91.81%, 88.53% and 91.91% for accuracy rate, sensitivity and precision respectively) compared to straight 3D-CNN with softmax in the diagnosis of lung cancer.

scholarly journals Automatic Lung Tumor Segmentation on PET/CT Images Using Fuzzy Markov Random Field Model

2014 ◽  
Vol 2014 ◽  
pp. 1-6 ◽  
Author(s):  
Yu Guo ◽  
Yuanming Feng ◽  
Jian Sun ◽  
Ning Zhang ◽  
Wang Lin ◽  
...  
Keyword(s):  
Lung Cancer ◽  
Random Field ◽  
Markov Random Field ◽  
Lung Tumor ◽  
Ct Images ◽  
Tumor Segmentation ◽  
Posterior Probability Distribution ◽  
Markov Random ◽  
Positron Emission ◽  
Pet Ct

The combination of positron emission tomography (PET) and CT images provides complementary functional and anatomical information of human tissues and it has been used for better tumor volume definition of lung cancer. This paper proposed a robust method for automatic lung tumor segmentation on PET/CT images. The new method is based on fuzzy Markov random field (MRF) model. The combination of PET and CT image information is achieved by using a proper joint posterior probability distribution of observed features in the fuzzy MRF model which performs better than the commonly used Gaussian joint distribution. In this study, the PET and CT simulation images of 7 non-small cell lung cancer (NSCLC) patients were used to evaluate the proposed method. Tumor segmentations with the proposed method and manual method by an experienced radiation oncologist on the fused images were performed, respectively. Segmentation results obtained with the two methods were similar and Dice’s similarity coefficient (DSC) was 0.85 ± 0.013. It has been shown that effective and automatic segmentations can be achieved with this method for lung tumors which locate near other organs with similar intensities in PET and CT images, such as when the tumors extend into chest wall or mediastinum.

Lung Tumor Delineation Based on Novel Tumor-Background Likelihood Models in PET-CT Images

2014 ◽  
Vol 61 (1) ◽  
pp. 218-224 ◽  
Author(s):  
Xiuying Wang ◽  
Cherry Ballangan ◽  
Hui Cui ◽  
Michael Fulham ◽  
Stefan Eberl ◽  
...  
Keyword(s):  
Lung Tumor ◽  
Ct Images ◽  
Tumor Delineation ◽  
Pet Ct

scholarly journals A Medical Service Application Based on 3D-CNN and Knowledge Graph

2021 ◽  
Vol 2078 (1) ◽  
pp. 012048
Author(s):  
Jiasheng Ni
Keyword(s):  
Lung Cancer ◽  
Deep Learning ◽  
Cancer Detection ◽  
Semantic Segmentation ◽  
Ct Images ◽  
Knowledge Graph ◽  
Medical Response ◽  
Learning Techniques ◽  
3D Cnn ◽  
Lung Cancer Detection

Abstract Remote medical prognosis application is a category of medical tests tool designed to collect patients’ body conditions and offer diagnosis results synchronously. However, most online applications are predicated on a simple chat bot which typically redirect patients to other online medical websites, which undermines the user experience and may prompt useless information for their reference. To tackle these issues, this paper proposed a medical prognosis application with deep learning techniques for a more responsive and intelligent medical prognosis procedure. This application can be break down into three parts-lung cancer detection, a database-supporting medical QA bot and a Hierarchical Bidirectional LSTM model (HBDA). A 3D-CNN model is built for the lung cancer detection, with a sequence of sliced CT images as inputs and outputs a probability scaler for tumor indications. A knowledge graph is applied in the medical QA bot implementation and the HBDA model is designed for semantic segmentation in order to better capture users’ intention in medical questions. For the performance of the medical prognosis, since we have limited computer memory, the 3D-CNN didn’t perform very well on detecting tumor conditions in the CT images with accuracy at around 70%. The knowledge graph-based medical QA bot intelligently recognize the underlying pattern in patients’ question and delivered decent medical response. The HBDA model performs well on distinguish the similarities and disparities between various medical questions, reaching accuracy at 90%. These results shed light for the feasibility of utilizing deep learning techniques such as 3D-CNN, Knowledge Graph, and Hierarchical Bi-directional LSTM to simulate the medical prognosis process.

scholarly journals Adaptive Attention Convolutional Neural Network for Liver Tumor Segmentation

2021 ◽  
Vol 11 ◽  
Author(s):  
Shunyao Luan ◽  
Xudong Xue ◽  
Yi Ding ◽  
Wei Wei ◽  
Benpeng Zhu
Keyword(s):  
Neural Network ◽  
Liver Tumor ◽  
Semantic Information ◽  
Liver Tumors ◽  
Ct Images ◽  
Attention Mechanism ◽  
Tumor Segmentation ◽  
Expansion Path ◽  
Liver Tumor Segmentation ◽  
End To End

PurposeAccurate segmentation of liver and liver tumors is critical for radiotherapy. Liver tumor segmentation, however, remains a difficult and relevant problem in the field of medical image processing because of the various factors like complex and variable location, size, and shape of liver tumors, low contrast between tumors and normal tissues, and blurred or difficult-to-define lesion boundaries. In this paper, we proposed a neural network (S-Net) that can incorporate attention mechanisms to end-to-end segmentation of liver tumors from CT images.MethodsFirst, this study adopted a classical coding-decoding structure to realize end-to-end segmentation. Next, we introduced an attention mechanism between the contraction path and the expansion path so that the network could encode a longer range of semantic information in the local features and find the corresponding relationship between different channels. Then, we introduced long-hop connections between the layers of the contraction path and the expansion path, so that the semantic information extracted in both paths could be fused. Finally, the application of closed operation was used to dissipate the narrow interruptions and long, thin divide. This eliminated small cavities and produced a noise reduction effect.ResultsIn this paper, we used the MICCAI 2017 liver tumor segmentation (LiTS) challenge dataset, 3DIRCADb dataset and doctors’ manual contours of Hubei Cancer Hospital dataset to test the network architecture. We calculated the Dice Global (DG) score, Dice per Case (DC) score, volumetric overlap error (VOE), average symmetric surface distance (ASSD), and root mean square error (RMSE) to evaluate the accuracy of the architecture for liver tumor segmentation. The segmentation DG for tumor was found to be 0.7555, DC was 0.613, VOE was 0.413, ASSD was 1.186 and RMSE was 1.804. For a small tumor, DG was 0.3246 and DC was 0.3082. For a large tumor, DG was 0.7819 and DC was 0.7632.ConclusionS-Net obtained more semantic information with the introduction of an attention mechanism and long jump connection. Experimental results showed that this method effectively improved the effect of tumor recognition in CT images and could be applied to assist doctors in clinical treatment.

Sign in / Sign up

Export Citation Format

Share Document