A novel deep learning-based 3D cell segmentation framework for future image-based disease detection

Cell segmentation plays a crucial role in understanding, diagnosing, and treating diseases. Despite the recent success of deep learning-based cell segmentation methods, it remains challenging to accurately segment densely packed cells in 3D cell membrane images. Existing approaches also require fine-tuning multiple manually selected hyperparameters on the new datasets. We develop a deep learning-based 3D cell segmentation pipeline, 3DCellSeg, to address these challenges. Compared to the existing methods, our approach carries the following novelties: (1) a robust two-stage pipeline, requiring only one hyperparameter; (2) a light-weight deep convolutional neural network (3DCellSegNet) to efficiently output voxel-wise masks; (3) a custom loss function (3DCellSeg Loss) to tackle the clumped cell problem; and (4) an efficient touching area-based clustering algorithm (TASCAN) to separate 3D cells from the foreground masks. Cell segmentation experiments conducted on four different cell datasets show that 3DCellSeg outperforms the baseline models on the ATAS (plant), HMS (animal), and LRP (plant) datasets with an overall accuracy of 95.6%, 76.4%, and 74.7%, respectively, while achieving an accuracy comparable to the baselines on the Ovules (plant) dataset with an overall accuracy of 82.2%. Ablation studies show that the individual improvements in accuracy is attributable to 3DCellSegNet, 3DCellSeg Loss, and TASCAN, with the 3DCellSeg demonstrating robustness across different datasets and cell shapes. Our results suggest that 3DCellSeg can serve a powerful biomedical and clinical tool, such as histo-pathological image analysis, for cancer diagnosis and grading.

Intelligent Segmentation and Recognition Method of Breast Cancer Based on Digital Image Processing Technology

With the development of digital image technology, judging diseases by medical image plays an important role in medical diagnosis. Mammography is the most effective imaging examination method for breast cancer at present. Intelligent segmentation and identification of breast cancer images and judging their size and classification by digital image processing technology can promote the development of clinical medicine. This paper introduces the preprocessing technology of breast cancer pathological image and medical image recognition technology of breast cancer. In order to improve the segmentation accuracy of image processing and optimize, the segmentation recognition ability in digital mammography was improved. Based on the technical basis of pathological image analysis of breast cancer, the architecture of intelligent segmentation and recognition system for breast cancer was constructed, and each functional module of intelligent system was introduced in detail. Based on digital image processing technology, filtering technology is used to reduce dryness and improve the clarity of the image. Public datasets INBreast and DDSM-BCRP were used to verify system’s performance, and it was tested on the breast cancer image test set. The experiment shows that the comprehensive performance of the intelligent segmentation and recognition system can realize the segmentation and recognition of breast cancer and has higher accuracy and interpretability, which is helpful to improve the diagnosis of doctors.

Deep Learning Technology in Pathological Image Analysis of Breast Tissue

To explore the application value of the multilevel pyramid convolutional neural network (MPCNN) model based on convolutional neural network (CNN) in breast histopathology image analysis, in this study, based on CNN algorithm and softmax classifier (SMC), a sparse autoencoder (SAE) is introduced to optimize it. The sliding window method is used to identify cells, and the CNN + SMC pathological image cell detection method is established. Furthermore, the local region active contour (LRAC) is introduced to optimize it and the LRAC fine segmentation model driven by local Gaussian distribution is established. On this basis, the sparse automatic encoder is further introduced to optimize it and the MPCNN model is established. The proposed algorithm is evaluated on the pathological image data set. The results showed that the Acc value, F value, and Re value of pathological cell detection of CNN + SMC algorithm were significantly higher than those of the other two algorithms ( P < 0.05). The Dice, OL, Sen, and Spe values of pathological image regional segmentation of CNN algorithm were significantly higher than those of the other two algorithms, and the difference was statistically significant ( P < 0.05). The accuracy, recall, and F-measure of the optimized CNN algorithm for detecting breast histopathological images were 85.25%, 89.27%, and 80.09%, respectively. In the two databases with segmentation standards, the segmentation accuracy of MPCNN is 55%, 73.1%, 78.8%, and 82.1%. In the deep convolution network model, the training time of the MPCNN algorithm is about 80 min. It shows that when the feature dimension is low, the feature map extracted by MPCNN is more effective than the traditional feature extraction method.

Review of Breast Cancer Pathologigcal Image Processing

Breast cancer is one of the most common malignancies. Pathological image processing of breast has become an important means for early diagnosis of breast cancer. Using medical image processing to assist doctors to detect potential breast cancer as early as possible has always been a hot topic in the field of medical image diagnosis. In this paper, a breast cancer recognition method based on image processing is systematically expounded from four aspects: breast cancer detection, image segmentation, image registration, and image fusion. The achievements and application scope of supervised learning, unsupervised learning, deep learning, CNN, and so on in breast cancer examination are expounded. The prospect of unsupervised learning and transfer learning for breast cancer diagnosis is prospected. Finally, the privacy protection of breast cancer patients is put forward.

Richer fusion network for breast cancer classification based on multimodal data

Background Deep learning algorithms significantly improve the accuracy of pathological image classification, but the accuracy of breast cancer classification using only single-mode pathological images still cannot meet the needs of clinical practice. Inspired by the real scenario of pathologists reading pathological images for diagnosis, we integrate pathological images and structured data extracted from clinical electronic medical record (EMR) to further improve the accuracy of breast cancer classification. Methods In this paper, we propose a new richer fusion network for the classification of benign and malignant breast cancer based on multimodal data. To make pathological image can be integrated more sufficient with structured EMR data, we proposed a method to extract richer multilevel feature representation of the pathological image from multiple convolutional layers. Meanwhile, to minimize the information loss for each modality before data fusion, we use the denoising autoencoder as a way to increase the low-dimensional structured EMR data to high-dimensional, instead of reducing the high-dimensional image data to low-dimensional before data fusion. In addition, denoising autoencoder naturally generalizes our method to make the accurate prediction with partially missing structured EMR data. Results The experimental results show that the proposed method is superior to the most advanced method in terms of the average classification accuracy (92.9%). In addition, we have released a dataset containing structured data from 185 patients that were extracted from EMR and 3764 paired pathological images of breast cancer, which can be publicly downloaded from http://ear.ict.ac.cn/?page_id=1663. Conclusions We utilized a new richer fusion network to integrate highly heterogeneous data to leverage the structured EMR data to improve the accuracy of pathological image classification. Therefore, the application of automatic breast cancer classification algorithms in clinical practice becomes possible. Due to the generality of the proposed fusion method, it can be straightforwardly extended to the fusion of other structured data and unstructured data.