scholarly journals Domain Adaptation for Medical Image Segmentation: A Meta-Learning Method

2021 ◽  
Vol 7 (2) ◽  
pp. 31
Author(s):  
Penghao Zhang ◽  
Jiayue Li ◽  
Yining Wang ◽  
Judong Pan
Keyword(s):  
Image Segmentation ◽  
Medical Image ◽  
Domain Adaptation ◽  
Medical Image Segmentation ◽  
Training Data ◽  
Tissue Type ◽  
Dice Similarity Coefficient ◽  
Learning Method ◽  
Task Distribution ◽  
Meta Learning

Convolutional neural networks (CNNs) have demonstrated great achievement in increasing the accuracy and stability of medical image segmentation. However, existing CNNs are limited by the problem of dependency on the availability of training data owing to high manual annotation costs and privacy issues. To counter this limitation, domain adaptation (DA) and few-shot learning have been extensively studied. Inspired by these two categories of approaches, we propose an optimization-based meta-learning method for segmentation tasks. Even though existing meta-learning methods use prior knowledge to choose parameters that generalize well from few examples, these methods limit the diversity of the task distribution that they can learn from in medical image segmentation. In this paper, we propose a meta-learning algorithm to augment the existing algorithms with the capability to learn from diverse segmentation tasks across the entire task distribution. Specifically, our algorithm aims to learn from the diversity of image features which characterize a specific tissue type while showing diverse signal intensities. To demonstrate the effectiveness of the proposed algorithm, we conducted experiments using a diverse set of segmentation tasks from the Medical Segmentation Decathlon and two meta-learning benchmarks: model-agnostic meta-learning (MAML) and Reptile. U-Net and Dice similarity coefficient (DSC) were selected as the baseline model and the main performance metric, respectively. The experimental results show that our algorithm maximally surpasses MAML and Reptile by 2% and 2.4% respectively, in terms of the DSC. By showing a consistent improvement in subjective measures, we can also infer that our algorithm can produce a better generalization of a target task that has few examples.

scholarly journals Unsupervised Domain Adaptation with Dual-Scheme Fusion Network for Medical Image Segmentation

2020 ◽  
Author(s):  
Danbing Zou ◽  
Qikui Zhu ◽  
Pingkun Yan
Keyword(s):  
Image Segmentation ◽  
Medical Image ◽  
Network Performance ◽  
Domain Adaptation ◽  
Medical Image Segmentation ◽  
Training Data ◽  
Tumor Segmentation ◽  
Target Domain ◽  
Brain Tumor Segmentation ◽  
Unsupervised Domain Adaptation

Domain adaptation aims to alleviate the problem of retraining a pre-trained model when applying it to a different domain, which requires large amount of additional training data of the target domain. Such an objective is usually achieved by establishing connections between the source domain labels and target domain data. However, this imbalanced source-to-target one way pass may not eliminate the domain gap, which limits the performance of the pre-trained model. In this paper, we propose an innovative Dual-Scheme Fusion Network (DSFN) for unsupervised domain adaptation. By building both source-to-target and target-to-source connections, this balanced joint information flow helps reduce the domain gap to further improve the network performance. The mechanism is further applied to the inference stage, where both the original input target image and the generated source images are segmented with the proposed joint network. The results are fused to obtain more robust segmentation. Extensive experiments of unsupervised cross-modality medical image segmentation are conducted on two tasks -- brain tumor segmentation and cardiac structures segmentation. The experimental results show that our method achieved significant performance improvement over other state-of-the-art domain adaptation methods.

scholarly journals Mixup (Sample Pairing) Can Improve the Performance of Deep Segmentation Networks

2021 ◽  
Vol 12 (1) ◽  
pp. 29-39
Author(s):  
Lars J. Isaksson ◽  
Paul Summers ◽  
Sara Raimondi ◽  
Sara Gandini ◽  
Abhir Bhalerao ◽  
...  
Keyword(s):  
Image Segmentation ◽  
Medical Image ◽  
Data Augmentation ◽  
Image Data ◽  
Magnetic Resonance Images ◽  
Medical Image Segmentation ◽  
Dice Similarity Coefficient ◽  
Surface Distance ◽  
Experienced Radiologist ◽  
Generalization Problem

Abstract Researchers address the generalization problem of deep image processing networks mainly through extensive use of data augmentation techniques such as random flips, rotations, and deformations. A data augmentation technique called mixup, which constructs virtual training samples from convex combinations of inputs, was recently proposed for deep classification networks. The algorithm contributed to increased performance on classification in a variety of datasets, but so far has not been evaluated for image segmentation tasks. In this paper, we tested whether the mixup algorithm can improve the generalization performance of deep segmentation networks for medical image data. We trained a standard U-net architecture to segment the prostate in 100 T2-weighted 3D magnetic resonance images from prostate cancer patients, and compared the results with and without mixup in terms of Dice similarity coefficient and mean surface distance from a reference segmentation made by an experienced radiologist. Our results suggest that mixup offers a statistically significant boost in performance compared to non-mixup training, leading to up to 1.9% increase in Dice and a 10.9% decrease in surface distance. The mixup algorithm may thus offer an important aid for medical image segmentation applications, which are typically limited by severe data scarcity.

Semantic Consistent Unsupervised Domain Adaptation for Cross-Modality Medical Image Segmentation

2021 ◽  
pp. 201-210
Author(s):  
Guodong Zeng ◽  
Till D. Lerch ◽  
Florian Schmaranzer ◽  
Guoyan Zheng ◽  
Jürgen Burger ◽  
...  
Keyword(s):  
Image Segmentation ◽  
Medical Image ◽  
Domain Adaptation ◽  
Medical Image Segmentation ◽  
Unsupervised Domain Adaptation

scholarly journals Synergistic Image and Feature Adaptation: Towards Cross-Modality Domain Adaptation for Medical Image Segmentation

2019 ◽  
Vol 33 ◽  
pp. 865-872 ◽  
Author(s):  
Cheng Chen ◽  
Qi Dou ◽  
Hao Chen ◽  
Jing Qin ◽  
Pheng-Ann Heng
Keyword(s):  
Image Segmentation ◽  
Medical Image ◽  
Domain Adaptation ◽  
State Of The Art ◽  
Medical Image Segmentation ◽  
Target Domain ◽  
Learning Procedure ◽  
The Neural Networks ◽  
Feature Adaptation ◽  
Segmentation Task

This paper presents a novel unsupervised domain adaptation framework, called Synergistic Image and Feature Adaptation (SIFA), to effectively tackle the problem of domain shift. Domain adaptation has become an important and hot topic in recent studies on deep learning, aiming to recover performance degradation when applying the neural networks to new testing domains. Our proposed SIFA is an elegant learning diagram which presents synergistic fusion of adaptations from both image and feature perspectives. In particular, we simultaneously transform the appearance of images across domains and enhance domain-invariance of the extracted features towards the segmentation task. The feature encoder layers are shared by both perspectives to grasp their mutual benefits during the end-to-end learning procedure. Without using any annotation from the target domain, the learning of our unified model is guided by adversarial losses, with multiple discriminators employed from various aspects. We have extensively validated our method with a challenging application of crossmodality medical image segmentation of cardiac structures. Experimental results demonstrate that our SIFA model recovers the degraded performance from 17.2% to 73.0%, and outperforms the state-of-the-art methods by a significant margin.

scholarly journals Match Feature U-Net: Dynamic Receptive Field Networks for Biomedical Image Segmentation

Symmetry ◽  
2020 ◽  
Vol 12 (8) ◽  
pp. 1230
Author(s):  
Xiaofei Qin ◽  
Chengzi Wu ◽  
Hang Chang ◽  
Hao Lu ◽  
Xuedian Zhang
Keyword(s):  
Image Segmentation ◽  
Receptive Field ◽  
Medical Image ◽  
Medical Image Analysis ◽  
Medical Image Segmentation ◽  
Training Data ◽  
Cell Segmentation ◽  
Biomedical Image ◽  
Nuclei Segmentation ◽  
Kernel Convolution

Medical image segmentation is a fundamental task in medical image analysis. Dynamic receptive field is very helpful for accurate medical image segmentation, which needs to be further studied and utilized. In this paper, we propose Match Feature U-Net, a novel, symmetric encoder– decoder architecture with dynamic receptive field for medical image segmentation. We modify the Selective Kernel convolution (a module proposed in Selective Kernel Networks) by inserting a newly proposed Match operation, which makes similar features in different convolution branches have corresponding positions, and then we replace the U-Net’s convolution with the redesigned Selective Kernel convolution. This network is a combination of U-Net and improved Selective Kernel convolution. It inherits the advantages of simple structure and low parameter complexity of U-Net, and enhances the efficiency of dynamic receptive field in Selective Kernel convolution, making it an ideal model for medical image segmentation tasks which often have small training data and large changes in targets size. Compared with state-of-the-art segmentation methods, the number of parameters in Match Feature U-Net (2.65 M) is 34% of U-Net (7.76 M), 29% of UNet++ (9.04 M), and 9.1% of CE-Net (29 M). We evaluated the proposed architecture in four medical image segmentation tasks: nuclei segmentation in microscopy images, breast cancer cell segmentation, gland segmentation in colon histology images, and disc/cup segmentation. Our experimental results show that Match Feature U-Net achieves an average Mean Intersection over Union (MIoU) gain of 1.8, 1.45, and 2.82 points over U-Net, UNet++, and CE-Net, respectively.

Sign in / Sign up

Export Citation Format

Share Document