scholarly journals Non-Local Context Encoder: Robust Biomedical Image Segmentation against Adversarial Attacks

2019 ◽  
Vol 33 ◽  
pp. 8417-8424 ◽  
Author(s):  
Xiang He ◽  
Sibei Yang ◽  
Guanbin Li ◽  
Haofeng Li ◽  
Huiyou Chang ◽  
...  
Keyword(s):  
Image Segmentation ◽  
State Of The Art ◽  
Contextual Information ◽  
Local Context ◽  
Deep Convolutional Neural Networks ◽  
Biomedical Image ◽  
Feature Representations ◽  
Segmentation Methods ◽  
Spatial Dependencies ◽  
Non Local

Recent progress in biomedical image segmentation based on deep convolutional neural networks (CNNs) has drawn much attention. However, its vulnerability towards adversarial samples cannot be overlooked. This paper is the first one that discovers that all the CNN-based state-of-the-art biomedical image segmentation models are sensitive to adversarial perturbations. This limits the deployment of these methods in safety-critical biomedical fields. In this paper, we discover that global spatial dependencies and global contextual information in a biomedical image can be exploited to defend against adversarial attacks. To this end, non-local context encoder (NLCE) is proposed to model short- and long-range spatial dependencies and encode global contexts for strengthening feature activations by channel-wise attention. The NLCE modules enhance the robustness and accuracy of the non-local context encoding network (NLCEN), which learns robust enhanced pyramid feature representations with NLCE modules, and then integrates the information across different levels. Experiments on both lung and skin lesion segmentation datasets have demonstrated that NLCEN outperforms any other state-of-the-art biomedical image segmentation methods against adversarial attacks. In addition, NLCE modules can be applied to improve the robustness of other CNN-based biomedical image segmentation methods.

scholarly journals PyConvU-Net: a lightweight and multiscale network for biomedical image segmentation

2021 ◽  
Vol 22 (1) ◽  
Author(s):  
Changyong Li ◽  
Yongxian Fan ◽  
Xiaodong Cai
Keyword(s):  
Image Segmentation ◽  
Deep Learning ◽  
State Of The Art ◽  
Experimental Results ◽  
Actual Situation ◽  
Controlled Experiments ◽  
Biomedical Image ◽  
Segmentation Methods ◽  
Art Performance

Abstract Background With the development of deep learning (DL), more and more methods based on deep learning are proposed and achieve state-of-the-art performance in biomedical image segmentation. However, these methods are usually complex and require the support of powerful computing resources. According to the actual situation, it is impractical that we use huge computing resources in clinical situations. Thus, it is significant to develop accurate DL based biomedical image segmentation methods which depend on resources-constraint computing. Results A lightweight and multiscale network called PyConvU-Net is proposed to potentially work with low-resources computing. Through strictly controlled experiments, PyConvU-Net predictions have a good performance on three biomedical image segmentation tasks with the fewest parameters. Conclusions Our experimental results preliminarily demonstrate the potential of proposed PyConvU-Net in biomedical image segmentation with resources-constraint computing.

scholarly journals A New Ensemble Learning Framework for 3D Biomedical Image Segmentation

2019 ◽  
Vol 33 ◽  
pp. 5909-5916 ◽  
Author(s):  
Hao Zheng ◽  
Yizhe Zhang ◽  
Lin Yang ◽  
Peixian Liang ◽  
Zhuo Zhao ◽  
...  
Keyword(s):  
Image Segmentation ◽  
Ensemble Learning ◽  
State Of The Art ◽  
3D Models ◽  
Superior Performance ◽  
3D Image ◽  
Convolutional Network ◽  
Biomedical Image ◽  
Learning Framework ◽  
2D And 3D

3D image segmentation plays an important role in biomedical image analysis. Many 2D and 3D deep learning models have achieved state-of-the-art segmentation performance on 3D biomedical image datasets. Yet, 2D and 3D models have their own strengths and weaknesses, and by unifying them together, one may be able to achieve more accurate results. In this paper, we propose a new ensemble learning framework for 3D biomedical image segmentation that combines the merits of 2D and 3D models. First, we develop a fully convolutional network based meta-learner to learn how to improve the results from 2D and 3D models (base-learners). Then, to minimize over-fitting for our sophisticated meta-learner, we devise a new training method that uses the results of the baselearners as multiple versions of “ground truths”. Furthermore, since our new meta-learner training scheme does not depend on manual annotation, it can utilize abundant unlabeled 3D image data to further improve the model. Extensive experiments on two public datasets (the HVSMR 2016 Challenge dataset and the mouse piriform cortex dataset) show that our approach is effective under fully-supervised, semisupervised, and transductive settings, and attains superior performance over state-of-the-art image segmentation methods.

scholarly journals A General System for Automatic Biomedical Image Segmentation Using Intensity Neighborhoods

2011 ◽  
Vol 2011 ◽  
pp. 1-12 ◽  
Author(s):  
Cheng Chen ◽  
John A. Ozolek ◽  
Wei Wang ◽  
Gustavo K. Rohde
Keyword(s):  
Image Segmentation ◽  
Learning Strategy ◽  
General System ◽  
Training Data ◽  
Tissue Segmentation ◽  
Biomedical Image ◽  
Nuclei Segmentation ◽  
Segmentation Methods ◽  
Microscopy Images ◽  
Better Than

Image segmentation is important with applications to several problems in biology and medicine. While extensively researched, generally, current segmentation methods perform adequately in the applications for which they were designed, but often require extensive modifications or calibrations before being used in a different application. We describe an approach that, with few modifications, can be used in a variety of image segmentation problems. The approach is based on a supervised learning strategy that utilizes intensity neighborhoods to assign each pixel in a test image its correct class based on training data. We describe methods for modeling rotations and variations in scales as well as a subset selection for training the classifiers. We show that the performance of our approach in tissue segmentation tasks in magnetic resonance and histopathology microscopy images, as well as nuclei segmentation from fluorescence microscopy images, is similar to or better than several algorithms specifically designed for each of these applications.

scholarly journals EHANet: An Effective Hierarchical Aggregation Network for Face Parsing

2020 ◽  
Vol 10 (9) ◽  
pp. 3135 ◽  
Author(s):  
Ling Luo ◽  
Dingyu Xue ◽  
Xinglong Feng
Keyword(s):  
Neural Networks ◽  
Real World ◽  
State Of The Art ◽  
Contextual Information ◽  
Semantic Gap ◽  
Deep Convolutional Neural Networks ◽  
Multi Scale ◽  
Hierarchical Aggregation ◽  
Real World Applications ◽  
Weighted Boundary

In recent years, benefiting from deep convolutional neural networks (DCNNs), face parsing has developed rapidly. However, it still has the following problems: (1) Existing state-of-the-art frameworks usually do not satisfy real-time while pursuing performance; (2) similar appearances cause incorrect pixel label assignments, especially in the boundary; (3) to promote multi-scale prediction, deep features and shallow features are used for fusion without considering the semantic gap between them. To overcome these drawbacks, we propose an effective and efficient hierarchical aggregation network called EHANet for fast and accurate face parsing. More specifically, we first propose a stage contextual attention mechanism (SCAM), which uses higher-level contextual information to re-encode the channel according to its importance. Secondly, a semantic gap compensation block (SGCB) is presented to ensure the effective aggregation of hierarchical information. Thirdly, the advantages of weighted boundary-aware loss effectively make up for the ambiguity of boundary semantics. Without any bells and whistles, combined with a lightweight backbone, we achieve outstanding results on both CelebAMask-HQ (78.19% mIoU) and Helen datasets (90.7% F1-score). Furthermore, our model can achieve 55 FPS on a single GTX 1080Ti card with 640 × 640 input and further reach over 300 FPS with a resolution of 256 × 256, which is suitable for real-world applications.

scholarly journals NLCA-Net: a non-local context attention network for stereo matching

2020 ◽  
Vol 9 ◽  
Author(s):  
Zhibo Rao ◽  
Mingyi He ◽  
Yuchao Dai ◽  
Zhidong Zhu ◽  
Bo Li ◽  
...  
Keyword(s):  
Stereo Matching ◽  
Hot Spot ◽  
Contextual Information ◽  
Feature Learning ◽  
Superior Performance ◽  
Local Context ◽  
Disparity Map ◽  
Matching Rule ◽  
Attention Network ◽  
Non Local

Accurate disparity prediction is a hot spot in computer vision, and how to efficiently exploit contextual information is the key to improve the performance. In this paper, we propose a simple yet effective non-local context attention network to exploit the global context information by using attention mechanisms and semantic information for stereo matching. First, we develop a 2D geometry feature learning module to get a more discriminative representation by taking advantage of multi-scale features and form them into the variance-based cost volume. Then, we construct a non-local attention matching module by using the non-local block and hierarchical 3D convolutions, which can effectively regularize the cost volume and capture the global contextual information. Finally, we adopt a geometry refinement module to refine the disparity map to further improve the performance. Moreover, we add the warping loss function to help the model learn the matching rule of the non-occluded region. Our experiments show that (1) our approach achieves competitive results on KITTI and SceneFlow datasets in the end-point error and the fraction of erroneous pixels $({D_1})$ ; (2) our proposed method particularly has superior performance in the reflective regions and occluded areas.

scholarly journals Non-Local U-Nets for Biomedical Image Segmentation

2020 ◽  
Vol 34 (04) ◽  
pp. 6315-6322
Author(s):  
Zhengyang Wang ◽  
Na Zou ◽  
Dinggang Shen ◽  
Shuiwang Ji
Keyword(s):  
Image Segmentation ◽  
Great Promise ◽  
Biomedical Image ◽  
Decoder Architecture ◽  
Efficiency And Effectiveness ◽  
Local Operators ◽  
Non Local ◽  
Infant Brain ◽  
Segmentation Task ◽  
Mr Image Segmentation

Deep learning has shown its great promise in various biomedical image segmentation tasks. Existing models are typically based on U-Net and rely on an encoder-decoder architecture with stacked local operators to aggregate long-range information gradually. However, only using the local operators limits the efficiency and effectiveness. In this work, we propose the non-local U-Nets, which are equipped with flexible global aggregation blocks, for biomedical image segmentation. These blocks can be inserted into U-Net as size-preserving processes, as well as down-sampling and up-sampling layers. We perform thorough experiments on the 3D multimodality isointense infant brain MR image segmentation task to evaluate the non-local U-Nets. Results show that our proposed models achieve top performances with fewer parameters and faster computation.

scholarly journals A Review of Deep-Learning-Based Medical Image Segmentation Methods

2021 ◽  
Vol 13 (3) ◽  
pp. 1224
Author(s):  
Xiangbin Liu ◽  
Liping Song ◽  
Shuai Liu ◽  
Yudong Zhang
Keyword(s):  
Image Processing ◽  
Image Segmentation ◽  
Deep Learning ◽  
Medical Image ◽  
Rapid Development ◽  
Medical Image Segmentation ◽  
Deep Convolutional Neural Networks ◽  
Biomedical Image Processing ◽  
Data Set ◽  
Segmentation Methods

As an emerging biomedical image processing technology, medical image segmentation has made great contributions to sustainable medical care. Now it has become an important research direction in the field of computer vision. With the rapid development of deep learning, medical image processing based on deep convolutional neural networks has become a research hotspot. This paper focuses on the research of medical image segmentation based on deep learning. First, the basic ideas and characteristics of medical image segmentation based on deep learning are introduced. By explaining its research status and summarizing the three main methods of medical image segmentation and their own limitations, the future development direction is expanded. Based on the discussion of different pathological tissues and organs, the specificity between them and their classic segmentation algorithms are summarized. Despite the great achievements of medical image segmentation in recent years, medical image segmentation based on deep learning has still encountered difficulties in research. For example, the segmentation accuracy is not high, the number of medical images in the data set is small and the resolution is low. The inaccurate segmentation results are unable to meet the actual clinical requirements. Aiming at the above problems, a comprehensive review of current medical image segmentation methods based on deep learning is provided to help researchers solve existing problems.

Sign in / Sign up

Export Citation Format

Share Document