scholarly journals GAN-Based ROI Image Translation Method for Predicting Image after Hair Transplant Surgery

Electronics ◽  
2021 ◽  
Vol 10 (24) ◽  
pp. 3066
Author(s):  
Do-Yeon Hwang ◽  
Seok-Hwan Choi ◽  
Jinmyeong Shin ◽  
Moonkyu Kim ◽  
Yoon-Ho Choi
Keyword(s):  
Image Segmentation ◽  
Similarity Index ◽  
The Other ◽  
Ensemble Method ◽  
Translation Method ◽  
Hair Transplantation ◽  
Generative Adversarial Network ◽  
Hair Transplant ◽  
Image Translation ◽  
The Ensemble Method

In this paper, we propose a new deep learning-based image translation method to predict and generate images after hair transplant surgery from images before hair transplant surgery. Since existing image translation models use a naive strategy that trains the whole distribution of translation, the image translation models using the original image as the input data result in converting not only the hair transplant surgery region, which is the region of interest (ROI) for image translation, but also the other image regions, which are not the ROI. To solve this problem, we proposed a novel generative adversarial network (GAN)-based ROI image translation method, which converts only the ROI and retains the image for the non-ROI. Specifically, by performing image translation and image segmentation independently, the proposed method generates predictive images from the distribution of images after hair transplant surgery and specifies the ROI to be used for generated images. In addition, by applying the ensemble method to image segmentation, we propose a more robust method through complementing the shortages of various image segmentation models. From the experimental results using a real medical image dataset, e.g., 1394 images before hair transplantation and 896 images after hair transplantation, to train the GAN model, we show that the proposed GAN-based ROI image translation method performed better than the other GAN-based image translation methods, e.g., by 23% in SSIM (Structural Similarity Index Measure), 452% in IoU (Intersection over Union), and 42% in FID (Frechet Inception Distance), on average. Furthermore, the ensemble method that we propose not only improves ROI detection performance but also shows consistent performances in generating better predictive images from preoperative images taken from diverse angles.

scholarly journals DAGAN: A Domain-Aware Method for Image-to-Image Translations

Complexity ◽  
2020 ◽  
Vol 2020 ◽  
pp. 1-15
Author(s):  
Xu Yin ◽  
Yan Li ◽  
Byeong-Seok Shin
Keyword(s):  
Image Segmentation ◽  
Translation Method ◽  
Image Translation

The image-to-image translation method aims to learn inter-domain mappings from paired/unpaired data. Although this technique has been widely used for visual predication tasks—such as classification and image segmentation—and achieved great results, we still failed to perform flexible translations when attempting to learn different mappings, especially for images containing multiple instances. To tackle this problem, we propose a generative framework DAGAN (Domain-aware Generative Adversarial etwork) that enables domains to learn diverse mapping relationships. We assumed that an image is composed with background and instance domain and then fed them into different translation networks. Lastly, we integrated the translated domains into a complete image with smoothed labels to maintain realism. We examined the instance-aware framework on datasets generated by YOLO and confirmed that this is capable of generating images of equal or better diversity compared to current translation models.

scholarly journals GPR B-Scan Image Denoising via Multi-Scale Convolutional Autoencoder with Data Augmentation

Electronics ◽  
2021 ◽  
Vol 10 (11) ◽  
pp. 1269
Author(s):  
Jiabin Luo ◽  
Wentai Lei ◽  
Feifei Hou ◽  
Chenghao Wang ◽  
Qiang Ren ◽  
...  
Keyword(s):  
Image Denoising ◽  
Data Augmentation ◽  
Noise Suppression ◽  
Random Noise ◽  
Similarity Index ◽  
Structural Similarity ◽  
Training Dataset ◽  
Generative Adversarial Network ◽  
Multi Scale ◽  
Convolutional Autoencoder

Ground-penetrating radar (GPR), as a non-invasive instrument, has been widely used in civil engineering. In GPR B-scan images, there may exist random noise due to the influence of the environment and equipment hardware, which complicates the interpretability of the useful information. Many methods have been proposed to eliminate or suppress the random noise. However, the existing methods have an unsatisfactory denoising effect when the image is severely contaminated by random noise. This paper proposes a multi-scale convolutional autoencoder (MCAE) to denoise GPR data. At the same time, to solve the problem of training dataset insufficiency, we designed the data augmentation strategy, Wasserstein generative adversarial network (WGAN), to increase the training dataset of MCAE. Experimental results conducted on both simulated, generated, and field datasets demonstrated that the proposed scheme has promising performance for image denoising. In terms of three indexes: the peak signal-to-noise ratio (PSNR), the time cost, and the structural similarity index (SSIM), the proposed scheme can achieve better performance of random noise suppression compared with the state-of-the-art competing methods (e.g., CAE, BM3D, WNNM).

Estimating Heterogeneous Treatment Effects and the Effects of Heterogeneous Treatments with Ensemble Methods

2017 ◽  
Vol 25 (4) ◽  
pp. 413-434 ◽  
Author(s):  
Justin Grimmer ◽  
Solomon Messing ◽  
Sean J. Westwood
Keyword(s):  
Treatment Effects ◽  
Ensemble Methods ◽  
Ensemble Method ◽  
Superior Performance ◽  
Accurate Estimation ◽  
Randomized Experiments ◽  
Heterogeneous Treatment Effects ◽  
Data Set ◽  
Heterogeneous Effects ◽  
The Ensemble Method

Randomized experiments are increasingly used to study political phenomena because they can credibly estimate the average effect of a treatment on a population of interest. But political scientists are often interested in how effects vary across subpopulations—heterogeneous treatment effects—and how differences in the content of the treatment affects responses—the response to heterogeneous treatments. Several new methods have been introduced to estimate heterogeneous effects, but it is difficult to know if a method will perform well for a particular data set. Rather than using only one method, we show how an ensemble of methods—weighted averages of estimates from individual models increasingly used in machine learning—accurately measure heterogeneous effects. Building on a large literature on ensemble methods, we show how the weighting of methods can contribute to accurate estimation of heterogeneous treatment effects and demonstrate how pooling models lead to superior performance to individual methods across diverse problems. We apply the ensemble method to two experiments, illuminating how the ensemble method for heterogeneous treatment effects facilitates exploratory analysis of treatment effects.

scholarly journals Image-to-Image Translation with Multi-Path Consistency Regularization

2019 ◽  
Author(s):  
Jianxin Lin ◽  
Yingce Xia ◽  
Yijun Wang ◽  
Tao Qin ◽  
Zhibo Chen
Keyword(s):  
Machine Learning ◽  
Computer Vision ◽  
The Other ◽  
Natural Images ◽  
Original Image ◽  
Target Domain ◽  
Source Domain ◽  
Face To Face ◽  
Image Translation ◽  
The Difference

Image translation across different domains has attracted much attention in both machine learning and computer vision communities. Taking the translation from a source domain to a target domain as an example, existing algorithms mainly rely on two kinds of loss for training: One is the discrimination loss, which is used to differentiate images generated by the models and natural images; the other is the reconstruction loss, which measures the difference between an original image and the reconstructed version. In this work, we introduce a new kind of loss, multi-path consistency loss, which evaluates the differences between direct translation from source domain to target domain and indirect translation from source domain to an auxiliary domain to target domain, to regularize training. For multi-domain translation (at least, three) which focuses on building translation models between any two domains, at each training iteration, we randomly select three domains, set them respectively as the source, auxiliary and target domains, build the multi-path consistency loss and optimize the network. For two-domain translation, we need to introduce an additional auxiliary domain and construct the multi-path consistency loss. We conduct various experiments to demonstrate the effectiveness of our proposed methods, including face-to-face translation, paint-to-photo translation, and de-raining/de-noising translation.

scholarly journals An Adaptive Generative Adversarial Network for Cardiac Segmentation from X-ray Chest Radiographs

2020 ◽  
Vol 10 (15) ◽  
pp. 5032
Author(s):  
Xiaochang Wu ◽  
Xiaolin Tian
Keyword(s):  
Image Segmentation ◽  
Medical Image Segmentation ◽  
Chest Radiographs ◽  
Generative Adversarial Networks ◽  
Generative Adversarial Network ◽  
X Ray ◽  
Adversarial Network ◽  
Cardiac Segmentation ◽  
Adversarial Networks ◽  
Feature Extractor

Medical image segmentation is a classic challenging problem. The segmentation of parts of interest in cardiac medical images is a basic task for cardiac image diagnosis and guided surgery. The effectiveness of cardiac segmentation directly affects subsequent medical applications. Generative adversarial networks have achieved outstanding success in image segmentation compared with classic neural networks by solving the oversegmentation problem. Cardiac X-ray images are prone to weak edges, artifacts, etc. This paper proposes an adaptive generative adversarial network for cardiac segmentation to improve the segmentation rate of X-ray images by generative adversarial networks. The adaptive generative adversarial network consists of three parts: a feature extractor, a discriminator and a selector. In this method, multiple generators are trained in the feature extractor. The discriminator scores the features of different dimensions. The selector selects the appropriate features and adjusts the network for the next iteration. With the help of the discriminator, this method uses multinetwork joint feature extraction to achieve network adaptivity. This method allows features of multiple dimensions to be combined to perform joint training of the network to enhance its generalization ability. The results of cardiac segmentation experiments on X-ray chest radiographs show that this method has higher segmentation accuracy and less overfitting than other methods. In addition, the proposed network is more stable.

Symbiotic Organisms Search Optimization for Multilevel Image Thresholding

2020 ◽  
Vol 11 (2) ◽  
pp. 31-61
Author(s):  
Falguni Chakraborty ◽  
Provas Kumar Roy ◽  
Debashis Nandi
Keyword(s):  
Image Segmentation ◽  
Heuristic Algorithms ◽  
Signal To Noise Ratio ◽  
Similarity Index ◽  
Symbiotic Relationship ◽  
Symbiotic Organisms Search ◽  
Image Thresholding ◽  
Prime Concern ◽  
Feature Similarity Index ◽  
Symbiotic Organisms

Determination of optimum thresholds is the prime concern of any multilevel image thresholding technique. The traditional methods for multilevel thresholding are computationally expensive, time-consuming, and also suffer from lack of accuracy and stability. To address this issue, the authors propose a new methodology for multilevel image thresholding based on a recently developed meta-heuristic algorithm, Symbiotic Organisms Search (SOS). The SOS algorithm has been inspired by the symbiotic relationship among the organism in nature. This article has utilized the concept of the symbiotic relationship among the organisms to optimize three objective functions: Otsu's between class variance and Kapur's and Tsallis entropy for image segmentation. The performance of the SOS based image segmentation algorithm has been evaluated using a set of benchmark images and has been compared with four recent meta-heuristic algorithms. The algorithms are compared in terms of effectiveness and consistency. The quality of the algorithms has been estimated by some well-defined quality metrics such as peak signal-to-noise ratio (PSNR), structure similarity index (SSIM), and, feature similarity index (FSIM). The experimental results of the algorithms reveal that the balance of intensification and diversification of the SOS algorithm to achieve the global optima is better than others.

Sign in / Sign up

Export Citation Format

Share Document