scholarly journals Semantic consistency generative adversarial network for cross-modality domain adaptation in ultrasound thyroid nodule classification

2022 ◽  
Author(s):  
Jun Zhao ◽  
Xiaosong Zhou ◽  
Guohua Shi ◽  
Ning Xiao ◽  
Kai Song ◽  
...  
Keyword(s):  
Thyroid Nodule ◽  
Domain Adaptation ◽  
Generative Adversarial Network ◽  
Semantic Consistency ◽  
Adversarial Network ◽  
Nodule Classification

scholarly journals 1D conditional generative adversarial network for spectrum-to-spectrum translation of simulated chemical reflectance signatures

2021 ◽  
Author(s):  
Cara Murphy ◽  
John Kerekes
Keyword(s):  
Classification Accuracy ◽  
Domain Adaptation ◽  
Real Data ◽  
Training Set ◽  
Generative Adversarial Network ◽  
Average Classification Accuracy ◽  
Adversarial Network ◽  
Chemical Residues ◽  
Reflectance Data

The classification of trace chemical residues through active spectroscopic sensing is challenging due to the lack of physics-based models that can accurately predict spectra. To overcome this challenge, we leveraged the field of domain adaptation to translate data from the simulated to the measured domain for training a classifier. We developed the first 1D conditional generative adversarial network (GAN) to perform spectrum-to-spectrum translation of reflectance signatures. We applied the 1D conditional GAN to a library of simulated spectra and quantified the improvement in classification accuracy on real data using the translated spectra for training the classifier. Using the GAN-translated library, the average classification accuracy increased from 0.622 to 0.723 on real chemical reflectance data, including data from chemicals not included in the GAN training set.

scholarly journals Multi-Source Domain Adaptation for Visual Sentiment Classification

2020 ◽  
Vol 34 (03) ◽  
pp. 2661-2668
Author(s):  
Chuang Lin ◽  
Sicheng Zhao ◽  
Lei Meng ◽  
Tat-Seng Chua
Keyword(s):  
Domain Adaptation ◽  
Sentiment Classification ◽  
Similar Distribution ◽  
Single Source ◽  
Target Domain ◽  
Generative Adversarial Network ◽  
Source Domain ◽  
Adversarial Network ◽  
Latent Space ◽  
Benchmark Datasets

Existing domain adaptation methods on visual sentiment classification typically are investigated under the single-source scenario, where the knowledge learned from a source domain of sufficient labeled data is transferred to the target domain of loosely labeled or unlabeled data. However, in practice, data from a single source domain usually have a limited volume and can hardly cover the characteristics of the target domain. In this paper, we propose a novel multi-source domain adaptation (MDA) method, termed Multi-source Sentiment Generative Adversarial Network (MSGAN), for visual sentiment classification. To handle data from multiple source domains, it learns to find a unified sentiment latent space where data from both the source and target domains share a similar distribution. This is achieved via cycle consistent adversarial learning in an end-to-end manner. Extensive experiments conducted on four benchmark datasets demonstrate that MSGAN significantly outperforms the state-of-the-art MDA approaches for visual sentiment classification.

scholarly journals Domain Adaptation for Imitation Learning Using Generative Adversarial Network

Sensors ◽  
2021 ◽  
Vol 21 (14) ◽  
pp. 4718
Author(s):  
Tho Nguyen Duc ◽  
Chanh Minh Tran ◽  
Phan Xuan Tan ◽  
Eiji Kamioka
Keyword(s):  
Optimal Policy ◽  
Domain Adaptation ◽  
Imitation Learning ◽  
High Dimensional ◽  
Autonomous Agent ◽  
Generative Adversarial Network ◽  
Reward Function ◽  
Domain Specific ◽  
Adversarial Network ◽  
Domain Configuration

Imitation learning is an effective approach for an autonomous agent to learn control policies when an explicit reward function is unavailable, using demonstrations provided from an expert. However, standard imitation learning methods assume that the agents and the demonstrations provided by the expert are in the same domain configuration. Such an assumption has made the learned policies difficult to apply in another distinct domain. The problem is formalized as domain adaptive imitation learning, which is the process of learning how to perform a task optimally in a learner domain, given demonstrations of the task in a distinct expert domain. We address the problem by proposing a model based on Generative Adversarial Network. The model aims to learn both domain-shared and domain-specific features and utilizes it to find an optimal policy across domains. The experimental results show the effectiveness of our model in a number of tasks ranging from low to complex high-dimensional.

scholarly journals Generative Adversarial Networks for Video-to-Video Domain Adaptation

2020 ◽  
Vol 34 (04) ◽  
pp. 3462-3469
Author(s):  
Jiawei Chen ◽  
Yuexiang Li ◽  
Kai Ma ◽  
Yefeng Zheng
Keyword(s):  
Network Architecture ◽  
Domain Adaptation ◽  
Colorectal Polyps ◽  
Generative Adversarial Networks ◽  
Generative Adversarial Network ◽  
Color Distribution ◽  
Adversarial Network ◽  
Adversarial Networks ◽  
General Network ◽  
Imaging Conditions

Endoscopic videos from multicentres often have different imaging conditions, e.g., color and illumination, which make the models trained on one domain usually fail to generalize well to another. Domain adaptation is one of the potential solutions to address the problem. However, few of existing works focused on the translation of video-based data. In this work, we propose a novel generative adversarial network (GAN), namely VideoGAN, to transfer the video-based data across different domains. As the frames of a video may have similar content and imaging conditions, the proposed VideoGAN has an X-shape generator to preserve the intra-video consistency during translation. Furthermore, a loss function, namely color histogram loss, is proposed to tune the color distribution of each translated frame. Two colonoscopic datasets from different centres, i.e., CVC-Clinic and ETIS-Larib, are adopted to evaluate the performance of domain adaptation of our VideoGAN. Experimental results demonstrate that the adapted colonoscopic video generated by our VideoGAN can significantly boost the segmentation accuracy, i.e., an improvement of 5%, of colorectal polyps on multicentre datasets. As our VideoGAN is a general network architecture, we also evaluate its performance with the CamVid driving video dataset on the cloudy-to-sunny translation task. Comprehensive experiments show that the domain gap could be substantially narrowed down by our VideoGAN.

scholarly journals Recognizing New Classes with Synthetic Data in the Loop: Application to Traffic Sign Recognition

Sensors ◽  
2020 ◽  
Vol 20 (3) ◽  
pp. 583
Author(s):  
Gabriel Villalonga ◽  
Joost Van de Weijer ◽  
Antonio M. López
Keyword(s):  
Domain Adaptation ◽  
Synthetic Data ◽  
Recognition System ◽  
Traffic Sign Recognition ◽  
Traffic Sign ◽  
Generative Adversarial Network ◽  
Adversarial Network ◽  
Sign Recognition ◽  
Short Period ◽  
Synthetic Images

On-board vision systems may need to increase the number of classes that can be recognized in a relatively short period. For instance, a traffic sign recognition system may suddenly be required to recognize new signs. Since collecting and annotating samples of such new classes may need more time than we wish, especially for uncommon signs, we propose a method to generate these samples by combining synthetic images and Generative Adversarial Network (GAN) technology. In particular, the GAN is trained on synthetic and real-world samples from known classes to perform synthetic-to-real domain adaptation, but applied to synthetic samples of the new classes. Using the Tsinghua dataset with a synthetic counterpart, SYNTHIA-TS, we have run an extensive set of experiments. The results show that the proposed method is indeed effective, provided that we use a proper Convolutional Neural Network (CNN) to perform the traffic sign recognition (classification) task as well as a proper GAN to transform the synthetic images. Here, a ResNet101-based classifier and domain adaptation based on CycleGAN performed extremely well for a ratio ∼ 1 / 4 for new/known classes; even for more challenging ratios such as ∼ 4 / 1 , the results are also very positive.

Sign in / Sign up

Export Citation Format

Share Document