scholarly journals A NEPHOGRAM PREDICTION METHOD BASED ON GENERATIVE ADVERSARIAL NETWORK

2020 ◽  
Vol XLII-3/W10 ◽  
pp. 925-930
Author(s):  
Y. Xun ◽  
W. Q. Yu
Keyword(s):  
Loss Function ◽  
Internal Representation ◽  
Prediction Method ◽  
Ground Truth ◽  
Generative Adversarial Network ◽  
Multi Scale ◽  
Adversarial Network ◽  
Basic Characteristics ◽  
Cloud Evolution

Abstract. As one of the important sources of meteorological information, satellite nephogram is playing an increasingly important role in the detection and forecast of disastrous weather. The predictions about the movement and transformation of cloud with certain timeliness can enhance the practicability of satellite nephogram. Based on the generative adversarial network in unsupervised learning, we propose a prediction model of time series nephogram, which construct the internal representation of cloud evolution accurately and realize nephogram prediction for the next several hours. We improve the traditional generative adversarial network by constructing the generator and discriminator used the multi-scale convolution network. After the scale transform process, different scales operate convolutions in parallel and then merge the features. This structure can solve the problem of long-term dependence in the traditional network, and both global and detailed features are considered. Then according to the network structure and practical application, we define a new loss function combined with adversarial loss function to accelerate the convergence of model and sharpen predictions which keeps the effectivity of predictions further. Our method has no need to carry out the stack mathematics calculation and the manual operations, has greatly enhanced the feasibility and the efficiency. The results show that this model can reasonably describe the basic characteristics and evolution trend of cloud cluster, the prediction nephogram has very high similarity to the ground-truth nephogram.

scholarly journals Interactive Removal of Microphone Object in Facial Images

Electronics ◽  
2019 ◽  
Vol 8 (10) ◽  
pp. 1115 ◽  
Author(s):  
Muhammad Kamran Javed Khan ◽  
Nizam Ud Din ◽  
Seho Bae ◽  
Juneho Yi
Keyword(s):  
Loss Function ◽  
Ground Truth ◽  
Generative Adversarial Network ◽  
Adversarial Network ◽  
Object Removal ◽  
Extensive Evaluation ◽  
Specific Object ◽  
Image Pairs ◽  
Two Stages ◽  
Facial Images

Removing a specific object from an image and replacing the hole left behind with visually plausible backgrounds is a very intriguing task. While recent deep learning based object removal methods have shown promising results on this task for some structured scenes, none of them have addressed the problem of object removal in facial images. The objective of this work is to remove microphone object in facial images and fill hole with correct facial semantics and fine details. To make our solution practically useful, we present an interactive method called MRGAN, where the user roughly provides the microphone region. For filling the hole, we employ a Generative Adversarial Network based image-to-image translation approach. We break the problem into two stages: inpainter and refiner. The inpainter estimates coarse prediction by roughly filling in the microphone region followed by the refiner which produces fine details under the microphone region. We unite perceptual loss, reconstruction loss and adversarial loss as joint loss function for generating a realistic face and similar structure to the ground truth. Because facial image pairs with or without microphone do not exist, we have trained our method on a synthetically generated microphone dataset from CelebA face images and evaluated on real world microphone images. Our extensive evaluation shows that MRGAN performs better than state-of-the-art image manipulation methods on real microphone images although we only train our method using the synthetic dataset created. Additionally, we provide ablation studies for the integrated loss function and for different network arrangements.

scholarly journals Thermal Deformation Defect Prediction for Layered Printing Using Convolutional Generative Adversarial Network

2020 ◽  
Vol 10 (19) ◽  
pp. 6860
Author(s):  
Jinghua Xu ◽  
Kang Wang ◽  
Shuyou Zhang ◽  
Guodong Yi ◽  
Jianrong Tan ◽  
...  
Keyword(s):  
Thermal Deformation ◽  
Laser Scanner ◽  
Surface Profile ◽  
Prediction Method ◽  
Small Sample ◽  
Defect Prediction ◽  
Generative Adversarial Network ◽  
Deformation Defect ◽  
Multi Scale ◽  
Adversarial Network

This paper presents a Thermal Deformation defect prediction method for layered printing using Convolutional Generative Adversarial Network (CGAN). Firstly, the original manifold mesh is converted into layered image in Printing Coordinate System (PCS). The trajectory inside layered image with various infill patterns are generated for making comparisons. Inspired by monocular vision and even binocular vision, the mathematical model of thermal defect prediction via infrared thermogram is built via virtual printing of Digital Twins to preset the initial parameters of Artificial Neural Network (ANN). Particularly, the depth convolution is used to extract multi-scale features of layered image. By using transfer learning techniques to identify small sample data, the CGAN is employed to build the nonlinear implicit relations between thermal deformation and multi-scale features. The binocular stereo vision laser scanner is used to determine the actual thermal deformation of the target printed objects. The shape deformation dissimilarity can be succinctly calculated by evaluating the surface profile error via mesh registration between the original source and target mesh model. The proposed method is verified by physical experiments. The experiment proved that the proposed method can deal with the thermal deformation with more optimal parameters, which contributes to performance forward design of irregular complex parts regarding diversified customized requirements.

scholarly journals Semi-MsST-GAN: A Semi-Supervised Segmentation Method for Corneal Ulcer Segmentation in Slit-Lamp Images

2022 ◽  
Vol 15 ◽  
Author(s):  
Tingting Wang ◽  
Meng Wang ◽  
Weifang Zhu ◽  
Lianyu Wang ◽  
Zhongyue Chen ◽  
...  
Keyword(s):  
Corneal Ulcer ◽  
Ground Truth ◽  
Semantic Features ◽  
Slit Lamp ◽  
Feature Maps ◽  
Generative Adversarial Network ◽  
Fluorescein Staining ◽  
Corneal Ulcers ◽  
Multi Scale ◽  
Adversarial Network

Corneal ulcer is a common leading cause of corneal blindness. It is difficult to accurately segment corneal ulcers due to the following problems: large differences in the pathological shapes between point-flaky and flaky corneal ulcers, blurred boundary, noise interference, and the lack of sufficient slit-lamp images with ground truth. To address these problems, in this paper, we proposed a novel semi-supervised multi-scale self-transformer generative adversarial network (Semi-MsST-GAN) that can leverage unlabeled images to improve the performance of corneal ulcer segmentation in fluorescein staining of slit-lamp images. Firstly, to improve the performance of segmenting the corneal ulcer regions with complex pathological features, we proposed a novel multi-scale self-transformer network (MsSTNet) as the MsST-GAN generator, which can guide the model to aggregate the low-level weak semantic features with the high-level strong semantic information and adaptively learn the spatial correlation in feature maps. Then, to further improve the segmentation performance by leveraging unlabeled data, the semi-supervised approach based on the proposed MsST-GAN was explored to solve the problem of the lack of slit-lamp images with corresponding ground truth. The proposed Semi-MsST-GAN was comprehensively evaluated on the public SUSTech-SYSU dataset, which contains 354 labeled and 358 unlabeled fluorescein staining slit-lamp images. The results showed that, compared with other state-of-the-art methods, our proposed method achieves better performance with comparable efficiency.

SGAN4AbSum: A Semantic-Enhanced Generative Adversarial Network for Abstractive Text Summarization

2021 ◽  
Author(s):  
Tham Vo
Keyword(s):  
Ground Truth ◽  
Text Summarization ◽  
Generative Adversarial Network ◽  
Convolutional Network ◽  
Training Strategy ◽  
Adversarial Network ◽  
Deep Recurrent Neural Network ◽  
Benchmark Datasets ◽  
Latent Representations ◽  
Abstractive Summarization

Abstract In abstractive summarization task, most of proposed models adopt the deep recurrent neural network (RNN)-based encoder-decoder architecture to learn and generate meaningful summary for a given input document. However, most of recent RNN-based models always suffer the challenges related to the involvement of much capturing high-frequency/reparative phrases in long documents during the training process which leads to the outcome of trivial and generic summaries are generated. Moreover, the lack of thorough analysis on the sequential and long-range dependency relationships between words within different contexts while learning the textual representation also make the generated summaries unnatural and incoherent. To deal with these challenges, in this paper we proposed a novel semantic-enhanced generative adversarial network (GAN)-based approach for abstractive text summarization task, called as: SGAN4AbSum. We use an adversarial training strategy for our text summarization model in which train the generator and discriminator to simultaneously handle the summary generation and distinguishing the generated summary with the ground-truth one. The input of generator is the jointed rich-semantic and global structural latent representations of training documents which are achieved by applying a combined BERT and graph convolutional network (GCN) textual embedding mechanism. Extensive experiments in benchmark datasets demonstrate the effectiveness of our proposed SGAN4AbSum which achieve the competitive ROUGE-based scores in comparing with state-of-the-art abstractive text summarization baselines.

scholarly journals Cognitive Covert Traffic Synthesis Method Based on Generative Adversarial Network

2021 ◽  
Vol 2021 ◽  
pp. 1-14
Author(s):  
Zhangguo Tang ◽  
Junfeng Wang ◽  
Huanzhou Li ◽  
Jian Zhang ◽  
Junhao Wang
Keyword(s):  
Loss Function ◽  
Learning Algorithm ◽  
Synthesis Method ◽  
Covert Channel ◽  
Covert Communication ◽  
New Paradigm ◽  
Generative Adversarial Network ◽  
Good Convergence ◽  
Adversarial Network ◽  
Activity Loss

In the intelligent era of human-computer symbiosis, the use of machine learning method for covert communication confrontation has become a hot topic of network security. The existing covert communication technology focuses on the statistical abnormality of traffic behavior and does not consider the sensory abnormality of security censors, so it faces the core problem of lack of cognitive ability. In order to further improve the concealment of communication, a game method of “cognitive deception” is proposed, which is aimed at eliminating the anomaly of traffic in both behavioral and cognitive dimensions. Accordingly, a Wasserstein Generative Adversarial Network of Covert Channel (WCCGAN) model is established. The model uses the constraint sampling of cognitive priors to construct the constraint mechanism of “functional equivalence” and “cognitive equivalence” and is trained by a dynamic strategy updating learning algorithm. Among them, the generative module adopts joint expression learning which integrates network protocol knowledge to improve the expressiveness and discriminability of traffic cognitive features. The equivalent module guides the discriminant module to learn the pragmatic relevance features through the activity loss function of traffic and the application loss function of protocol for end-to-end training. The experimental results show that WCCGAN can directly synthesize traffic with comprehensive concealment ability, and its behavior concealment and cognitive deception are as high as 86.2% and 96.7%, respectively. Moreover, the model has good convergence and generalization ability and does not depend on specific assumptions and specific covert algorithms, which realizes a new paradigm of cognitive game in covert communication.

scholarly journals Best Selection of Generative Adversarial Networks Hyper-Parameters using Genetic Algorithm

2020 ◽  
Author(s):  
Fajr Alarsan ◽  
Mamoon Younes
Keyword(s):  
Genetic Algorithm ◽  
Programming Language ◽  
Loss Function ◽  
Generative Adversarial Networks ◽  
Accuracy Function ◽  
Generative Adversarial Network ◽  
Adversarial Network ◽  
Adversarial Networks ◽  
Parameters Selection ◽  
Selection Of

Abstract Generative Adversarial Networks (GANs) are most popular generative frameworks that have achieved compelling performance. They follow an adversarial approach where two deep models generator and discriminator compete with each other In this paper, we propose a Generative Adversarial Network with best hyper-parameters selection to generate fake images for digits number 1 to 9 with generator and train discriminator to decide whereas the generated images are fake or true. Using Genetic Algorithm technique to adapt GAN hyper-parameters, the final method is named GANGA:Generative Adversarial Network with Genetic Algorithm. Anaconda environment with tensorflow library facilitates was used, python as programming language also used with needed libraries. The implementation was done using MNIST dataset to validate our work. The proposed method is to let Genetic algorithm to choose best values of hyper-parameters depending on minimizing a cost function such as a loss function or maximizing accuracy function. GA was used to select values of Learning rate, Batch normalization, Number of neurons and a parameter of Dropout layer.

Sign in / Sign up

Export Citation Format

Share Document