scholarly journals Copy-Move Forgery Detection and Localization Using a Generative Adversarial Network and Convolutional Neural-Network

Information ◽  
2019 ◽  
Vol 10 (9) ◽  
pp. 286
Author(s):  
Younis Abdalla ◽  
M. Tariq Iqbal ◽  
Mohamed Shehata
Keyword(s):  
Neural Network ◽  
New Technologies ◽  
Generative Adversarial Networks ◽  
Detection Accuracy ◽  
Forgery Detection ◽  
Generative Adversarial Network ◽  
Neural Network Approach ◽  
Adversarial Network ◽  
Copy Move Forgery Detection ◽  
Detection And Localization

The problem of forged images has become a global phenomenon that is spreading mainly through social media. New technologies have provided both the means and the support for this phenomenon, but they are also enabling a targeted response to overcome it. Deep convolution learning algorithms are one such solution. These have been shown to be highly effective in dealing with image forgery derived from generative adversarial networks (GANs). In this type of algorithm, the image is altered such that it appears identical to the original image and is nearly undetectable to the unaided human eye as a forgery. The present paper investigates copy-move forgery detection using a fusion processing model comprising a deep convolutional model and an adversarial model. Four datasets are used. Our results indicate a significantly high detection accuracy performance (~95%) exhibited by the deep learning CNN and discriminator forgery detectors. Consequently, an end-to-end trainable deep neural network approach to forgery detection appears to be the optimal strategy. The network is developed based on two-branch architecture and a fusion module. The two branches are used to localize and identify copy-move forgery regions through CNN and GAN.

scholarly journals Speech Emotion Recognition using Data Augmentation Method by Cycle-Generative Adversarial Networks

2021 ◽  
Author(s):  
Arash Shilandari ◽  
Hossein Marvi ◽  
Hossein Khosravi
Keyword(s):  
Neural Network ◽  
Emotion Recognition ◽  
Speech Processing ◽  
Data Augmentation ◽  
Generative Adversarial Networks ◽  
Speech Emotion Recognition ◽  
Support Vector ◽  
Generative Adversarial Network ◽  
Adversarial Network ◽  
Adversarial Networks

Nowadays, and with the mechanization of life, speech processing has become so crucial for the interaction between humans and machines. Deep neural networks require a database with enough data for training. The more features are extracted from the speech signal, the more samples are needed to train these networks. Adequate training of these networks can be ensured when there is access to sufficient and varied data in each class. If there is not enough data; it is possible to use data augmentation methods to obtain a database with enough samples. One of the obstacles to developing speech emotion recognition systems is the Data sparsity problem in each class for neural network training. The current study has focused on making a cycle generative adversarial network for data augmentation in a system for speech emotion recognition. For each of the five emotions employed, an adversarial generating network is designed to generate data that is very similar to the main data in that class, as well as differentiate the emotions of the other classes. These networks are taught in an adversarial way to produce feature vectors like each class in the space of the main feature, and then they add to the training sets existing in the database to train the classifier network. Instead of using the common cross-entropy error to train generative adversarial networks and to remove the vanishing gradient problem, Wasserstein Divergence has been used to produce high-quality artificial samples. The suggested network has been tested to be applied for speech emotion recognition using EMODB as training, testing, and evaluating sets, and the quality of artificial data evaluated using two Support Vector Machine (SVM) and Deep Neural Network (DNN) classifiers. Moreover, it has been revealed that extracting and reproducing high-level features from acoustic features, speech emotion recognition with separating five primary emotions has been done with acceptable accuracy.

scholarly journals Generating Scenery Images with Larger Variety According to User Descriptions

2021 ◽  
Vol 11 (21) ◽  
pp. 10224
Author(s):  
Hsu-Yung Cheng ◽  
Chih-Chang Yu
Keyword(s):  
Neural Network ◽  
Data Augmentation ◽  
Memory Cell ◽  
Generative Adversarial Networks ◽  
Image Generation ◽  
Generative Adversarial Network ◽  
Data Set ◽  
Adversarial Network ◽  
Adversarial Networks ◽  
Hidden Layer

In this paper, a framework based on generative adversarial networks is proposed to perform nature-scenery generation according to descriptions from the users. The desired place, time and seasons of the generated scenes can be specified with the help of text-to-image generation techniques. The framework improves and modifies the architecture of a generative adversarial network with attention models by adding the imagination models. The proposed attentional and imaginative generative network uses the hidden layer information to initialize the memory cell of the recurrent neural network to produce the desired photos. A data set containing different categories of scenery images is established to train the proposed system. The experiments validate that the proposed method is able to increase the quality and diversity of the generated images compared to the existing method. A possible application of road image generation for data augmentation is also demonstrated in the experimental results.

RESEARCH OF GENERATIVE ADVERSARIAL NETWORKS FOR THE SYNTHESIS OF NEW MEDICAL DATA

2020 ◽  
Vol 2020 (2) ◽  
pp. 17-23
Author(s):  
Vladislav Laptev ◽  
Vyacheslav Danilov ◽  
Olga Gerget
Keyword(s):  
Neural Network ◽  
Network Architecture ◽  
Medical Data ◽  
Training Data ◽  
Generative Adversarial Networks ◽  
Training Procedure ◽  
Neural Network Architecture ◽  
Generative Adversarial Network ◽  
Adversarial Network ◽  
Adversarial Networks

The paper considers the development of a Generative Adversarial Network (GAN) for the synthesis of new medical data. The developed GAN consists of two models trained simultaneously: a generative model (G - Generator), estimating the distribution of data, and a discriminating model (D - Discriminator), which estimates the probability that the sample is obtained from the training data, and not from generator G. To create G, we used own neural network architecture based on convolutional layers using experimental functions of Tensor Flow Addons. To create discriminator D, we used a Transfer Learning (TL) approach. The training procedure is to maximize the likelihood that discriminator D will make a mistake. Experiments show that the proposed GAN architecture completely copes with the task of synthesizing of new medical data.

scholarly journals Detection and localization enhancement for satellite images with small forgeries using modified GAN-based CNN structure

2020 ◽  
Vol 6 (3) ◽  
pp. 278
Author(s):  
Mohamed Mahmoud Fouad ◽  
Eslam Magdy Mostafa ◽  
Mohamed Abdelmoneim Elshafey
Keyword(s):  
Satellite Images ◽  
Experimental Results ◽  
Geological Survey ◽  
Detection Accuracy ◽  
Generative Adversarial Network ◽  
Image Forgery ◽  
Adversarial Network ◽  
The Us ◽  
Detection And Localization

The image forgery process can be simply defined as inserting some objects of different sizes to vanish some structures or scenes. Satellite images can be forged in many ways, such as copy-paste, copy-move, and splicing processes. Recent approaches present a generative adversarial network (GAN) as an effective method for identifying the presence of spliced forgeries and identifying their locations with a higher detection accuracy of large- and medium-sized forgeries. However, such recent approaches clearly show limited detection accuracy of small-sized forgeries. Accordingly, the localization step of such small-sized forgeries is negatively impacted. In this paper, two different approaches for detecting and localizing small-sized forgeries in satellite images are proposed. The first approach is inspired by a recently presented GAN-based approach and is modified to an enhanced version. The experimental results manifest that the detection accuracy of the first proposed approach noticeably increased to 86% compared to its inspiring one with 79% for the small-sized forgeries. Whereas, the second proposed approach uses a different design of a CNN-based discriminator to significantly enhance the detection accuracy to 94%, using the same dataset obtained from NASA and the US Geological Survey (USGS) for validation and testing. Furthermore, the results show a comparable detection accuracy in large- and medium-sized forgeries using the two proposed approaches compared to the competing ones. This study can be applied in the forensic field, with clear discrimination between the forged and pristine images.

scholarly journals Adversarial Sample Detection with Gaussian Mixture Conditional Generative Adversarial Networks

2021 ◽  
Vol 2021 ◽  
pp. 1-18
Author(s):  
Pengfei Zhang ◽  
Xiaoming Ju
Keyword(s):  
Neural Network ◽  
Gaussian Mixture ◽  
Physical World ◽  
Training Data ◽  
Generative Adversarial Networks ◽  
Support Vector ◽  
Generative Adversarial Network ◽  
Adversarial Network ◽  
Adversarial Networks ◽  
Testing Stage

It is important to detect adversarial samples in the physical world that are far away from the training data distribution. Some adversarial samples can make a machine learning model generate a highly overconfident distribution in the testing stage. Thus, we proposed a mechanism for detecting adversarial samples based on semisupervised generative adversarial networks (GANs) with an encoder-decoder structure; this mechanism can be applied to any pretrained neural network without changing the network’s structure. The semisupervised GANs also give us insight into the behavior of adversarial samples and their flow through the layers of a deep neural network. In the supervised scenario, the latent feature of the semisupervised GAN and the target network’s logit information are used as the input of the external classifier support vector machine to detect the adversarial samples. In the unsupervised scenario, first, we proposed a one-class classier based on the semisupervised Gaussian mixture conditional generative adversarial network (GM-CGAN) to fit the joint feature information of the normal data, and then, we used a discriminator network to detect normal data and adversarial samples. In both supervised scenarios and unsupervised scenarios, experimental results show that our method outperforms latest methods.

scholarly journals Realistic Face Image Generation System Based on GANs

2020 ◽  
Author(s):  
Zhike Han ◽  
Bin Yang ◽  
Yiren Du ◽  
Xingyu Du ◽  
Hao Xing ◽  
...  
Keyword(s):  
Neural Network ◽  
Network Model ◽  
Neural Network Model ◽  
Generative Adversarial Networks ◽  
Data Sets ◽  
Generation System ◽  
Generative Adversarial Network ◽  
Adversarial Network ◽  
Adversarial Networks ◽  
Face Generation

The purpose of this paper is to study the help of generative adversarial networks (GAN) for face generation, and to explore whether the network can have an effect on complex face generation. Training an image translation neural network model based on a generative adversarial network with the help of a large number of real human face data sets. Using the CV2-based face tagging algorithm and the HED-based face edge extraction algorithm to obtain input information, and then based on the translation neural network model Developing a face generation system through Tensorflow, Torch and other frameworks to realize the function of generating real faces through sketches or “changing faces” through existing faces. Finally, this model provides training configuration and training information.

scholarly journals Weed Detection Model Using the Generative Adversarial Network and Deep Convolutional Neural Network

2021 ◽  
Author(s):  
S. Anthoniraj ◽  
P. Karthikeyan ◽  
V. Vivek
Keyword(s):  
Neural Network ◽  
Convolutional Neural Network ◽  
Crop Production ◽  
Deep Convolutional Neural Network ◽  
Generative Adversarial Networks ◽  
Weed Detection ◽  
Generative Adversarial Network ◽  
Detection Model ◽  
Adversarial Network ◽  
Improved Performance

Agriculture crop demand is increasing day by day because of population. Crop production can be increased by removing weeds in the agriculture field. However, weed detection is a complicated problem in the agriculture field. The main objective of this paper is to improve the accuracy of weed detection by combining generative adversarial networks and convolutional neural networks. We have implemented deep learning models, namely Generative Adversarial Network and Deep Convolutional Neural Network (GAN-DCNN), AlexNet, VGG16, ResNet50, and Google Net perform the detection of the weed. A generative Adversarial Network generates the weed image, and Deep Convolutional Neural Network detects the weed in the image. GAN-DCNN method outperforms than existing weed detection method. Simulation results confirm that the proposed GAN-DCNN has improved performance with a maximum weed detection rate of 87.12 and 96.34 accuracies.

ORGANIC (1).pdf

2017 ◽  
Author(s):  
Benjamin Sanchez-Lengeling ◽  
Carlos Outeiral ◽  
Gabriel L. Guimaraes ◽  
Alan Aspuru-Guzik
Keyword(s):  
Machine Learning ◽  
Learning Community ◽  
Chemical Species ◽  
Material Design ◽  
Organic Photovoltaic ◽  
Generative Adversarial Networks ◽  
Generative Adversarial Network ◽  
Adversarial Network ◽  
Adversarial Networks ◽  
Photovoltaic Material

Molecular discovery seeks to generate chemical species tailored to very specific needs. In this paper, we present ORGANIC, a framework based on Objective-Reinforced Generative Adversarial Networks (ORGAN), capable of producing a distribution over molecular space that matches with a certain set of desirable metrics. This methodology combines two successful techniques from the machine learning community: a Generative Adversarial Network (GAN), to create non-repetitive sensible molecular species, and Reinforcement Learning (RL), to bias this generative distribution towards certain attributes. We explore several applications, from optimization of random physicochemical properties to candidates for drug discovery and organic photovoltaic material design.

scholarly journals Restoring Raindrops Using Attentive Generative Adversarial Networks

2021 ◽  
Vol 11 (15) ◽  
pp. 7034
Author(s):  
Hee-Deok Yang
Keyword(s):  
Weather Conditions ◽  
Recurrent Network ◽  
Generative Adversarial Networks ◽  
Navigation Systems ◽  
Vision Systems ◽  
Generative Adversarial Network ◽  
Network Layers ◽  
Adversarial Network ◽  
Adversarial Networks ◽  
Outdoor Vision

Artificial intelligence technologies and vision systems are used in various devices, such as automotive navigation systems, object-tracking systems, and intelligent closed-circuit televisions. In particular, outdoor vision systems have been applied across numerous fields of analysis. Despite their widespread use, current systems work well under good weather conditions. They cannot account for inclement conditions, such as rain, fog, mist, and snow. Images captured under inclement conditions degrade the performance of vision systems. Vision systems need to detect, recognize, and remove noise because of rain, snow, and mist to boost the performance of the algorithms employed in image processing. Several studies have targeted the removal of noise resulting from inclement conditions. We focused on eliminating the effects of raindrops on images captured with outdoor vision systems in which the camera was exposed to rain. An attentive generative adversarial network (ATTGAN) was used to remove raindrops from the images. This network was composed of two parts: an attentive-recurrent network and a contextual autoencoder. The ATTGAN generated an attention map to detect rain droplets. A de-rained image was generated by increasing the number of attentive-recurrent network layers. We increased the number of visual attentive-recurrent network layers in order to prevent gradient sparsity so that the entire generation was more stable against the network without preventing the network from converging. The experimental results confirmed that the extended ATTGAN could effectively remove various types of raindrops from images.

Sign in / Sign up

Export Citation Format

Share Document