scholarly journals FT-GAN: Face Transformation with Key Points Alignment for Pose-Invariant Face Recognition

Electronics ◽  
2019 ◽  
Vol 8 (7) ◽  
pp. 807 ◽  
Author(s):  
Weiwei Zhuang ◽  
Liang Chen ◽  
Chaoqun Hong ◽  
Yuxin Liang ◽  
Keshou Wu
Keyword(s):  
Face Recognition ◽  
Generative Adversarial Networks ◽  
Facial Features ◽  
Adversarial Networks ◽  
Key Points ◽  
In The Wild ◽  
Novel Method ◽  
Face Synthesis ◽  
Unconstrained Face

Face recognition has been comprehensively studied. However, face recognition in the wild still suffers from unconstrained face directions. Frontal face synthesis is a popular solution, but some facial features are missed after synthesis. This paper presents a novel method for pose-invariant face recognition. It is based on face transformation with key points alignment based on generative adversarial networks (FT-GAN). In this method, we introduce CycleGAN for pixel transformation to achieve coarse face transformation results, and these results are refined by key point alignment. In this way, frontal face synthesis is modeled as a two-task process. The results of comprehensive experiments show the effectiveness of FT-GAN.

scholarly journals Look across Elapse: Disentangled Representation Learning and Photorealistic Cross-Age Face Synthesis for Age-Invariant Face Recognition

2019 ◽  
Vol 33 ◽  
pp. 9251-9258 ◽  
Author(s):  
Jian Zhao ◽  
Yu Cheng ◽  
Yi Cheng ◽  
Yang Yang ◽  
Fang Zhao ◽  
...  
Keyword(s):  
Face Recognition ◽  
Representation Learning ◽  
Paired Data ◽  
The Arts ◽  
Deep Architecture ◽  
Age Variation ◽  
In The Wild ◽  
Unconstrained Face Recognition ◽  
Face Synthesis ◽  
Unconstrained Face

Despite the remarkable progress in face recognition related technologies, reliably recognizing faces across ages still remains a big challenge. The appearance of a human face changes substantially over time, resulting in significant intraclass variations. As opposed to current techniques for ageinvariant face recognition, which either directly extract ageinvariant features for recognition, or first synthesize a face that matches target age before feature extraction, we argue that it is more desirable to perform both tasks jointly so that they can leverage each other. To this end, we propose a deep Age-Invariant Model (AIM) for face recognition in the wild with three distinct novelties. First, AIM presents a novel unified deep architecture jointly performing cross-age face synthesis and recognition in a mutual boosting way. Second, AIM achieves continuous face rejuvenation/aging with remarkable photorealistic and identity-preserving properties, avoiding the requirement of paired data and the true age of testing samples. Third, we develop effective and novel training strategies for end-to-end learning the whole deep architecture, which generates powerful age-invariant face representations explicitly disentangled from the age variation. Extensive experiments on several cross-age datasets (MORPH, CACD and FG-NET) demonstrate the superiority of the proposed AIM model over the state-of-the-arts. Benchmarking our model on one of the most popular unconstrained face recognition datasets IJB-C additionally verifies the promising generalizability of AIM in recognizing faces in the wild.

scholarly journals WGAN-E: A Generative Adversarial Networks for Facial Feature Security

Electronics ◽  
2020 ◽  
Vol 9 (3) ◽  
pp. 486
Author(s):  
Chunxue Wu ◽  
Bobo Ju ◽  
Yan Wu ◽  
Neal N. Xiong ◽  
Sheng Zhang
Keyword(s):  
Face Recognition ◽  
Intelligent Systems ◽  
Human Life ◽  
Facial Feature ◽  
Generative Adversarial Networks ◽  
Facial Features ◽  
Learning Technology ◽  
Adversarial Networks ◽  
Face Features ◽  
Hashing Algorithm

Artificial intelligence technology plays an increasingly important role in human life. For example, distinguishing different people is an essential capability of many intelligent systems. To achieve this, one possible technical means is to perceive and recognize people by optical imaging of faces, so-called face recognition technology. After decades of research and development, especially the emergence of deep learning technology in recent years, face recognition has made great progress with more and more applications in the fields of security, finance, education, social security, etc. The field of computer vision has become one of the most successful branch areas. With the wide application of biometrics technology, bio-encryption technology came into being. Aiming at the problems of classical hash algorithm and face hashing algorithm based on Multiscale Block Local Binary Pattern (MB-LBP) feature improvement, this paper proposes a method based on Generative Adversarial Networks (GAN) to encrypt face features. This work uses Wasserstein Generative Adversarial Networks Encryption (WGAN-E) to encrypt facial features. Because the encryption process is an irreversible one-way process, it protects facial features well. Compared with the traditional face hashing algorithm, the experimental results show that the face feature encryption algorithm has better confidentiality.

scholarly journals Dynamics of Fourier Modes in Torus Generative Adversarial Networks

Mathematics ◽  
2021 ◽  
Vol 9 (4) ◽  
pp. 325
Author(s):  
Ángel González-Prieto ◽  
Alberto Mozo ◽  
Edgar Talavera ◽  
Sandra Gómez-Canaval
Keyword(s):  
Fourier Series ◽  
Generative Adversarial Networks ◽  
Learning Models ◽  
Training Process ◽  
Small Perturbations ◽  
Adversarial Networks ◽  
Novel Method ◽  
Truncated Fourier Series ◽  
Real Flow ◽  
Machine Learning Models

Generative Adversarial Networks (GANs) are powerful machine learning models capable of generating fully synthetic samples of a desired phenomenon with a high resolution. Despite their success, the training process of a GAN is highly unstable, and typically, it is necessary to implement several accessory heuristics to the networks to reach acceptable convergence of the model. In this paper, we introduce a novel method to analyze the convergence and stability in the training of generative adversarial networks. For this purpose, we propose to decompose the objective function of the adversary min–max game defining a periodic GAN into its Fourier series. By studying the dynamics of the truncated Fourier series for the continuous alternating gradient descend algorithm, we are able to approximate the real flow and to identify the main features of the convergence of GAN. This approach is confirmed empirically by studying the training flow in a 2-parametric GAN, aiming to generate an unknown exponential distribution. As a by-product, we show that convergent orbits in GANs are small perturbations of periodic orbits so the Nash equillibria are spiral attractors. This theoretically justifies the slow and unstable training observed in GANs.

scholarly journals Modelling and forecasting art movements with CGANs

2020 ◽  
Vol 7 (4) ◽  
pp. 191569
Author(s):  
Edoardo Lisi ◽  
Mohammad Malekzadeh ◽  
Hamed Haddadi ◽  
F. Din-Houn Lau ◽  
Seth Flaxman
Keyword(s):  
Generative Adversarial Networks ◽  
Vector Autoregressive ◽  
Adversarial Networks ◽  
Latent Distribution ◽  
Small Set ◽  
One Step ◽  
Temporal Aspect ◽  
Novel Method ◽  
The Mean ◽  
Modelling And Forecasting

Conditional generative adversarial networks (CGANs) are a recent and popular method for generating samples from a probability distribution conditioned on latent information. The latent information often comes in the form of a discrete label from a small set. We propose a novel method for training CGANs which allows us to condition on a sequence of continuous latent distributions f (1) , …, f ( K ) . This training allows CGANs to generate samples from a sequence of distributions. We apply our method to paintings from a sequence of artistic movements, where each movement is considered to be its own distribution. Exploiting the temporal aspect of the data, a vector autoregressive (VAR) model is fitted to the means of the latent distributions that we learn, and used for one-step-ahead forecasting, to predict the latent distribution of a future art movement f ( K +1) . Realizations from this distribution can be used by the CGAN to generate ‘future’ paintings. In experiments, this novel methodology generates accurate predictions of the evolution of art. The training set consists of a large dataset of past paintings. While there is no agreement on exactly what current art period we find ourselves in, we test on plausible candidate sets of present art, and show that the mean distance to our predictions is small.

scholarly journals Age Progression and Regression with Spatial Attention Modules

2020 ◽  
Vol 34 (07) ◽  
pp. 11378-11385
Author(s):  
Qi Li ◽  
Yunfan Liu ◽  
Zhenan Sun
Keyword(s):  
Spatial Attention ◽  
Generative Adversarial Networks ◽  
Age Progression ◽  
Training Images ◽  
Adversarial Networks ◽  
Face Images ◽  
Multiple Datasets ◽  
Image Translation ◽  
In The Wild ◽  
Face Aging

Age progression and regression refers to aesthetically rendering a given face image to present effects of face aging and rejuvenation, respectively. Although numerous studies have been conducted in this topic, there are two major problems: 1) multiple models are usually trained to simulate different age mappings, and 2) the photo-realism of generated face images is heavily influenced by the variation of training images in terms of pose, illumination, and background. To address these issues, in this paper, we propose a framework based on conditional Generative Adversarial Networks (cGANs) to achieve age progression and regression simultaneously. Particularly, since face aging and rejuvenation are largely different in terms of image translation patterns, we model these two processes using two separate generators, each dedicated to one age changing process. In addition, we exploit spatial attention mechanisms to limit image modifications to regions closely related to age changes, so that images with high visual fidelity could be synthesized for in-the-wild cases. Experiments on multiple datasets demonstrate the ability of our model in synthesizing lifelike face images at desired ages with personalized features well preserved, and keeping age-irrelevant regions unchanged.

scholarly journals Lightweight and Resource-Constrained Learning Network for Face Recognition with Performance Optimization

Sensors ◽  
2020 ◽  
Vol 20 (21) ◽  
pp. 6114
Author(s):  
Hsiao-Chi Li ◽  
Zong-Yue Deng ◽  
Hsin-Han Chiang
Keyword(s):  
Face Recognition ◽  
Performance Optimization ◽  
Learning Network ◽  
Key Points ◽  
Reference Images ◽  
In The Wild ◽  
Constrained Learning ◽  
The Difference ◽  
Computational Resources ◽  
High Degree

Despite considerable progress in face recognition technology in recent years, deep learning (DL) and convolutional neural networks (CNN) have revealed commendable recognition effects with the advent of artificial intelligence and big data. FaceNet was presented in 2015 and is able to significantly improve the accuracy of face recognition, while also being powerfully built to counteract several common issues, such as occlusion, blur, illumination change, and different angles of head pose. However, not all hardware can sustain the heavy computing load in the execution of the FaceNet model. In applications in the security industry, lightweight and efficient face recognition are two key points for facilitating the deployment of DL and CNN models directly in field devices, due to their limited edge computing capability and low equipment cost. To this end, this paper provides a lightweight learning network improved from FaceNet, which is called FN13, to break through the hardware limitation of constrained computational resources. The proposed FN13 takes the advantage of center loss to reduce the variations of the between-class features and enlarge the difference of the within-class features, instead of the triplet loss by using FaceNet. The resulting model reduces the number of parameters and maintains a high degree of accuracy, only requiring few grayscale reference images per subject. The validity of FN13 is demonstrated by conducting experiments on the Labeled Faces in the Wild (LFW) dataset, as well as an analytical discussion regarding specific disguise problems.

scholarly journals Face Recognition Technology Based on Partial Facial Features

2021 ◽  
Vol 37 (5) ◽  
pp. 292-297
Author(s):  
Winney Eva
Keyword(s):  
Face Recognition ◽  
Facial Features ◽  
The Past ◽  
Key Points ◽  
The Face ◽  
Full Face ◽  
Human Faces

In the past two decades, many face recognition methods have been proposed. Among them, most researchers use the entire face as the basis for recognition. The basic technical route is to extract and compare the general features of the entire face. However, in actual scenes, human faces may be blocked by obstacles. Therefore, how to realize face recognition by using some of the facial features that can be obtained? In addition, this partial face recognition technology is mostly based on the acquisition of key points of the face to recognize the whole face. This review intends to summarize the full face and partial face recognition methods based on key points of the face.

scholarly journals Evolving optimum camouflage with Generative Adversarial Networks

2018 ◽  
Author(s):  
Laszlo Talas ◽  
John G. Fennell ◽  
Karin Kjernsmo ◽  
Innes C. Cuthill ◽  
Nicholas E. Scott-Samuel ◽  
...  
Keyword(s):  
Arms Race ◽  
Generative Adversarial Networks ◽  
Adversarial Networks ◽  
Novel Method ◽  
Multiple Environments ◽  
Evolutionary Arms Race

AbstractWe describe a novel method to exploit Generative Adversarial Networks to simulate an evolutionary arms race between the camouflage of a synthetic prey and its predator. Patterns evolved using our methods are shown to provide progressively more effective concealment and outperform two recognised camouflage techniques. The method will be invaluable, particularly for biologists, for rapidly developing and testing optimal camouflage or signalling patterns in multiple environments.

Sign in / Sign up

Export Citation Format

Share Document