Adapted discriminative coupled mappings for low-resolution face recognition with one-shot

2021 ◽  
pp. 1-15
Author(s):  
Yongjie Chu ◽  
Touqeer Ahmad ◽  
Lindu Zhao
Keyword(s):  
Face Recognition ◽  
Law Enforcement ◽  
High Resolution ◽  
Domain Adaptation ◽  
Face Image ◽  
Discriminative Learning ◽  
Low Resolution ◽  
Face Images ◽  
World Environment

Low-resolution face recognition with one-shot is a prevalent problem encountered in law enforcement, where it generally requires to recognize the low-resolution face images captured by surveillance cameras with the only one high-resolution profile face image in the database. The problem is very tough because the available samples is quite few and the quality of unknown images is quite low. To effectively address this issue, this paper proposes Adapted Discriminative Coupled Mappings (AdaDCM) approach, which integrates domain adaptation and discriminative learning. To achieve good domain adaptation performance for small size dataset, a new domain adaptation technique called Bidirectional Locality Matching-based Domain Adaptation (BLM-DA) is first developed. Then the proposed AdaDCM is formulated by unifying BLM-DA and discriminative coupled mappings into a single framework. AdaDCM is extensively evaluated on FERET, LFW, and SCface databases, which includes LR face images obtained in constrained, unconstrained, and real-world environment. The promising results on these datasets demonstrate the effectiveness of AdaDCM in LR face recognition with one-shot.

scholarly journals Multimodal Low Resolution Face and Frontal Gait Recognition from Surveillance Video

Electronics ◽  
2021 ◽  
Vol 10 (9) ◽  
pp. 1013
Author(s):  
Sayan Maity ◽  
Mohamed Abdel-Mottaleb ◽  
Shihab S. Asfour
Keyword(s):  
Face Recognition ◽  
High Resolution ◽  
Gait Cycle ◽  
Gait Recognition ◽  
Recognition System ◽  
Multimodal Fusion ◽  
Surveillance Video ◽  
Low Resolution ◽  
Model Free ◽  
Face Images

Biometric identification using surveillance video has attracted the attention of many researchers as it can be applicable not only for robust identification but also personalized activity monitoring. In this paper, we present a novel multimodal recognition system that extracts frontal gait and low-resolution face images from frontal walking surveillance video clips to perform efficient biometric recognition. The proposed study addresses two important issues in surveillance video that did not receive appropriate attention in the past. First, it consolidates the model-free and model-based gait feature extraction approaches to perform robust gait recognition only using the frontal view. Second, it uses a low-resolution face recognition approach which can be trained and tested using low-resolution face information. This eliminates the need for obtaining high-resolution face images to create the gallery, which is required in the majority of low-resolution face recognition techniques. Moreover, the classification accuracy on high-resolution face images is considerably higher. Previous studies on frontal gait recognition incorporate assumptions to approximate the average gait cycle. However, we quantify the gait cycle precisely for each subject using only the frontal gait information. The approaches available in the literature use the high resolution images obtained in a controlled environment to train the recognition system. However, in our proposed system we train the recognition algorithm using the low-resolution face images captured in the unconstrained environment. The proposed system has two components, one is responsible for performing frontal gait recognition and one is responsible for low-resolution face recognition. Later, score level fusion is performed to fuse the results of the frontal gait recognition and the low-resolution face recognition. Experiments conducted on the Face and Ocular Challenge Series (FOCS) dataset resulted in a 93.5% Rank-1 for frontal gait recognition and 82.92% Rank-1 for low-resolution face recognition, respectively. The score level multimodal fusion resulted in 95.9% Rank-1 recognition, which demonstrates the superiority and robustness of the proposed approach.

Low-Resolution Face Recognition with Single Sample per Person via Domain Adaptation

2019 ◽  
Vol 33 (05) ◽  
pp. 1956005 ◽  
Author(s):  
Yongjie Chu ◽  
Yong Zhao ◽  
Touqeer Ahmad ◽  
Lindu Zhao
Keyword(s):  
Face Recognition ◽  
Domain Adaptation ◽  
Face Image ◽  
Single Sample ◽  
Low Resolution ◽  
Target Domain ◽  
Discriminative Ability ◽  
Surveillance Camera ◽  
Single Sample Per Person ◽  
Suspect Identification

Numerous low-resolution (LR) face images are captured by a growing number of surveillance cameras nowadays. In some particular applications, such as suspect identification, it is required to recognize an LR face image captured by the surveillance camera using only one high-resolution (HR) profile face image on the ID card. This leads to LR face recognition with single sample per person (SSPP), which is more challenging than conventional LR face recognition or SSPP face recognition. To address this tough problem, we propose a Boosted Coupled Marginal Fisher Analysis (CMFA) approach, which unites domain adaptation and coupled mappings. An auxiliary database containing multiple HR and LR samples is introduced to explore more discriminative information, and locality preserving domain adaption (LPDA) is designed to realize good domain adaptation between SSPP training set (target domain) and auxiliary database (source domain). We perform LPDA on HR and LR images in both domains, then in the domain adaptation space we apply CMFA to learn the discriminative coupled mappings for classification. The learned coupled mappings embed knowledge from the auxiliary dataset, thus their discriminative ability is superior. We extensively evaluate the proposed method on FERET, LFW and SCface database, the promising results demonstrate its effectiveness on LR face recognition with SSPP.

Low-resolution and open-set face recognition via recursive label propagation based on statistical classification

2019 ◽  
Vol 17 (02) ◽  
pp. 1940002 ◽  
Author(s):  
Shan Xue ◽  
Hong Zhu
Keyword(s):  
Face Recognition ◽  
Super Resolution ◽  
Recall Rate ◽  
Face Image ◽  
Label Propagation ◽  
Statistical Classification ◽  
Low Resolution ◽  
Face Images ◽  
Open Set ◽  
Discriminative Feature

In video surveillance, the captured face images are usually suffered from low-resolution (LR), besides, not all the probe images have mates in the gallery under the premise that only a single frontal high-resolution (HR) face image per subject. To address this problem, a novel face recognition framework called recursive label propagation based on statistical classification (ReLPBSC) has been proposed in this paper. Firstly, we employ VGG to extract robust discriminative feature vectors to represent each face. Then we select the corresponding LR face in the probe for each HR gallery face by similarity. Based on the picked HR–LR pairs, ReLPBSC is implemented for recognition. The main contributions of the proposed approach are as follows: (i) Inspired by substantial achievements of deep learning methods, VGG is adopted to achieve discriminative representation for LR faces to avoid the super-resolution steps; (ii) the accepted and rejected threshold parameters, which are not fixed in face recognition, can be achieved with ReLPBSC adaptively; (iii) the unreliable subjects never enrolled in the gallery can be rejected automatically with designed methods. Experimental results in [Formula: see text] pixels resolution show that the proposed method can achieve 86.64% recall rate while keeping 100% precision.

scholarly journals AN EFFICIENT METHOD TO FEED HIGH RESOLUTION IMAGES TO FACIAL ANALYSIS SYSTEMS

2013 ◽  
pp. 68-71
Author(s):  
ROOPA R ◽  
MRS. VANI.K. S ◽  
MRS. NAGAVENI. V
Keyword(s):  
Image Processing ◽  
Face Recognition ◽  
High Resolution ◽  
Super Resolution ◽  
Poor Quality ◽  
Low Resolution ◽  
Resolution Method ◽  
Facial Analysis ◽  
Face Images ◽  
High Resolution Images

Image Processing is any form of signal processing for which the image is an input such as a photograph or video frame. The output of image processing may be either an image or a set of characteristics or parameters related to the image. In many facial analysis systems like Face Recognition face is used as an important biometric. Facial analysis systems need High Resolution images for their processing. The video obtained from inexpensive surveillance cameras are of poor quality. Processing of poor quality images leads to unexpected results. To detect face images from a video captured by inexpensive surveillance cameras, we will use AdaBoost algorithm. If we feed those detected face images having low resolution and low quality to face recognition systems they will produce some unstable and erroneous results. Because these systems have problem working with low resolution images. Hence we need a method to bridge the gap between on one hand low- resolution and low-quality images and on the other hand facial analysis systems. Our approach is to use a Reconstruction Based Super Resolution method. In Reconstruction Based Super Resolution method we will generate a face-log containing images of similar frontal faces of the highest possible quality using head pose estimation technique. Then, we use a Learning Based Super-Resolution algorithm applied to the result of the reconstruction-based part to improve the quality by another factor of two. Hence the total system quality factor will be improved by four.

scholarly journals Validation of a new SAFRAN-based gridded precipitation product for Spain and comparisons to Spain02 and ERA-Interim

2017 ◽  
Vol 21 (4) ◽  
pp. 2187-2201 ◽  
Author(s):  
Pere Quintana-Seguí ◽  
Marco Turco ◽  
Sixto Herrera ◽  
Gonzalo Miguez-Macho
Keyword(s):  
High Resolution ◽  
Land Surface ◽  
Climate Models ◽  
Hydrological Cycle ◽  
Interpolation Method ◽  
Rain Gauge ◽  
Surface Model ◽  
Low Resolution ◽  
Precipitation Events

Abstract. Offline land surface model (LSM) simulations are useful for studying the continental hydrological cycle. Because of the nonlinearities in the models, the results are very sensitive to the quality of the meteorological forcing; thus, high-quality gridded datasets of screen-level meteorological variables are needed. Precipitation datasets are particularly difficult to produce due to the inherent spatial and temporal heterogeneity of that variable. They do, however, have a large impact on the simulations, and it is thus necessary to carefully evaluate their quality in great detail. This paper reports the quality of two high-resolution precipitation datasets for Spain at the daily time scale: the new SAFRAN-based dataset and Spain02. SAFRAN is a meteorological analysis system that was designed to force LSMs and has recently been extended to the entirety of Spain for a long period of time (1979/1980–2013/2014). Spain02 is a daily precipitation dataset for Spain and was created mainly to validate regional climate models. In addition, ERA-Interim is included in the comparison to show the differences between local high-resolution and global low-resolution products. The study compares the different precipitation analyses with rain gauge data and assesses their temporal and spatial similarities to the observations. The validation of SAFRAN with independent data shows that this is a robust product. SAFRAN and Spain02 have very similar scores, although the latter slightly surpasses the former. The scores are robust with altitude and throughout the year, save perhaps in summer when a diminished skill is observed. As expected, SAFRAN and Spain02 perform better than ERA-Interim, which has difficulty capturing the effects of the relief on precipitation due to its low resolution. However, ERA-Interim reproduces spells remarkably well in contrast to the low skill shown by the high-resolution products. The high-resolution gridded products overestimate the number of precipitation days, which is a problem that affects SAFRAN more than Spain02 and is likely caused by the interpolation method. Both SAFRAN and Spain02 underestimate high precipitation events, but SAFRAN does so more than Spain02. The overestimation of low precipitation events and the underestimation of intense episodes will probably have hydrological consequences once the data are used to force a land surface or hydrological model.

scholarly journals Shuffle block SRGAN for face image super-resolution reconstruction

2020 ◽  
Vol 53 (7-8) ◽  
pp. 1429-1439
Author(s):  
Ziwei Zhang ◽  
Yangjing Shi ◽  
Xiaoshi Zhou ◽  
Hongfei Kan ◽  
Juan Wen
Keyword(s):  
Face Recognition ◽  
Learning Strategy ◽  
Signal To Noise Ratio ◽  
Similarity Index ◽  
Super Resolution ◽  
Face Image ◽  
Low Resolution ◽  
Index Method ◽  
Face Features ◽  
Image Super Resolution

When low-resolution face images are used for face recognition, the model accuracy is substantially decreased. How to recover high-resolution face features from low-resolution images precisely and efficiently is an essential subtask in face recognition. In this study, we introduce shuffle block SRGAN, a new image super-resolution network inspired by the SRGAN structure. By replacing the residual blocks with shuffle blocks, we can achieve efficient super-resolution reconstruction. Furthermore, by considering the generated image quality in the loss function, we can obtain more realistic super-resolution images. We train and test SB-SRGAN in three public face image datasets and use transfer learning strategy during the training process. The experimental results show that shuffle block SRGAN can achieve desirable image super-resolution performance with respect to visual effect as well as the peak signal-to-noise ratio and structure similarity index method metrics, compared with the performance attained by the other chosen deep-leaning models.

Robust and discriminative dictionary learning for face recognition

2018 ◽  
Vol 16 (02) ◽  
pp. 1840004 ◽  
Author(s):  
Guojun Lin ◽  
Meng Yang ◽  
Linlin Shen ◽  
Mingzhong Yang ◽  
Mei Xie
Keyword(s):  
Face Recognition ◽  
Facial Expressions ◽  
Dictionary Learning ◽  
State Of The Art ◽  
Face Image ◽  
Superior Performance ◽  
Face Images ◽  
Proposed Model ◽  
Classification Capability ◽  
Discriminative Dictionary Learning

For face recognition, conventional dictionary learning (DL) methods have some disadvantages. First, face images of the same person vary with facial expressions and pose, illumination and disguises, so it is hard to obtain a robust dictionary for face recognition. Second, they don’t cover important components (e.g., particularity and disturbance) completely, which limit their performance. In the paper, we propose a novel robust and discriminative DL (RDDL) model. The proposed model uses sample diversities of the same face image to learn a robust dictionary, which includes class-specific dictionary atoms and disturbance dictionary atoms. These atoms can well represent the data from different classes. Discriminative regularizations on the dictionary and the representation coefficients are used to exploit discriminative information, which improves effectively the classification capability of the dictionary. The proposed RDDL is extensively evaluated on benchmark face image databases, and it shows superior performance to many state-of-the-art dictionary learning methods for face recognition.

scholarly journals 3D Face Image Inpainting with Generative Adversarial Nets

2020 ◽  
Vol 2020 ◽  
pp. 1-11
Author(s):  
Tongxin Wei ◽  
Qingbao Li ◽  
Jinjin Liu ◽  
Ping Zhang ◽  
Zhifeng Chen
Keyword(s):  
Face Recognition ◽  
Recognition Performance ◽  
Image Inpainting ◽  
Face Image ◽  
Edge Information ◽  
3D Face ◽  
Face Images ◽  
The Face ◽  
Match Effect ◽  
Traditional Image

In the process of face recognition, face acquisition data is seriously distorted. Many face images collected are blurred or even missing. Faced with so many problems, the traditional image inpainting was based on structure, while the current popular image inpainting method is based on deep convolutional neural network and generative adversarial nets. In this paper, we propose a 3D face image inpainting method based on generative adversarial nets. We identify two parallels of the vector to locate the planer positions. Compared with the previous, the edge information of the missing image is detected, and the edge fuzzy inpainting can achieve better visual match effect. We make the face recognition performance dramatically boost.

scholarly journals Kernel Coupled Cross-Regression for Low-Resolution Face Recognition

2013 ◽  
Vol 2013 ◽  
pp. 1-9
Author(s):  
Zhifei Wang ◽  
Zhenjiang Miao ◽  
Yanli Wan ◽  
Zhen Tang
Keyword(s):  
Face Recognition ◽  
Time Complexity ◽  
Recognition Performance ◽  
Recognition Rate ◽  
Feature Space ◽  
Low Resolution ◽  
Face Images ◽  
Novel Method ◽  
Nonlinear Embedding ◽  
Spectral Regression

Low resolution (LR) in face recognition (FR) surveillance applications will cause the problem of dimensional mismatch between LR image and its high-resolution (HR) template. In this paper, a novel method called kernel coupled cross-regression (KCCR) is proposed to deal with this problem. Instead of processing in the original observing space directly, KCCR projects LR and HR face images into a unified nonlinear embedding feature space using kernel coupled mappings and graph embedding. Spectral regression is further employed to improve the generalization performance and reduce the time complexity. Meanwhile, cross-regression is developed to fully utilize the HR embedding to increase the information of the LR space, thus to improve the recognition performance. Experiments on the FERET and CMU PIE face database show that KCCR outperforms the existing structure-based methods in terms of recognition rate as well as time complexity.

Sign in / Sign up

Export Citation Format

Share Document