scholarly journals A Novel Infrared and Visible Image Fusion Approach Based on Adversarial Neural Network

Sensors ◽  
2021 ◽  
Vol 22 (1) ◽  
pp. 304
Author(s):  
Xianglong Chen ◽  
Haipeng Wang ◽  
Yaohui Liang ◽  
Ying Meng ◽  
Shifeng Wang

The presence of fake pictures affects the reliability of visible face images under specific circumstances. This paper presents a novel adversarial neural network designed named as the FTSGAN for infrared and visible image fusion and we utilize FTSGAN model to fuse the face image features of infrared and visible image to improve the effect of face recognition. In FTSGAN model design, the Frobenius norm (F), total variation norm (TV), and structural similarity index measure (SSIM) are employed. The F and TV are used to limit the gray level and the gradient of the image, while the SSIM is used to limit the image structure. The FTSGAN fuses infrared and visible face images that contains bio-information for heterogeneous face recognition tasks. Experiments based on the FTSGAN using hundreds of face images demonstrate its excellent performance. The principal component analysis (PCA) and linear discrimination analysis (LDA) are involved in face recognition. The face recognition performance after fusion improved by 1.9% compared to that before fusion, and the final face recognition rate was 94.4%. This proposed method has better quality, faster rate, and is more robust than the methods that only use visible images for face recognition.

Author(s):  
Seyed Omid Shahdi ◽  
S. A. R. Abu-Bakar

At present, frontal or even near frontal face recognition problem is no longer considered as a challenge. Recently, the shift has been to improve the recognition rate for the nonfrontal face. In this work, a neural network paradigm based on the radial basis function approach is proposed to tackle the challenge of recognizing faces in different poses. Exploiting the symmetrical properties of human face, our work takes the advantage of the existence of even half of the face. The strategy is to maximize the linearity relationship based on the local information of the face rather than on the global information. To establish the relationship, our proposed method employs discrete wavelet transform and multi-color uniform local binary pattern (ULBP) in order to obtain features for the local information. The local information will then be represented by a single vector known as the face feature vector. This face feature vector will be used to estimate the frontal face feature vector which will be used for matching with the actual vector. With such an approach, our proposed method relies on a database that contains only single frontal face images. The results shown in this paper demonstrate the robustness of our proposed method even at low-resolution conditions.


2015 ◽  
Vol 734 ◽  
pp. 562-567 ◽  
Author(s):  
En Zeng Dong ◽  
Yan Hong Fu ◽  
Ji Gang Tong

This paper proposed a theoretically efficient approach for face recognition based on principal component analysis (PCA) and rotation invariant uniform local binary pattern texture features in order to weaken the effects of varying illumination conditions and facial expressions. Firstly, the rotation invariant uniform LBP operator was adopted to extract the local texture feature of the face images. Then PCA method was used to reduce the dimensionality of the extracted feature and get the eigenfaces. Finally, the nearest distance classification was used to distinguish each face. The method has been accessed on Yale and ATR-Jaffe face databases. Results demonstrate that the proposed method is superior to standard PCA and its recognition rate is higher than the traditional PCA. And the proposed algorithm has strong robustness against the illumination changes, pose, rotation and expressions.


2021 ◽  
Vol 2021 ◽  
pp. 1-12
Author(s):  
Zhixue Liang

In the contactless delivery scenario, the self-pickup cabinet is an important terminal delivery device, and face recognition is one of the efficient ways to achieve contactless access express delivery. In order to effectively recognize face images under unrestricted environments, an unrestricted face recognition algorithm based on transfer learning is proposed in this study. First, the region extraction network of the faster RCNN algorithm is improved to improve the recognition speed of the algorithm. Then, the first transfer learning is applied between the large ImageNet dataset and the face image dataset under restricted conditions. The second transfer learning is applied between face image under restricted conditions and unrestricted face image datasets. Finally, the unrestricted face image is processed by the image enhancement algorithm to increase its similarity with the restricted face image, so that the second transfer learning can be carried out effectively. Experimental results show that the proposed algorithm has better recognition rate and recognition speed on the CASIA-WebFace dataset, FLW dataset, and MegaFace dataset.


Author(s):  
Yallamandaiah S. ◽  
Purnachand N.

<p>In the area of computer vision, face recognition is a challenging task because of the pose, facial expression, and illumination variations. The performance of face recognition systems reduces in an unconstrained environment. In this work, a new face recognition approach is proposed using a guided image filter, and a convolutional neural network (CNN). The guided image filter is a smoothing operator and performs well near the edges. Initially, the ViolaJones algorithm is used to detect the face region and then smoothened by a guided image filter. Later the proposed CNN is used to extract the features and recognize the faces. The experiments were performed on face databases like ORL, JAFFE, and YALE and attained a recognition rate of 98.33%, 99.53%, and 98.65% respectively. The experimental results show that the suggested face recognition method attains good results than some of the state-of-the-art techniques.</p>


2021 ◽  
Vol 18 (5) ◽  
pp. 6638-6651
Author(s):  
Huilin Ge ◽  
◽  
Yuewei Dai ◽  
Zhiyu Zhu ◽  
Biao Wang

<abstract> <sec><title>Purpose</title><p>Due to the lack of prior knowledge of face images, large illumination changes, and complex backgrounds, the accuracy of face recognition is low. To address this issue, we propose a face detection and recognition algorithm based on multi-task convolutional neural network (MTCNN).</p> </sec> <sec><title>Methods</title><p>In our paper, MTCNN mainly uses three cascaded networks, and adopts the idea of candidate box plus classifier to perform fast and efficient face recognition. The model is trained on a database of 50 faces we have collected, and Peak Signal-to-Noise Ratio (PSNR), Structural Similarity Index Measurement (SSIM), and receiver operating characteristic (ROC) curve are used to analyse MTCNN, Region-CNN (R-CNN) and Faster R-CNN.</p> </sec> <sec><title>Results</title><p>The average PSNR of this technique is 1.24 dB higher than that of R-CNN and 0.94 dB higher than that of Faster R-CNN. The average SSIM value of MTCNN is 10.3% higher than R-CNN and 8.7% higher than Faster R-CNN. The Area Under Curve (AUC) of MTCNN is 97.56%, the AUC of R-CNN is 91.24%, and the AUC of Faster R-CNN is 92.01%. MTCNN has the best comprehensive performance in face recognition. For the face images with defective features, MTCNN still has the best effect.</p> </sec> <sec><title>Conclusions</title><p>This algorithm can effectively improve face recognition to a certain extent. The accuracy rate and the reduction of the false detection rate of face detection can not only be better used in key places, ensure the safety of property and security of the people, improve safety, but also better reduce the waste of human resources and improve efficiency.</p> </sec> </abstract>


2011 ◽  
Vol 204-210 ◽  
pp. 216-219
Author(s):  
Hong Zhang

It's well known that the technology of human face recognition has become a hot topicin pattern recognition field. Though a lot of progress has been made by many researchersthese years, many key problems still have to be solved in order to popularize the application of face recognition because of the complexity of face recognition. The background, development and main methods of face recognition are introducedfirstly in this paper, then a face recognition method which is based on wavelet transform,KL transform and BP neural networks is used in the paper.Here the face feature extraction includes wavelet transform and KL transform.Moreover,the recognition classifier is BP neural networks.The simulation testing in the paper holds good recognition rate.


Author(s):  
Edy Winarno ◽  
Agus Harjoko ◽  
Aniati Murni Arymurthy ◽  
Edi Winarko

<p>The main problem in face recognition system based on half-face pattern is how to anticipate poses and illuminance variations to improve recognition rate. To solve this problem, we can use two lenses on stereo vision camera in face recognition system. Stereo vision camera has left and right lenses that can be used to produce a 2D image of each lens. Stereo vision camera in face recognition has capability to produce two of 2D face images with a different angle. Both angle of the face image will produce a detailed image of the face and better lighting levels on each of the left and right lenses. In this study, we proposed a face recognition technique, using 2 lens on a stereo vision camera namely symmetrical half-join. Symmetrical half-join is a method of normalizing the image of the face detection on each of the left and right lenses in stereo vision camera, then cropping and merging at each image. Tests on face recognition rate based on the variety of poses and variations in illumination shows that the symmetrical half-join method is able to provide a high accuracy of face recognition and can anticipate variations in given pose and illumination variations. The proposed model is able to produce 86% -97% recognition rate on a variety of poses and variations in angles between 0 °- 22.5 °. The variation of illuminance measured using a lux meter can result in 90% -100% recognition rate for the category of at least dim lighting levels (above 10 lux).</p>


2018 ◽  
Vol 2018 ◽  
pp. 1-9 ◽  
Author(s):  
Kun Sun ◽  
Xin Yin ◽  
Mingxin Yang ◽  
Yang Wang ◽  
Jianying Fan

At present, the face recognition method based on deep belief network (DBN) has advantages of automatically learning the abstract information of face images and being affected slightly by active factors, so it becomes the main method in the face recognition area. Because DBN ignores the local information of face images, the face recognition rate based on DBN is badly affected. To solve this problem, a face recognition method based on center-symmetric local binary pattern (CS-LBP) and DBN (FRMCD) is proposed in this paper. Firstly, the face image is divided into several subblocks. Secondly, CS-LBP is used to extract texture features of each image subblock. Thirdly, texture feature histograms are formed and input into the DBN visual layer. Finally, face classification and face recognition are completed through deep learning in DBN. Through the experiments on face databases ORL, Extend Yale B, and CMU-PIE by the proposed method (FRMCD), the best partitioning way of the face image and the hidden unit number of the DBN hidden layer are obtained. Then, comparative experiments between the FRMCD and traditional methods are performed. The results show that the recognition rate of FRMCD is superior to those of traditional methods; the highest recognition rate is up to 98.82%. When the number of training samples is less, the FRMCD has more significant advantages. Compared with the method based on local binary pattern (LBP) and DBN, the time-consuming of FRMCD is shorter.


2012 ◽  
Vol 2012 ◽  
pp. 1-12 ◽  
Author(s):  
Naser Zaeri

Numerous face recognition techniques have been developed owing to the growing number of real-world applications. Most of current algorithms for face recognition involve considerable amount of computations and hence they cannot be used on devices constrained with limited speed and memory. In this paper, we propose a novel solution for efficient face recognition problem for systems that utilize small memory capacities and demand fast performance. The new technique divides the face images into components and finds the discriminant phases of the Fourier transform of these components automatically using the sequential floating forward search method. A thorough study and comprehensive experiments relating time consumption versus system performance are applied to benchmark face image databases. Finally, the proposed technique is compared with other known methods and evaluated through the recognition rate and the computational time, where we achieve a recognition rate of 98.5% with computational time of 6.4 minutes for a database consisting of 2360 images.


2021 ◽  
Vol 2021 ◽  
pp. 1-11
Author(s):  
Shoujun Tang ◽  
Mohammad Shabaz

Face recognition is one of the popular areas of research in the field of computer vision. It is mainly used for identification and security system. One of the major challenges in face recognition is identification under numerous illumination environments by changing the direction of light or modifying the lighting magnitude. Exacting illumination invariant features is an effective approach to solve this problem. Conventional face recognition algorithms based on nonsubsampled contourlet transform (NSCT) and bionic mode are not capable enough to recognize the similar faces with great accuracy. Hence, in this paper, an attempt is made to propose an enhanced cerebellum-basal ganglia mechanism (CBGM) for face recognition. The integral projection and geometric feature assortment method are used to acquire the facial image features. The cognition model is deployed which is based on the cerebellum-basal ganglia mechanism and is applied for extraction of features from the face image to achieve greater accuracy for recognition of face images. The experimental results reveal that the enhanced CBGM algorithm can effectively recognize face images with greater accuracy. The recognition rate of 100 AR face images has been found to be 96.9%. The high recognition accuracy rate has been achieved by the proposed CBGM technique.


Sign in / Sign up

Export Citation Format

Share Document