A NEW APPROACH FOR FACE-IRIS MULTIMODAL BIOMETRIC RECOGNITION USING SCORE FUSION

Author(s):  
MARYAM ESKANDARI ◽  
ÖNSEN TOYGAR ◽  
HASAN DEMIREL

In this paper, a new approach based on score level fusion is presented to obtain a robust recognition system by concatenating face and iris scores of several standard classifiers. The proposed method concatenates face and iris match scores instead of concatenating features as in feature-level fusion. The features from face and iris are extracted using local and global feature extraction methods such as PCA, subspace LDA, spPCA, mPCA and LBP. Transformation-based score fusion and classifier-based score fusion are then involved in the process to obtain, concatenate and classify the matching scores. Different fusion techniques at matching score level, feature level and decision level are compared with the proposed method to emphasize improvement and effectiveness of the proposed method. In order to validate the proposed scheme, a combined database is formed using ORL and BANCA face databases together with CASIA and UBIRIS iris databases. The results based on recognition performance and ROC analysis demonstrate that the proposed score level fusion achieves a significant improvement over unimodal methods and other multimodal face-iris fusion methods.

Author(s):  
Milind E Rane ◽  
Umesh S Bhadade

The paper proposes a t-norm-based matching score fusion approach for a multimodal heterogenous biometric recognition system. Two trait-based multimodal recognition system is developed by using biometrics traits like palmprint and face. First, palmprint and face are pre-processed, extracted features and calculated matching score of each trait using correlation coefficient and combine matching scores using t-norm based score level fusion. Face database like Face 94, Face 95, Face 96, FERET, FRGC and palmprint database like IITD are operated for training and testing of algorithm. The results of experimentation show that the proposed algorithm provides the Genuine Acceptance Rate (GAR) of 99.7% at False Acceptance Rate (FAR) of 0.1% and GAR of 99.2% at FAR of 0.01% significantly improves the accuracy of a biometric recognition system. The proposed algorithm provides the 0.53% more accuracy at FAR of 0.1% and 2.77% more accuracy at FAR of 0.01%, when compared to existing works.


Author(s):  
Mina Farmanbar ◽  
Önsen Toygar

This paper proposes hybrid approaches based on both feature level and score level fusion strategies to provide a robust recognition system against the distortions of individual modalities. In order to compare the proposed schemes, a virtual multimodal database is formed from FERET face and PolyU palmprint databases. The proposed hybrid systems concatenate features extracted by local and global feature extraction methods such as Local Binary Patterns, Log Gabor, Principal Component Analysis and Linear Discriminant Analysis. Match score level fusion is performed in order to show the effectiveness and accuracy of the proposed schemes. The experimental results based on these databases reported a significant improvement of the proposed schemes compared with unimodal systems and other multimodal face–palmprint fusion methods.


Author(s):  
David Zhang ◽  
Fengxi Song ◽  
Yong Xu ◽  
Zhizhen Liang

With this chapter we aims at describing several basic aspects of matching score level fusion. Section 14.1 provides a description of basic characteristics of matching score fusion in the form of introduction. Section 14.2 shows a number of matching score fusion rules. Section 14.3 surveys several typical normalization procedures of raw matching scores. Section 14.4 gives an example of matching score level fusion method. Finally, Section 14.5 provides several brief comments on matching score fusion.


2011 ◽  
Vol 48-49 ◽  
pp. 1010-1013 ◽  
Author(s):  
Yong Li ◽  
Jian Ping Yin ◽  
En Zhu

The performance of biometric systems can be improved by combining multiple units through score level fusion. In this paper, different fusion rules based on match scores are comparatively studied for multi-unit fingerprint recognition. A novel fusion model for multi-unit system is presented first. Based on this model, we analyze the five common score fusion rules: sum, max, min, median and product. Further, we propose a new method: square. Note that the performance of these strategies can complement each other, we introduce the mixed rule: square-sum. We prove that square-sum rule outperforms square and sum rules. The experimental results show good performance of the proposed methods.


Author(s):  
Surinder kaur ◽  
Gopal Chaudhary ◽  
Javalkar Dinesh kumar

Nowadays, Biometric systems are prevalent for personal recognition. But due to pandemic COVID 19, it is difficult to pursue a touch-based biometric system. To encourage a touchless biometric system, a less constrained multimodal personal identification system using palmprint and dorsal hand vein is presented. Hand based Touchless recognition system gives a higher user-friendly system and avoids the spread of coronavirus. A method using Convolution Neural Networks(CNN) to extract discriminative features from the data samples is proposed. A pre-trained function PCANeT is used in the experiments to show the performance of the system in fusion scheme. This method doesn’t require keeping the palm in a specific position or at a certain distance like most other papers. Different patches of ROI are used at two different layers of CNN. Fusion of palmprint and dorsal hand vein is done for final result matching. Both Feature level and score level fusion methods are compared. Results shows the accuracy of upto 98.55% and 98.86% and Equal error rate (EER) of upto 1.22% and 0.93% for score level fusion and feature level fusion, respectively. Our method gives higher accurate results in a less constrained environment.


Author(s):  
Esraa Alqaralleh ◽  
Önsen Toygar

This paper proposes a 2D ear recognition approach that is based on the fusion of ear and tragus using score-level fusion strategy. An attempt to overcome the effect of partial occlusion, pose variation and weak illumination challenges is done since the accuracy of ear recognition may be reduced if one or more of these challenges are available. In this study, the effect of the aforementioned challenges is estimated separately, and many samples of ear that are affected by two different challenges concurrently are also considered. The tragus is used as a biometric trait because it is often free from occlusion; it also provides discriminative features even in different poses and illuminations. The features are extracted using local binary patterns and the evaluation has been done on three datasets of USTB database. It has been observed that the fusion of ear and tragus can improve the recognition performance compared to the unimodal systems. Experimental results show that the proposed method enhances the recognition rates by fusion of parts that are nonoccluded with tragus in the cases of partial occlusion, pose variation and weak illumination. It is observed that the proposed method performs better than feature-level fusion methods and most of the state-of-the-art ear recognition systems.


Sensors ◽  
2020 ◽  
Vol 20 (19) ◽  
pp. 5523 ◽  
Author(s):  
Nada Alay ◽  
Heyam H. Al-Baity

With the increasing demand for information security and security regulations all over the world, biometric recognition technology has been widely used in our everyday life. In this regard, multimodal biometrics technology has gained interest and became popular due to its ability to overcome a number of significant limitations of unimodal biometric systems. In this paper, a new multimodal biometric human identification system is proposed, which is based on a deep learning algorithm for recognizing humans using biometric modalities of iris, face, and finger vein. The structure of the system is based on convolutional neural networks (CNNs) which extract features and classify images by softmax classifier. To develop the system, three CNN models were combined; one for iris, one for face, and one for finger vein. In order to build the CNN model, the famous pertained model VGG-16 was used, the Adam optimization method was applied and categorical cross-entropy was used as a loss function. Some techniques to avoid overfitting were applied, such as image augmentation and dropout techniques. For fusing the CNN models, different fusion approaches were employed to explore the influence of fusion approaches on recognition performance, therefore, feature and score level fusion approaches were applied. The performance of the proposed system was empirically evaluated by conducting several experiments on the SDUMLA-HMT dataset, which is a multimodal biometrics dataset. The obtained results demonstrated that using three biometric traits in biometric identification systems obtained better results than using two or one biometric traits. The results also showed that our approach comfortably outperformed other state-of-the-art methods by achieving an accuracy of 99.39%, with a feature level fusion approach and an accuracy of 100% with different methods of score level fusion.


Sign in / Sign up

Export Citation Format

Share Document