Facial expression analysis using local directional stigma mean patterns and convolutional neural networks

This paper represents automatic facial expression analysis method named Local Directional Stigma Mean Patterns (LDSMP) for automatic facial expression analysis and image retrieval using content based facial expression image retrieval and CNN. The traditional local patterns such as Local Binary Patterns (LBP) and Local Ternary Patterns (LTP) are applied for face recognition and expression analysis, calculated using relationship between the center pixel and neighboring pixels. The proposed method calculates the eight directional difference values then divided into the three ranges based on threshold values. Thus, the values are substituted with basic three positive values (+3, +2, +1) and three negative values (-3, -2, -1) to get more sensitive information from an image rather than aforementioned methods. The threshold can be select either static which is selected by user or dynamic is evaluated from image itself and supports to improve the efficiency. The performance of the proposed method is further improved by giving this patterns as input to the Convolutional Neural Networks (CNN) and compared with the existing methods LBP, LTP, and Directional Binary Code (DBC) in terms of Average Precision (AP), Average Recall (AR), and Average Retrieval Rate (ARR) using standard databases COREL 10K (DB1) and JAFFE (The Japanese Female Facial Expression) (DB2) and Extended Cohn-Kanade (CK +) (DB3) dataset.

Image classification using concatenated of co-occurrence matrix features and local ternary patterns

Texture, color, and shape are the three main components that the human visual brain uses to identify or identify environments and objects. Therefore, tissue classification has been considered by many scientific researchers in the last decade. The texture features can be used in many different vision and machine learning problems. As of now, various methods have been proposed for classifying tissues. In all methods, the accuracy of the classification is a major challenge that needs to be improved. This article presents a new method based on a combination of two efficient tissue descriptors, the co-occurrence matrix and local ternary patterns (LTP). First, the local binary pattern and LTP are performed to extract information from the local tissue. In the next step, a subset of statistical properties is extracted from the gray surface concurrency matrices. Finally, the interconnected features are used to teach classification. Performance is evaluated for accuracy on the Brodatz reference data set. The experimental results show that the proposed method offers a higher degree of classification compared to some advanced methods.

Contactless Multi-biometric System Using Fingerprint and Palmprint Selfies

Due to the COVID-19 pandemic, automated contactless person identification based on the human hand has become very vital and an appealing biometric trait. Since, people are expected to cover their faces with masks, and advised avoiding touching surfaces. It is well-known that usually contact-based hand biometrics suffer from issues like deformation due to uneven distribution of pressure or improper placement on sensor, and hygienic concerns. Whereas, to mitigate such problems, contactless imaging is expected to collect the hand biometrics information without any deformation and leading to higher person recognition accuracy; besides maintaining hygienic and pandemic concerns. Towards this aim, in this paper, an effective multi-biometric scheme for person authentication based on contactless fingerprint and palmprint selfies has been proposed. In this study, for simplicity and efficiency, three local descriptors, i.e., local phase quantization (LPQ), local Ternary patterns (LTP), and binarized statistical image features (BSIF), have been employed to extract salient features from contactless fingerprint and palmprint selfies. The score level fusion based multi-biometric system developed in this work combines the matching scores using two different fusion techniques, i.e., transformation based-rules like triangular norms and classifier based-rules like SVM. Experimental results on two publicly available databases (i.e., PolyU contactless to contact-based fingerprint database and IIT-Delhi touchless palmprint dataset) show that the proposed contactless multi-biometric selfie system can easily outperform uni-biometrics.