A Multi Model Framework for Grading of Human Emotion Using CNN and Computer Vision

Emotion analysis is an area which is been widely used in the forensic crime detection domain, a mentoring device for depressed students, psychologically affected patient treatment. The current system helps only in identifying the emotions but not in identifying the level of emotions like whether the individual is truly happy/sad or pretending to be happy /sad. In this proposed work a novel methodology has been introduced. We have rebuilt the Traditional Local Binary Pattern (LBP) feature operator to image the expression and combine the abstract characteristics of facial expression learned from the neural network of deep convolution with the modified features of the texture of the LBP facial expression in the full connection layer. These extracted features have been subjected as input for CNN Alex Net to classify the level of emotions. The results obtained in this phase are used in the confusion matrix for analysis of grading of emotions like Grade-1, Grade-2, and Grade-3 obtained an accuracy of 87.58% in the comparative analysis.

Real time Face Detection and Optimal Face Mapping for Online Classes

The main objective of this paper is to provide a web-based tool for identifying faces in a real-time environment, such as Online Classes. Face recognition in real-time is now a fascinating field with an ever-increasing challenge such as light variations, occlusion, variation in facial expressions, etc. During the current pandemic scenario of COVID-19, the demand for online classrooms has rapidly increased. This has escalated the need for a real-time, economic, simple, and convenient way to track the attendance of the students in a live classroom. This paper addresses the aforementioned issue by proposing a real-time online attendance system. Two alternative face recognition algorithms are perceived in order to develop the tool for realtime face detection and recognition with improved accuracy. The algorithms adopted are Local Binary Pattern Histogram(LBPH) and Convolutional Neural Network (CNN) for face recognition as well as Haar cascade classifier with boosting for face detection. Experimental results show that CNN with an accuracy of 95% is better in this context than LBPH that yields an accuracy of 78%.

Classification of Parkinson’s disease patients based on spectrogram using local binary pattern descriptors

Extreme learning machine is an algorithm that has shown a good performance facing classification and regression problems. It has gained great acceptance by the scientific community due to the simplicity of the model and its sola great generalization capacity. This work proposes the use of extreme learning machine neural networks to carry out the classification between Parkinson’s disease patients and healthy individuals. The descriptor used corresponds to the feature vector generated applying the local binary Pattern algorithm to the grayscale spectrograms. The spectrograms are obtained from the audio signal samples from the considered repository. Experiments are conducted with single hidden layer and multilayer extreme learning machine networks comparing the results of each structure. Results show that hierarchical extreme learning machine with three hidden layers has a better general performance over multilayer extreme learning machine networks and a single hidden layer extreme learning machine. The rate of success obtained is within the ranges presented in the literature. However, the hierarchical network training time is considerably faster compared to multilayer networks of three or two hidden layers.

Identifikasi Jenis Kayu Berdasarkan Fitur Tekstur Local Binary Pattern Menggunakan Metode Learning Vector Quantization

Pada umumnya pengenalan jenis kayu masih dilakukan dengan menggunakan indera penglihatan dan penciuman. Hal tersebut dapat mempengaruhi proses jual beli dimana waktu yang dibutuhkan untuk pengenalan kayu menjadi lebih lama sehingga menyebabkan proses bisnis menjadi kurang efektif. Penelitian ini bertujuan untuk membangun suatu model machine learning untuk proses identifikasi jenis kayu berdasarkan fitur teksur citra pada kayu. Metode Local Binary Pattern (LBP) digunakan dalam proses ekstraksi ciri untuk menghasilkan vektor ciri yang dijadikan data input pada proses klasifikasi citra dengan menggunakan metode Learning Vector Quantization (LVQ). Parameter yang digunakan pada metode LBP meliputi numpoint dan radius dengan nilai 1 sampai 10. Hasil penelitian dari metode ini didapatkan akurasi tertinggi 68,33% pada numpoint 2 dan radius 1. Hasil pengujian yang cukup rendah dapat dipengaruhi oleh beberapa faktor yaitu jumlah citra latih dan terdapat beberapa citra kayu memiliki pola yang hampir sama.

Automatic Gemstone Classification Using Computer Vision

This paper presents a computer-vision-based methodology for automatic image-based classification of 2042 training images and 284 unseen (test) images divided into 68 categories of gemstones. A series of feature extraction techniques (33 including colour histograms in the RGB, HSV and CIELAB space, local binary pattern, Haralick texture and grey-level co-occurrence matrix properties) were used in combination with different machine-learning algorithms (Logistic Regression, Linear Discriminant Analysis, K-Nearest Neighbour, Decision Tree, Random Forest, Naive Bayes and Support Vector Machine). Deep-learning classification with ResNet-18 and ResNet-50 was also investigated. The optimal combination was provided by a Random Forest algorithm with the RGB eight-bin colour histogram and local binary pattern features, with an accuracy of 69.4% on unseen images; the algorithms required 0.0165 s to process the 284 test images. These results were compared against three expert gemmologists with at least 5 years of experience in gemstone identification, who obtained accuracies between 42.6% and 66.9% and took 42–175 min to classify the test images. As expected, the human experts took much longer than the computer vision algorithms, which in addition provided, albeit marginal, higher accuracy. Although these experiments included a relatively low number of images, the superiority of computer vision over humans is in line with what has been reported in other areas of study, and it is encouraging to further explore the application in gemmology and related areas.