High-Fidelity 3D Digital Human Head Creation from RGB-D Selfies

We present a fully automatic system that can produce high-fidelity, photo-realistic three-dimensional (3D) digital human heads with a consumer RGB-D selfie camera. The system only needs the user to take a short selfie RGB-D video while rotating his/her head and can produce a high-quality head reconstruction in less than 30 s. Our main contribution is a new facial geometry modeling and reflectance synthesis procedure that significantly improves the state of the art. Specifically, given the input video a two-stage frame selection procedure is first employed to select a few high-quality frames for reconstruction. Then a differentiable renderer-based 3D Morphable Model (3DMM) fitting algorithm is applied to recover facial geometries from multiview RGB-D data, which takes advantages of a powerful 3DMM basis constructed with extensive data generation and perturbation. Our 3DMM has much larger expressive capacities than conventional 3DMM, allowing us to recover more accurate facial geometry using merely linear basis. For reflectance synthesis, we present a hybrid approach that combines parametric fitting and Convolutional Neural Networks (CNNs) to synthesize high-resolution albedo/normal maps with realistic hair/pore/wrinkle details. Results show that our system can produce faithful 3D digital human faces with extremely realistic details. The main code and the newly constructed 3DMM basis is publicly available.

FACIAL EMOTION DETECTION USING OPEN CV

Automatic Face Detection innovations have made numerous upgrades in evolving world. Brilliant ATTENDANCE SYSTEM utilizing ongoing face acknowledgment is a genuine world arrangement which accompanies everyday exercises of taking care of understudies participation. The administration of participation framework can be an extraordinary weight on educators in case it is finished by hands.To determine this issue we utilize auto and brilliant participation framework which is by and large executed with the assistance of biometric called Face Detection. The primary execution steps utilized in this kind of framework are face location and perceiving the identified countenances. Face Detection is an interaction where the framework will actually want to recognize the human faces which will be caught by the camera. Here , we execute a computerized participation the board framework for understudies of the class by utilizing face acknowledgment method..

A Survey on Differential Privacy for Unstructured Data Content

Huge amount of unstructured data including image, video, audio, and text are ubiquitously generated and shared, it is a challenge to protect sensitive personal information in them, such as human faces, voiceprints, and authorships. Differential privacy is the standard privacy protection technology that provides rigorous privacy guarantees for various data. This survey summarizes and analyzes differential privacy solutions to protect unstructured data content before they are shared with untrusted parties. These differential privacy methods obfuscate unstructured data after they are represented with vectors, and then reconstruct them with obfuscated vectors. We summarize specific privacy models and mechanisms together with possible challenges in them. We also conclude their privacy guarantees against AI attacks and utility losses. Finally, we discuss several possible directions for future research.

Mesh Network of eHealth Intelligent Agents for Visually Impaired and Blind People

Smart assistive devices for blind and visually impaired (B&VI) people are of high interest today since wearable IoT hardware became available for a wide range of users. In the first project, the Raspberry Pi 3 B board measures a distance to the nearest obstacle via ultrasonic sensor HC-SR04 and recognizes human faces by Pi camera, OpenCV library, and Adam Geitgey module. Objects are found by Bluetooth devices of classes 1-3 and iBeacons. Intelligent eHealth agents cooperate with one another in a smart city mesh network via MQTT and BLE protocols. In the second project, B&VIs are supported to play golf. Golf flagsticks have sound marking devices with a buzzer, NodeMcu Lua ESP8266 ESP-12 WiFi board, and WiFi remote control. In the third project, an assistive device supports the orientation of B&VIs by measuring the distance to obstacles via Arduino Uno and HC-SR04. The distance is pronounced through headphones. In the fourth project, the soft-/hardware complex uses Raspberry Pi 3 B and Bytereal iBeacon fingerprinting to uniquely identify the B&VI location at industrial facilities.

Algorithmic Analysis of Automatic Attendance System using Facial Recognition

Attendance management can become a tedious task for teachers if it is performed manually.. This problem can be solved with the help of an automatic attendance management system. But validation is one of the main issues in the system. Generally, biometrics are used in the smart automatic attendance system. Managing attendance with the help of face recognition is one of the biometric methods with better efficiency as compared to others. Smart Attendance with the help of instant face recognition is a real-life solution that helps in handling daily life activities and maintaining a student attendance system. Face recognition-based attendance system uses face biometrics which is based on high resolution monitor video and other technologies to recognize the face of the student. In project, the system will be able to find and recognize human faces fast and accurately with the help of images or videos that will be captured through a surveillance camera. It will convert the frames of the video into images so that our system can easily search that image in the attendance database.

Web-Based Modernized Architecture Over Cloud Computing for Facial Extraction and Recognition

Web content is diverse and is regarded as the primary source of accessible information that can be accessed through reference links. Web facial images are one type of web content that relates to important web pages and is considered important information for individuals. This chapter proposes face recognition as a service architecture that is based on real-world images from the web. The proposed service is implemented as a service for other third parties via cloud computing; additionally, its architecture is built via cloud using virtual machines that can be expanded based on resource demands. Web crawlers crawl web pages and retrieve images for elastic cloud storage. The collected images are then used to remove human faces and prepare the face images for identification and identifying the matched face of the set through successive phases. This chapter used PCA for features extraction and KNN for identification. Experiments show that increasing the number of crawler instances improves crawling speed and improves face recognition accuracy by preferring Euclidean over other metrics.

A Review on Online Classroom Attendance Marking System Using Face Recognition, Python, Computer Vision, and Digital Image Processing

The face is that the identity of someone. The tactic to appear out this physical feature has seen an exquisite change since the advent of the image processing method. Attendance is monitored in every school, college and library. The regular method for attendance is for teachers to call student name & mark attendance. Nowadays, AI has been explored for computer vision-related applications. So, we use the neural network concept in Face recognition for automatically attendance marking systems. This project will perform the face recognition and face detection algorithms, to generate the computer systems strength of acquiring and recognizing human faces fast, accurately, and precisely in live streams so that the systems can be used in the marking attendance

Implementasi Metode Unsupervised Learning Pada Sistem Keamanan Dengan Optimalisasi Penyimpanan Kamera IP

Security monitoring systems using face recognition can be applied to CCTV or IP cameras. This is intended to improve the security system and make it easier for users to track criminals is theft. The experiment was carried out by detecting human faces for 24 hours using different cameras, namely an HD camera that was active during the day and a Night Vision camera that was active at night. The application of Unsupervised Learning method with the concept of an image cluster, aims to distinguish the faces of known or unknown people according to the dataset built in the Raspberry Pi 4. The user interface media of this system is a web-based application built with Python Flask and Python MySQL. This application can be accessed using the domain provided by the IP Forwarding device which can be accessed anywhere. According to the test results on optimization of storage, the system is able to save files only when a face is detected with an average file size of ± 2.28 MB for 1x24 hours of streaming. So that this storage process becomes more efficient and economical compared to the storage process for CCTV or IP cameras in general.

“What Is Hidden behind the Mask?” Facial Emotion Recognition at the Time of COVID-19 Pandemic in Cognitively Normal Multiple Sclerosis Patients

Social cognition deficits have been described in people with multiple sclerosis (PwMS), even in absence of a global cognitive impairment, affecting predominantly the ability to adequately process emotions from human faces. The COVID-19 pandemic has forced people to wear face masks that might interfere with facial emotion recognition. Therefore, in the present study, we aimed at investigating the ability of emotion recognition in PwMS from faces wearing masks. We enrolled a total of 42 cognitively normal relapsing–remitting PwMS and a matched group of 20 healthy controls (HCs). Participants underwent a facial emotion recognition task in which they had to recognize from faces wearing or not surgical masks which of the six basic emotions (happiness, anger, fear, sadness, surprise, disgust) was presented. Results showed that face masks negatively affected emotion recognition in all participants (p < 0.001); in particular, PwMS showed a global worse accuracy than HCs (p = 0.005), mainly driven by the “no masked” (p = 0.021) than the “masked” (p = 0.064) condition. Considering individual emotions, PwMS showed a selective impairment in the recognition of fear, compared with HCs, in both the conditions investigated (“masked”: p = 0.023; “no masked”: p = 0.016). Face masks affected negatively also response times (p < 0.001); in particular, PwMS were globally hastier than HCs (p = 0.024), especially in the “masked” condition (p = 0.013). Furthermore, a detailed characterization of the performance of PwMS and HCs in terms of accuracy and response speed was proposed. Results from the present study showed the effect of face masks on the ability to process facial emotions in PwMS, compared with HCs. Healthcare professionals working with PwMS at the time of the COVID-19 outbreak should take into consideration this effect in their clinical practice. Implications in the everyday life of PwMS are also discussed.

PulseEdit: Editing Physiological Signal in Facial Videos for Privacy Protection

Recent studies have shown that physiological signals can be remotely captured from human faces using a portable color camera under ambient light. This technology, namely remote photoplethysmography (rPPG), can be used to collect users' physiological status who are sitting in front of a camera, which may raise physiological privacy issues. To avoid the privacy abuse of the rPPG technology, this paper develops PulseEdit, a novel and efficient algorithm that can edit the physiological signals in facial videos without affecting visual appearance to protect the user's physiological signal from disclosure. PulseEdit can either remove the trace of the physiological signal in a video or transform the video to contain a target physiological signal chosen by a user. Experimental results show that PulseEdit can effectively edit physiological signals in facial videos and prevent heart rate measurement based on rPPG. It is possible to utilize PulseEdit in adversarial scenarios against some rPPG-based visual security algorithms. We present analyses on the performance of PulseEdit against rPPG-based liveness detection and rPPG-based deepfake detection, and demonstrate its ability to circumvent these visual security algorithms.