scholarly journals The Face Module Emerged in a Deep Convolutional Neural Network Selectively Deprived of Face Experience

2021 ◽  
Vol 15 ◽  
Author(s):  
Shan Xu ◽  
Yiyuan Zhang ◽  
Zonglei Zhen ◽  
Jia Liu
Keyword(s):  
Neural Network ◽  
Convolutional Neural Network ◽  
Deep Convolutional Neural Network ◽  
Domain Specificity ◽  
Domain Specific ◽  
Specific Experience ◽  
Face Categorization ◽  
The Face ◽  
Nature Vs Nurture

Can we recognize faces with zero experience on faces? This question is critical because it examines the role of experiences in the formation of domain-specific modules in the brain. Investigation with humans and non-human animals on this issue cannot easily dissociate the effect of the visual experience from that of the hardwired domain-specificity. Therefore, the present study built a model of selective deprivation of the experience on faces with a representative deep convolutional neural network, AlexNet, by removing all images containing faces from its training stimuli. This model did not show significant deficits in face categorization and discrimination, and face-selective modules automatically emerged. However, the deprivation reduced the domain-specificity of the face module. In sum, our study provides empirical evidence on the role of nature vs. nurture in developing the domain-specific modules that domain-specificity may evolve from non-specific experience without genetic predisposition, and is further fine-tuned by domain-specific experience.

scholarly journals The face module emerged in a deep convolutional neural network selectively deprived of face experience

2020 ◽  
Author(s):  
Shan Xu ◽  
Yiyuan Zhang ◽  
Zonglei Zhen ◽  
Jia Liu
Keyword(s):  
Neural Network ◽  
Convolutional Neural Network ◽  
Deep Convolutional Neural Network ◽  
Domain Specificity ◽  
Domain Specific ◽  
Specific Experience ◽  
Face Categorization ◽  
The Face ◽  
The Brain

AbstractCan we recognize faces with zero experience on faces? This question is critical because it examines the role of experiences in the formation of domain-specific modules in the brain. Investigation with humans and non-human animals on this issue cannot easily dissociate the effect of the visual experience from that of the hardwired domain-specificity. Therefore the present study built a model of selective deprivation of the experience on faces with a representative deep convolutional neural network, AlexNet, by removing all images containing faces from its training stimuli. This model did not show significant deficits in face categorization and discrimination, and face-selective modules automatically emerged. However, the deprivation reduced the domain-specificity of the face module. In sum, our study provides undisputable evidence on the role of nature versus nurture in developing the domain-specific modules that domain-specificity may evolve from non-specific experience without genetic predisposition, and is further fine-tuned by domain-specific experience.

scholarly journals Multidimensional face representation in deep convolutional neural network reveals the mechanism underlying AI racism

2020 ◽  
Author(s):  
Jinhua Tian ◽  
Hailun Xie ◽  
Siyuan Hu ◽  
Jia Liu
Keyword(s):  
Neural Network ◽  
Convolutional Neural Network ◽  
Underlying Mechanism ◽  
Deep Convolutional Neural Network ◽  
The Other ◽  
Identification Accuracy ◽  
Social Bias ◽  
Novel Approach ◽  
The Face ◽  
Ai Ethics

AbstractThe increasingly popular application of AI runs the risks of amplifying social bias, such as classifying non-white faces to animals. Recent research has attributed the bias largely to data for training. However, the underlying mechanism is little known, and therefore strategies to rectify the bias are unresolved. Here we examined a typical deep convolutional neural network (DCNN), VGG-Face, which was trained with a face dataset consisting of more white faces than black and Asian faces. The transfer learning result showed significantly better performance in identifying white faces, just like the well-known social bias in human, the other-race effect (ORE). To test whether the effect resulted from the imbalance of face images, we retrained the VGG-Face with a dataset containing more Asian faces, and found a reverse ORE that the newly-trained VGG-Face preferred Asian faces over white faces in identification accuracy. In addition, when the number of Asian faces and white faces were matched in the dataset, the DCNN did not show any bias. To further examine how imbalanced image input led to the ORE, we performed the representational similarity analysis on VGG-Face’s activation. We found that when the dataset contained more white faces, the representation of white faces was more distinct, indexed by smaller ingroup similarity and larger representational Euclidean distance. That is, white faces were scattered more sparsely in the representational face space of the VGG-Face than the other faces. Importantly, the distinctiveness of faces was positively correlated with the identification accuracy, which explained the ORE observed in the VGG-Face. In sum, our study revealed the mechanism underlying the ORE in DCNNs, which provides a novel approach of study AI ethics. In addition, the face multidimensional representation theory discovered in human was found also applicable to DCNNs, advocating future studies to apply more cognitive theories to understand DCNN’s behavior.

scholarly journals Optimization-Driven Kernel and Deep Convolutional Neural Network for Multi-View Face Video Super Resolution

2020 ◽  
Vol 12 (3) ◽  
pp. 77-95
Author(s):  
Amar B. Deshmukh ◽  
N. Usha Rani
Keyword(s):  
Neural Network ◽  
Convolutional Neural Network ◽  
Super Resolution ◽  
Block Size ◽  
Face Image ◽  
Deep Convolutional Neural Network ◽  
Grey Wolf Optimizer ◽  
Video Frames ◽  
The Face ◽  
Deep Cnn

One of the major challenges faced by video surveillance is recognition from low-resolution videos or person identification. Image enhancement methods play a significant role in enhancing the resolution of the video. This article introduces a technique for face super resolution based on a deep convolutional neural network (Deep CNN). At first, the video frames are extracted from the input video and the face detection is performed using the Viola-Jones algorithm. The detected face image and the scaling factors are fed into the Fractional-Grey Wolf Optimizer (FGWO)-based kernel weighted regression model and the proposed Deep CNN separately. Finally, the results obtained from both the techniques are integrated using a fuzzy logic system, offering a face image with enhanced resolution. Experimentation is carried out using the UCSD face video dataset, and the effectiveness of the proposed Deep CNN is checked depending on the block size and the upscaling factor values and is evaluated to be the best when compared to other existing techniques with an improved SDME value of 80.888.

scholarly journals An Hybrid Attention-Based System for the Prediction of Facial Attributes

2021 ◽  
pp. 116-127
Author(s):  
Souad Khellat-Kihel ◽  
Zhenan Sun ◽  
Massimo Tistarelli
Keyword(s):  
Neural Network ◽  
Convolutional Neural Network ◽  
Network Architecture ◽  
High Performance ◽  
Binary Classification ◽  
Deep Convolutional Neural Network ◽  
Network Layers ◽  
Visual Tasks ◽  
The Face ◽  
Facial Attributes

AbstractRecent research on face analysis has demonstrated the richness of information embedded in feature vectors extracted from a deep convolutional neural network. Even though deep learning achieved a very high performance on several challenging visual tasks, such as determining the identity, age, gender and race, it still lacks a well grounded theory which allows to properly understand the processes taking place inside the network layers. Therefore, most of the underlying processes are unknown and not easy to control. On the other hand, the human visual system follows a well understood process in analyzing a scene or an object, such as a face. The direction of the eye gaze is repeatedly directed, through purposively planned saccadic movements, towards salient regions to capture several details. In this paper we propose to capitalize on the knowledge of the saccadic human visual processes to design a system to predict facial attributes embedding a biologically-inspired network architecture, the HMAX. The architecture is tailored to predict attributes with different textural information and conveying different semantic meaning, such as attributes related and unrelated to the subject’s identity. Salient points on the face are extracted from the outputs of the S2 layer of the HMAX architecture and fed to a local texture characterization module based on LBP (Local Binary Pattern). The resulting feature vector is used to perform a binary classification on a set of pre-defined visual attributes. The devised system allows to distill a very informative, yet robust, representation of the imaged faces, allowing to obtain high performance but with a much simpler architecture as compared to a deep convolutional neural network. Several experiments performed on publicly available, challenging, large datasets demonstrate the validity of the proposed approach.

LENS CLASSIFICATION ACCORDING TO THE TYPE OF LIGHT SPOT USING A NEURAL NETWORK

2020 ◽  
Vol 2020 (4) ◽  
pp. 4-14
Author(s):  
Vladimir Budak ◽  
Ekaterina Ilyina
Keyword(s):  
Neural Network ◽  
Light Intensity ◽  
Convolutional Neural Network ◽  
Deep Convolutional Neural Network ◽  
Beam Angle ◽  
New Model ◽  
Technical Parameters ◽  
Transfer Training ◽  
Trained Network

The article proposes the classification of lenses with different symmetrical beam angles and offers a scale as a spot-light’s palette. A collection of spotlight’s images was created and classified according to the proposed scale. The analysis of 788 pcs of existing lenses and reflectors with different LEDs and COBs carried out, and the dependence of the axial light intensity from beam angle was obtained. A transfer training of new deep convolutional neural network (CNN) based on the pre-trained GoogleNet was performed using this collection. GradCAM analysis showed that the trained network correctly identifies the features of objects. This work allows us to classify arbitrary spotlights with an accuracy of about 80 %. Thus, light designer can determine the class of spotlight and corresponding type of lens with its technical parameters using this new model based on CCN.

Sign in / Sign up

Export Citation Format

Share Document