Multi-Scale Facial Scanning via Spatial Lstm for Latent Facial Feature Representation

2017 ◽  
Author(s):  
Seong Tae Kim ◽  
Yeoreum Choi ◽  
Yong Man Ro
Keyword(s):  
Facial Feature ◽  
Feature Representation ◽  
Multi Scale ◽  
Facial Scanning

scholarly journals Weighted statistical binary patterns for facial feature representation

2021 ◽  
Author(s):  
Hung Phuoc Truong ◽  
Thanh Phuong Nguyen ◽  
Yong-Guk Kim
Keyword(s):  
Comprehensive Evaluation ◽  
Facial Feature ◽  
Input Image ◽  
Feature Representation ◽  
Illumination Variation ◽  
Straight Line ◽  
Mean And Variance ◽  
The Mean ◽  
Face Datasets ◽  
Degraded Images

AbstractWe present a novel framework for efficient and robust facial feature representation based upon Local Binary Pattern (LBP), called Weighted Statistical Binary Pattern, wherein the descriptors utilize the straight-line topology along with different directions. The input image is initially divided into mean and variance moments. A new variance moment, which contains distinctive facial features, is prepared by extracting root k-th. Then, when Sign and Magnitude components along four different directions using the mean moment are constructed, a weighting approach according to the new variance is applied to each component. Finally, the weighted histograms of Sign and Magnitude components are concatenated to build a novel histogram of Complementary LBP along with different directions. A comprehensive evaluation using six public face datasets suggests that the present framework outperforms the state-of-the-art methods and achieves 98.51% for ORL, 98.72% for YALE, 98.83% for Caltech, 99.52% for AR, 94.78% for FERET, and 99.07% for KDEF in terms of accuracy, respectively. The influence of color spaces and the issue of degraded images are also analyzed with our descriptors. Such a result with theoretical underpinning confirms that our descriptors are robust against noise, illumination variation, diverse facial expressions, and head poses.

scholarly journals Learning rich features with hybrid loss for brain tumor segmentation

2021 ◽  
Vol 21 (S2) ◽  
Author(s):  
Daobin Huang ◽  
Minghui Wang ◽  
Ling Zhang ◽  
Haichun Li ◽  
Minquan Ye ◽  
...  
Keyword(s):  
Feature Extraction ◽  
Brain Tumor ◽  
Class Imbalance ◽  
Feature Representation ◽  
Loss Functions ◽  
Radiotherapy Planning ◽  
Tumor Segmentation ◽  
Brain Tumor Segmentation ◽  
Scale Feature ◽  
Multi Scale

Abstract Background Accurately segment the tumor region of MRI images is important for brain tumor diagnosis and radiotherapy planning. At present, manual segmentation is wildly adopted in clinical and there is a strong need for an automatic and objective system to alleviate the workload of radiologists. Methods We propose a parallel multi-scale feature fusing architecture to generate rich feature representation for accurate brain tumor segmentation. It comprises two parts: (1) Feature Extraction Network (FEN) for brain tumor feature extraction at different levels and (2) Multi-scale Feature Fusing Network (MSFFN) for merge all different scale features in a parallel manner. In addition, we use two hybrid loss functions to optimize the proposed network for the class imbalance issue. Results We validate our method on BRATS 2015, with 0.86, 0.73 and 0.61 in Dice for the three tumor regions (complete, core and enhancing), and the model parameter size is only 6.3 MB. Without any post-processing operations, our method still outperforms published state-of-the-arts methods on the segmentation results of complete tumor regions and obtains competitive performance in another two regions. Conclusions The proposed parallel structure can effectively fuse multi-level features to generate rich feature representation for high-resolution results. Moreover, the hybrid loss functions can alleviate the class imbalance issue and guide the training process. The proposed method can be used in other medical segmentation tasks.

scholarly journals A Dual-Model Architecture with Grouping-Attention-Fusion for Remote Sensing Scene Classification

2021 ◽  
Vol 13 (3) ◽  
pp. 433
Author(s):  
Junge Shen ◽  
Tong Zhang ◽  
Yichen Wang ◽  
Ruxin Wang ◽  
Qi Wang ◽  
...  
Keyword(s):  
Remote Sensing ◽  
Feature Representation ◽  
Dual Model ◽  
Scene Classification ◽  
Remote Sensing Images ◽  
Single Model ◽  
Fusion Strategy ◽  
Multi Scale ◽  
The Arts ◽  
Scene Representation

Remote sensing images contain complex backgrounds and multi-scale objects, which pose a challenging task for scene classification. The performance is highly dependent on the capacity of the scene representation as well as the discriminability of the classifier. Although multiple models possess better properties than a single model on these aspects, the fusion strategy for these models is a key component to maximize the final accuracy. In this paper, we construct a novel dual-model architecture with a grouping-attention-fusion strategy to improve the performance of scene classification. Specifically, the model employs two different convolutional neural networks (CNNs) for feature extraction, where the grouping-attention-fusion strategy is used to fuse the features of the CNNs in a fine and multi-scale manner. In this way, the resultant feature representation of the scene is enhanced. Moreover, to address the issue of similar appearances between different scenes, we develop a loss function which encourages small intra-class diversities and large inter-class distances. Extensive experiments are conducted on four scene classification datasets include the UCM land-use dataset, the WHU-RS19 dataset, the AID dataset, and the OPTIMAL-31 dataset. The experimental results demonstrate the superiority of the proposed method in comparison with the state-of-the-arts.

scholarly journals Image Gradient-based Joint Direct Visual Odometry for Stereo Camera

2017 ◽  
Author(s):  
Jianke Zhu
Keyword(s):  
Visual Odometry ◽  
Research Problem ◽  
Feature Representation ◽  
Local Optimum ◽  
Multi Scale ◽  
Illumination Changes ◽  
Pyramid Scheme ◽  
Gradient Based ◽  
Feature Based ◽  
Dense 3D Reconstruction

Visual odometry is an important research problem for computer vision and robotics. In general, the feature-based visual odometry methods heavily rely on the accurate correspondences between local salient points, while the direct approaches could make full use of whole image and perform dense 3D reconstruction simultaneously. However, the direct visual odometry usually suffers from the drawback of getting stuck at local optimum especially with large displacement, which may lead to the inferior results. To tackle this critical problem, we propose a novel scheme for stereo odometry in this paper, which is able to improve the convergence with more accurate pose. The key of our approach is a dual Jacobian optimization that is fused into a multi-scale pyramid scheme. Moreover, we introduce a gradient-based feature representation, which enjoys the merit of being robust to illumination changes. Furthermore, a joint direct odometry approach is proposed to incorporate the information from the last frame and previous keyframes. We have conducted the experimental evaluation on the challenging KITTI odometry benchmark, whose promising results show that the proposed algorithm is very effective for stereo visual odometry.

scholarly journals Does My Face FIT?: A Face Image Task Reveals Structure and Distortions of Facial Feature Representation

PLoS ONE ◽  
2013 ◽  
Vol 8 (10) ◽  
pp. e76805 ◽  
Author(s):  
Christina T. Fuentes ◽  
Catarina Runa ◽  
Xenxo Alvarez Blanco ◽  
Verónica Orvalho ◽  
Patrick Haggard
Keyword(s):  
Facial Feature ◽  
Face Image ◽  
Feature Representation

scholarly journals GourmetNet: Food Segmentation Using Multi-Scale Waterfall Features with Spatial and Channel Attention

Sensors ◽  
2021 ◽  
Vol 21 (22) ◽  
pp. 7504
Author(s):  
Udit Sharma ◽  
Bruno Artacho ◽  
Andreas Savakis
Keyword(s):  
Feature Extraction ◽  
State Of The Art ◽  
Extraction Process ◽  
Feature Representation ◽  
Post Processing ◽  
Multi Scale ◽  
Spatial Pooling ◽  
Current State ◽  
Nutrition Monitoring ◽  
Multiple Levels

We propose GourmetNet, a single-pass, end-to-end trainable network for food segmentation that achieves state-of-the-art performance. Food segmentation is an important problem as the first step for nutrition monitoring, food volume and calorie estimation. Our novel architecture incorporates both channel attention and spatial attention information in an expanded multi-scale feature representation using our advanced Waterfall Atrous Spatial Pooling module. GourmetNet refines the feature extraction process by merging features from multiple levels of the backbone through the two attention modules. The refined features are processed with the advanced multi-scale waterfall module that combines the benefits of cascade filtering and pyramid representations without requiring a separate decoder or post-processing. Our experiments on two food datasets show that GourmetNet significantly outperforms existing current state-of-the-art methods.

scholarly journals Analysis of Feature Extraction and Anti-Interference of Face Image under Deep Reconstruction Network Algorithm

Complexity ◽  
2021 ◽  
Vol 2021 ◽  
pp. 1-15
Author(s):  
Jin Yang ◽  
Yuxuan Zhao ◽  
Shihao Yang ◽  
Xinxin Kang ◽  
Xinyan Cao ◽  
...  
Keyword(s):  
Feature Extraction ◽  
Face Recognition ◽  
Bayesian Method ◽  
Feature Matching ◽  
Facial Feature ◽  
Face Image ◽  
Feature Representation ◽  
Image Feature ◽  
Training Time ◽  
Network Algorithm

In face recognition systems, highly robust facial feature representation and good classification algorithm performance can affect the effect of face recognition under unrestricted conditions. To explore the anti-interference performance of convolutional neural network (CNN) reconstructed by deep learning (DL) framework in face image feature extraction (FE) and recognition, in the paper, first, the inception structure in the GoogleNet network and the residual error in the ResNet network structure are combined to construct a new deep reconstruction network algorithm, with the random gradient descent (SGD) and triplet loss functions as the model optimizer and classifier, respectively, and it is applied to the face recognition in Labeled Faces in the Wild (LFW) face database. Then, the portrait pyramid segmentation and local feature point segmentation are applied to extract the features of face images, and the matching of face feature points is achieved using Euclidean distance and joint Bayesian method. Finally, Matlab software is used to simulate the algorithm proposed in this paper and compare it with other algorithms. The results show that the proposed algorithm has the best face recognition effect when the learning rate is 0.0004, the attenuation coefficient is 0.0001, the training method is SGD, and dropout is 0.1 (accuracy: 99.03%, loss: 0.0047, training time: 352 s, and overfitting rate: 1.006), and the algorithm proposed in this paper has the largest mean average precision compared to other CNN algorithms. The correct rate of face feature matching of the algorithm proposed in this paper is 84.72%, which is higher than LetNet-5, VGG-16, and VGG-19 algorithms, the correct rates of which are 6.94%, 2.5%, and 1.11%, respectively, but lower than GoogleNet, AlexNet, and ResNet algorithms. At the same time, the algorithm proposed in this paper has a faster matching time (206.44 s) and a higher correct matching rate (88.75%) than the joint Bayesian method, indicating that the deep reconstruction network algorithm proposed in this paper can be used in face image recognition, FE, and matching, and it has strong anti-interference.

scholarly journals Deep Learning for Facial Beauty Prediction

Information ◽  
2020 ◽  
Vol 11 (8) ◽  
pp. 391
Author(s):  
Kerang Cao ◽  
Kwang-nam Choi ◽  
Hoekyung Jung ◽  
Lini Duan
Keyword(s):  
Deep Learning ◽  
Information Transmission ◽  
Network Design ◽  
Gradient Flow ◽  
Facial Feature ◽  
Feature Representation ◽  
Feature Maps ◽  
Regression Problem ◽  
The Arts ◽  
Facial Beauty

Facial beauty prediction (FBP) is a burgeoning issue for attractiveness evaluation, which aims to make assessment consistent with human opinion. Since FBP is a regression problem, to handle this issue, there are data-driven methods for finding the relations between facial features and beauty assessment. Recently, deep learning methods have shown its amazing capacity for feature representation and analysis. Convolutional neural networks (CNNs) have shown tremendous performance on facial recognition and comprehension, which are proved as an effective method for facial feature exploration. Lately, there are well-designed networks with efficient structures investigated for better representation performance. However, these designs concentrate on the effective block but do not build an efficient information transmission pathway, which led to a sub-optimal capacity for feature representation. Furthermore, these works cannot find the inherent correlations of feature maps, which also limits the performance. In this paper, an elaborate network design for FBP issue is proposed for better performance. A residual-in-residual (RIR) structure is introduced to the network for passing the gradient flow deeper, and building a better pathway for information transmission. By applying the RIR structure, a deeper network can be established for better feature representation. Besides the RIR network design, an attention mechanism is introduced to exploit the inner correlations among features. We investigate a joint spatial-wise and channel-wise attention (SCA) block to distribute the importance among features, which finds a better representation for facial information. Experimental results show our proposed network can predict facial beauty closer to a human’s assessment than state-of-the-arts.

Sign in / Sign up

Export Citation Format

Share Document