scholarly journals A Multifeature Learning and Fusion Network for Facial Age Estimation

Sensors ◽  
2021 ◽  
Vol 21 (13) ◽  
pp. 4597
Author(s):  
Yulan Deng ◽  
Shaohua Teng ◽  
Lunke Fei ◽  
Wei Zhang ◽  
Imad Rida
Keyword(s):  
Age Estimation ◽  
State Of The Art ◽  
Great Influence ◽  
Embedded Devices ◽  
Face Images ◽  
Memory Overhead ◽  
Art Methods ◽  
Previous State ◽  
Effectiveness And Efficiency ◽  
Facial Age

Age estimation from face images has attracted much attention due to its favorable and many real-world applications such as video surveillance and social networking. However, most existing studies usually learn a single kind of age feature and ignore other appearance features such as gender and race, which have a great influence on the age pattern. In this paper, we proposed a compact multifeature learning and fusion method for age estimation. Specifically, we first used three subnetworks to learn gender, race, and age information. Then, we fused these complementary features to further form more robust features for age estimation. Finally, we engineered a regression-ranking age-feature estimator to convert the fusion features into the exact age numbers. Experimental results on three benchmark databases demonstrated the effectiveness and efficiency of the proposed method on facial age estimation in comparison to previous state-of-the-art methods. Moreover, compared with previous state-of-the-art methods, our model was more compact with only a 20 MB memory overhead and is suitable for deployment on mobile or embedded devices for age estimation.

scholarly journals Coherent video generation for multiple hand-held cameras with dynamic foreground

2020 ◽  
Vol 6 (3) ◽  
pp. 291-306
Author(s):  
Fang-Lue Zhang ◽  
Connelly Barnes ◽  
Hao-Tian Zhang ◽  
Junhong Zhao ◽  
Gabriel Salas
Keyword(s):  
Video Sequence ◽  
State Of The Art ◽  
Close Attention ◽  
Cut Points ◽  
Social Events ◽  
Art Methods ◽  
Previous State ◽  
Smooth Transitions

Abstract For many social events such as public performances, multiple hand-held cameras may capture the same event. This footage is often collected by amateur cinematographers who typically have little control over the scene and may not pay close attention to the camera. For these reasons, each individually captured video may fail to cover the whole time of the event, or may lose track of interesting foreground content such as a performer. We introduce a new algorithm that can synthesize a single smooth video sequence of moving foreground objects captured by multiple hand-held cameras. This allows later viewers to gain a cohesive narrative experience that can transition between different cameras, even though the input footage may be less than ideal. We first introduce a graph-based method for selecting a good transition route. This allows us to automatically select good cut points for the hand-held videos, so that smooth transitions can be created between the resulting video shots. We also propose a method to synthesize a smooth photorealistic transition video between each pair of hand-held cameras, which preserves dynamic foreground content during this transition. Our experiments demonstrate that our method outperforms previous state-of-the-art methods, which struggle to preserve dynamic foreground content.

scholarly journals Multifeature Extreme Ordinal Ranking Machine for Facial Age Estimation

2015 ◽  
Vol 2015 ◽  
pp. 1-9 ◽  
Author(s):  
Wei Zhao ◽  
Han Wang ◽  
Guang-Bin Huang
Keyword(s):  
Age Estimation ◽  
Optimization Problems ◽  
State Of The Art ◽  
Mathematical Optimization ◽  
The State ◽  
Estimation Methods ◽  
Estimation Accuracy ◽  
Training Process ◽  
Ordinal Ranking ◽  
Facial Age

Recently the state-of-the-art facial age estimation methods are almost originated from solving complicated mathematical optimization problems and thus consume huge quantities of time in the training process. To refrain from such algorithm complexity while maintaining a high estimation accuracy, we propose a multifeature extreme ordinal ranking machine (MFEORM) for facial age estimation. Experimental results clearly demonstrate that the proposed approach can sharply reduce the runtime (even up to nearly one hundred times faster) while achieving comparable or better estimation performances than the state-of-the-art approaches. The inner properties of MFEORM are further explored with more advantages.

scholarly journals Age Label Distribution Learning Based on Unsupervised Comparisons of Faces

2021 ◽  
Vol 2021 ◽  
pp. 1-7
Author(s):  
Qiyuan Li ◽  
Zongyong Deng ◽  
Weichang Xu ◽  
Zhendong Li ◽  
Hao Liu
Keyword(s):  
Age Estimation ◽  
State Of The Art ◽  
Processing Method ◽  
Wireless Sensor ◽  
Learning Method ◽  
Significant Progress ◽  
Meaningful Information ◽  
Label Distribution Learning ◽  
Label Distribution ◽  
Facial Age

Although label distribution learning has made significant progress in the field of face age estimation, unsupervised learning has not been widely adopted and is still an important and challenging task. In this work, we propose an unsupervised contrastive label distribution learning method (UCLD) for facial age estimation. This method is helpful to extract semantic and meaningful information of raw faces with preserving high-order correlation between adjacent ages. Similar to the processing method of wireless sensor network, we designed the ConAge network with the contrast learning method. As a result, our model maximizes the similarity of positive samples by data enhancement and simultaneously pushes the clusters of negative samples apart. Compared to state-of-the-art methods, we achieve compelling results on the widely used benchmark, i.e., MORPH.

A Thermal Blended Facial Expression Analysis and Recognition System Using Deformed Thermal Facial Areas

2021 ◽  
Author(s):  
Priya Saha ◽  
Debotosh Bhattacharjee ◽  
Barin Kumar De ◽  
Mita Nasipuri
Keyword(s):  
Facial Expression ◽  
Facial Expressions ◽  
Expression Analysis ◽  
State Of The Art ◽  
Recognition System ◽  
Facial Expression Analysis ◽  
Face Images ◽  
Art Methods ◽  
Facial Area ◽  
Thermal Face

There are many research works in visible as well as thermal facial expression analysis and recognition. Several facial expression databases have been designed in both modalities. However, little attention has been given for analyzing blended facial expressions in the thermal infrared spectrum. In this paper, we have introduced a Visual-Thermal Blended Facial Expression Database (VTBE) that contains visual and thermal face images with both basic and blended facial expressions. The database contains 12 posed blended facial expressions and spontaneous six basic facial expressions in both modalities. In this paper, we have proposed Deformed Thermal Facial Area (DTFA) in thermal expressive face image and make an analysis to differentiate between basic and blended expressions using DTFA. Here, the fusion of DTFA and Deformed Visual Facial Area (DVFA) has been proposed combining the features of both modalities and experiments and has been conducted on this new database. However, to show the effectiveness of our proposed approach, we have compared our method with state-of-the-art methods using USTC-NVIE database. Experiment results reveal that our approach is superior to state-of-the-art methods.

scholarly journals Simple Shading Correction Method for Brightfield Whole Slide Imaging

Sensors ◽  
2020 ◽  
Vol 20 (11) ◽  
pp. 3084
Author(s):  
Yoon-Oh Tak ◽  
Anjin Park ◽  
Janghoon Choi ◽  
Jonghyun Eom ◽  
Hyuk-Sang Kwon ◽  
...  
Keyword(s):  
State Of The Art ◽  
Correction Method ◽  
Input Image ◽  
Image Sequences ◽  
Whole Slide Imaging ◽  
Pattern Noise ◽  
Art Methods ◽  
Previous State ◽  
Fixed Pattern Noise

Whole slide imaging (WSI) refers to the process of creating a high-resolution digital image of a whole slide. Since digital images are typically produced by stitching image sequences acquired from different fields of view, the visual quality of the images can be degraded owing to shading distortion, which produces black plaid patterns on the images. A shading correction method for brightfield WSI is presented, which is simple but robust not only against typical image artifacts caused by specks of dust and bubbles, but also against fixed-pattern noise, or spatial variations in pixel values under uniform illumination. The proposed method comprises primarily of two steps. The first step constructs candidates of a shading distortion model from a stack of input image sequences. The second step selects the optimal model from the candidates. The proposed method was compared experimentally with two previous state-of-the-art methods, regularized energy minimization (CIDRE) and background and shading correction (BaSiC) and showed better correction scores, as smooth operations and constraints were not imposed when estimating the shading distortion. The correction scores, averaged over 40 image collections, were as follows: proposed method, 0.39 ± 0.099; CIDRE method, 0.67 ± 0.047; BaSiC method, 0.55 ± 0.038. Based on the quantitative evaluations, we can confirm that the proposed method can correct not only shading distortion, but also fixed-pattern noise, compared with the two previous state-of-the-art methods.

scholarly journals The Impact of Asymmetric Left and Asymmetric Right Face Images on Accurate Age Estimation

2019 ◽  
Vol 2019 ◽  
pp. 1-10 ◽  
Author(s):  
Muhammad Sajid ◽  
Naeem Iqbal Ratyal ◽  
Nouman Ali ◽  
Bushra Zafar ◽  
Saadat Hanif Dar ◽  
...  
Keyword(s):  
Age Estimation ◽  
State Of The Art ◽  
Face Image ◽  
Facial Aging ◽  
Face Images ◽  
Left And Right ◽  
Sleeping Habits ◽  
The Impact ◽  
Asymmetric Aging ◽  
Sun Light

Aging affects left and right half face differently owing to numerous factors such as sleeping habits, exposure to sun light, and weaker face muscles of one side of face. In computer vision, age of a given face image is estimated using features that are correlated with age, such as moles, scars, and wrinkles. In this study we report the asymmetric aging of the left and right sides of face images and its impact on accurate age estimation. Left symmetric faces were perceived as younger while right symmetric faces were perceived as older when presented to the state-of-the-art age estimator. These findings show that facial aging is an asymmetric process which plays role in accurate facial age estimation. Experimental results on two large datasets verify the significance of using asymmetric right face image to estimate the age of a query face image more accurately compared to the corresponding original or left asymmetric face image.

Automatic Recognition of Flock Behavior of Chickens with Convolutional Neural Network and Kinect Sensor

2018 ◽  
Vol 32 (07) ◽  
pp. 1850023 ◽  
Author(s):  
Haitao Pu ◽  
Jian Lian ◽  
Mingqu Fan
Keyword(s):  
Neural Network ◽  
Convolutional Neural Network ◽  
Learning Strategy ◽  
State Of The Art ◽  
Domestic Animal ◽  
Image Features ◽  
Kinect Sensor ◽  
Multi Scale ◽  
Art Methods ◽  
Effectiveness And Efficiency

In this paper, we propose an automatic convolutional neural network (CNN)-based method to recognize the chicken behavior within a poultry farm using a Kinect sensor. It resolves the hardships in flock behavior image classification by leveraging a data-driven mechanism and exploiting non-manually extracted multi-scale image features which combine both the local and global characteristics of the image. To our best knowledge, this is probably the first attempt of deep learning strategy in the field of domestic animal behavior recognition. To testify the performance of our proposed method, we conducted experiments between state-of-the-art methods and our method. Experimental results witness that our proposed approach outperforms the state-of-the-art methods both in effectiveness and efficiency. Our proposed CNN architecture for recognizing flock behavior of chickens produces an extremely impressive accuracy of 99.17%.

scholarly journals Partially Supervised Named Entity Recognition via the Expected Entity Ratio Loss

2021 ◽  
Vol 9 ◽  
pp. 1320-1335
Author(s):  
Thomas Effland ◽  
Michael Collins
Keyword(s):  
Latent Variables ◽  
State Of The Art ◽  
Named Entity Recognition ◽  
Entity Recognition ◽  
Annotation Scheme ◽  
Named Entity ◽  
Art Methods ◽  
Previous State

Abstract We study learning named entity recognizers in the presence of missing entity annotations. We approach this setting as tagging with latent variables and propose a novel loss, the Expected Entity Ratio, to learn models in the presence of systematically missing tags. We show that our approach is both theoretically sound and empirically useful. Experimentally, we find that it meets or exceeds performance of strong and state-of-the-art baselines across a variety of languages, annotation scenarios, and amounts of labeled data. In particular, we find that it significantly outperforms the previous state-of-the-art methods from Mayhew et al. (2019) and Li et al. (2021) by +12.7 and +2.3 F1 score in a challenging setting with only 1,000 biased annotations, averaged across 7 datasets. We also show that, when combined with our approach, a novel sparse annotation scheme outperforms exhaustive annotation for modest annotation budgets.1

scholarly journals Visual Dialogue State Tracking for Question Generation

2020 ◽  
Vol 34 (07) ◽  
pp. 11831-11838 ◽  
Author(s):  
Wei Pang ◽  
Xiaojie Wang
Keyword(s):  
State Of The Art ◽  
Experimental Results ◽  
Question Generation ◽  
Art Methods ◽  
Previous State ◽  
State Tracking ◽  
Art Performance

GuessWhat?! is a visual dialogue task between a guesser and an oracle. The guesser aims to locate an object supposed by the oracle oneself in an image by asking a sequence of Yes/No questions. Asking proper questions with the progress of dialogue is vital for achieving successful final guess. As a result, the progress of dialogue should be properly represented and tracked. Previous models for question generation pay less attention on the representation and tracking of dialogue states, and therefore are prone to asking low quality questions such as repeated questions. This paper proposes visual dialogue state tracking (VDST) based method for question generation. A visual dialogue state is defined as the distribution on objects in the image as well as representations of objects. Representations of objects are updated with the change of the distribution on objects. An object-difference based attention is used to decode new question. The distribution on objects is updated by comparing the question-answer pair and objects. Experimental results on GuessWhat?! dataset show that our model significantly outperforms existing methods and achieves new state-of-the-art performance. It is also noticeable that our model reduces the rate of repeated questions from more than 50% to 21.9% compared with previous state-of-the-art methods.

Sign in / Sign up

Export Citation Format

Share Document