FASSD-Net Model for Person Semantic Segmentation

This paper proposes the use of the FASSD-Net model for semantic segmentation of human silhouettes, these silhouettes can later be used in various applications that require specific characteristics of human interaction observed in video sequences for the understanding of human activities or for human identification. These applications are classified as high-level task semantic understanding. Since semantic segmentation is presented as one solution for human silhouette extraction, it is concluded that convolutional neural networks (CNN) have a clear advantage over traditional methods for computer vision, based on their ability to learn the representations of appropriate characteristics for the task of segmentation. In this work, the FASSD-Net model is used as a novel proposal that promises real-time segmentation in high-resolution images exceeding 20 FPS. To evaluate the proposed scheme, we use the Cityscapes database, which consists of sundry scenarios that represent human interaction with its environment (these scenarios show the semantic segmentation of people, difficult to solve, that favors the evaluation of our proposal), To adapt the FASSD-Net model to human silhouette semantic segmentation, the indexes of the 19 classes traditionally proposed for Cityscapes were modified, leaving only two labels: One for the class of interest labeled as person and one for the background. The Cityscapes database includes the category “human” composed for “rider” and “person” classes, in which the rider class contains incomplete human silhouettes due to self-occlusions for the activity or transport used. For this reason, we only train the model using the person class rather than human category. The implementation of the FASSD-Net model with only two classes shows promising results in both a qualitative and quantitative manner for the segmentation of human silhouettes.

A Fast-RCNN Implementation for Human Silhouette Detection in Video Sequences

The intention of this article is to implement a system of detection and segmentation of human silhouettes, the above mentioned tasks present a great challenge in security topics and innovation, in the last years and mainly on automated video surveillance systems, which require understanding the presence and human interaction in video sequences, e.g. Human Computer Interaction (HCI), Human Behaviour comprehension, Human fall detection, among others, but the most important is behavioural biometrics, this paper tackles the common step in these research areas: the Human silhouette extraction through the bounding box. To evaluate the proposed system, standardized databases where used and also proper videos are obtained trying to emulate real-world scenarios, where the quality and the distance are factors that have demonstrated challenges for the detection with computer vision and machine learning.