scholarly journals Transferable Feature Representation for Visible-to-Infrared Cross-Dataset Human Action Recognition

Complexity ◽  
2018 ◽  
Vol 2018 ◽  
pp. 1-20 ◽  
Author(s):  
Yang Liu ◽  
Zhaoyang Lu ◽  
Jing Li ◽  
Chao Yao ◽  
Yanzi Deng
Keyword(s):  
Visible Light ◽  
Transfer Learning ◽  
Action Recognition ◽  
Domain Adaptation ◽  
Human Action Recognition ◽  
Human Action ◽  
Feature Representation ◽  
Support Vector ◽  
Auxiliary Data ◽  
Infrared Data

Recently, infrared human action recognition has attracted increasing attention for it has many advantages over visible light, that is, being robust to illumination change and shadows. However, the infrared action data is limited until now, which degrades the performance of infrared action recognition. Motivated by the idea of transfer learning, an infrared human action recognition framework using auxiliary data from visible light is proposed to solve the problem of limited infrared action data. In the proposed framework, we first construct a novel Cross-Dataset Feature Alignment and Generalization (CDFAG) framework to map the infrared data and visible light data into a common feature space, where Kernel Manifold Alignment (KEMA) and a dual aligned-to-generalized encoders (AGE) model are employed to represent the feature. Then, a support vector machine (SVM) is trained, using both the infrared data and visible light data, and can classify the features derived from infrared data. The proposed method is evaluated on InfAR, which is a publicly available infrared human action dataset. To build up auxiliary data, we set up a novel visible light action dataset XD145. Experimental results show that the proposed method can achieve state-of-the-art performance compared with several transfer learning and domain adaptation methods.

scholarly journals Human action recognition based on deep network and feature fusion

Filomat ◽  
2020 ◽  
Vol 34 (15) ◽  
pp. 4967-4974
Author(s):  
Dongli Wang ◽  
Jun Yang ◽  
Yan Zhou ◽  
Zhen Zhou
Keyword(s):  
Action Recognition ◽  
Feature Fusion ◽  
Human Action Recognition ◽  
Human Action ◽  
Feature Representation ◽  
Support Vector ◽  
Motion Information ◽  
Global Motion ◽  
Difference Images ◽  
Temporal Feature

Feature representation is of vital importance for human action recognition. In recent few years, the application of deep learning in action recognition has become popular. However, for action recognition in videos, the advantage of single convolution feature over traditional methods is not so evident. In this paper, a novel feature representation that combines spatial and temporal feature with global motion information is proposed. Specifically, spatial and temporal feature from RGB images is extracted by convolutional neural network (CNN) and long short-term memory (LSTM) network. On the other hand, global motion information extracted from motion difference images using another separate CNN. Hereby, the motion difference images are binary video frames processed by exclusive or (XOR). Finally, support vector machine (SVM) is adopted as classifier. Experimental results on YouTube Action and UCF-50 show the superiority of the proposed method.

Efficient Feature Representation for Human Action Recognition in DS&SP

2014 ◽  
Vol 889-890 ◽  
pp. 1057-1064
Author(s):  
Rui Feng Li ◽  
Liang Liang Wang ◽  
Teng Fei Zhang
Keyword(s):  
Support Vector Machine ◽  
Action Recognition ◽  
Large Volume ◽  
Human Action Recognition ◽  
Human Action ◽  
Feature Representation ◽  
Support Vector ◽  
Action Representation ◽  
Kinect Sensor ◽  
Combined Action

Human action often requires a large volume and computation-consuming representation for an accurate recognition with good diversity as the large complexity and variability of actions and scenarios. In this paper, an efficiency combined action representation approach is proposed to deal with the dilemma between accuracy and diversity. Two action features are extracted for combination from a Kinect sensor: silhouette and 3D message. An improved Histograms of Gradient named Interest-HOG is proposed for silhouette representation while the feature angles between skeleton points are calculated as the 3D representation. Kernel Principle Componet Analysis (KPCA) is also applied bidirectionally in our work to process the Interest-HOG descriptor for getting a concise and normative vector whose volume is same as the 3D one aimed at a successful combining. A depth dataset named DS&SP including 10 kinds of actions performed by 12 persons in 4 scenarios is built as the benchmark for our approach based on which Support Vector Machine (SVM) is employed for training and testing. Experimental results show that our approach has good performance in accuracy, efficiency and robustness of self-occlusion.

Hybrid Feature Vector-Assisted Action Representation for Human Action Recognition Using Support Vector Machines

2021 ◽  
pp. 1-22
Author(s):  
L. Nirmala Devi ◽  
A.Nageswar Rao
Keyword(s):  
Action Recognition ◽  
Feature Vector ◽  
Learning Algorithm ◽  
Gabor Filter ◽  
Principal Component ◽  
Human Action Recognition ◽  
Human Action ◽  
Visual Surveillance ◽  
Support Vector ◽  
Significant Research

Human action recognition (HAR) is one of most significant research topics, and it has attracted the concentration of many researchers. Automatic HAR system is applied in several fields like visual surveillance, data retrieval, healthcare, etc. Based on this inspiration, in this chapter, the authors propose a new HAR model that considers an image as input and analyses and exposes the action present in it. Under the analysis phase, they implement two different feature extraction methods with the help of rotation invariant Gabor filter and edge adaptive wavelet filter. For every action image, a new vector called as composite feature vector is formulated and then subjected to dimensionality reduction through principal component analysis (PCA). Finally, the authors employ the most popular supervised machine learning algorithm (i.e., support vector machine [SVM]) for classification. Simulation is done over two standard datasets; they are KTH and Weizmann, and the performance is measured through an accuracy metric.

scholarly journals Feature Fusion of Deep Spatial Features and Handcrafted Spatiotemporal Features for Human Action Recognition

Sensors ◽  
2019 ◽  
Vol 19 (7) ◽  
pp. 1599 ◽  
Author(s):  
Md Uddin ◽  
Young-Koo Lee
Keyword(s):  
Action Recognition ◽  
State Of The Art ◽  
Human Action Recognition ◽  
Human Action ◽  
Support Vector ◽  
Feature Descriptor ◽  
Weber’S Law ◽  
Weber's Law ◽  
Spatiotemporal Features ◽  
Spatial Features

Human action recognition plays a significant part in the research community due to its emerging applications. A variety of approaches have been proposed to resolve this problem, however, several issues still need to be addressed. In action recognition, effectively extracting and aggregating the spatial-temporal information plays a vital role to describe a video. In this research, we propose a novel approach to recognize human actions by considering both deep spatial features and handcrafted spatiotemporal features. Firstly, we extract the deep spatial features by employing a state-of-the-art deep convolutional network, namely Inception-Resnet-v2. Secondly, we introduce a novel handcrafted feature descriptor, namely Weber’s law based Volume Local Gradient Ternary Pattern (WVLGTP), which brings out the spatiotemporal features. It also considers the shape information by using gradient operation. Furthermore, Weber’s law based threshold value and the ternary pattern based on an adaptive local threshold is presented to effectively handle the noisy center pixel value. Besides, a multi-resolution approach for WVLGTP based on an averaging scheme is also presented. Afterward, both these extracted features are concatenated and feed to the Support Vector Machine to perform the classification. Lastly, the extensive experimental analysis shows that our proposed method outperforms state-of-the-art approaches in terms of accuracy.

A Set of New Hermite Kernel Functions in Kernel Extreme Learning Machine and Application in Human Action Recognition

2019 ◽  
Vol 33 (12) ◽  
pp. 1955014 ◽  
Author(s):  
Xueping Liu ◽  
Xingzuo Yue
Keyword(s):  
Extreme Learning Machine ◽  
Action Recognition ◽  
Structural Information ◽  
Image Data ◽  
Human Action Recognition ◽  
Human Action ◽  
Kernel Functions ◽  
Support Vector ◽  
Learning Speed ◽  
Learning Machine

The kernel function has been successfully utilized in the extreme learning machine (ELM) that provides a stabilized and generalized performance and greatly reduces the computational complexity. However, the selection and optimization of the parameters constituting the most common kernel functions are tedious and time-consuming. In this study, a set of new Hermit kernel functions derived from the generalized Hermit polynomials has been proposed. The significant contributions of the proposed kernel include only one parameter selected from a small set of natural numbers; thus, the parameter optimization is greatly facilitated and excessive structural information of the sample data is retained. Consequently, the new kernel functions can be used as optimal alternatives to other common kernel functions for ELM at a rapid learning speed. The experimental results showed that the proposed kernel ELM method tends to have similar or better robustness and generalized performance at a faster learning speed than the other common kernel ELM and support vector machine methods. Consequently, when applied to human action recognition by depth video sequence, the method also achieves excellent performance, demonstrating its time-based advantage on the video image data.

scholarly journals Human Action Recognition Based on Foreground Trajectory and Motion Difference Descriptors

2019 ◽  
Vol 9 (10) ◽  
pp. 2126 ◽  
Author(s):  
Suge Dong ◽  
Daidi Hu ◽  
Ruijun Li ◽  
Mingtao Ge
Keyword(s):  
Action Recognition ◽  
Human Action Recognition ◽  
Human Action ◽  
Support Vector ◽  
Recognition Method ◽  
Foreground Region ◽  
Dense Trajectory ◽  
Trajectory Method ◽  
Direction Information ◽  
Action Category

Aimed at the problems of high redundancy of trajectory and susceptibility to background interference in traditional dense trajectory behavior recognition methods, a human action recognition method based on foreground trajectory and motion difference descriptors is proposed. First, the motion magnitude of each frame is estimated by optical flow, and the foreground region is determined according to each motion magnitude of the pixels; the trajectories are only extracted from behavior-related foreground regions. Second, in order to better describe the relative temporal information between different actions, a motion difference descriptor is introduced to describe the foreground trajectory, and the direction histogram of the motion difference is constructed by calculating the direction information of the motion difference per unit time of the trajectory point. Finally, a Fisher vector (FV) is used to encode histogram features to obtain video-level action features, and a support vector machine (SVM) is utilized to classify the action category. Experimental results show that this method can better extract the action-related trajectory, and it can improve the recognition accuracy by 7% compared to the traditional dense trajectory method.

Feature Extraction and Representation for Distributed Multi-View Human Action Recognition

2013 ◽  
Vol 3 (2) ◽  
pp. 145-154 ◽  
Author(s):  
Jiajia Luo ◽  
Wei Wang ◽  
Hairong Qi
Keyword(s):  
Action Recognition ◽  
Approximation Error ◽  
Human Action Recognition ◽  
Human Action ◽  
Base Station ◽  
Feature Representation ◽  
Superior Performance ◽  
Feature Descriptor ◽  
Testing Stage ◽  
New Feature

Multi-view human action recognition has gained a lot of attention in recent years for its superior performance as compared to single view recognition. In this paper, we propose a new framework for the real-time realization of human action recognition in distributed camera networks (DCNs). We first present a new feature descriptor (Mltp-hist) that is tolerant to illumination change, robust in homogeneous region and computationally efficient. Taking advantage of the proposed Mltp-hist, the noninformative 3-D patches generated from the background can be further removed automatically that effectively highlights the foreground patches. Next, a new feature representation method based on sparse coding is presented to generate the histogram representation of local videos to be transmitted to the base station for classification. Due to the sparse representation of extracted features, the approximation error is reduced. Finally, at the base station, a probability model is produced to fuse the information from various views and a class label is assigned accordingly. Compared to the existing algorithms, the proposed framework has three advantages while having less requirements on memory and bandwidth consumption: 1) no preprocessing is required; 2) communication among cameras is unnecessary; and 3) positions and orientations of cameras do not need to be fixed. We further evaluate the proposed framework on the most popular multi-view action dataset IXMAS. Experimental results indicate that our proposed framework repeatedly achieves state-of-the-art results when various numbers of views are tested. In addition, our approach is tolerant to the various combination of views and benefit from introducing more views at the testing stage. Especially, our results are still satisfactory even when large misalignment exists between the training and testing samples.

Human Action Recognition Based on Normalized Interest Points and Super-Interest Points

2014 ◽  
Vol 11 (01) ◽  
pp. 1450005
Author(s):  
Yangyang Wang ◽  
Yibo Li ◽  
Xiaofei Ji
Keyword(s):  
Action Recognition ◽  
Clustering Algorithm ◽  
Three Dimensional ◽  
Temporal Correlation ◽  
Human Action Recognition ◽  
Human Action ◽  
Feature Representation ◽  
Interest Point ◽  
Interest Points ◽  
Active Research

Visual-based human action recognition is currently one of the most active research topics in computer vision. The feature representation directly has a crucial impact on the performance of the recognition. Feature representation based on bag-of-words is popular in current research, but the spatial and temporal relationship among these features is usually discarded. In order to solve this issue, a novel feature representation based on normalized interest points is proposed and utilized to recognize the human actions. The novel representation is called super-interest point. The novelty of the proposed feature is that the spatial-temporal correlation between the interest points and human body can be directly added to the representation without considering scale and location variance of the points by introducing normalized points clustering. The novelty concerns three tasks. First, to solve the diversity of human location and scale, interest points are normalized based on the normalization of the human region. Second, to obtain the spatial-temporal correlation among the interest points, the normalized points with similar spatial and temporal distance are constructed to a super-interest point by using three-dimensional clustering algorithm. Finally, by describing the appearance characteristic of the super-interest points and location relationship among the super-interest points, a new feature representation is gained. The proposed representation formation sets up the relationship among local features and human figure. Experiments on Weizmann, KTH, and UCF sports dataset demonstrate that the proposed feature is effective for human action recognition.

Sign in / Sign up

Export Citation Format

Share Document