Action Recognition from Pose Signature in Static Image

Author(s):  
Yinzhong Qian ◽  
Wenbin Chen ◽  
I-fan Shen

This paper addresses the problem of action recognition from body pose. Detecting body pose in static image faces great challenges because of pose variability. Our method is based on action-specific hierarchical poselet. We use hierarchical body parts each of which is represented by a set of poselets to demonstrate the pose variability of the body part. Pose signature of a body part is represented by a vector of detection responses of all poselets for the part. In order to suppress detection error and ambiguity we explore to use part-based model (PBM) as detection context. We propose a constrained optimization algorithm for detecting all poselets of each part in context of PBM, which recover neglected pose clue by global optimization. We use a PBM with hierarchical part structure, where body parts have varying granularity from whole body steadily decreasing to limb parts. From the structure we get models with different depth to study saliency of different body parts in action recognition. Pose signature of an action image is composed of pose signature of all the body parts in the PBM, which provides rich discriminate information for our task. We evaluate our algorithm on two datasets. Compared with counterpart methods, pose signature has obvious performance improvement on static image dataset. While using the model trained from static image dataset to label detected action person on video dataset, pose signature achieves state-of-the-art performance.

2019 ◽  
Vol 36 (3) ◽  
pp. 343-363 ◽  
Author(s):  
Patricia Irwin

Abstract This paper argues that a core component of root meaning is the distinction between body parts versus the body conceived as a whole. This distinction is shown to be relevant in the acceptability of motion sentences in English with whole-body roots like $\sqrt {\textsc{dance}} $ and body-part roots like $\sqrt {\textsc{smile}} $. In keeping with the assumption that roots lack syntactic category, I argue that verbal roots occur freely in syntactic structures but that some root-structure combinations are degraded (or unacceptable), and that this is due to an incompatibility between conceptual root content and interpreted syntactic structure.


2010 ◽  
Vol 16 (4) ◽  
pp. 112-121 ◽  
Author(s):  
Brennen W. Mills ◽  
Owen B. J. Carter ◽  
Robert J. Donovan

The objective of this case study was to experimentally manipulate the impact on arousal and recall of two characteristics frequently occurring in gruesome depictions of body parts in smoking cessation advertisements: the presence or absence of an external physical insult to the body part depicted; whether or not the image contains a clear figure/ground demarcation. Three hundred participants (46% male, 54% female; mean age 27.3 years, SD = 11.4) participated in a two-stage online study wherein they viewed and responded to a series of gruesome 4-s video images. Seventy-two video clips were created to provide a sample of images across the two conditions: physical insult versus no insult and clear figure/ground demarcation versus merged or no clear figure/ground demarcation. In stage one, participants viewed a randomly ordered series of 36 video clips and rated how “confronting” they considered each to be. Seven days later (stage two), to test recall of each video image, participants viewed all 72 clips and were asked to identify those they had seen previously. Images containing a physical insult were consistently rated more confronting and were remembered more accurately than images with no physical insult. Images with a clear figure/ground demarcation were rated as no more confronting but were consistently recalled with greater accuracy than those with unclear figure/ground demarcation. Makers of gruesome health warning television advertisements should incorporate some form of physical insult and use a clear figure/ground demarcation to maximize image recall and subsequent potential advertising effectiveness.


1981 ◽  
Vol 26 (4) ◽  
pp. 224-227 ◽  
Author(s):  
David M. Garner

Despite much recent interest in the objective measurement of body image in anorexia nervosa, many questions remain regarding basic mechanisms responsible for the findings as well as their meaning in the disorder. It is unclear if “whole body” measures assess the same underlying phenomena as the “body part” method, and it is unclear if body image disturbances are etiologic or a byproduct of anorexia nervosa. The possible association between self-esteem and body satisfaction and the relationship of the latter variable to actual size estimation supports the hypothesis that size perception may be closely tied to satisfaction with non-physical aspects of self. Finally it must be determined if over estimation is a function of a general psychological disturbance or of a deficit of specific interest in this disorder. Despite these questions, the way in which anorexic patients see themselves as well as the cognitive and affective responses to this perception remains an interesting and potentially fruitful area of study with this disorder.


Author(s):  
Kaixuan Chen ◽  
Lina Yao ◽  
Dalin Zhang ◽  
Bin Guo ◽  
Zhiwen Yu

Multi-modality is an important feature of sensor based activity recognition. In this work, we consider two inherent characteristics of human activities, the spatially-temporally varying salience of features and the relations between activities and corresponding body part motions. Based on these, we propose a multi-agent spatial-temporal attention model. The spatial-temporal attention mechanism helps intelligently select informative modalities and their active periods. And the multiple agents in the proposed model represent activities with collective motions across body parts by independently selecting modalities associated with single motions. With a joint recognition goal, the agents share gained information and coordinate their selection policies to learn the optimal recognition model. The experimental results on four real-world datasets demonstrate that the proposed model outperforms the state-of-the-art methods.


2019 ◽  
Vol 9 (4) ◽  
pp. 752 ◽  
Author(s):  
Junhua Gu ◽  
Chuanxin Lan ◽  
Wenbai Chen ◽  
Hu Han

While remarkable progress has been made to pedestrian detection in recent years, robust pedestrian detection in the wild e.g., under surveillance scenarios with occlusions, remains a challenging problem. In this paper, we present a novel approach for joint pedestrian and body part detection via semantic relationship learning under unconstrained scenarios. Specifically, we propose a Body Part Indexed Feature (BPIF) representation to encode the semantic relationship between individual body parts (i.e., head, head-shoulder, upper body, and whole body) and highlight per body part features, providing robustness against partial occlusions to the whole body. We also propose an Adaptive Joint Non-Maximum Suppression (AJ-NMS) to replace the original NMS algorithm widely used in object detection, leading to higher precision and recall for detecting overlapped pedestrians. Experimental results on the public-domain CUHK-SYSU Person Search Dataset show that the proposed approach outperforms the state-of-the-art methods for joint pedestrian and body part detection in the wild.


2018 ◽  
Vol 7 (3.24) ◽  
pp. 44
Author(s):  
Norlizaa Mohamad ◽  
Jafri Mohd Rohani ◽  
Ismail Abdul Rahman ◽  
Anis Amira Mat Zuki

Prolonged standing is one of the common activities in electronic industry as the task requirement. Prolonged standing can cause discomfort on the body of the workers and can lead to injury and occupational disease. The purpose of this study is to investigate standing workers perception on the fatigue and the discomfort on their respective body region for 12 hours working time. The subjects are the 80 workers with a good health condition and at least 6 months tenure. The subject data are collected via questionnaires and Likert scale to define the discomfort, pain, and fatigue. The workers were interviewed regarding their job and perceived fatigue discomfort. The results show the domination of the lower body region with the higher mean at the lower back, legs, and foot ankle. No statistically significant differences were found between the job tenure and body part discomfort pain and fatigue. There is a significant relation between gender and discomfort pain on legs and foot ankle. The result also shows a strong relation between age and the discomfort body parts of thigh and foot ankle. The perceptions of the workers towards discomfort pain and fatigue cause by prolonged standing during performing the task. The results from this study will provide a view for industrial consultants or ergonomist with evidence to support for ergonomic interventions for prolonged standing activity such as job rotation and work-rest schedule. 


2020 ◽  
Vol 1 (1) ◽  
Author(s):  
Yuko Okamoto ◽  
Ryo Kitada ◽  
Takanori Kochiyama ◽  
Hiroaki Naruse ◽  
Kai Makita ◽  
...  

Abstract The lateral occipitotemporal cortex (LOTC) that responds to human bodies and body parts has been implicated in social development and neurodevelopmental disorders like autism spectrum disorder (ASD). Neuroimaging studies using a representational similarity analysis (RSA) revealed that body representation in the LOTC of typically developing (TD) adults is categorized into 3 clusters: action effector body parts, noneffector body parts, and face parts. However, its organization of younger people (i.e., children and adolescents) and its association with individual traits remain unclear. In this functional MRI study, TD adults and children/adolescents observed photographs of hands, feet, arms, legs, chests, waists, upper/lower faces, the whole body, and chairs. The univariate analysis showed that fewer child/adolescent participants showed left LOTC activation in response to whole-body images (relative to those of chairs) than adult participants. Contrastingly, the RSA on both age groups revealed a comparable body representation with 3 clusters of body parts in the bilateral LOTC. Hence, this result indicates that, although response to whole-body images can differ, LOTC body part representations for children/ adolescents and adults are highly similar. Furthermore, sensory atypicality is associated with spatial LOTC organization, suggesting the importance of this region for understanding individual difference, which is frequently observed in ASD.


2012 ◽  
Vol 16 (3) ◽  
pp. 319-335
Author(s):  
Bistoon Abasi ◽  
Amer Gheitury

Human body as a universal possession of human beings constitutes an interesting domain where questions regarding semantic categorisations might be sought crosslinguistically. In the following, we will attempt to describe the terms used to refer to the body in Hawrami, an Iranian language spoken in Paveh, a small township in the western province of Kermanshah near Iraqi borders. Due to the scarcity of written material, the inventory of 202 terms referring to external and internal body parts were obtained through a field work, which took a long time, and techniques, such as the “colouring task”, observation and recording the terms as used in ordinary conversations and informal interviews with native speakers. The semantic properties of the terms and the way they are related in a partonymy or locative relationship were also investigated. As far as universals of body part terms are concerned, while conforming to ‘depth principle’ concerning the number of levels each partonomy may consist of, Hawrami violates an important feature of this principle by not allowing transitive relations between different levels of partonomic hierarchies. In addition, Hawrami lacks a term for labelling the ‘whole’.


2002 ◽  
Vol 10 (1-2) ◽  
pp. 341-367 ◽  
Author(s):  
Ning Yu

This study presents a semantic analysis of how emotions and emotional experiences are described in Chinese. It focuses on conventionalized expressions in Chinese, namely compounds and idioms, which contain body-part terms. The body-part terms are divided into two classes: those denoting external body parts and those denoting internal body parts or organs. It is found that, with a few exceptions, the expressions involving external body parts are originally metonymic, describing emotions in terms of their externally observable bodily events and processes. However, once conventionalized, these expressions are also used metaphorically regardless of emotional symptoms or gestures. The expressions involving internal organs evoke imaginary bodily images that are primarily metaphorical. It is found that the metaphors, though imaginary in nature, are not really all arbitrary. They seem to have a bodily or psychological basis, although they are inevitably influenced by cultural models.


1970 ◽  
Vol 176 (1044) ◽  
pp. 291-293

It is generally assumed that in multicellular organisms the diversity of the different cell types is the result of different gene activity which becomes manifest in the course of development. This theoretical concept of cell differentiation was developed on the basis of results obtained from a relatively small number of suitable experimental systems. One of them comprises the imaginal disks of the fruitfly Drosophila melanogaster . Imaginal disks are larval primordia in holometabolic insects such as flies and mosquitoes, and consist of densely packed populations of morphologically uniform cells. They give rise to defined structures of the adult body (mainly integument), thus replacing parts of the larva which are almost completely histolysed during metamorphosis. The prospective fate of the various imaginal disks can be tested, for example, by transplantation experiments. Individual disks are removed from larvae of a genetically marked strain and transplanted into the body cavity of another larva with which the transplants undergo metamorphosis. The metamorphosed derivatives of the disks are then found in the abdomen of the fly and can be microscopically identified on the basis of the morphology of bristles, hairs and other structural features of the integument. The same method is applied for examination of the developmental performance of disk fragments. From the results of such experiments the following conclusions are drawn: (1) Individual disks of fully grown larvae, that is larvae which are ready to pupate, are determined (programmed) for exactly defined body parts of the adult organism. (2) The individual subregions of such a body part can be localized precisely within a disk. Based on these facts fate maps (anlage plans) can be worked out. (3) From experiments in which different genetically marked disks are intermingled and then transplanted into larvae it is concluded that even single cells are determined for structures of a specific body region.


Sign in / Sign up

Export Citation Format

Share Document