Deictic Gesture Retargeting for Telepresence Avatars in Dissimilar Object and User Arrangements

2020 ◽  
Author(s):  
Meejin Kim ◽  
Sung-Hee Lee
Keyword(s):  
Deictic Gesture

scholarly journals The type of shared activity shapes caregiver and infant communication

Gesture ◽  
2010 ◽  
Vol 10 (2-3) ◽  
pp. 279-296 ◽  
Author(s):  
Daniel Puccini ◽  
Mireille Hassemer ◽  
Dorothé Salomo ◽  
Ulf Liszkowski
Keyword(s):  
Language Development ◽  
Specific Pattern ◽  
Free Play ◽  
Language Learner ◽  
Language Usage ◽  
Human Communication ◽  
Shared Activity ◽  
Deictic Gesture ◽  
Natural Interactions ◽  
Communicative Input

For the beginning language learner, communicative input is not based on linguistic codes alone. This study investigated two extralinguistic factors which are important for infants’ language development: the type of ongoing shared activity and non-verbal, deictic gestures. The natural interactions of 39 caregivers and their 12-month-old infants were recorded in two semi-natural contexts: a free play situation based on action and manipulation of objects, and a situation based on regard of objects, broadly analogous to an exhibit. Results show that the type of shared activity structures both caregivers’ language usage and caregivers’ and infants’ gesture usage. Further, there is a specific pattern with regard to how caregivers integrate speech with particular deictic gesture types. The findings demonstrate a pervasive influence of shared activities on human communication, even before language has emerged. The type of shared activity and caregivers’ systematic integration of specific forms of deictic gestures with language provide infants with a multimodal scaffold for a usage-based acquisition of language.

scholarly journals Maternal label and gesture use affects acquisition of specific object names

2010 ◽  
Vol 38 (1) ◽  
pp. 201-221 ◽  
Author(s):  
MARIA ZAMMIT ◽  
GRAHAM SCHAFER
Keyword(s):  
Linguistic Development ◽  
Iconic Gesture ◽  
Deictic Gesture ◽  
Specific Object ◽  
Picture Description ◽  
Predictive Relations ◽  
Gestural Input

ABSTRACTTen mothers were observed prospectively, interacting with their infants aged 0 ; 10 in two contexts (picture description and noun description). Maternal communicative behaviours were coded for volubility, gestural production and labelling style. Verbal labelling events were categorized into three exclusive categories: label only; label plus deictic gesture; label plus iconic gesture. We evaluated the predictive relations between maternal communicative style and children's subsequent acquisition of ten target nouns. Strong relations were observed between maternal communicative style and children's acquisition of the target nouns. Further, even controlling for maternal volubility and maternal labelling, maternal use of iconic gestures predicted the timing of acquisition of nouns in comprehension. These results support the proposition that maternal gestural input facilitates linguistic development, and suggest that such facilitation may be a function of gesture type.

scholarly journals ‘Lip-pointing’

Gesture ◽  
2002 ◽  
Vol 1 (2) ◽  
pp. 185-211 ◽  
Author(s):  
N.J. Enfield
Keyword(s):  
Functional Properties ◽  
Conventional Form ◽  
Form And Function ◽  
Deictic Gesture ◽  
Pointing Gestures ◽  
And Function ◽  
Pointing Gesture ◽  
Head Area

‘Lip-pointing’ is a widespread but little-documented form of deictic gesture, which may involve not just protruding one or both lips, but also raising the head, sticking out the chin, lifting the eyebrows, among other things. This paper discusses form and function of lip-pointing with reference to a set of examples collected on video in Laos. There are various parameters with respect to which the conventional form of a lip-pointing gesture may vary. There is also a range of ways in which lip-pointing gestures can be coordinated with other kinds of deictic gesture such as various forms of hand pointing. The attested coordinating/sequencing possibilities can be related to specific functional properties of lip-pointing among Lao speakers, particularly in the context of other forms of deictic gesture, which have different functional properties. It is argued that the ‘vector’ of lip-pointing is in fact defined by gaze, and that the lip-pointing action itself (like other kinds of ‘pointing’ involving the head area) is a ‘gaze-switch’, i.e. it indicates that the speaker is now pointing out something with his or her gaze. Finally, I consider the position of lip-pointing in the broader deictic gesture system of Lao speakers, firstly as a ‘lower register’ form, and secondly as a form of deictic gesture which may contrast with forms of hand pointing.

scholarly journals An HPSG approach to synchronous speech and deixis

2011 ◽  
Author(s):  
Katya Alahverdzhieva ◽  
Alex Lascarides
Keyword(s):  
Speech Signal ◽  
Integration Process ◽  
Hand Gestures ◽  
Standard Methods ◽  
Face To Face ◽  
Deictic Gesture ◽  
Starting Point ◽  
Rule Out

The use of hand gestures to point at objects and individuals, or to navigate through landmarks on a virtually created map is ubiquitous in face-to-face conversation. We take this observation as a starting point, and we demonstrate that deictic gestures can be analysed on a par with speech by using standard methods from constraint-based grammars such as HPSG. In particular, we use the form of the deictic signal, the form of the speech signal (including its prosodic marking) and their relative temporal performance to derive an integrated multimodal tree that maps to an integrated multimodal meaning. The integration process is constrained via construction rules that rule out ill-formed input. These rules are driven from an empirical corporal study which sheds light on the interaction between speech and deictic gesture.

Sign in / Sign up

Export Citation Format

Share Document