scholarly journals Investigating the effects of visual saliency on deictic gesture production by a humanoid robot

Author(s):  
Aaron St. Clair ◽  
Ross Mead ◽  
Maja J Mataric
2012 ◽  
Vol 2012 ◽  
pp. 1-11 ◽  
Author(s):  
Kurosh Madani ◽  
Dominik M. Ramik ◽  
Cristophe Sabourin

As part of “intelligence,” the “awareness” is the state or ability to perceive, feel, or be mindful of events, objects, or sensory patterns: in other words, to be conscious of the surrounding environment and its interactions. Inspired by early-ages human skills developments and especially by early-ages awareness maturation, the present paper accosts the robots intelligence from a different slant directing the attention to combining both “cognitive” and “perceptual” abilities. Within such a slant, the machine (robot) shrewdness is constructed on the basis of a multilevel cognitive concept attempting to handle complex artificial behaviors. The intended complex behavior is the autonomous discovering of objects by robot exploring an unknown environment: in other words, proffering the robot autonomy and awareness in and about unknown backdrop.


2015 ◽  
Vol 43 (4) ◽  
pp. 948-963 ◽  
Author(s):  
ŞEYDA ÖZÇALIŞKAN ◽  
LAUREN B. ADAMSON ◽  
NEVENA DIMITROVA ◽  
JHONELLE BAILEY ◽  
LAUREN SCHMUCK

AbstractEarly spontaneous gesture, specifically deictic gesture, predicts subsequent vocabulary development in typically developing (TD) children. Here, we ask whether deictic gesture plays a similar role in predicting later vocabulary size in children with Down Syndrome (DS), who have been shown to have difficulties in speech production, but strengths in spontaneous gesture and baby sign use. We compared the gestures and baby signs produced by twenty-three children with DS (Mage = 2;6) and twenty-three TD children (Mage = 1;6), in relation to their expressive spoken vocabulary size one year later. Children with DS showed significant deficits in gesture production, particularly for deictic gestures, but strengths in baby sign production, compared to their typically developing peers. More importantly, it was the baby signs produced by children with DS, but not deictic gestures, that predicted their spoken vocabulary size one year later. Our results further highlight the important role baby signs can play in language development in children with developmental disorders.


2019 ◽  
Vol 62 (12) ◽  
pp. 4417-4432 ◽  
Author(s):  
Carola de Beer ◽  
Jan P. de Ruiter ◽  
Martina Hielscher-Fastabend ◽  
Katharina Hogrefe

Purpose People with aphasia (PWA) use different kinds of gesture spontaneously when they communicate. Although there is evidence that the nature of the communicative task influences the linguistic performance of PWA, so far little is known about the influence of the communicative task on the production of gestures by PWA. We aimed to investigate the influence of varying communicative constraints on the production of gesture and spoken expression by PWA in comparison to persons without language impairment. Method Twenty-six PWA with varying aphasia severities and 26 control participants (CP) without language impairment participated in the study. Spoken expression and gesture production were investigated in 2 different tasks: (a) spontaneous conversation about topics of daily living and (b) a cartoon narration task, that is, retellings of short cartoon clips. The frequencies of words and gestures as well as of different gesture types produced by the participants were analyzed and tested for potential effects of group and task. Results Main results for task effects revealed that PWA and CP used more iconic gestures and pantomimes in the cartoon narration task than in spontaneous conversation. Metaphoric gestures, deictic gestures, number gestures, and emblems were more frequently used in spontaneous conversation than in cartoon narrations by both participant groups. Group effects show that, in both tasks, PWA's gesture-to-word ratios were higher than those for the CP. Furthermore, PWA produced more interactive gestures than the CP in both tasks, as well as more number gestures and pantomimes in spontaneous conversation. Conclusions The current results suggest that PWA use gestures to compensate for their verbal limitations under varying communicative constraints. The properties of the communicative task influence the use of different gesture types in people with and without aphasia. Thus, the influence of communicative constraints needs to be considered when assessing PWA's multimodal communicative abilities.


2019 ◽  
Author(s):  
Aleksandra Mikov ◽  
Dragana Vukliš ◽  
Branislav Borovac ◽  
Milan Gnjatović ◽  
Jovica Tasevski ◽  
...  
Keyword(s):  

Author(s):  
Marlete Silva ◽  
José Maurício Santos Torres da Motta
Keyword(s):  

Sign in / Sign up

Export Citation Format

Share Document