Learning user's preference in controlling facial expressions of an embodied agent by the user's face

In order to create effective storytelling agents three fundamental questions must be answered: first, is a physically embodied agent preferable to a virtual agent or a voice-only narration? Second, does a human voice have an advantage over a synthesized voice? Third, how should the emotional trajectory of the different characters in a story be related to a storyteller’s facial expressions during storytelling time, and how does this correlate with the apparent emotions on the faces of the listeners? The results of two specially designed studies indicate that the physically embodied robot produces more narrative attention to the listener as compared to a virtual embodiment, that a human voice is preferable over the current state of the art of text-to-speech, and that there is a complex yet interesting relation between the emotion lines of the story, the facial expressions of the narrating agent, and the emotions of the listener, and that the empathizing of the listener is evident through its facial expressions. This work constitutes an important step towards emotional storytelling robots that can observe their listeners and adapt their style in order to maximize their effectiveness.

Download Full-text

Faster Choice-Reaction Times to Positive than to Negative Facial Expressions

Journal of Psychophysiology ◽

10.1027//0269-8803.17.3.113 ◽

2003 ◽

Vol 17 (3) ◽

pp. 113-123 ◽

Cited By ~ 76

Author(s):

Jukka M. Leppänen ◽

Mirja Tenhunen ◽

Jari K. Hietanen

Keyword(s):

Facial Expressions ◽

Cognitive Processing ◽

Response Selection ◽

Reaction Times ◽

Happy Face ◽

Response Onset ◽

Response Execution ◽

Onset Response ◽

Positive Stimuli ◽

Choice Reaction Times

Abstract Several studies have shown faster choice-reaction times to positive than to negative facial expressions. The present study examined whether this effect is exclusively due to faster cognitive processing of positive stimuli (i.e., processes leading up to, and including, response selection), or whether it also involves faster motor execution of the selected response. In two experiments, response selection (onset of the lateralized readiness potential, LRP) and response execution (LRP onset-response onset) times for positive (happy) and negative (disgusted/angry) faces were examined. Shorter response selection times for positive than for negative faces were found in both experiments but there was no difference in response execution times. Together, these results suggest that the happy-face advantage occurs primarily at premotoric processing stages. Implications that the happy-face advantage may reflect an interaction between emotional and cognitive factors are discussed.

Download Full-text

Comparable Modulation of the Late Positive Potential by Emotion Regulation in Younger and Older Adults

Journal of Psychophysiology ◽

10.1027/0269-8803/a000009 ◽

2010 ◽

Vol 24 (3) ◽

pp. 186-197 ◽

Cited By ~ 23

Author(s):

Sandra J. E. Langeslag ◽

Jan W. Van Strien

Keyword(s):

Emotion Regulation ◽

Facial Expressions ◽

Age Differences ◽

Late Positive Potential ◽

Self Report ◽

Apparent Discrepancy ◽

Positive Potential ◽

Psychophysiological Responses ◽

Psychophysiological Measures ◽

Emotional Pictures

It has been suggested that emotion regulation improves with aging. Here, we investigated age differences in emotion regulation by studying modulation of the late positive potential (LPP) by emotion regulation instructions. The electroencephalogram of younger (18–26 years) and older (60–77 years) adults was recorded while they viewed neutral, unpleasant, and pleasant pictures and while they were instructed to increase or decrease the feelings that the emotional pictures elicited. The LPP was enhanced when participants were instructed to increase their emotions. No age differences were observed in this emotion regulation effect, suggesting that emotion regulation abilities are unaffected by aging. This contradicts studies that measured emotion regulation by self-report, yet accords with studies that measured emotion regulation by means of facial expressions or psychophysiological responses. More research is needed to resolve the apparent discrepancy between subjective self-report and objective psychophysiological measures.

Download Full-text

Wiser Reasoning and Less Disgust Have the Potential to Better Achieve Suicide Prevention

Crisis ◽

10.1027/0227-5910/a000709 ◽

2020 ◽

pp. 1-8

Author(s):

Chao S. Hu ◽

Jiajia Ji ◽

Jinhao Huang ◽

Zhe Feng ◽

Dong Xie ◽

...

Keyword(s):

High School ◽

Suicide Prevention ◽

Cause Of Death ◽

Facial Expressions ◽

Emotional Reaction ◽

Suicide Method ◽

University Teachers ◽

Advice Giving ◽

Prevention Techniques

Abstract. Background: High school and university teachers need to advise students against attempting suicide, the second leading cause of death among 15–29-year-olds. Aims: To investigate the role of reasoning and emotion in advising against suicide. Method: We conducted a study with 130 students at a university that specializes in teachers' education. Participants sat in front of a camera, videotaping their advising against suicide. Three raters scored their transcribed advice on "wise reasoning" (i.e., expert forms of reasoning: considering a variety of conditions, awareness of the limitation of one's knowledge, taking others' perspectives). Four registered psychologists experienced in suicide prevention techniques rated the transcripts on the potential for suicide prevention. Finally, using the software Facereader 7.1, we analyzed participants' micro-facial expressions during advice-giving. Results: Wiser reasoning and less disgust predicted higher potential for suicide prevention. Moreover, higher potential for suicide prevention was associated with more surprise. Limitations: The actual efficacy of suicide prevention was not assessed. Conclusion: Wise reasoning and counter-stereotypic ideas that trigger surprise probably contribute to the potential for suicide prevention. This advising paradigm may help train teachers in advising students against suicide, measuring wise reasoning, and monitoring a harmful emotional reaction, that is, disgust.

Download Full-text

Perception of Emotional Expressions in Adults

Journal of Individual Differences ◽

10.1027/1614-0001/a000183 ◽

2016 ◽

Vol 37 (1) ◽

pp. 16-23 ◽

Cited By ~ 2

Author(s):

Chit Yuen Yi ◽

Matthew W. E. Murry ◽

Amy L. Gentzler

Keyword(s):

Facial Expressions ◽

Negative Mood ◽

Emotion Perception ◽

State Level ◽

Past Research ◽

Negative Emotionality ◽

Basic Emotions ◽

Perceived Intensity ◽

Trait Level ◽

Facial Expressions Of Emotion

Abstract. Past research suggests that transient mood influences the perception of facial expressions of emotion, but relatively little is known about how trait-level emotionality (i.e., temperament) may influence emotion perception or interact with mood in this process. Consequently, we extended earlier work by examining how temperamental dimensions of negative emotionality and extraversion were associated with the perception accuracy and perceived intensity of three basic emotions and how the trait-level temperamental effect interacted with state-level self-reported mood in a sample of 88 adults (27 men, 18–51 years of age). The results indicated that higher levels of negative mood were associated with higher perception accuracy of angry and sad facial expressions, and higher levels of perceived intensity of anger. For perceived intensity of sadness, negative mood was associated with lower levels of perceived intensity, whereas negative emotionality was associated with higher levels of perceived intensity of sadness. Overall, our findings added to the limited literature on adult temperament and emotion perception.

Download Full-text