scholarly journals Pupil dilation reflects the time course of emotion recognition in human vocalizations

2018 ◽  
Vol 8 (1) ◽  
Author(s):  
Manuel Oliva ◽  
Andrey Anikin
Keyword(s):  
Emotion Recognition ◽  
Time Course ◽  
Pupil Dilation

scholarly journals Analyzing the Time Course of Pupillometric Data

2019 ◽  
Vol 23 ◽  
pp. 233121651983248 ◽  
Author(s):  
Jacolien van Rij ◽  
Petra Hendriks ◽  
Hedderik van Rijn ◽  
R. Harald Baayen ◽  
Simon N. Wood
Keyword(s):  
Regression Analysis ◽  
Language Processing ◽  
Nonlinear Regression ◽  
Time Course ◽  
Time Series Data ◽  
Pupil Dilation ◽  
Series Data ◽  
Measured Signal ◽  
Full Time ◽  
Psycholinguistic Research

This article provides a tutorial for analyzing pupillometric data. Pupil dilation has become increasingly popular in psychological and psycholinguistic research as a measure to trace language processing. However, there is no general consensus about procedures to analyze the data, with most studies analyzing extracted features from the pupil dilation data instead of analyzing the pupil dilation trajectories directly. Recent studies have started to apply nonlinear regression and other methods to analyze the pupil dilation trajectories directly, utilizing all available information in the continuously measured signal. This article applies a nonlinear regression analysis, generalized additive mixed modeling, and illustrates how to analyze the full-time course of the pupil dilation signal. The regression analysis is particularly suited for analyzing pupil dilation in the fields of psychological and psycholinguistic research because generalized additive mixed models can include complex nonlinear interactions for investigating the effects of properties of stimuli (e.g., formant frequency) or participants (e.g., working memory score) on the pupil dilation signal. To account for the variation due to participants and items, nonlinear random effects can be included. However, one of the challenges for analyzing time series data is dealing with the autocorrelation in the residuals, which is rather extreme for the pupillary signal. On the basis of simulations, we explain potential causes of this extreme autocorrelation, and on the basis of the experimental data, we show how to reduce their adverse effects, allowing a much more coherent interpretation of pupillary data than possible with feature-based techniques.

scholarly journals Individual Variations in Effort: Assessing Pupillometry for the Hearing Impaired

2019 ◽  
Vol 23 ◽  
pp. 233121651984559 ◽  
Author(s):  
Anita E. Wagner ◽  
Leanne Nagels ◽  
Paolo Toffanin ◽  
Jane M. Opie ◽  
Deniz Başkent
Keyword(s):  
Time Course ◽  
Experimental Manipulation ◽  
Individual Variability ◽  
Pupil Dilation ◽  
Task Demands ◽  
Hearing Impaired ◽  
Speech Comprehension ◽  
Growth Curve Analysis ◽  
Pupillary Responses ◽  
Individual Variations

Assessing effort in speech comprehension for hearing-impaired (HI) listeners is important, as effortful processing of speech can limit their hearing rehabilitation. We examined the measure of pupil dilation in its capacity to accommodate the heterogeneity that is present within clinical populations by studying lexical access in users with sensorineural hearing loss, who perceive speech via cochlear implants (CIs). We compared the pupillary responses of 15 experienced CI users and 14 age-matched normal-hearing (NH) controls during auditory lexical decision. A growth curve analysis was applied to compare the responses between the groups. NH listeners showed a coherent pattern of pupil dilation that reflects the task demands of the experimental manipulation and a homogenous time course of dilation. CI listeners showed more variability in the morphology of pupil dilation curves, potentially reflecting variable sources of effort across individuals. In follow-up analyses, we examined how speech perception, a task that relies on multiple stages of perceptual analyses, poses multiple sources of increased effort for HI listeners, wherefore we might not be measuring the same source of effort for HI as for NH listeners. We argue that interindividual variability among HI listeners can be clinically meaningful in attesting not only the magnitude but also the locus of increased effort. The understanding of individual variations in effort requires experimental paradigms that (a) differentiate the task demands during speech comprehension, (b) capture pupil dilation in its time course per individual listeners, and (c) investigate the range of individual variability present within clinical and NH populations.

scholarly journals Restricted Visual Scanpaths During Emotion Recognition in Childhood Social Anxiety Disorder

2021 ◽  
Vol 12 ◽  
Author(s):  
Johan Lundin Kleberg ◽  
Emilie Bäcklin Löwenberg ◽  
Jennifer Y. F. Lau ◽  
Eva Serlachius ◽  
Jens Högström
Keyword(s):  
Anxiety Disorder ◽  
Social Anxiety ◽  
Eye Tracking ◽  
Emotion Recognition ◽  
Face Perception ◽  
Social Anxiety Disorder ◽  
Pupil Dilation ◽  
Childhood And Adolescence ◽  
Healthy Controls ◽  
Significant Group

Background: Social anxiety disorder (SAD) has its typical onset in childhood and adolescence. Maladaptive processing of social information may contribute to the etiology and maintenance of SAD. During face perception, individuals execute a succession of visual fixations known as a scanpath which facilitates information processing. Atypically long scanpaths have been reported in adults with SAD, but no data exists from pediatric samples. SAD has also been linked to atypical arousal during face perception. Both metrics were examined in one of the largest eye-tracking studies of pediatric SAD to date.Methods: Participants were children and adolescents with SAD (n = 61) and healthy controls (n = 39) with a mean age of 14 years (range 10–17) who completed an emotion recognition task. The visual scanpath and pupil dilation (an indirect index of arousal) were examined using eye tracking.Results: Scanpaths of youth with SAD were shorter, less distributed, and consisted of a smaller number of fixations than those of healthy controls. These findings were supported by both frequentist and Bayesian statistics. Higher pupil dilation was also observed in the SAD group, but despite a statistically significant group difference, this result was not supported by the Bayesian analysis.Conclusions: The results were contrary to findings from adult studies, but similar to what has been reported in neurodevelopmental conditions associated with social interaction impairments. Restricted scanpaths may disrupt holistic representation of faces known to favor adaptive social understanding.

Implementation of Pupil Dilation in AI-Based Emotion Recognition

2021 ◽  
pp. 447-454
Author(s):  
K. S. Maanav Charan ◽  
Alenkar K. Aswin ◽  
K. S. Ackshaya Varshini ◽  
S. Kirthica
Keyword(s):  
Emotion Recognition ◽  
Pupil Dilation

The time course of emotion recognition in speech and music

2019 ◽  
Vol 145 (5) ◽  
pp. 3058-3074 ◽  
Author(s):  
Henrik Nordström ◽  
Petri Laukka
Keyword(s):  
Emotion Recognition ◽  
Time Course

scholarly journals Children's gradient sensitivity to phonological mismatch: considering the dynamics of looking behavior and pupil dilation

2018 ◽  
Vol 46 (1) ◽  
pp. 1-23 ◽  
Author(s):  
Katalin TAMÁSI ◽  
Cristina MCKEAN ◽  
Adamantios GAFOS ◽  
Barbara HÖHLE
Keyword(s):  
Time Course ◽  
Pupillary Response ◽  
Pupil Dilation ◽  
The Other ◽  
Preferential Looking ◽  
Differential Responses ◽  
First Time ◽  
Phonological Mismatch ◽  
Over Time

AbstractIn a preferential looking paradigm, we studied how children's looking behavior and pupillary response were modulated by the degree of phonological mismatch between the correct label of a target referent and its manipulated form. We manipulated degree of mismatch by introducing one or more featural changes to the target label. Both looking behavior and pupillary response were sensitive to degree of mismatch, corroborating previous studies that found differential responses in one or the other measure. Using time-course analyses, we present for the first time results demonstrating full separability among conditions (detecting difference not only between one vs. more, but also between two and three featural changes). Furthermore, the correct labels and small featural changes were associated with stable target preference, while large featural changes were associated with oscillating looking behavior, suggesting significant shifts in looking preference over time. These findings further support and extend the notion that early words are represented in great detail, containing subphonemic information.

scholarly journals On the Time Course of Vocal Emotion Recognition

PLoS ONE ◽  
2011 ◽  
Vol 6 (11) ◽  
pp. e27256 ◽  
Author(s):  
Marc D. Pell ◽  
Sonja A. Kotz
Keyword(s):  
Emotion Recognition ◽  
Time Course ◽  
Vocal Emotion Recognition ◽  
Vocal Emotion

scholarly journals Restricted visual scanpaths during emotion recognition in childhood social anxiety disorder

2020 ◽  
Author(s):  
Johan Lundin Kleberg ◽  
Emilie Bäcklin Löwenberg ◽  
Jennifer Lau ◽  
Eva Serlachius ◽  
Jens Högström
Keyword(s):  
Anxiety Disorder ◽  
Social Anxiety ◽  
Emotion Recognition ◽  
Social Anxiety Disorder ◽  
Recognition Task ◽  
Pupil Dilation ◽  
Childhood And Adolescence ◽  
Significant Group ◽  
Significant Group Difference ◽  
Visual Fixations

Background: Social anxiety disorder (SAD) has its typical onset in childhood and adolescence. Maladaptive processing of social information may contribute to the etiology and maintenance. During face perception, individuals extract information with a succession of visual fixations known as a scanpath. Atypically long scanpaths have been reported in adults with SAD, but no data exists from pediatric samples. SAD has also been linked to atypical arousal. Both metrics were examined in one of the largest eye-tracking studies of pediatric SAD to dateMethods: Children and adolescents with SAD (n = 62) and healthy controls (n = 39) completed an emotion recognition task. The visual scanpath and pupil dilation (an indirect index of arousal) were examined. The analysis plan was preregistered.Results: Youth with SAD showed restricted scanpaths, a finding supported by both frequentist and Bayesian statistics. Higher pupil dilation was also observed in the SAD group, but despite a statistically significant group difference, this result was not supported by the Bayesian analysis.Conclusions: Findings are contrary to findings from adult studies, but similar to what has been reported in neurodevelopmental conditions associated with social interaction impairments. Restricted scanpaths may disrupt holistic representation of faces known to favor adaptive social understanding.

Sign in / Sign up

Export Citation Format

Share Document