Unsupervised Clustering of Individuals Sharing Selective Attentional Focus Using Physiological Synchrony

Research on brain signals as indicators of a certain attentional state is moving from laboratory environments to everyday settings. Uncovering the attentional focus of individuals in such settings is challenging because there is usually limited information about real-world events, as well as a lack of data from the real-world context at hand that is correctly labeled with respect to individuals' attentional state. In most approaches, such data is needed to train attention monitoring models. We here investigate whether unsupervised clustering can be combined with physiological synchrony in the electroencephalogram (EEG), electrodermal activity (EDA), and heart rate to automatically identify groups of individuals sharing attentional focus without using knowledge of the sensory stimuli or attentional focus of any of the individuals. We used data from an experiment in which 26 participants listened to an audiobook interspersed with emotional sounds and beeps. Thirteen participants were instructed to focus on the narrative of the audiobook and 13 participants were instructed to focus on the interspersed emotional sounds and beeps. We used a broad range of commonly applied dimensionality reduction ordination techniques—further referred to as mappings—in combination with unsupervised clustering algorithms to identify the two groups of individuals sharing attentional focus based on physiological synchrony. Analyses were performed using the three modalities EEG, EDA, and heart rate separately, and using all possible combinations of these modalities. The best unimodal results were obtained when applying clustering algorithms on physiological synchrony data in EEG, yielding a maximum clustering accuracy of 85%. Even though the use of EDA or heart rate by itself did not lead to accuracies significantly higher than chance level, combining EEG with these measures in a multimodal approach generally resulted in higher classification accuracies than when using only EEG. Additionally, classification results of multimodal data were found to be more consistent across algorithms than unimodal data, making algorithm choice less important. Our finding that unsupervised classification into attentional groups is possible is important to support studies on attentional engagement in everyday settings.

Interpersonal Physiological Synchrony for Detecting Moments of Connection in Persons With Dementia: A Pilot Study

Interpersonal physiological synchrony has been successfully used to characterize social interactions and social processes during a variety of interpersonal interactions. There are a handful of measures of interpersonal physiological synchrony, but those that exist have only been validated on able-bodied adults. Here, we present a novel information-theory based measure of interpersonal physiological synchrony—normalized Symbolic Transfer Entropy (NSTE)—and compare its performance with a popular physiological synchrony measure—physiological concordance and single session index (SSI). Using wearable sensors, we measured the electrodermal activity (EDA) of five individuals with dementia and six able-bodied individuals as they participated in a movement activity that aimed to foster connection in persons with dementia. We calculated time-resolved NSTE and SSI measures for case studies of three dyads and compared them against moments of observed interpersonal connection in video recordings of the activity. Our findings suggest that NSTE-based measures of interpersonal physiological synchrony may provide additional advantages over SSI, including resolving moments of ambiguous SSI and providing information about the direction of information flow between participants. This study also investigated the feasibility of using interpersonal synchrony to gain insight into moments of connection experienced by individuals with dementia and further encourages exploration of these measures in other populations with reduced communicative abilities.

Clients’ Emotional Experiences Tied to Therapist-Led (but Not Client-Led) Physiological Synchrony during Imagery Rescripting

Imagery rescripting (IR), an effective intervention technique, may achieve its benefits through various change mechanisms. Previous work has indicated that client–therapist physiological synchrony during IR may serve as one such mechanism. The present work explores the possibility that therapist-led vs. client-led synchrony may be differentially tied to clients’ emotional experiences in therapy. The analyses were conducted with data taken from an open trial of a brief protocol for treating test anxiety (86 IR sessions from 50 client–therapist dyads). Physiological synchrony in electrodermal activity was indexed using two cross-correlation functions per session: once for client leading and again for therapist leading (in both cases, with lags up to 10 s). The clients’ and therapists’ in-session emotions were assessed with the Profile of Mood States. Actor–partner interdependence models showed that certain client (but not therapist) in-session emotions, namely higher contentment and lower anxiety and depression, were tied to therapist-led (but not client-led) physiological synchrony. The results suggest that therapist-led synchrony (i.e., clients’ arousal tracking therapists’ earlier arousal) is tied to more positive and less negative emotional experiences for clients.

Synchrony in the periphery: inter-subject correlation of physiological responses during live music concerts

While there is an increasing shift in cognitive science to study perception of naturalistic stimuli, this study extends this goal to naturalistic contexts by assessing physiological synchrony across audience members in a concert setting. Cardiorespiratory, skin conductance, and facial muscle responses were measured from participants attending live string quintet performances of full-length works from Viennese Classical, Contemporary, and Romantic styles. The concert was repeated on three consecutive days with different audiences. Using inter-subject correlation (ISC) to identify reliable responses to music, we found that highly correlated responses depicted typical signatures of physiological arousal. By relating physiological ISC to quantitative values of music features, logistic regressions revealed that high physiological synchrony was consistently predicted by faster tempi (which had higher ratings of arousing emotions and engagement), but only in Classical and Romantic styles (rated as familiar) and not the Contemporary style (rated as unfamiliar). Additionally, highly synchronised responses across all three concert audiences occurred during important structural moments in the music—identified using music theoretical analysis—namely at transitional passages, boundaries, and phrase repetitions. Overall, our results show that specific music features induce similar physiological responses across audience members in a concert context, which are linked to arousal, engagement, and familiarity.