Video-based tracking approach for nonverbal synchrony: A comparison of Motion Energy Analysis and OpenPose

Author(s):  
K. Fujiwara ◽  
K. Yokomitsu
2021 ◽  
pp. 216770262098529
Author(s):  
Keren Cohen ◽  
Fabian T. Ramseyer ◽  
Shachaf Tal ◽  
Sigal Zilcha-Mano

Given the importance of the alliance in psychotherapy, nonverbal synchrony has been suggested as a promising automatic objective marker of its levels and development. Accumulating research presents mixed results regarding the association between alliance and nonverbal synchrony. In the current study, we propose that one of the reasons for the inconsistencies is that previous studies did not disentangle trait-like characteristics from state-like changes occurring throughout treatment. To test this, we had 86 patients enrolled in an ongoing randomized controlled trial, along with their therapists, report their alliance levels after every session. Nonverbal movement synchrony was quantified by motion energy analysis for each of the 16 sessions of treatment. Findings suggest a significant association between nonverbal synchrony and the state-like effect of patient-reported alliance ( p < .0001) but not for the trait-like effect. The results confirm the importance of disentangling the state-like and trait-like components because they may have distinct effects.


2021 ◽  
Vol 12 ◽  
Author(s):  
Petra Nyman-Salonen ◽  
Virpi-Liisa Kykyri ◽  
Wolfgang Tschacher ◽  
Joona Muotka ◽  
Anu Tourunen ◽  
...  

Nonverbal synchrony between individuals has a robust relation to the positive aspects of relationships. In psychotherapy, where talking is the cure, nonverbal synchrony has been related to a positive outcome of therapy and to a stronger therapeutic alliance between therapist and client in dyadic settings. Only a few studies have focused on nonverbal synchrony in multi-actor therapy conversations. Here, we studied the synchrony of head and body movements in couple therapy, with four participants present (spouses and two therapists). We analyzed more than 2000min of couple therapy videos from 11 couple therapy cases using Motion Energy Analysis and a Surrogate Synchrony (SUSY), a procedure used earlier in dyadic psychotherapy settings. SUSY was calculated for all six dyads per session, leading to synchrony computations for 66 different dyads. Significant synchrony occurred in all 29 analyzed sessions and between the majority of dyads. Complex models were used to determine the relations between nonverbal synchrony and the clients’ well-being and all participants’ evaluations of the therapeutic alliance. The clients’ well-being was related to body synchronies in the sessions. Differences were found between the clients’ and therapists’ alliance evaluations: the clients’ alliance evaluations were related to synchrony between both dyads of opposite gender, whereas the therapists’ alliance evaluations were related to synchrony between dyads of the same gender, but opposite to themselves. With four participants present, our study introduces a new aspect of nonverbal synchrony, since as a dyad synchronizes, the other two participants are observing it. Nonverbal synchrony seems to be as important in couple therapy as in individual psychotherapy, but the presence of multiple participants makes the patterns more complex.


2021 ◽  
pp. 1-7
Author(s):  
Anna Sandmeir ◽  
Désirée Schoenherr ◽  
Uwe Altmann ◽  
Christoph Nikendei ◽  
Henning Schauenburg ◽  
...  

Psychomotor retardation is a well-known clinical phenomenon in depressed patients that can be measured in various ways. This study aimed to investigate objectively measured gross body movement (GBM) during a semi-structured clinical interview in patients with a depressive disorder and its relation with depression severity. A total of 41 patients with a diagnosis of depressive disorder were assessed both with a clinician-rated interview (Hamilton Depression Rating Scale) and a self-rating questionnaire (Beck Depression Inventory-II) for depression severity. Motion energy analysis (MEA) was applied on videos of additional semi-structured clinical interviews. We considered (partial) correlations between patients’ GBM and depression scales. There was a significant, moderate negative correlation between both measures for depression severity (total scores) and GBM during the diagnostic interview. However, there was no significant correlation between the respective items assessing motor symptoms in the clinician-rated and the patient-rated depression severity scale and GBM. Findings imply that neither clinician ratings nor self-ratings of psychomotor symptoms in depressed patients are correlated with objectively measured GBM. MEA thus offers a unique insight into the embodied symptoms of depression that are not available via patients’ self-ratings or clinician ratings.


2010 ◽  
Vol 3 (9) ◽  
pp. 200-200
Author(s):  
B. Krekelberg ◽  
K. Dobkins ◽  
T. D Albright

2020 ◽  
Vol 49 (4) ◽  
pp. 231-240
Author(s):  
Uwe Altmann ◽  
Lukas A. Knitter ◽  
Julija Meier ◽  
Maria Brümmel ◽  
Bernhard Strauß

Zusammenfassung. Theoretischer Hintergrund: Psychische Störungen gehen mit Veränderungen des nonverbalen Verhaltens einher. Fragestellung: Die Pilotstudie untersuchte, inwiefern Charakteristika von Mimik, Körper- und Kopfbewegungen als diagnostische Kriterien depressiver Störungen geeignet sind und testete dabei computerbasierte Messungen des nonverbalen Verhaltens. Methode: Die Stichprobe umfasste N = 15 Patient_innen mit depressiver Störung und N = 15 gesunde Kontrollpersonen. Mit Fragebögen wurden Depressivität (PHQ-9), Ängstlichkeit (GAD-7) und Schmerzbeeinträchtigung (PDI) erfasst. Strukturierte Anamneseinterviews zu körperlichen Beschwerden wurden mit Video aufgezeichnet. Mimik und Bewegungen wurden automatisch mit OpenFace und Motion Energy Analysis kodiert. Ergebnisse: Hypothesenkonform lächelten depressive Personen seltener (Hedges g = 1.56) und bewegten ihren Kopf weniger ( g = 0.79) als Gesunde. Expressionen von Trauer sowie Häufigkeit, Dauer und Geschwindigkeit von Körperbewegungen waren nicht für die Gruppenzugehörigkeit prädiktiv. Schlussfolgerungen: Es lässt sich schlussfolgern, dass computerbasierte Messungen des nonverbalen Verhaltens zur Untersuchung nonverbaler Korrelate depressiver Störungen geeignet sind und dass psychomotorische Hemmung und emotionale Eintrübung nicht bei allen nonverbalen Charakteristika zu Tage treten.


2018 ◽  
Vol 200 ◽  
pp. 35-41 ◽  
Author(s):  
Derek J. Dean ◽  
Alayna T. Samson ◽  
Raeana Newberry ◽  
Vijay A. Mittal

Sign in / Sign up

Export Citation Format

Share Document