scholarly journals A Review of Explicit and Implicit Assumptions When Providing Personalized Feedback Based on Self-Report EMA Data

2021 ◽  
Vol 12 ◽  
Author(s):  
IJsbrand Leertouwer ◽  
Angélique O. J. Cramer ◽  
Jeroen K. Vermunt ◽  
Noémi K. Schuurman

Ecological Momentary Assessment (EMA) in which participants report on their moment-to-moment experiences in their natural environment, is a hot topic. An emerging field in clinical psychology based on either EMA, or what we term Ecological Retrospective Assessment (ERA) as it requires retrospectivity, is the field of personalized feedback. In this field, EMA/ERA-data-driven summaries are presented to participants with the goal of promoting their insight in their experiences. Underlying this procedure are some fundamental assumptions about (i) the relation between true moment-to-moment experiences and retrospective evaluations of those experiences, (ii) the translation of these experiences and evaluations to different types of data, (iii) the comparison of these different types of data, and (iv) the impact of a summary of moment-to-moment experiences on retrospective evaluations of those experiences. We argue that these assumptions deserve further exploration, in order to create a strong evidence-based foundation for the personalized feedback procedure.

2021 ◽  
Author(s):  
IJsbrand Leertouwer ◽  
Angélique Odette Joanne Cramer ◽  
Jeroen K. Vermunt ◽  
Noémi Katalin Schuurman

Ecological Momentary Assessment (EMA), in which participants report on their moment-to-moment experiences in their natural environment, is a hot topic. An emerging field in clinical psychology based on either EMA, or what we term Ecological Retrospective Assessment (ERA) as it requires retrospectivity, is the field of personalized feedback. In this field, EMA/ERA-data-driven summaries are presented to participants with the goal of promoting their insight in their functioning. Underlying this procedure are some fundamental assumptions about (1) the relation between true moment-to-moment experiences and retrospective evaluations of those experiences, (2) the translation of these experiences and evaluations to different types of data (3) the comparison of these different types of data (4) the impact of a summary of moment-to-moment experiences on retrospective evaluations of those experiences. We argue that these assumptions deserve further exploration, in order to create a strong evidence-based foundation for the personalized feedback procedure.


Author(s):  
Yu-Hsiang Wu ◽  
Jingjing Xu ◽  
Elizabeth Stangl ◽  
Shareka Pentony ◽  
Dhruv Vyas ◽  
...  

Abstract Background Ecological momentary assessment (EMA) often requires respondents to complete surveys in the moment to report real-time experiences. Because EMA may seem disruptive or intrusive, respondents may not complete surveys as directed in certain circumstances. Purpose This article aims to determine the effect of environmental characteristics on the likelihood of instances where respondents do not complete EMA surveys (referred to as survey incompletion), and to estimate the impact of survey incompletion on EMA self-report data. Research Design An observational study. Study Sample Ten adults hearing aid (HA) users. Data Collection and Analysis Experienced, bilateral HA users were recruited and fit with study HAs. The study HAs were equipped with real-time data loggers, an algorithm that logged the data generated by HAs (e.g., overall sound level, environment classification, and feature status including microphone mode and amount of gain reduction). The study HAs were also connected via Bluetooth to a smartphone app, which collected the real-time data logging data as well as presented the participants with EMA surveys about their listening environments and experiences. The participants were sent out to wear the HAs and complete surveys for 1 week. Real-time data logging was triggered when participants completed surveys and when participants ignored or snoozed surveys. Data logging data were used to estimate the effect of environmental characteristics on the likelihood of survey incompletion, and to predict participants' responses to survey questions in the instances of survey incompletion. Results Across the 10 participants, 715 surveys were completed and survey incompletion occurred 228 times. Mixed effects logistic regression models indicated that survey incompletion was more likely to happen in the environments that were less quiet and contained more speech, noise, and machine sounds, and in the environments wherein directional microphones and noise reduction algorithms were enabled. The results of survey response prediction further indicated that the participants could have reported more challenging environments and more listening difficulty in the instances of survey incompletion. However, the difference in the distribution of survey responses between the observed responses and the combined observed and predicted responses was small. Conclusion The present study indicates that EMA survey incompletion occurs systematically. Although survey incompletion could bias EMA self-report data, the impact is likely to be small.


2021 ◽  
Author(s):  
IJsbrand Leertouwer ◽  
Noémi Katalin Schuurman ◽  
Jeroen Vermunt

Retrospective Assessment (RA) scores are often found to be higher than the mean of Ecological Momentary Assessment (EMA) scores about a concurrent period. This difference is generally interpreted as bias towards salient experiences in RA. During RA, participants are often asked to summarize their experiences in unspecific terms, which may indeed facilitate bias. At least in this unspecific form, the summary that participants apply to their remembered experiences can take many different forms. In this study, we reanalyzed an existing dataset (N = 92) using a repeated N = 1 approach. We reported on interindividual differences between EMA data and RA score, and assessed for each participant whether it was likely that their RA score was an approximation of the mean of their experiences as captured by their EMA data. We found considerable interpersonal differences in the difference between EMA scores and RA scores, as well as some extreme cases. Furthermore, for a considerable part of the sample (n = 46 for positive affect, n = 60 for negative affect), we did not reject the null hypothesis that their RA score represented the mean of their experiences as captured by their EMA data. We conclude that in its current unspecific form, RA may facilitate bias, although not for everyone. Future studies may determine whether more specific forms of RA reduce bias, while acknowledging interindividual differences.


Author(s):  
Saul Shiffman

Ecological momentary assessment (EMA) is a method for collecting data in real time and in real-world settings in order to avoid retrospective biases, collect ecologically valid data, and study behavioral processes over time. EMA is particularly suited for studying substance use because use is episodic and related to contextual factors like mood, setting, and cues. This chapter addresses the application of EMA to substance use research, describing important elements of EMA design and analysis and illustrating them with examples from substance use research. It discusses and reviews data on methodological issues such as compliance and reactivity and covers considerations in designing EMA studies of substance use. Data on the associations between EMA data on substance use and more traditional self-report data are reviewed. EMA methods reveal substance use patterns not captured by questionnaires or retrospective data and hold promise for substance use research and treatment.


2019 ◽  
Author(s):  
Andrea Chmitorz ◽  
Karolina Kurth ◽  
Lara K. Mey ◽  
Mario Wenzel ◽  
Klaus Lieb ◽  
...  

BACKGROUND Many of the existing scales for microstressor assessment do not differentiate between objective (i. e., observable) stressor events as opposed to stressful cognitions or concerns and often mix these items with other aspects of stress, such as perceived stressor severity, the evoked stress reaction or further consequences on health. This may result in spurious associations with other questionnaires measuring such constructs. Since most scales were de-veloped several decades ago, modern life stressors may not be represented. OBJECTIVE To develop a questionnaire that a) focuses on the retrospective assessment of objective microstressors over a one-week period and b) separates stressor occurrence from perceived stressor severity. METHODS Cross-sectional (N=109) and longitudinal studies (N=10 and N=70) were conduct-ed. In the longitudinal studies, Ecological Momentary Assessment (EMA) was used to com-pare stressor data, collected five times per day for 30 days, with retrospective reports (end-of-day, -week). Pearson correlations and multilevel-modelling were used in the analyses. RESULTS High correlations were found between the end-of-week, end-of-day and EMA data for microstressor occurrence (counts) (r ≥ .69 for comparisons per week, r ≥ .83 for cumulated data) and for mean perceived microstressor severity (r ≥ .74 for comparisons per week, r ≥ .85 for cumulated data). The end-of-week questionnaire predicted the EMA assessments suf-ficiently (counts: b= .03, 95% CI= .02 to .03, P<.001; severity: b= .67, 95% CI= .52 to .82, P<.001), the association did not change significantly over the period of four subsequent weeks. CONCLUSIONS Our results provide evidence for the ecological validity of the MIMIS questionnaire. CLINICALTRIAL none


2021 ◽  
Vol 7 ◽  
pp. 205520762098821
Author(s):  
Stephanie P Goldstein ◽  
Adam Hoover ◽  
E Whitney Evans ◽  
J Graham Thomas

Objectives Behavioral obesity treatment (BOT) produces clinically significant weight loss and health benefits for many individuals with overweight/obesity. Yet, many individuals in BOT do not achieve clinically significant weight loss and/or experience weight regain. Lapses (i.e., eating that deviates from the BOT prescribed diet) could explain poor outcomes, but the behavior is understudied because it can be difficult to assess. We propose to study lapses using a multi-method approach, which allows us to identify objectively-measured characteristics of lapse behavior (e.g., eating rate, duration), examine the association between lapse and weight change, and estimate nutrition composition of lapse. Method We are recruiting participants (n = 40) with overweight/obesity to enroll in a 24-week BOT. Participants complete biweekly 7-day ecological momentary assessment (EMA) to self-report on eating behavior, including dietary lapses. Participants continuously wear the wrist-worn ActiGraph Link to characterize eating behavior. Participants complete 24-hour dietary recalls via structured interview at 6-week intervals to measure the composition of all food and beverages consumed. Results While data collection for this trial is still ongoing, we present data from three pilot participants who completed EMA and wore the ActiGraph to illustrate the feasibility, benefits, and challenges of this work. Conclusion This protocol will be the first multi-method study of dietary lapses in BOT. Upon completion, this will be one of the largest published studies of passive eating detection and EMA-reported lapse. The integration of EMA and passive sensing to characterize eating provides contextually rich data that will ultimately inform a nuanced understanding of lapse behavior and enable novel interventions. Trial registration: Registered clinical trial NCT03739151; URL: https://clinicaltrials.gov/ct2/show/NCT03739151


Assessment ◽  
2021 ◽  
pp. 107319112098388
Author(s):  
Kevin M. King ◽  
Max A. Halvorson ◽  
Kevin S. Kuehn ◽  
Madison C. Feil ◽  
Liliana J. Lengua

There is a small body of research that has connected individual differences in negative urgency, the tendency to report rash actions in response to negative emotions, with self-report depressive and anxiety symptoms. Despite the conceptual overlap of negative urgency with negative emotionality, the tendency to experience frequent and intense negative emotions, even fewer studies have examined whether the association of negative urgency with internalizing symptoms hold when controlling for negative emotionality. In the current study, we estimated the bivariate association between negative urgency and internalizing symptoms, tested whether they remained significant after partialling out negative emotionality, and tested whether these effects generalized to real-time experiences of negative emotions. We used data from five independent samples of high school and college students, assessed with global self-report ( n = 1,297) and ecological momentary assessment ( n = 195). Results indicated that in global self-report data, negative urgency was moderately and positively associated with depressive and anxiety symptoms, and the partial association with depressive symptoms (but not anxiety symptoms) controlling for negative emotionality remained significant and moderate in magnitude. This pattern was replicated in ecological momentary assessment data. Negative urgency may convey risk for depressive symptoms, independent of the effects of negative emotionality.


Author(s):  
Alona Emodi-Perlman ◽  
Daniele Manfrendini ◽  
Tamar Shalev-Antsel ◽  
Ilanit Yevdayev ◽  
Pessia Frideman-Rubin ◽  
...  

Diagnosis of Awake Bruxism (AB) is problematic due to the inability to use continuous recordings during daytime activities. Recently, a new semi-instrumental approach was suggested, viz., an Ecological Momentary Assessment (EMA), with the use of a smartphone application. With the application subjects are requested to report, at least 12 times per day, the status of their masticatory muscle activity (relaxed muscles, jaw bracing without tooth contact, teeth contact, teeth clenching or teeth grinding). The aim of the present study was to compare the EMA to the assessment of AB as defined by a single point self-report. The most frequent condition recorded by the EMA was relaxed muscles (ca. 60%) and the least frequent one - Teeth grinding (0.6 %). The relaxed muscle condition also showed the lowest coefficient of variance over a 7day period of report. Additionally, only the relaxed muscles and the Jaw bracing conditions presented an acceptable ability to discriminate between AB positive and AB negative subjects, as defined by single point self-report questions. The combination between self-report and EMA may have a potential to promote our ability to diagnose AB. We suggest to re-consider the conditions of Teeth contact and Teeth grinding while using EMA to evaluate AB.


Sign in / Sign up

Export Citation Format

Share Document