scholarly journals Occurrence of and Reasons for “Missing Events” in Mobile Dietary Assessments: Results From Three Event-Based Ecological Momentary Assessment Studies

10.2196/15430 ◽  
2020 ◽  
Vol 8 (10) ◽  
pp. e15430 ◽  
Author(s):  
Katrin Ziesemer ◽  
Laura Maria König ◽  
Carol Jo Boushey ◽  
Karoline Villinger ◽  
Deborah Ronja Wahl ◽  
...  

Background Establishing a methodology for assessing nutritional behavior comprehensively and accurately poses a great challenge. Mobile technologies such as mobile image-based food recording apps enable eating events to be assessed in the moment in real time, thereby reducing memory biases inherent in retrospective food records. However, users might find it challenging to take images of the food they consume at every eating event over an extended period, which might lead to incomplete records of eating events (missing events). Objective Analyzing data from 3 studies that used mobile image-based food recording apps and varied in their technical enrichment, this study aims to assess how often eating events (meals and snacks) were missed over a period of 8 days in a naturalistic setting by comparing the number of recorded events with the number of normative expected events, over time, and with recollections of missing events. Methods Participants in 3 event-based Ecological Momentary Assessment (EMA) studies using mobile image-based dietary assessments were asked to record all eating events (study 1, N=38, 1070 eating events; study 2, N=35, 934 eating events; study 3, N=110, 3469 eating events). Study 1 used a basic app; study 2 included 1 fixed reminder and the possibility to add meals after the actual eating events occurred instead of in the moment (addendum); and study 3 included 2 fixed reminders, an addendum feature, and the option to record skipped meals. The number of recalled missed events and their reasons were assessed by semistructured interviews after the EMA period (studies 1 and 2) and daily questionnaires (study 3). Results Overall, 183 participants reported 5473 eating events. Although the momentary adherence rate as indexed by a comparison with normative expected events was generally high across all 3 studies, a differential pattern of results emerged with a higher rate of logged meals in the more technically intensive study 3. Multilevel models for the logging trajectories of reported meals in all 3 studies showed a significant, albeit small, decline over time (b=−.11 to −.14, Ps<.001, pseudo-R²=0.04-0.06), mainly because of a drop in reported snacks between days 1 and 2. Intraclass coefficients indicated that 38% or less of the observed variance was because of individual differences. The most common reasons for missing events were competing activities and technical issues, whereas situational barriers were less important. Conclusions Three different indicators (normative, time stability, and recalled missing events) consistently indicated missing events. However, given the intensive nature of diet EMA protocols, the effect sizes were rather small and the logging trajectories over time were remarkably stable. Moreover, the individual’s actual state and context seemed to exert a greater influence on adherence rates than stable individual differences, which emphasizes the need for a more nuanced understanding of the factors that affect momentary adherence.

Author(s):  
Katrin Ziesemer ◽  
Laura Maria König ◽  
Carol Jo Boushey ◽  
Karoline Villinger ◽  
Deborah Ronja Wahl ◽  
...  

BACKGROUND Establishing a methodology for assessing nutritional behavior comprehensively and accurately poses a great challenge. Mobile technologies such as mobile image-based food recording apps enable eating events to be assessed in the moment in real time, thereby reducing memory biases inherent in retrospective food records. However, users might find it challenging to take images of the food they consume at every eating event over an extended period, which might lead to incomplete records of eating events (<i>missing events</i>). OBJECTIVE Analyzing data from 3 studies that used mobile image-based food recording apps and varied in their technical <i>enrichment</i>, this study aims to assess how often eating events (meals and snacks) were missed over a period of 8 days in a naturalistic setting by comparing the number of recorded events with the number of normative expected events, over time, and with recollections of missing events. METHODS Participants in 3 event-based Ecological Momentary Assessment (EMA) studies using mobile image-based dietary assessments were asked to record all eating events (study 1, N=38, 1070 eating events; study 2, N=35, 934 eating events; study 3, N=110, 3469 eating events). Study 1 used a <i>basic</i> app; study 2 included 1 fixed reminder and the possibility to add meals after the actual eating events occurred instead of in the moment (<i>addendum</i>); and study 3 included 2 fixed reminders, an addendum feature, and the option to record skipped meals. The number of recalled missed events and their reasons were assessed by semistructured interviews after the EMA period (studies 1 and 2) and daily questionnaires (study 3). RESULTS Overall, 183 participants reported 5473 eating events. Although the momentary adherence rate as indexed by a comparison with normative expected events was generally high across all 3 studies, a differential pattern of results emerged with a higher rate of logged meals in the more technically intensive study 3. Multilevel models for the logging trajectories of reported meals in all 3 studies showed a significant, albeit small, decline over time (b=−.11 to −.14, <i>P</i>s&lt;.001, pseudo-R²=0.04-0.06), mainly because of a drop in reported snacks between days 1 and 2. Intraclass coefficients indicated that 38% or less of the observed variance was because of individual differences. The most common reasons for missing events were competing activities and technical issues, whereas situational barriers were less important. CONCLUSIONS Three different indicators (normative, time stability, and recalled missing events) consistently indicated missing events. However, given the intensive nature of diet EMA protocols, the effect sizes were rather small and the logging trajectories over time were remarkably stable. Moreover, the individual’s actual state and context seemed to exert a greater influence on adherence rates than stable individual differences, which emphasizes the need for a more nuanced understanding of the factors that affect momentary adherence.


Buildings ◽  
2019 ◽  
Vol 9 (2) ◽  
pp. 54 ◽  
Author(s):  
Lina Engelen ◽  
Fabian Held

Studying the workplace often involves using observational, self-report recall, or focus group tools, which all have their established advantages and disadvantages. There is, however, a need for a readily available, low-invasive method that can provide longitudinal, repeated, and concurrent in-the-moment information to understand the workplace well. In this study, ecological momentary assessment (EMA) was used to collect 508 real-time responses about activities, posture, work performance, social interactions, and mood in 64 adult office workers in three Australian workplaces. The response rate was 53%, and the time to fill out the survey was 50 seconds on average. On average, the participants were sitting, standing, and walking in 84%, 9%, and 7% of survey instances, respectively. The participants reported they were working alone at their desks in 55% of all reported instances. Reported mood varied up to nine points within one person over the course of the post-occupancy observations. EMA can be used to paint a rich picture of occupants’ experiences and perceptions and to gain invaluable understanding of temporal patterns of the workplace, how the space is used, and how aspects of the workplace interact. This information can be used to make improvements to the physical and social workspaces and enhance occupants’ work performance and mood.


2019 ◽  
Vol 128 (9) ◽  
pp. 829-837 ◽  
Author(s):  
Viann N. Nguyen-Feng ◽  
Patricia A. Frazier ◽  
Ali Stockness ◽  
Scott Lunos ◽  
Alexis N. Hoedeman ◽  
...  

Objectives: Voice handicap has generally been measured at a single timepoint. Little is known about its variability from hour to hour or day to day. Voice handicap has been shown to be negatively related to voice-related perceived control in cross-sectional studies, but the within-person variability in voice-related perceived control is also unknown. We aimed to use ecological momentary assessment (EMA) to (1) assess the feasibility of EMA to examine daily voice handicap and voice-related perceived control in patients with voice disorders, (2) measure within-person variability in daily voice handicap and perceived control, and (3) characterize temporal associations (eg, correlations over time) between daily voice handicap and perceived control. Methods: Adults with voice problems were recruited from a large public university medical center in the Midwest. They completed baseline measures, followed by twice-daily assessments, including selected items measuring voice handicap and perceived control, and then repeated the baseline measures at the final timepoint. Feasibility was assessed via completion rates. Within-person variability was measured using standard deviations. Temporal associations were characterized using simulation modeling analysis. Results: EMA of voice handicap and perceived control was feasible in this patient population. Momentary voice handicap varied more than perceived control, though both were variable. Multiple patterns of temporal associations between daily voice handicap and perceived control were found. Conclusions: These findings identified important variability in (1) measures of voice handicap and perceived control and (2) their associations over time. Future EMA studies in patients with voice disorders are both feasible and warranted.


2017 ◽  
Vol 38 (8) ◽  
pp. 1121-1146 ◽  
Author(s):  
Christina Matz-Costa ◽  
Stephanie Cosner Berzin ◽  
Marcie Pitt-Catsouphes ◽  
Cal J Halvorsen

The ecological momentary assessment (EMA) method was used to examine the antecedents and correlates of older adults’ in-the-moment perceptions of meaning at work. Data were collected six times per day for 7 days from 30 older adults who were mostly social entrepreneurs and who were engaged in purpose work (i.e., work that addresses a social problem or issue). We found concurrent effects of two types of affective states (i.e., relaxed and energetic) and generative work behaviors (i.e., sharing information about one’s work and encouraging/inviting others into one’s work) on three measures of perceptions of meaningful work (i.e., high passion for one’s work, high sense of engagement in one’s work, and high connection to a sense of meaning in life). Feeling energetic had a lagged effect on meaningful work approximately 2.5 and 5 hr later in the day. We consider ways to foster engagement in meaningful work as a path toward healthy aging.


2021 ◽  
Author(s):  
Cheng K. Fred Wen ◽  
Doerte U. Junghaenel ◽  
David B. Newman ◽  
Stefan Schneider ◽  
Marilyn Mendez ◽  
...  

BACKGROUND Ecological Momentary Assessment (EMA) has the potential to minimize recall bias by having people report on their experiences in the moment (momentary model) or over short periods of time (coverage model). This potential hinges on the assumption that participants provide ratings based on the reporting timeframe instructions prescribed in the EMA items. However, it is unclear what timeframes participants are actually using when they answer EMA questions and whether participant training improves participants’ adherence to the reporting instructions. OBJECTIVE The objectives of this study are to investigate the reporting timeframes participants used when answering EMA questions and whether participant training improves participants’ adherence to the EMA reporting timeframe instructions. METHODS This study used telephone-based cognitive interviews to investigate this question. In a 2x2 factorial design, participants (n=100) were assigned to receive either basic or enhanced EMA training and also randomized to rate their experiences using a momentary (at the moment you were called) or coverage (since the last phone call) model. Participants received 5 calls over the course of one day to provide ratings; after each rating, participants were immediately interviewed about the timeframe that they used to answer the EMA questions. Two raters independently coded the momentary interview responses into timeframe categories (Cohen’s kappa = 0.64 (95%CI: 0.55-0.73)). RESULTS Results from the momentary conditions showed that most of the calls referred to the period during the call (28.6%) or just before the call (49.2%) to provide ratings; the remainder were from longer reporting periods. Multinomial logistic regression results indicated a significant training effect (χ2 (1, 199)=16.61, p<0.001), where the enhanced training condition yielded more reports within the intended reporting timeframes for momentary EMA reports. Cognitive interview data from the coverage model did not lend themselves to reliable coding and were not analyzed. CONCLUSIONS These findings provide the first evidence about adherence to EMA instructions to reporting periods, and that enhanced participant training improves adherence to the timeframe specified in momentary EMA studies.


Author(s):  
Heather T. Schatten ◽  
Kenneth J. D. Allen ◽  
Michael F. Armey

As emotion is a dynamic construct, ecological momentary assessment (EMA) methods, which gather data at multiple time points in individuals’ real-world environments, in the moment, are particularly well suited to measure emotion dysregulation and related constructs. EMA methods can identify contextual events that prompt or follow an emotional response. This chapter provides an overview of traditional methods of studying emotion dysregulation and how EMA can be used to capture emotion dysregulation in daily life, both within and independent of psychiatric diagnoses. It reviews the literature on emotion dysregulation and related constructs within specific diagnoses (e.g., depression, bipolar disorder, borderline personality disorder, and eating disorders) and behaviors (e.g., suicide, nonsuicidal self-injury, and alcohol use). Finally, it discusses future directions in EMA research, as well as its implications for psychological treatment.


2018 ◽  
Author(s):  
Aidan G.C. Wright ◽  
Johannes Zimmermann

Ambulatory assessment (also known as ecological momentary assessment) has enjoyed enthusiastic implementation in psychological research. The ability to assess thoughts, feelings, behavior, physiology, and context intensively and repeatedly in the moment in an individual’s natural ecology affords access to data that can answer exciting questions about sequences of events and dynamic processes in daily life. Ambulatory assessment also holds unique promise for developing personalized models of individuals (i.e., precision or person-specific assessment) that might be transformative for applied settings such as clinical practice. However, successfully translating ambulatory assessment from bench to bedside is challenging because of the inherent tension between idiographic and nomothetic principles of measurement. We argue that the value of applied ambulatory assessment will be most fully realized by balancing the ability to develop personalized models with ensuring comparability among individuals.


Author(s):  
Marjolein R. Thunnissen ◽  
Marije aan het Rot ◽  
Barbara J. van den Hoofdakker ◽  
Maaike H. Nauta

AbstractTraditionally, symptoms of youth psychopathology are assessed with questionnaires, clinical interviews, or laboratory observations. Ecological Momentary Assessment (EMA) could be a particularly valuable additional methodology, since EMA enables examining the daily lives of youths near real-time, considering fluctuations and specific contexts of symptoms. This systematic review aimed to review the characteristics of current EMA applications and to provide a synthesis of their potential in studying youth psychopathology. Following a systematic search in PsycInfo and Medline, we identified 50 studies in clinical samples. Most studies used EMA to examine fluctuations in symptoms, affect, and behavior, and the relation with contextual factors. EMA was also used to investigate interactions between parents and their children over time, and to monitor and predict treatment response. EMA appeared feasible in youth and could provide valuable insights that contribute to understanding youth psychopathology. Benefits, gaps, and suggestions for future research and clinical practice are discussed.


10.2196/11845 ◽  
2019 ◽  
Vol 6 (5) ◽  
pp. e11845 ◽  
Author(s):  
Aaron M Mofsen ◽  
Thomas L Rodebaugh ◽  
Ginger E Nicol ◽  
Colin A Depp ◽  
J Philip Miller ◽  
...  

A major problem in mental health clinical trials, such as depression, is low assay sensitivity in primary outcome measures. This has contributed to clinical trial failures, resulting in the exodus of the pharmaceutical industry from the Central Nervous System space. This reduced assay sensitivity in psychiatry outcome measures stems from inappropriately broad measures, recall bias, and poor interrater reliability. Limitations in the ability of traditional measures to differentiate between the trait versus state-like nature of individual depressive symptoms also contributes to measurement error in clinical trials. In this viewpoint, we argue that ecological momentary assessment (EMA)—frequent, real time, in-the-moment assessments of outcomes, delivered via smartphone—can both overcome these psychometric challenges and reduce clinical trial failures by increasing assay sensitivity and minimizing recall and rater bias. Used in this manner, EMA has the potential to further our understanding of treatment response by allowing for the assessment of dynamic interactions between treatment and distinct symptom response.


Sign in / Sign up

Export Citation Format

Share Document