scholarly journals Patterns of Missing Data with Ecological Momentary Assessment: Feasibility Report from a Pilot Study of People Who Use Drugs (Preprint)

10.2196/31421 ◽  
2021 ◽  
Author(s):  
Kelly L. Markowski ◽  
Jeffrey A. Smith ◽  
G. Robin Gauthier ◽  
Sela R. Harcey
2021 ◽  
Author(s):  
Kelly L Markowski ◽  
Jeffrey A Smith ◽  
G Robin Gauthier ◽  
Sela R Harcey

BACKGROUND Ecological momentary assessment (EMA) is a set of research methods that capture events, feelings, and behaviors as they unfold in their <i>real-world</i> setting. Capturing data <i>in the moment</i> reduces important sources of measurement error but also generates challenges for noncompliance (ie, missing data). To date, EMA research has only examined the overall rates of noncompliance. OBJECTIVE In this study, we identify four types of noncompliance among people who use drugs and aim to examine the factors associated with the most common types. METHODS Data were obtained from a recent pilot study of 28 Nebraskan people who use drugs who answered EMA questions for 2 weeks. We examined questions that were not answered because they were <i>skipped</i>, they <i>expired</i>, the phone was switched <i>off</i>, or the <i>phone died</i> after receiving them. RESULTS We found that the phone being switched <i>off</i> and questions <i>expiring</i> comprised 93.34% (1739/1863 missing question-instances) of our missing data. Generalized structural equation model results show that participant-level factors, including age (relative risk ratio [RRR]=0.93; <i>P</i>=.005), gender (RRR=0.08; <i>P</i>=.006), homelessness (RRR=3.80; <i>P</i>=.04), personal device ownership (RRR=0.14; <i>P</i>=.008), and network size (RRR=0.57; <i>P</i>=.001), are important for predicting <i>off</i> missingness, whereas only question-level factors, including time of day (ie, morning compared with afternoon, RRR=0.55; <i>P</i>&lt;.001) and day of week (ie, Tuesday-Saturday compared with Sunday, RRR=0.70, <i>P</i>=.02; RRR=0.64, <i>P</i>=.005; RRR=0.58, <i>P</i>=.001; RRR=0.55, <i>P</i>&lt;.001; and RRR=0.66, <i>P</i>=.008, respectively) are important for predicting <i>expired</i> missingness. The week of study is important for both (ie, week 2 compared with week 1, RRR=1.21, <i>P</i>=.03, for <i>off</i> missingness and RRR=1.98, <i>P</i>&lt;.001, for <i>expired</i> missingness). CONCLUSIONS We suggest a three-pronged strategy to preempt missing EMA data with high-risk populations: first, provide additional resources for participants likely to experience phone charging problems (eg, people experiencing homelessness); second, ask questions when participants are not likely to experience competing demands (eg, morning); and third, incentivize continued compliance as the study progresses. Attending to these issues can help researchers ensure maximal data quality. CLINICALTRIAL


2004 ◽  
Vol 2 (2) ◽  
pp. 113-131 ◽  
Author(s):  
Helena Levitt ◽  
Annette Wood ◽  
Douglas E. Moul ◽  
Martica Hall ◽  
Anne Germain ◽  
...  

2017 ◽  
Vol 43 (3) ◽  
pp. 354-381 ◽  
Author(s):  
Stephanie A. Kovalchik ◽  
Steven C. Martino ◽  
Rebecca L. Collins ◽  
William G. Shadel ◽  
Elizabeth J. D’Amico ◽  
...  

Ecological momentary assessment (EMA) is a popular assessment method in psychology that aims to capture events, emotions, and cognitions in real time, usually repeatedly throughout the day. Because EMA typically involves more intensive monitoring than traditional assessment methods, missing data are commonly an issue and this missingness may bias results. EMA can involve two types of missing data: known missingness, arising from nonresponse to scheduled prompts, and hidden missingness, arising from nonreporting of focal events (e.g., an urge to smoke or a meal). Prior research on missing data in EMA has focused almost exclusively on nonresponse to scheduled prompts. In this study, we introduce a scaled inverse probability weighting approach to assess the risk of bias due to nonreporting of events due to fatigue on estimates of exposure or correlates of exposure. In our proposed approach, the inverse probability is the estimated probability of compliance with random prompts from a model that uses participant and contextual factors to predict this compliance and a fatigue factor that adjusts for attrition in event reporting over time. We demonstrate the use and utility of our bias assessment method with the Tracking and Recording Alcohol Communications Study, an EMA study of adolescent exposure to alcohol advertising.


2021 ◽  
Author(s):  
Iulia Niculescu ◽  
Hannah Quirt ◽  
Twinkle Arora ◽  
Terry Borsook ◽  
Robin Green ◽  
...  

BACKGROUND Barriers to assessing depression in advanced dementia include the presence of informant and patient recall biases. Ecological momentary assessment provides an improved approach for mood assessment by collecting observations in intervals throughout the day, decreasing recall bias, and increasing ecological validity. OBJECTIVE This study aims to evaluate the feasibility, reliability, and validity of the modified 4-item Cornell Scale for Depression in Dementia for Momentary Assessment (mCSDD4-MA) tool to assess depression in patients with advanced dementia. METHODS A intensive longitudinal pilot study design was used. A total of 12 participants with advanced dementia were enrolled from an inpatient psychogeriatric unit. Participants were assessed using clinical depression assessments at admission and discharge. Research staff recorded observations four times a day for 6 weeks on phones with access to the mCSDD4-MA tool. Descriptive data related to feasibility were reported (ie, completion rates). Statistical models were used to examine the interrater reliability and construct and predictive validity of the data. RESULTS Overall, 1923 observations were completed, representing 55.06% (1923/3496) of all rating opportunities with 2 raters and 66.01% (1923/2913) with at least one rater. Moderate interrater reliability was demonstrated for all items, except for <i>lack of interest</i>. Moderate correlations were observed between observers and patient-reported outcomes, where observers reported fewer symptoms relative to participants’ self-reports. Several items were associated with and able to predict depression. CONCLUSIONS The mCSDD4-MA tool was feasible to use, and most items in the tool showed moderate reliability and validity for assessing depression in dementia. Repeated and real-time depression assessment in advanced dementia holds promise for the identification of clinical depression and depressive symptoms.


JMIR Aging ◽  
10.2196/29021 ◽  
2021 ◽  
Vol 4 (3) ◽  
pp. e29021
Author(s):  
Iulia Niculescu ◽  
Hannah Quirt ◽  
Twinkle Arora ◽  
Terry Borsook ◽  
Robin Green ◽  
...  

Background Barriers to assessing depression in advanced dementia include the presence of informant and patient recall biases. Ecological momentary assessment provides an improved approach for mood assessment by collecting observations in intervals throughout the day, decreasing recall bias, and increasing ecological validity. Objective This study aims to evaluate the feasibility, reliability, and validity of the modified 4-item Cornell Scale for Depression in Dementia for Momentary Assessment (mCSDD4-MA) tool to assess depression in patients with advanced dementia. Methods A intensive longitudinal pilot study design was used. A total of 12 participants with advanced dementia were enrolled from an inpatient psychogeriatric unit. Participants were assessed using clinical depression assessments at admission and discharge. Research staff recorded observations four times a day for 6 weeks on phones with access to the mCSDD4-MA tool. Descriptive data related to feasibility were reported (ie, completion rates). Statistical models were used to examine the interrater reliability and construct and predictive validity of the data. Results Overall, 1923 observations were completed, representing 55.06% (1923/3496) of all rating opportunities with 2 raters and 66.01% (1923/2913) with at least one rater. Moderate interrater reliability was demonstrated for all items, except for lack of interest. Moderate correlations were observed between observers and patient-reported outcomes, where observers reported fewer symptoms relative to participants’ self-reports. Several items were associated with and able to predict depression. Conclusions The mCSDD4-MA tool was feasible to use, and most items in the tool showed moderate reliability and validity for assessing depression in dementia. Repeated and real-time depression assessment in advanced dementia holds promise for the identification of clinical depression and depressive symptoms.


2021 ◽  
Author(s):  
Holly Krohn ◽  
Jerry Guintivano ◽  
Rachel Frische ◽  
Jamie Steed ◽  
Hannah Rackers ◽  
...  

BACKGROUND Wearable tracking devices and mobile health technology are increasingly used in an effort to enhance clinical care and delivery of personalized medical treatment. Postpartum depression is the most frequently diagnosed complication of childbirth but significant gaps in screening and treatment remain. OBJECTIVE We investigated the clinical utility and acceptability of using ecological momentary assessment to collect daily mood, sleep, and activity data through the use of an Apple Watch and mobile app among women with postpartum depression. METHODS This was a pilot study consisting of three in-person research visits over the course of a 6-week enrollment period. Questionnaires to assess depression, anxiety, and maternal functioning were periodically collected, along with daily self-reported symptoms and passively collected physiological data via an Apple Watch. Feedback was collected from study participants and the study clinician to determine the utility and acceptability of daily tracking. Compliance with daily ecological momentary assessments was also measured. RESULTS Of the 26 women enrolled, 23 completed the 6-week study. On average, participants completed 66.7% of all active daily assessments and 73.9% of all passive measures. Further, all 23 participants completed the three required visits with the research team. CONCLUSIONS Using ecological momentary assessment to track daily symptoms of postpartum depression with a wearable device was largely endorsed as feasible, acceptable and clinically useful by participants and the study clinician and could be a innovative solution to increase care access during the COVID-19 pandemic.


Sign in / Sign up

Export Citation Format

Share Document