Factors influencing participants’ engagement with an interactive text-message intervention to improve sun protection behaviors: “SunText” randomized controlled trial

Abstract There is growing evidence suggesting that text-message-based interventions are effective to promote sun protection behaviors. However, it is still unclear how engagement and adherence with the intervention messages can be optimized through intervention design. This study evaluated the effect of different combinations of personalized and two-way interactive messages on participant engagement with a theory-based skin cancer prevention intervention. In the SunText study conducted in February–July 2019 in Queensland, Australia participants 18–40 years were randomized to four different text message schedules using a Latin square design. This study analyzed if the order and intensity in which the schedules were received were associated with participants’ level of engagement, and if this differed by demographic factors. Out of the 389 participants enrolled in the study, 375 completed the intervention period and remained for analysis. The overall intervention engagement rate was 71% and decreased from the beginning to the end of the study (82.2%–61.4%). The group starting with personalized, but not interactive messaging showed the lowest engagement rate. The intervention involving interactive messages three times a week for 4 weeks achieved the highest engagement rate. The intervention with increasing frequency (personalized and interactive three times a week for 2 weeks; then daily for 2 weeks) had lower engagement than intervention with constant or decreasing frequency. Engagement with two-way interactive messages was high across all intervention groups. Results suggest enhanced engagement with constant or decreasing message frequency compared to increasing frequency.

Download Full-text

Research and Implementation Lessons Learned From a Youth-Targeted Digital Health Randomized Controlled Trial (the ARMADILLO Study)

JMIR mhealth and uhealth ◽

10.2196/13005 ◽

2019 ◽

Vol 7 (8) ◽

pp. e13005

Author(s):

Lianne Gonsalves ◽

Winnie Wangari Njeri ◽

Megan Schroeder ◽

Jefferson Mwaisaka ◽

Peter Gichangi

Keyword(s):

Randomized Controlled Trial ◽

Digital Health ◽

Controlled Trial ◽

Text Message ◽

Health Interventions ◽

World Health ◽

Intervention Period ◽

Implementation Challenges ◽

Randomized Controlled ◽

Client Side

Background Evidence is lacking on the efficacy of sexual and reproductive health (SRH) communication interventions for youth (aged 15-24 years), especially from low- and middle-income countries. Therefore, the World Health Organization initiated the Adolescent/Youth Reproductive Mobile Access and Delivery Initiative for Love and Life Outcomes (ARMADILLO) program, a free, menu-based, on-demand text message (SMS, short message service) platform providing validated SRH content developed in collaboration with young people. A randomized controlled trial (RCT) assessing the effect of the ARMADILLO intervention on SRH-related outcomes was implemented in Kwale County, Kenya. Objective This paper describes the implementation challenges related to the RCT, observed during enrollment and the intervention period, and their implications for digital health researchers and program implementers. Methods This was an open, three-armed RCT. Following completion of a baseline survey, participants were randomized into the ARMADILLO intervention (arm 1), a once-a-week contact SMS text message (arm 2), or usual care (arm 3, no intervention). The intervention period lasted seven weeks, after which participants completed an endline survey. Results Two study team decisions had significant implications for the success of the trial’s enrollment and intervention implementation: a hands-off participant recruitment process and a design flaw in an initial language selection menu. As a result, three weeks after recruitment began, 660 participants had been randomized; however, 107 (53%) participants in arm 1 and 136 (62%) in arm 2 were “stuck” at the language menu. The research team called 231 of these nonengaging participants and successfully reached 136 to learn reasons for nonengagement. Thirty-two phone numbers were found to be either not linked to our participants (a wrong number) or not in their primary possession (a shared phone). Among eligible participants, 30 participants indicated that they had assumed the introductory message was a scam or spam. Twenty-seven participants were confused by some aspect of the system. Eleven were apathetic about engaging. Twenty-four nonengagers experienced some sort of technical issue. All participants eventually started their seven-week study period. Conclusions The ARMADILLO study’s implementation challenges provide several lessons related to both researching and implementing client-side digital health interventions, including (1) have meticulous phone data collection protocols to reduce wrong numbers, (2) train participants on the digital intervention in efficacy assessments, and (3) recognize that client-side digital health interventions have analog discontinuation challenges. Implementation lessons were (1) determine whether an intervention requires phone ownership or phone access, (2) digital health campaigns need to establish a credible presence in a busy digital space, and (3) interest in a service can be sporadic or fleeting. Clinical Trial International Standard Randomized Controlled Trial Number (ISRCTN): 85156148; http://www.isrctn. com/ISRCTN85156148

Download Full-text