Developing a Consensus for Adolescent and Young Adult mHealth HIV Prevention Interventions in the United States: Delphi Method (Preprint)

BACKGROUND Engaging adolescents and young adults (AYA) who are at elevated risk for HIV acquisition or who are living with HIV in healthcare has posed a major challenge in HIV prevention and care efforts. Mobile health (mHealth) interventions are a popular and accessible strategy to support AYA engagement despite barriers to care present along the HIV care continuum. Even with progress in the field of mHealth research, expert recommendations for the process of designing, evaluating, and implementing HIV-related mHealth interventions are underdeveloped. OBJECTIVE The aim of this study was to compile expert recommendations on the development, evaluation, and implementation of AYA-focused HIV prevention and care mHealth interventions. METHODS Experts from adolescent mHealth HIV research networks and investigators of recently funded HIV mHealth projects and programs were identified and invited to complete a series of electronic surveys related to the design, implementation, and evaluation of HIV-related mHealth interventions. A modified Delphi method was used to ask experts to score 35 survey items on a 4-point Likert scale from not important to very important and encouraged experts to leave additional comments in text boxes. Responses were reviewed by the researchers, a team of four HIV mHealth intervention experts. The average importance ratings from survey responses were calculated and then categorized as retained (high importance), flagged (mid-level importance), or dropped (no/low importance). Additionally, thematic analysis of expert comments helped modify survey items for the next survey round. An evaluation of the level of agreement among experts on the most important items followed each round until consensus was reached. RESULTS Of the 35 invited experts, 23 completed the first survey representing a variety of roles within a research team. Following two rounds of Delphi surveys, experts scored 86% of the 30 survey items included in round two as important to very important. The final consensus items included 24 recommendations related to the mHealth intervention design process (n=15), evaluation (n=2), and implementation (n=7). The three survey items with the highest average scores focused on the design process, specifically, (1) creating a diverse team including researchers, app software developers, youth representation, (2) the importance of AYA-focused content, and the (3) value of an iterative process. Additionally, experts highlighted the importance of establishing the best ways to collect data and the types of data for collection during the evaluation process as well as constructing a plan for participant technology disruption when implementing an mHealth intervention. CONCLUSIONS The modified Delphi method was a useful tool to convene experts to determine recommendations for AYA-focused HIV prevention and care mHealth interventions. These recommendations can inform future mHealth interventions. To ensure acceptability, feasibility, and efficacy of these AYA HIV prevention interventions, the focus must be on specific needs of AYA by including representation of AYA in the process, including consistent and relevant content, ensuring appropriate data is collected, and considering technology and health accessibility barriers.