Mixed-Methods Evaluation of the Phased Implementation of a National Telehealth Weight Management Program for Veterans (Preprint)
BACKGROUND The burden of obesity is high among U.S. veterans yet many face barriers to engaging in in-person, facility-based treatment programs. To improve access to weight-management services, the Veterans Health Administration (VHA) developed TeleMOVE®, a home-based 82-day curriculum that utilizes in-home messaging devices to promote weight loss in VHA patients facing barriers to accessing facility-based services. OBJECTIVE Our primary aims were to establish preliminary evidence for the program to engage the priority population based on the number of patients enrolled per site as well as the program’s clinical effectiveness as demonstrated by average weight lost per patient. A secondary aim was to understand factors influencing implementation variability across demonstration sites to develop recommendations to inform the national TeleMOVE dissemination. METHODS We employed a formative mixed-methods design to evaluate the phased implementation of TeleMOVE programming at nine demonstration sites and to compare patient- and site-level measures of program uptake. Data was collected between October 1, 2009 and September 30, 2012. Twenty-eight stakeholders were recruited to provide contextual details while patient-level program outcomes were extracted from VHA patient care databases. Program stakeholders were recruited to participate in two rounds of semi-structured interviews about aspects of implementation processes, site-level contextual factors, and daily program delivery. Administrative data was used to evaluate program enrollment rates and clinical outcomes. To assess preliminary clinical effectiveness, weight loss outcomes for veterans who enrolled in TeleMOVE were compared to outcomes for participants enrolled in standard MOVE! at each demonstration site as well as to national averages during the first two years of program implementation. RESULTS Program uptake was high at two sites, delayed-high at one site, low at three sites, and three late-adopting sites declined interviews. At six months post-enrollment, mean weight loss was comparable for TeleMOVE (n=417) and MOVE! (n=1543) participants at -5.2 lb (SD=14.4) and -5.1 lb (SD=12.2), respectively (p=.91). All sites reported high program complexity because TeleMOVE required more staff time per participant than MOVE! due to logistical and technical assistance issues related to the devices. High-uptake sites overcame implementation challenges by leveraging strong communication networks with stakeholders, adapting the program to patient needs whenever possible, setting programmatic goals and monitoring feedback of results, and taking time to reflect and evaluate on delivery to foster incremental delivery improvements whereas, low-uptake sites reported less leadership support and effective communication among stakeholders. CONCLUSIONS This evaluation of the phased implementation of a new clinical telehealth program demonstrates the value of partnership-based research in which researchers not only provide operational leaders with rapid and responsive feedback regarding the effectiveness of a new clinical program but also relevant feedback into contextual factors related to implementation to enable adaptations for national rollout of the program.