What Happened in ‘The HERizon Project’?—Process Evaluation of a Multi-Arm Remote Physical Activity Intervention for Adolescent Girls

This mixed-methods process evaluation examines the reach, recruitment, fidelity, adherence, acceptability, mechanisms of impact, and context of remote 12-week physical activity (PA) interventions for adolescent girls named The HERizon Project. The study was comprised of four arms—a PA programme group, a behaviour change support group, a combined group, and a comparison group. Data sources included intervention deliverer and participant logbooks (100 and 71% respective response rates, respectively), exit surveys (72% response rate), and semi-structured focus groups/interviews conducted with a random subsample of participants from each of the intervention arms (n = 34). All intervention deliverers received standardised training and successfully completed pre-intervention competency tasks. Based on self-report logs, 99% of mentors adhered to the call guide, and 100% of calls and live workouts were offered. Participant adherence and intervention receipt were also high for all intervention arms. Participants were generally satisfied with the intervention components; however, improvements were recommended for the online social media community within the PA programme and combined intervention arms. Autonomy, sense of accomplishment, accountability, and routine were identified as factors facilitating participant willingness to adhere to the intervention across all intervention arms. Future remote interventions should consider structured group facilitation to encourage a genuine sense of community among participants.

Planning implementation and scale-up of physical activity interventions for people with walking difficulties: study protocol for the process evaluation of the ComeBACK trial

Background There is currently little evidence of planning for real-world implementation of physical activity interventions. We are undertaking the ComeBACK (Coaching and Exercise for Better Walking) study, a 3-arm hybrid Type 1 randomised controlled trial evaluating a health coaching intervention and a text messaging intervention. We used an implementation planning framework, the PRACTical planning for Implementation and Scale-up (PRACTIS), to guide the process evaluation for the trial. The aim of this paper is to describe the protocol for the process evaluation of the ComeBACK trial using the framework of the PRACTIS guide. Methods A mixed methods process evaluation protocol was developed informed by the Medical Research Council (MRC) guidance on process evaluations for complex interventions and the PRACTIS guide. Quantitative data, including participant questionnaires, health coach and administrative logbooks, and website and text message usage data, is being collected over the trial period. Semi-structured interviews and focus groups with trial participants, health coaches and health service stakeholders will explore expectations, factors influencing the delivery of the ComeBACK interventions and potential scalability within existing health services. These data will be mapped against the steps of the PRACTIS guide, with reporting at the level of the individual, provider, organisational and community/systems. Quantitative and qualitative data will elicit potential contextual barriers and facilitators to implementation and scale-up. Quantitative data will be reported descriptively, and qualitative data analysed thematically. Discussion This process evaluation integrates an evaluation of prospective implementation and scale-up. It is envisaged this will inform barriers and enablers to future delivery, implementation and scale-up of physical activity interventions. To our knowledge, this is the first paper to describe the application of PRACTIS to guide the process evaluation of physical activity interventions. Trial registration Australian and New Zealand Clinical Trials Registry (ANZCTR) Registration date: 10/12/2018.

A model for sustainable, partnership-based telehealth services in rural India: An early process evaluation from Tuver village, Gujarat

Background Telehealth can improve access to high-quality healthcare for rural populations in India. However, rural communities often have other needs, such as sanitation or employment, to benefit fully from telehealth offerings, highlighting a need for systems-level solutions. A Business of Humanity approach argues that innovative solutions to wicked problems like these require strategic decision-making that attends to a) humaneness, e.g., equity and safety and b) humankind, or the needs and potential of large and growing markets comprised of marginalized and low-income individuals. The approach is expected to improve economic performance and long-term value creation for partners, thus supporting sustainability. Methods A demonstration project was conducted in Tuver, a rural and tribal village in Gujarat, India. The project included seven components: a partnership that emphasized power-sharing and complementary contributions; telehealth services; health promotion; digital services; power infrastructure; water and sanitation; and agribusiness. Core partners included the academic partner, local village leadership, a local development foundation, a telehealth provider, and a design-build contractor. This early process evaluation relies on administrative data, field notes, and project documentation and was analyzed using a case study approach. Results Findings highlight the importance of taking a systems perspective and engaging inter-sectoral partners through alignment of values and goals. Additionally, the creation of a synergistic, health-promoting ecosystem offers potential to support telehealth services in the long-term. At the same time, engaging rural, tribal communities in the use of technological advances posed a challenge, though local staff and intermediaries were effective in bridging disconnects. Conclusion Overall, this early process evaluation highlights the promise and challenges of using a Business of Humanity approach for coordinated, sustainable community-level action to improve the health and well-being of marginalized communities.

Mechanisms and Contextual Factors Affecting the Implementation of Animal Health Surveillance in Tanzania: A Process Evaluation

A strong animal health surveillance system is an essential determinant of the health of animal and human population. To ensure its functionality and performance, it needs to be evaluated regularly. Therefore, a process evaluation was conducted in this study to assess animal health surveillance processes, mechanisms and the contextual factors which facilitate or hinder uptake, implementation and sustainability of the system in Tanzania. A mixed-method study design was used to evaluate the national animal health surveillance system guided by a framework for process evaluation of complex interventions developed by Moore and others. The system was assessed against standard guidelines and procedures using the following attributes: fidelity, adherence, exposure, satisfaction, participation rate, recruitment and context. Quantitative and qualitative data were collected using a cross-sectional survey, key informant interviews, document review, site visits and non-participant observation. Data from questionnaires were downloaded, cleaned and analyzed in Microsoft™ Excel. Qualitative data were analyzed following deductive thematic and content analysis methods. Fidelity attribute showed that case identification is mainly based on clinical signs due to limited laboratory services for confirmation. Data collection was not well-coordinated and there were multiple disparate reporting channels. Adherence in terms of the proportion of reports submitted per month was only 61% of the target. District-level animal health officials spent an average of 60% of their weekly time on surveillance-related activities, but only 12% of them were satisfied with the surveillance system. Their dissatisfaction was caused by large area coverage with little to no facilitation, poor communication, and lack of a supporting system. The cost of surveillance data was found to be 1.4 times higher than the annual surveillance budget. The timeliness of the system ranged between 0 and 153 days from the observation date (median = 2 days, mean = 6 days). The study pointed out some deviations in animal health surveillance processes from the standard guidelines and their implication on the system's performance. The system could be improved by developing a user-friendly unified reporting system, the active involvement of subnational level animal health officials, optimization of data sources and an increase in the horizon of the financing mechanism.

A Protocol on Using the RE-AIM Framework in the Process Evaluation of the Primary Health Integrated Care Project for Four Chronic Conditions in Kenya

Background: There has been a rapid increase in morbidity and mortality arising from non-communicable diseases (NCDs). The Academic Model Providing Access to Healthcare (AMPATH) program has established a chronic disease management program in collaboration with the Ministry of Health (MoH) in Kenya at over 150 health facilities in western Kenya. The primary health integrated care for chronic (PIC4C) disease project seeks to deliver preventive, promotive, and curative care for diabetes, hypertension, cervical and breast cancers at the primary health care level. We apply the RE-AIM framework to conduct a process evaluation of the integrated PIC4C model. This paper describes the protocol we are using in the PIC4C process evaluation planning and activities.Methods and Analysis: This evaluation utilizes clinic reports as well as primary data collected in two waves. Using mixed methods (secondary data, observation, semi-structured interviews, and focus group discussions), the process evaluation assesses the reach, effectiveness, adoption, implementation and maintenance of the PIC4C model in Busia and Trans Nzoia Kenya. The evaluation captures the PIC4C process, experiences of implementers and users, and the wishes of those using the PIC4C services. We will analyse our data across the RE-AIM dimensions using descriptive statistics and two-sample t-test to compare the mean scores for baseline and end line. Qualitative data will be analyzed thematically.Discussion: The process evaluation of the PIC4C model in Kenya allows implementers and users to reflect and question its implementation, uptake and maintenance. Our experiences thus far suggest practicable strategies to facilitate primary health care can benefit extensively from deliberate process evaluation of the programs undertaken. Furthermore, integrating the RE-AIM framework in the process evaluation of health programs is valuable due to its pragmatic and reporting usefulness.

The Australian living guidelines for the clinical care of people with COVID-19: What worked, what didn’t and why, a mixed methods process evaluation

Introduction The Australian National COVID-19 Clinical Evidence Taskforce is producing living, evidence-based, national guidelines for treatment of people with COVID-19 which are updated each week. To continually improve the process and outputs of the Taskforce, and inform future living guideline development, we undertook a concurrent process evaluation examining Taskforce activities and experience of team members and stakeholders during the first 5 months of the project. Methods The mixed-methods process evaluation consisted of activity and progress audits, an online survey of all Taskforce participants; and semi-structured interviews with key contributors. Data were collected through five, prospective 4-weekly timepoints (beginning first week of May 2020) and three, fortnightly retrospective timepoints (March 23, April 6 and 20). We collected and analysed quantitative and qualitative data. Results An updated version of the guidelines was successfully published every week during the process evaluation. The Taskforce formed in March 2020, with a nominal start date of March 23. The first version of the guideline was published two weeks later and included 10 recommendations. By August 24, in the final round of the process evaluation, the team of 11 staff, working with seven guideline panels and over 200 health decision-makers, had developed 66 recommendations addressing 58 topics. The Taskforce website had received over 200,000 page views. Satisfaction with the work of the Taskforce remained very high (>90% extremely or somewhat satisfied) throughout. Several key strengths, challenges and methods questions for the work of the Taskforce were identified. Conclusions In just over 5 months of activity, the National COVID-19 Clinical Evidence Taskforce published 20 weekly updates to the evidence-based national treatment guidelines for COVID-19. This process evaluation identified several factors that enabled this achievement (e.g. an extant skill base in evidence review and convening), along with challenges that needed to be overcome (e.g. managing workloads, structure and governance) and methods questions (pace of updating, and thresholds for inclusion of evidence) which may be useful considerations for other living guidelines projects. An impact evaluation is also being conducted separately to examine awareness, acceptance and use of the guidelines.