Costs and staffing resource requirements for adaptive clinical trials: quantitative and qualitative results from the Costing Adaptive Trials project

Background Adaptive designs offer great promise in improving the efficiency and patient-benefit of clinical trials. An important barrier to further increased use is a lack of understanding about which additional resources are required to conduct a high-quality adaptive clinical trial, compared to a traditional fixed design. The Costing Adaptive Trials (CAT) project investigated which additional resources may be required to support adaptive trials. Methods We conducted a mock costing exercise amongst seven Clinical Trials Units (CTUs) in the UK. Five scenarios were developed, derived from funded clinical trials, where a non-adaptive version and an adaptive version were described. Each scenario represented a different type of adaptive design. CTU staff were asked to provide the costs and staff time they estimated would be needed to support the trial, categorised into specified areas (e.g. statistics, data management, trial management). This was calculated separately for the non-adaptive and adaptive version of the trial, allowing paired comparisons. Interviews with 10 CTU staff who had completed the costing exercise were conducted by qualitative researchers to explore reasons for similarities and differences. Results Estimated resources associated with conducting an adaptive trial were always (moderately) higher than for the non-adaptive equivalent. The median increase was between 2 and 4% for all scenarios, except for sample size re-estimation which was 26.5% (as the adaptive design could lead to a lengthened study period). The highest increase was for statistical staff, with lower increases for data management and trial management staff. The percentage increase in resources varied across different CTUs. The interviews identified possible explanations for differences, including (1) experience in adaptive trials, (2) the complexity of the non-adaptive and adaptive design, and (3) the extent of non-trial specific core infrastructure funding the CTU had. Conclusions This work sheds light on additional resources required to adequately support a high-quality adaptive trial. The percentage increase in costs for supporting an adaptive trial was generally modest and should not be a barrier to adaptive designs being cost-effective to use in practice. Informed by the results of this research, guidance for investigators and funders will be developed on appropriately resourcing adaptive trials.

Measuring the effects of a personalized music intervention on agitated behaviors among nursing home residents with dementia: design features for cluster-randomized adaptive trial

Background Agitated and aggressive behaviors (behaviors) are common in nursing home (NH) residents with dementia. Medications commonly used to manage behaviors have dangerous side effects. NHs are adopting non-pharmacological interventions to manage behaviors, despite a lack of effectiveness evidence and an understanding of optimal implementation strategies. We are conducting an adaptive trial to evaluate the effects of personalized music on behaviors. Adaptive trials may increase efficiency and reduce costs associated with traditional RCTs by learning and making modifications to the trial while it is ongoing. Methods We are conducting two consecutive parallel cluster-randomized trials with 54 NHs in each trial (27 treatment, 27 control). Participating NHs were recruited from 4 corporations which differ in size, ownership structure, geography, and residents’ racial composition. After randomization, there were no significant differences between the NHs randomized to each trial with respect to baseline behaviors, number of eligible residents, degree of cognitive impairment, or antipsychotic use. Agitated behavior frequency is assessed via staff interviews (primary outcome), required nursing staff conducted resident assessments (secondary outcome), and direct observations of residents (secondary outcome). Between the two parallel trials, the adaptive design will be used to test alternative implementation strategies, increasingly enroll residents who are likely to benefit from the intervention, and seamlessly conduct a stage III/IV trial. Discussion This adaptive trial allows investigators to estimate the impact of a popular non-pharmaceutical intervention (personalized music) on residents’ behaviors, under pragmatic, real-world conditions testing two implementation strategies. This design has the potential to reduce the research timeline by improving the likelihood of powered results, increasingly enrolling residents most likely to benefit from intervention, sequentially assessing the effectiveness of implementation strategies in the same trial, and creating a statistical model to reduce the future need for onsite data collection. The design may also increase research equity by enrolling and tailoring the intervention to populations otherwise excluded from research. Our design will inform pragmatic testing of other interventions with limited efficacy evidence but widespread stakeholder adoption because of the real-world need for non-pharmaceutical approaches. {2a} Trial registration ClinicalTrials.govNCT03821844. Registered on January 30, 2019. This trial registration meets the World Health Organization (WHO) minimum standard.

Controlled evaLuation of Angiotensin Receptor Blockers for COVID-19 respIraTorY disease (CLARITY): Statistical analysis plan for a randomised controlled Bayesian adaptive sample size trial

The CLARITY trial (Controlled evaLuation of Angiotensin Receptor Blockers for COVID-19 respIraTorY Disease) investigates the effectiveness of angiotensin receptor blockers in addition to standard care compared to placebo (in Indian sites) with standard care in reducing the duration and severity of lung failure in patients with COVID-19. The CLARITY trial is a multi-centre, randomised controlled Bayesian adaptive trial with regular planned analyses where pre-specified decision rules will be assessed to determine whether the trial should be stopped due to sufficient evidence of treatment effectiveness or futility. Here we describe the statistical analysis plan for the trial, and define the pre-specified decision rules, including those that could lead to the trial being halted. The primary outcome is clinical status on a 7-point ordinal scale adapted from the WHO Clinical Progression scale assessed at Day 14. The primary analysis will follow the intention-to-treat principle. A Bayesian adaptive trial design was selected because there is considerable uncertainty about the extent of potential benefit of this treatment.

Value of Adaptive Trials and Surrogate Endpoints for Clinical Decision-Making in Rare Cancers

Despite high-level endorsement, the number of adaptive Phase II/III trials in rare cancers needs to be improved, with better understanding of their value for clinical decisions in daily practice. This paper describes approaches to trial design in rare cancers, which has been supplemented by a search of ClinicalTrials.gov for adaptive trial designs in rare cancer. In addition, an online survey of 3,200 oncologists was conducted. Practicing physicians were questioned on the importance of different evidence levels, types of adaptive trial design, and categories of surrogate endpoints for clinical decision making. The results of the online survey revealed that evidence from Phase II/III trials with an adaptive design and relatively small sample size was considered high value in rare cancer by 97% of responders, similar to the randomized controlled trial rating (82%). Surrogate clinical endpoints were considered valuable alternatives to overall survival by 80% of oncologists. Preferred adaptive designs were futility analysis, interim analysis, adaptive sample size, and adaptive randomization. In conclusion, rare cancer oncologists rate evidence from adaptive clinical trials with as high a value and importance for clinical decision making processes as conventional randomized controlled trials. All stakeholders have a vested interest in advances in clinical trial designs to ensure efficient and timely development of innovative medicinal products to allow more patients faster access to the pivotal treatment.