Protecting clinical trials in cystic fibrosis during the SARS-CoV-2 pandemic: risks and mitigation measures

The SARS-CoV-2 pandemic has disrupted clinical trials worldwide. The European Cystic Fibrosis Society-Clinical Trials Network (ECFS-CTN) has tracked clinical trial disruption by surveying its 58 trial sites across 17 European countries and collated information on measures to mitigate the impact of the pandemic and ensure trial continuity. Here, we present recommendations on how to reduce the risk of SARS-CoV-2 exposure to patients and trial staff by implementing remote trial visits where possible, using home assessments, video and phone calls, electronic consent, and home delivery of study drugs. We discuss the practicalities of remote source data verification, protocol amendments, changing trial site location, and staff absences and home working. We outline recommendations on how to protect trial outcomes, including home assessments, safety reporting, protocol deviations, and recruitment challenges. Finally, we discuss the importance of continued access to study drugs via extension trials for some patients. This guidance was co-created from the shared knowledge and experience of sites in our network and was re-distributed directly to all ECFS-CTN sites to help mitigate the impact of further waves of the SARS-CoV-2 pandemic. We will also use this guidance to assist companies, academia, and consortia with future protocol design and risk mitigation plans. This guidance can be applied to clinical trials in other diseases and could help sites that are not supported by clinical trial networks.

Risk-Based Monitoring in Clinical Trials: Past, Present, and Future

Risk-based monitoring (RBM) is a powerful tool for efficiently ensuring patient safety and data integrity in a clinical trial, enhancing overall trial quality. To better understand the state of RBM implementation across the clinical trial industry, the Association of Clinical Research Organizations (ACRO) conducted a landscape survey among its member companies across 6,513 clinical trials ongoing at the end of 2019. Of these trials, 22% included at least 1 of the 5 RBM components: key risk indicators (KRIs), centralized monitoring, off-site/remote-site monitoring, reduced source data verification (SDV), and reduced source document review (SDR). The implementation rates for the individual RBM components ranged 8%–19%, with the most frequently implemented component being centralized monitoring and the least frequently implemented being reduced SDR. When the COVID-19 pandemic emerged in early 2020, additional data were collected to assess its impact on trial monitoring, focusing specifically on trials switching from on-site monitoring to off-site/remote-site monitoring. These mid-pandemic data show that the vast majority of monitoring visits were on-site in February 2020, but an even higher percentage were off-site in April, corresponding with the first peak of the pandemic. Despite this shift, similar numbers of non-COVID-related protocol deviations were detected from February through June, suggesting little or no reduction in monitoring effectiveness. The pre- and mid-pandemic data provide two very different snapshots of RBM implementation, but both support the need to promote adoption of this approach while also highlighting an opportunity to capitalize on the recent shift toward greater RBM uptake in a post-pandemic environment.

Protecting Clinical Trials in Cystic Fibrosis; COVID-19 Mitigation Measures Crowd Sourced from the European Cystic Fibrosis Society Clinical Trials Network

The SARS-CoV-2 pandemic has disrupted clinical trials worldwide. The European Cystic Fibrosis Society-Clinical Trials Network (ECFS-CTN) has tracked clinical trial disruption by surveying its 58 trial sites across 17 European countries and collated information on measures to mitigate the impact of the pandemic and ensure trial continuity. Here we present recommendations on how to reduce the risk of SARS-CoV-2 exposure to patients and trial staff by implementing remote trial visits where possible, using home assessments, video and phone calls, electronic consent and home delivery of study drug. We discuss the practicalities of remote source data verification, protocol amendments, changing trial site location, and staff absences and home working. We outline how to protect trial outcomes, including home assessments, safety reporting, protocol deviations and recruitment challenges. Finally, we discuss the importance of continued access to study drug via extension trials for some patients. This guidance was co-created from the shared knowledge and experience of sites in our network and was re-distributed directly to all ECFS-CTN sites to help mitigate the impact of further waves of the SARS-CoV-2 pandemic. We will also use this guidance to assist companies, academia and consortia with future protocol design and risk mitigation plans.

Evaluation of Data Errors and Monitoring Activities in a Trial in Japan Using a Risk-Based Approach Including Central Monitoring and Site Risk Assessment

Background Risk-based monitoring (RBM) is a slow uptake in some trial sponsors. There are three main reasons for this. First, there is the fear of making large investments into advanced RBM technology solutions. Second, it is considered that RBM is most suitable for large, complex trials. Third, there is the fear of errors in both critical and non-critical data, appearing as reduced on-site monitoring is being conducted. Methods Our RBM team identified, evaluated, and mitigated trial risks, as well as devised a monitoring strategy. The clinical research associate (CRA) assessed the site risks, and the RBM team conducted central monitoring. We compared all data errors and on-site monitoring time between the partial switching sites [sites that had switched to partial source data verification (SDV) and source data review (SDR)] and the 100% SDV and SDR sites (sites that had implemented 100% SDV and SDR). Results Partial switching sites did not require any critical data correction and had a smaller number of data corrections through on-site monitoring than the 100% SDV and SDR sites. The RBM strategy reduced the on-site monitoring time by 30%. Conclusions The results suggest that RBM can be successfully implemented through the use of site risk assessment and central monitoring with practically no additional investment in technology and still produced similar results in terms of subject safety and data quality, as well as the cost savings that have been reported in global complex studies.

Data quality methods through remote source data verification auditing: results from the Congenital Cardiac Research Collaborative

Background: Multicentre research databases can provide insights into healthcare processes to improve outcomes and make practice recommendations for novel approaches. Effective audits can establish a framework for reporting research efforts, ensuring accurate reporting, and spearheading quality improvement. Although a variety of data auditing models and standards exist, barriers to effective auditing including costs, regulatory requirements, travel, and design complexity must be considered. Materials and methods: The Congenital Cardiac Research Collaborative conducted a virtual data training initiative and remote source data verification audit on a retrospective multicentre dataset. CCRC investigators across nine institutions were trained to extract and enter data into a robust dataset on patients with tetralogy of Fallot who required neonatal intervention. Centres provided de-identified source files for a randomised 10% patient sample audit. Key auditing variables, discrepancy types, and severity levels were analysed across two study groups, primary repair and staged repair. Results: Of the total 572 study patients, data from 58 patients (31 staged repairs and 27 primary repairs) were source data verified. Amongst the 1790 variables audited, 45 discrepancies were discovered, resulting in an overall accuracy rate of 97.5%. High accuracy rates were consistent across all CCRC institutions ranging from 94.6% to 99.4% and were reported for both minor (1.5%) and major discrepancies type classifications (1.1%). Conclusion: Findings indicate that implementing a virtual multicentre training initiative and remote source data verification audit can identify data quality concerns and produce a reliable, high-quality dataset. Remote auditing capacity is especially important during the current COVID-19 pandemic.

Clinical trial monitoring effectiveness: Remote risk-based monitoring versus on-site monitoring with 100% source data verification

Background/Aims: Traditional on-site monitoring of clinical trials via frequent site visits and 100% source data verification is cost-consuming, and it still cannot guarantee data quality effectively. Depending on the types and designs of clinical trials, an alternative would be combining several monitoring methods, such as risk-based monitoring and remote monitoring. However, there is insufficient evidence of its effectiveness. This research compared the effectiveness of risk-based monitoring with a remote monitoring system with that of traditional on-site monitoring. Methods: With a cloud-based remote monitoring system called beagle View®, we created a remote risk-based monitoring methodology that focused only on critical data and processes. We selected a randomized controlled trial conducted at Tohoku University Hospital and randomly sampled 11 subjects whose case report forms had already been reviewed by data managers. Critical data and processes were verified retrospectively by remote risk-based monitoring; later, all data and processes were confirmed by on-site monitoring. We compared the ability of remote risk-based monitoring to detect critical data and process errors with that of on-site monitoring with 100% source data verification, including an examination of clinical trial staff workload and potential cost savings. Results: Of the total data points (n = 5617), 19.7% (n = 1105, 95% confidence interval = 18.7–20.7) were identified as critical. The error rates of critical data detected by on-site monitoring, remote risk-based monitoring, and data review by data managers were 7.6% (n = 84, 95% CI = 6.2–9.3), 7.6% (n = 84, 95% confidence interval = 6.2–9.3), and 3.9% (n = 43, 95% confidence interval = 2.9–5.2), respectively. The total number of critical process errors detected by on-site monitoring was 14. Of these 14, 92.9% (n = 13, 95% confidence interval = 68.5–98.7) and 42.9% (n = 6, 95% confidence interval = 21.4–67.4) of critical process errors were detected by remote risk-based monitoring and data review by data managers, respectively. The mean time clinical trial staff spent dealing with remote risk-based monitoring was 9.9 ± 5.3 (mean ± SD) min per visit per subject. Our calculations show that remote risk-based monitoring saved between 9 and 41 on-site monitoring visits, corresponding to a cost of between US$13,500 and US$61,500 per trial site. Conclusion: Remote risk-based monitoring was able to detect critical data and process errors as well as on-site monitoring with 100% source data verification, saving travel time and monitoring costs. Remote risk-based monitoring offers an effective alternative to traditional on-site monitoring of clinical trials.

Trial in Progress: A Real-World Cohort Study Reporting Patient Profiles, Clinical Outcomes, and Unmet Medical Need of Patients with Paroxysmal Nocturnal Hemoglobinuria Treated with Eculizumab in the Essen Center in Germany

Background Paroxysmal nocturnal hemoglobinuria (PNH) is a life-threatening disease of dysregulated complement activation. It is a rare disease with an estimated incidence of 1 to 1.5 cases per million people globally. Eculizumab is a humanized monoclonal anti-complement component 5 antibody that was approved for the treatment of patients with PNH in the United States and European Union in 2007, yet unmet medical needs remain. Up to half of patients continue to require blood transfusions despite treatment with eculizumab, and hemolytic activity remains detectable in many patients (Brodsky et al. Blood. 2008). Eculizumab is not available in many countries. In places where treatment is approved, there are further impediments to access, such as cost of treatment, reimbursement issues, infrastructure limitations, and patient restrictions (Risitano et al. Am J Hematol. 2018; Risitano et al. Front Immunol. 2019). Data published on real-world outcomes of eculizumab are limited. Here we describe a study that will retroactively analyze data from patients with PNH treated with eculizumab at the Essen University Hospital in Germany. Study Design and Methods This retrospective, secondary data use, cohort study will include all patients at the Essen University Hospital who were diagnosed with PNH and treated with eculizumab prior to April 2018. Clinical data from medical records were entered into an electronic case report form (eCRF). Source data verification has been performed for all clinical data. Laboratory data were extracted directly from the hospital computer system. The Essen University hospital also checked and verified missing laboratory data. Patient-level data in the eCRF and laboratory data were fully anonymized. The primary objective of the study is to understand the remaining unmet medical need by describing the eculizumab dose and frequency of dose adjustment and describing the proportions of patients who experience intravascular and extravascular hemolysis while on treatment. The secondary objectives include explorations of the association between lactate dehydrogenase (LDH) and hemoglobin stabilization with clinical outcomes (eg, breakthrough hemolysis and the need for red blood cell transfusion), the association between PNH clone size and clinical outcomes and the risk of thrombosis, the changes in LDH and hemoglobin levels over time, the need for red blood cell transfusion during eculizumab treatment, and the proportion of eculizumab-treated patients with positive monospecific Coombs test results. In addition, opportunities to apply machine-learning methodologies to predict patients who may not respond to eculizumab will be explored. Many of the analyses will be descriptive. The associations between LDH and hemoglobin with clinical outcomes will be evaluated using rank correlation coefficients or logistic regression. Multivariable regression will be used to explore the prognostic value of clone size on clinical outcomes and thrombosis events. This retrospective study includes 85 patients with PNH with complete clinical and laboratory data (Table). The median age of the cohort was 38 years old, and the cohort was split evenly between men and women. Many patients received a diagnosis of PNH prior to the availability of eculizumab, as the year of diagnosis was 2010 or earlier for 53 patients (62%). The median years of follow-up from initiation of eculizumab was 4.7 years. Overall, 34% had aplastic anemia at diagnosis, and symptoms of fatigue, abdominal pain, and kidney failure were reported in 60%, 34%, and 15%, respectively. At data cutoff, 92% of patients were still alive. Summary The patient demographics in this study are comparable to other studies in PNH, suggesting a representative population. With median follow-up time of nearly 5 years, this study will allow for a long-term assessment of the patient experience with eculizumab. High-quality study data is ensured via full source data verification of clinical data and verification of missing laboratory data. These study results will help to address many research questions in PNH, identify the remaining unmet medical need, and also inform new drug development. Disclosures Versmold: F. Hoffmann-La Roche Ltd: Other: All authors received support for third party writing assistance, furnished by Scott Battle, PhD, provided by F. Hoffmann-La Roche, Basel, Switzerland.. Raiser:F. Hoffmann-La Roche Ltd: Other: All authors received support for third party writing assistance, furnished by Scott Battle, PhD, provided by F. Hoffmann-La Roche, Basel, Switzerland.. Faghmous:F. Hoffmann-La Roche Ltd: Ended employment in the past 24 months, Other: All authors received medical writing support for this abstract, furnished by Scott Battle, funded by F. Hoffmann-La Roche Ltd, Basel, Switzerland. ; Kite Pharma: Current Employment. Katz:F. Hoffmann-La Roche Ltd: Current Employment, Other: All authors received support for third party writing assistance, furnished by Scott Battle, PhD, provided by F. Hoffmann-La Roche, Basel, Switzerland.. Shang:F. Hoffmann-La Roche Ltd: Current Employment, Current equity holder in publicly-traded company, Other: All authors received support for third party writing assistance, furnished by Scott Battle, PhD, provided by F. Hoffmann-La Roche, Basel, Switzerland.. Xu:F. Hoffmann-La Roche Ltd: Current Employment, Other: All authors received support for third party writing assistance, furnished by Scott Battle, PhD, provided by F. Hoffmann-La Roche, Basel, Switzerland.. Röth:Novartis: Consultancy, Honoraria; Roche: Consultancy, Honoraria, Research Funding; Sanofi: Consultancy, Honoraria; Biocryst: Consultancy, Honoraria; Apellis: Consultancy, Honoraria; Alexion Pharmaceuticals Inc.: Consultancy, Honoraria, Research Funding.

4500 Providing a System for Practical Monitoring Training for Clinical Trials within Academic Institutions

OBJECTIVES/GOALS: The goal was to understand the effectiveness of a novel clinical trial educational module and a corresponding initiative designed and disseminated by the Southern California Clinical and Translational Science Institute (SC-CTSI) to increase the quality of clinical trials conducted in academia. METHODS/STUDY POPULATION: The CRCs (Clinical Research Coordinators) for the initiative are asked to complete the online training. Possible study protocols are picked to be monitored by the CRCs. The monitor is instructed to study the protocol extensively and prepare for their monitoring visit. The trained monitor from the initiative then reaches out to the CRC of the study that is to be monitored and carries out the monitoring visit. Afterwards, the monitor sends initiative personnel the monitoring report, which is evaluated to see if the monitor checked everything they should have during the visit. The PI of the study is contacted with highlights from the monitoring report and improvements that they can make. RESULTS/ANTICIPATED RESULTS: The first study monitored was a site of a large NIH-sponsored study where the consent forms were signed electronically. It was found that the monitor could not access the consent forms. Therefore, the monitor could not do source data verification. The PI of the study said that they would be raising this issue with the NIH. During the monitoring visit of the second study chosen for the initiative, patient binders were specifically examined for informed consent and source documentation completeness. The charts of patients were also reviewed. The only deviation found was a missing signature in the Investigator Site File. For the last two studies, data will be reported. DISCUSSION/SIGNIFICANCE OF IMPACT: Monitors were not only able to monitor efficiently, but also able to point out deficiencies in the monitoring practices of large studies. This model could be expanded to other academic institutions to establish quality management systems to ensure data integrity and subject protection.