AbstractBackgroundReal-world data are receiving attention from regulators, biopharmaceuticals and payors as a potential source of clinical evidence. However, the suitability of these data to produce evidence commensurate with randomized controlled trials (RCTs) and the best practices in their use remain unclear. We sought to compare the real-world effectiveness of Tofacitinib in the treatment of IBD against efficacy rates published by corresponding RCTs.MethodsElectronic health records at the University of California, San Francisco (UCSF) were queried and reviewed to identify 86 Tofacitinib-treated IBD patients through 4/2019. The primary endpoint was treatment effectiveness. This was measured by time-to-treatment-discontinuation and by the primary endpoints of RCTs in Ulcerative Colitis (UC) and Crohn’s Disease (CD). Endpoints were measured and analyzed following a previously published protocol and analysis plan.Findings86 patients (68 with UC, 18 with CD) initiated Tofacitinib for IBD treatment. Most of the data needed to calculate baseline and follow-up disease activity indices were documented within the EHR(77% for UC, 91% for CD). Baseline characteristics of the UCSF and RCT cohorts were similar, except for a longer disease duration and 100% treatment failure of Tumor Necrosis Factor inhibitors in the former. None of the UCSF cohort would have met the RCT eligibility criteria due to multiple reasons.The rate of achieving the RCT primary endpoints were highly similar to the published rates for both UC(16%, P=0·5) and CD (38%, P=0·8). However, treatment persistence was substantially higher: 69% for UC (week 52) and 75% for CD (week 26).InterpretationAn analysis of routinely collected clinical data can reproduce published Tofacitinib efficacy rates, but also indicates far greater treatment durability than suggested by RCTs including possible benefit in CD. These results underscore the value of real-world studies to complement RCTs.FundingThe National Institutes of Health and UCSF Bakar InstituteResearch in ContextEvidence before this studyTofacitinib is the most recently approved treatment for Ulcerative Colitis. Data related to treatment efficacy for either IBD subtype is generally limited, whether from controlled trials or real-world studies. A search of clinicaltrials.gov was performed in January 2019 for completed phase 2 or 3, interventional, placebo-controlled clinical trials matching the terms “Crohn’s Disease” OR “Ulcerative Colitis” in the conditions field, and matching “Placebo” AND “Tofacitinib” OR “CP-690,550”) in the Interventions field. We identified three Phase 3 trials for UC (OCTAVE trials, all initially reported in a single article in 2016) and three Phase 2 trials of CD (two published in the same article in 2017, one reported in 2014). The Phase 3 UC trials reported 57·6% pooled clinical response rate in the Tofacitinib-assigned groups after 8 weeks (induction), and a 37·5% pooled remission rate among eligible induction trial responders in the Tofacitinib-assigned groups at 52 weeks. The 2017 CD trial reported a 70·8% pooled rate of response or remission in the Tofacitinib-assigned groups after 8 weeks, and a 47·6% pooled rate of response or remission among enrolled induction-trial responders at 26 weeks. A bias assessment of both UC and CD trials indicated a high risk of attrition bias and unclear risk of bias related to conflicts of interest. We also performed a search of pubmed.gov in January 2019 using search terms (“Colitis” OR “Crohn’s”) AND (“Tofacitinib” OR “CP-690,550”) OR “real-world” to identify cohort studies of Tofacitinib efficacy in routine clinical practice. No studies meeting these criteria were identified.Added value of this studyThis is one of the early studies to closely compare the results of clinical trials with the continuously-updated data captured in the electronic health records, and the very the first to assess the efficacy-effectiveness gap for Tofacitinib. We found that none of the patients treated at our center thus far would have qualified for the clinical trial based on published eligibility criteria. We found that the drug appeared to perform similarly to its efficacy when using the endpoints reported in clinical trials, but treatment persistence was significantly greater than would have been expected from the reported trial outcomes: 69% for UC at week 52 and 75% for CD at week 26.Implications of all the available evidenceTofacitinib is an effective treatment for the Ulcerative colitis and may be efficacious for Crohn’s disease. Controlled trials may not be representative of real-world cohorts, may not be optimally designed to identify efficacious drugs, and may not accurately predict patterns of use in clinical practice. Further studies using real-world data as well as methods to enable their proper use are needed to confirm and continuously monitor the efficacy and safety of drugs, both for on- and off-label use.
Real-World Data for Planning Eligibility Criteria and Enhancing Recruitment: Recommendations from the Clinical Trials Transformation Initiative
