How Can We Make More Rapid Progress in the Leveraging of Real-World Evidence by Regulatory Decision Makers?

2021 ◽  
Author(s):  
Marc L. Berger ◽  
William Crown
Author(s):  
Jessica M. Franklin ◽  
Kai‐Li Liaw ◽  
Solomon Iyasu ◽  
Cathy Critchlow ◽  
Nancy Dreyer

Yakhak Hoeji ◽  
2020 ◽  
Vol 64 (2) ◽  
pp. 136-155
Author(s):  
Hi Gin Sung ◽  
Han-Heui Park ◽  
Gyu-Won Jung ◽  
Ju-Young Shin

2021 ◽  
Author(s):  
Yidi Huang ◽  
William Yuan ◽  
Isaac S. Kohane ◽  
Brett K. Beaulieu-Jones

AbstractCase-control study designs are commonly used in retrospective analyses of Real-World Evidence (RWE). Due to the increasingly wide availability of RWE, it can be difficult to determine whether findings are robust or the result of testing multiple hypotheses. We investigate the potential effects of modifying cohort definitions in a case-control association study between depression and Type 2 Diabetes Mellitus (T2D). We found that small permutations to the criteria used to define the control population result in significant shifts in both the demographic structure of the identified cohort as well as the odds ratio of association. These differences remain present when testing against age and sex-matched controls. We believe this offers strong support for the need for robust guidelines, best practices and regulations around the use of observational RWE for clinical or regulatory decision making.


2019 ◽  
Vol 26 (11) ◽  
pp. 1189-1194 ◽  
Author(s):  
Tina Hernandez-Boussard ◽  
Keri L Monda ◽  
Blai Coll Crespo ◽  
Dan Riskin

Abstract Objective With growing availability of digital health data and technology, health-related studies are increasingly augmented or implemented using real world data (RWD). Recent federal initiatives promote the use of RWD to make clinical assertions that influence regulatory decision-making. Our objective was to determine whether traditional real world evidence (RWE) techniques in cardiovascular medicine achieve accuracy sufficient for credible clinical assertions, also known as “regulatory-grade” RWE. Design Retrospective observational study using electronic health records (EHR), 2010–2016. Methods A predefined set of clinical concepts was extracted from EHR structured (EHR-S) and unstructured (EHR-U) data using traditional query techniques and artificial intelligence (AI) technologies, respectively. Performance was evaluated against manually annotated cohorts using standard metrics. Accuracy was compared to pre-defined criteria for regulatory-grade. Differences in accuracy were compared using Chi-square test. Results The dataset included 10 840 clinical notes. Individual concept occurrence ranged from 194 for coronary artery bypass graft to 4502 for diabetes mellitus. In EHR-S, average recall and precision were 51.7% and 98.3%, respectively and 95.5% and 95.3% in EHR-U, respectively. For each clinical concept, EHR-S accuracy was below regulatory-grade, while EHR-U met or exceeded criteria, with the exception of medications. Conclusions Identifying an appropriate RWE approach is dependent on cohorts studied and accuracy required. In this study, recall varied greatly between EHR-S and EHR-U. Overall, EHR-S did not meet regulatory grade criteria, while EHR-U did. These results suggest that recall should be routinely measured in EHR-based studes intended for regulatory use. Furthermore, advanced data and technologies may be required to achieve regulatory grade results.


2021 ◽  
Vol 8 ◽  
Author(s):  
Meng Li ◽  
Shengqi Chen ◽  
Yunfeng Lai ◽  
Zuanji Liang ◽  
Jiaqi Wang ◽  
...  

Real world evidence (RWE) and real-world data (RWD) are drawing ever-increasing attention in the pharmaceutical industry and drug regulatory authorities (DRAs) all over the world due to their paramount role in supporting drug development and regulatory decision making. However, there is little systematic documentary analysis about how RWE was integrated for the use by the DRAs in evaluating new treatment approaches and monitoring post-market safety. This study aimed to analyze and discuss the integration of RWE into regulatory decision-making process from the perspective of DRAs. Different development strategies to develop and adopt RWE by the DRAs in the US, Europe, and China were reviewed and compared, and the challenges encountered were discussed. It was found that different strategies on development of RWE were applied by FDA, EMA, and NMPA. The extent to which RWE was adopted in China was relatively limited compared to that in the US and EU, which was highly related to the national pharmaceutical environment and development stages. A better understanding of the overall goals, inputs, activities, outputs, and outcomes in developing RWE will help inform actions to harness RWD and leverage RWE for better health care decisions.


2021 ◽  
Vol 7 ◽  
pp. 205520762110599
Author(s):  
Ariel B. Bourla ◽  
Neal J. Meropol

Real world data (RWD) are data relating to patient health status and/or the delivery of health care routinely collected from a variety of sources; real-world evidence (RWE) generated by RWD analyses can become an important component of drug development programs and, potentially, regulatory decision-making. As a RWD source, electronic health records (EHRs) can now provide patient-level data at unparalleled depth and granularity. We propose a RWE generation framework that could maximize the synergy between RWD and prospective clinical trials by capitalizing on an emerging data curation infrastructure that may be applied to both retrospective and prospective research. In this platform, centralized data collection and monitoring could be enabled via routine EHR use, and seamlessly integrated with select intentional data capture during prospective study periods. By bridging the divide between routine care and clinical research, this integrated platform aggregates retrospective and prospective data, collected both routinely and intentionally. This approach makes clinical trial participation more available to patients, increasing the potential depth of data, representativeness and efficiency of clinical research.


2020 ◽  
Vol 29 (10) ◽  
pp. 1228-1235 ◽  
Author(s):  
Mehmet Burcu ◽  
Nancy A. Dreyer ◽  
Jessica M. Franklin ◽  
Michael D. Blum ◽  
Cathy W. Critchlow ◽  
...  

Blood ◽  
2021 ◽  
Vol 138 (Supplement 1) ◽  
pp. 5037-5037
Author(s):  
Donna R. Rivera ◽  
Jennifer J Lee ◽  
Melanie Royce ◽  
R. Angelo de Claro ◽  
Nicole J. Gormley ◽  
...  

Abstract Background Aligning with 21st Century Cures legislation, FDA is exploring methodologies to advance appropriate uses of Real World Data (RWD) to generate Real World Evidence (RWE). RWD to support regulatory decision making has markedly increased in oncology. This review specifically focused on the analysis of RWD containing submissions for medical products in development for the treatment of hematological malignancies and associated treatment related conditions (e.g., Cytokine Release Syndrome (CRS), Graft Versus Host Disease (GVHD). Methods A systematic search was conducted using internal FDA databases to identify RWD submissions from 2010 to 2020. Search terms included: real world evidence, real world data, electronic health record, cancer registry, administrative claims, external control arm, observational cohort, historical control arm, real world Overall Survival (rwOS) , real world Response Rate (rwRR), real world Overall Response Rate rwORR and real world Complete Response (rwCR). Regulatory submissions specific to malignant hematology and associated treatment related conditions were reviewed, and pre-defined common data elements were extracted and validated by independent dual review. Descriptive statistics were calculated. Results A total of 142 regulatory submissions included RWD from 2011-2020. A subset of 94 RWD submissions met the criteria for further evaluation, of which 20 (21%) submissions corresponding with 14 molecular entities were for hematologic malignancies or treatment related conditions (e.g., CRS, GVHD). RWD submissions increased substantially over time, with 14 (70%) of submissions received between 2019-2020. Specific evaluation for pediatric indications was referenced in 15% of submissions. The most commonly referenced RWD source was EHR data (55%), followed by use of multiple sources (20%), and registry data (15%). Approximately 90% of the submissions aimed to support treatment effectiveness. Primary RWD study objectives included supporting approval of a new molecular entity (NME) (40%), expanding an approved indication (25%), conversion from accelerated to regular approval (15%), and providing data to inform postmarketing safety evaluation (20%). Among RWD submissions, response endpoints (e.g., rwORR, rwCR, rwPR, Partial Response) and overall survival (e.g., rwOS) were most frequently selected as primary outcomes for 50% and 20% of proposals respectively; however, these outcomes were included as any endpoint in 65% and 75% of submissions. Conclusion This review demonstrates increasing use of various RWD sources to support evidence generation for drug development in hematologic malignancies and associated treatment related conditions with the primary objective of supporting demonstration of effectiveness using rwOS or real world response measures as primary endpoints. Given the increased inclusion of RWD in regulatory submissions, further methodological development is needed, including in the selection and validation of rwEndpoints. Appropriate study design must be aligned with a clear regulatory objective to ensure that RWD can be adequately evaluated. Additionally, the development of standardized metrics for data characterization and transparency in reporting of RWD are foundational steps to the evaluation of fit for purpose RWD to support regulatory decision making. Disclosures No relevant conflicts of interest to declare.


BMJ Open ◽  
2018 ◽  
Vol 8 (6) ◽  
pp. e021864 ◽  
Author(s):  
Kelly Plueschke ◽  
Patricia McGettigan ◽  
Alexandra Pacurariu ◽  
Xavier Kurz ◽  
Alison Cave

Sign in / Sign up

Export Citation Format

Share Document