scholarly journals Real-world evidence to support Payer/HTA decisions about highly innovative technologies in the EU—actions for stakeholders

2020 ◽  
Vol 36 (4) ◽  
pp. 459-468 ◽  
Author(s):  
Karen M. Facey ◽  
Piia Rannanheimo ◽  
Laura Batchelor ◽  
Marine Borchardt ◽  
Jo de Cock
Keyword(s):  
Real World ◽  
Evidence Base ◽  
Real World Data ◽  
Innovative Technologies ◽  
Strategic Intent ◽  
Methods Development ◽  
Learning Health System ◽  
Real World Evidence ◽  
Technology Life Cycle

ObjectivesThere are divergent views on the potential of real-world data (RWD) to inform decisions made by regulators, health technology assessment (HTA) bodies, payers, clinicians, and patients. This RWE4Decisions initiative explored the particularly challenging setting of highly innovative technologies, which require Payers/HTAs to make decisions on a small evidence base with major uncertainties. The aim was to go beyond strategic intent to consider actions that each stakeholder could take to improve use of RWD in this setting.ResultsCase studies of recent Payer/HTA decisions about highly innovative technologies were considered in light of recent international initiatives about RWD. This showed a lack of clarity about the Payer/HTA questions that could be answered by RWD and how the quality of real-world evidence (RWE) could be assessed. All stakeholders worked together to create a vision whereby stakeholders agree what RWD can be collected for highly innovative technologies based on principles of collaboration and transparency. For each stakeholder group, recommended actions to support the generation, analysis, and interpretation of RWD to inform decision making were developed. For HTA bodies, this includes cross border HTA/regulatory collaboration to agree RWD requirements over the technology life cycle to inform initial recommendations and reassessment, data analytics methods development for HTA, and promotion of transparency in RWE studies.RecommendationsStakeholders need to collaborate on demonstration projects to consider how RWE can be developed to inform healthcare decisions and contribute to a learning network that can develop systems to support a learning health system and improve patient outcomes through best use of RWD.

scholarly journals The Expanding Role of Real-World Evidence Trials in Health Care Decision Making

2019 ◽  
Vol 14 (1) ◽  
pp. 174-179 ◽  
Author(s):  
David C. Klonoff
Keyword(s):  
Real World ◽  
Clinical Evidence ◽  
Real World Data ◽  
Medical Products ◽  
Advantages And Disadvantages ◽  
Randomized Controlled ◽  
Real World Evidence ◽  
Care Decision

Real-world evidence (RWE) is the clinical evidence about benefits or risks of medical products derived from analyzing real world data (RWD), which are data collected through routine clinical practice. This article discusses the advantages and disadvantages of RWE studies, how these studies differ from randomized controlled trials (RCTs), how to overcome barriers to current skepticism about RWE, how FDA is using RWE, how to improve the quality of RWE, and finally the future of RWE trials.

scholarly journals Increasing Trust in Real-World Evidence Through Evaluation of Observational Data Quality

2021 ◽  
Author(s):  
Clair Blacketer ◽  
Frank J Defalco ◽  
Patrick B Ryan ◽  
Peter R Rijnbeek
Keyword(s):  
Data Quality ◽  
Real World ◽  
R Package ◽  
Observational Research ◽  
Real World Data ◽  
Quality Reporting ◽  
Healthcare Data ◽  
Real World Evidence ◽  
Quality Checks

Advances in standardization of observational healthcare data have enabled methodological breakthroughs, rapid global collaboration, and generation of real-world evidence to improve patient outcomes. Standardizations in data structure, such as use of Common Data Models (CDM), need to be coupled with standardized approaches for data quality assessment. To ensure confidence in real-world evidence generated from the analysis of real-world data, one must first have confidence in the data itself. The Data Quality Dashboard is an open-source R package that reports potential quality issues in an OMOP CDM instance through the systematic execution and summarization of over 3,300 configurable data quality checks. We describe the implementation of check types across a data quality framework of conformance, completeness, plausibility, with both verification and validation. We illustrate how data quality checks, paired with decision thresholds, can be configured to customize data quality reporting across a range of observational health data sources. We discuss how data quality reporting can become part of the overall real-world evidence generation and dissemination process to promote transparency and build confidence in the resulting output. Transparently communicating how well CDM standardized databases adhere to a set of quality measures adds a crucial piece that is currently missing from observational research. Assessing and improving the quality of our data will inherently improve the quality of the evidence we generate.

Contributions of Real-World Evidence and Real-World Data to Decision-Making in the Management of Soft Tissue Sarcomas

Oncology ◽  
2021 ◽  
Vol 99 (Suppl. 1) ◽  
pp. 3-7
Author(s):  
George D. Demetri ◽  
Silvia Stacchiotti
Keyword(s):  
Decision Making ◽  
Soft Tissue ◽  
Real World ◽  
Soft Tissue Sarcomas ◽  
Clinical Settings ◽  
Disease Entity ◽  
Real World Data ◽  
World Data ◽  
Real World Evidence

Real-world data are defined as data relating to any aspect of a patient’s health status collected in the context of routine health surveillance and medical care delivery. Sources range from insurance billing claims through to electronic surveillance data (e.g., activity trackers). Real-world data derive from large populations in diverse clinical settings and thus can be extrapolated more readily than clinical trial data to patients in different clinical settings or with a variety of comorbidities. Real-world data are used to generate real-world evidence, which might be regarded as a “meta-analysis” of accumulated real-world data. Increasingly, regulatory authorities are recognizing the value of real-world data and real-world evidence, especially for rare diseases where it may be practically unfeasible to conduct randomized controlled trials. However, the quality of real-world evidence depends on the quality of the data collected which, in turn, depends on a correct pathological diagnosis and the homogeneous behaviour of a reliably defined and consistent disease entity. As each of the more than 80 varieties of soft tissue sarcoma (STS) types represents a distinct disease entity, the situation is exceedingly complicated. Discordant diagnoses, which affect data quality, present a major challenge for use of real-world data. As real-world data are difficult to collect, collaboration across sarcoma reference institutions and sophisticated information technology solutions are required before the potential of real-world evidence to inform decision-making in the management of STS can be fully exploited.

scholarly journals Border control and SARS-CoV-2: an opportunity for generating highly policy-relevant, real-world evidence

2021 ◽  
Author(s):  
Jacob Burns ◽  
Ani Movsisyan ◽  
Eva A Rehfuess ◽  
Jan M Stratil
Keyword(s):  
Real World ◽  
Evidence Base ◽  
Control Measures ◽  
Border Control ◽  
Combined Effects ◽  
Repeated Testing ◽  
Real World Data ◽  
World Data ◽  
Real World Evidence ◽  
Study Type

We propose a study type that would contribute to the evidence base related to border control measures. Over a study period during which arriving travellers are quarantined, repeated testing and/or screening at regular intervals would provide real-world data on the relative and combined effects of various screening and testing measures.

scholarly journals Allergen immunotherapy: the growing role of observational and randomised trial “real-world evidence”

2021 ◽  
Author(s):  
Giovanni Paoletti ◽  
Danilo Di Bona ◽  
Derek Chu ◽  
Davide Firinu ◽  
Enrico Heffler ◽  
...  
Keyword(s):  
Real World ◽  
Allergen Immunotherapy ◽  
Clinical Decision Making ◽  
Randomised Trial ◽  
Unmet Need ◽  
Real Life ◽  
Real World Data ◽  
Level Of Evidence ◽  
Real World Evidence

Although there is a considerable body of knowledge about allergen immunotherapy (AIT), there is a lack of data on the reliability of real-world evidence (RWE) in AIT and consequently, a lack of information on how AIT effectively works in real life. To address the current unmet need for an appraisal of the quality of RWE in AIT, the European Academy of Allergy and Clinical Immunology Methodology Committee recently initiated a systematic review of observational studies of AIT, which will use the RELEVANT tool and the Grading of Recommendations Assessment, Development and Evaluation approach (GRADE) to rate the quality of the evidence base as a whole. The next step will be to develop a broadly applicable, pragmatic “real-world” database using systematic data collection. Based on the current RWE base, and perspectives and recommendations of authorities and scientific societies, a hierarchy of RWE in AIT is proposed, which places pragmatic trials and registry data at the positions of highest level of evidence. There is a need to establish more AIT registries that collect data in a cohesive way, using standardised protocols. This will provide an essential source of real-world data that can be easily shared, promoting evidence-based research and quality improvement in study design and clinical decision-making.

scholarly journals Real-world evidence: perspectives on challenges, value, and alignment of regulatory and national health technology assessment data collection requirements

2021 ◽  
Vol 37 ◽  
Author(s):  
Hannah Sievers ◽  
Angelika Joos ◽  
Mickaël Hiligsmann
Keyword(s):  
Health Technology Assessment ◽  
Technology Assessment ◽  
Real World ◽  
Health Technology ◽  
Practical Experience ◽  
Added Value ◽  
Real World Data ◽  
Conflicting Demands ◽  
Real World Evidence ◽  
Semistructured Interviews

Abstract Objective This study aims to assess stakeholder perceptions on the challenges and value of real-world evidence (RWE) post approval, the differences in regulatory and health technology assessment (HTA) real-world data (RWD) collection requirements under the German regulation for more safety in drug supply (GSAV), and future alignment opportunities to create a complementary framework for postapproval RWE requirements. Methods Eleven semistructured interviews were conducted purposively with pharmaceutical industry experts, regulatory authorities, health technology assessment bodies (HTAbs), and academia. The interview questions focused on the role of RWE post approval, the added value and challenges of RWE, the most important requirements for RWD collection, experience with registries as a source of RWD, perceptions on the GSAV law, RWE requirements in other countries, and the differences between regulatory and HTA requirements and alignment opportunities. The interviews were recorded, transcribed, and translated for coding in Nvivo to summarize the findings. Results All experts agree that RWE could close evidence gaps by showing the actual value of medicines in patients under real-world conditions. However, experts acknowledged certain challenges such as: (i) heterogeneous perspectives and differences in outcome measures for RWE generation and (ii) missing practical experience with RWD collected through mandatory registries within the German benefit assessment due to an unclear implementation of the GSAV. Conclusions This study revealed that all stakeholder groups recognize the added value of RWE but experience conflicting demands for RWD collection. Harmonizing requirements can be achieved through common postlicensing evidence generation (PLEG) plans and joint scientific advice to address uncertainties regarding evidence needs and to optimize drug development.

scholarly journals Generating real-world evidence from unstructured clinical notes to examine clinical utility of genetic tests: use case in BRCAness

2021 ◽  
Vol 21 (1) ◽  
Author(s):  
Yiqing Zhao ◽  
Saravut J. Weroha ◽  
Ellen L. Goode ◽  
Hongfang Liu ◽  
Chen Wang
Keyword(s):  
Targeted Therapy ◽  
Data Quality ◽  
Real World ◽  
Genetic Information ◽  
Genetic Data ◽  
Real World Data ◽  
Rule Based ◽  
Clinical Notes ◽  
Real World Evidence ◽  
F Measure

Abstract Background Next-generation sequencing provides comprehensive information about individuals’ genetic makeup and is commonplace in oncology clinical practice. However, the utility of genetic information in the clinical decision-making process has not been examined extensively from a real-world, data-driven perspective. Through mining real-world data (RWD) from clinical notes, we could extract patients’ genetic information and further associate treatment decisions with genetic information. Methods We proposed a real-world evidence (RWE) study framework that incorporates context-based natural language processing (NLP) methods and data quality examination before final association analysis. The framework was demonstrated in a Foundation-tested women cancer cohort (N = 196). Upon retrieval of patients’ genetic information using NLP system, we assessed the completeness of genetic data captured in unstructured clinical notes according to a genetic data-model. We examined the distribution of different topics regarding BRCA1/2 throughout patients’ treatment process, and then analyzed the association between BRCA1/2 mutation status and the discussion/prescription of targeted therapy. Results We identified seven topics in the clinical context of genetic mentions including: Information, Evaluation, Insurance, Order, Negative, Positive, and Variants of unknown significance. Our rule-based system achieved a precision of 0.87, recall of 0.93 and F-measure of 0.91. Our machine learning system achieved a precision of 0.901, recall of 0.899 and F-measure of 0.9 for four-topic classification and a precision of 0.833, recall of 0.823 and F-measure of 0.82 for seven-topic classification. We found in result-containing sentences, the capture of BRCA1/2 mutation information was 75%, but detailed variant information (e.g. variant types) is largely missing. Using cleaned RWD, significant associations were found between BRCA1/2 positive mutation and targeted therapies. Conclusions In conclusion, we demonstrated a framework to generate RWE using RWD from different clinical sources. Rule-based NLP system achieved the best performance for resolving contextual variability when extracting RWD from unstructured clinical notes. Data quality issues such as incompleteness and discrepancies exist thus manual data cleaning is needed before further analysis can be performed. Finally, we were able to use cleaned RWD to evaluate the real-world utility of genetic information to initiate a prescription of targeted therapy.

scholarly journals Real-world evidence data on the monoclonal antibody erenumab in migraine prevention: perspectives of treating physicians in Germany

2021 ◽  
Vol 22 (1) ◽  
Author(s):  
Andreas Straube ◽  
Philipp Stude ◽  
Charly Gaul ◽  
Katrin Schuh ◽  
Mirja Koch
Keyword(s):  
Quality Of Life ◽  
Monoclonal Antibody ◽  
Clinical Trials ◽  
Real World ◽  
Treatment Patterns ◽  
Patient Profile ◽  
Real World Evidence ◽  
Patient Profiles ◽  
Treatment Responses

Abstract Background Erenumab, the first-in-class fully human monoclonal antibody targeting the calcitonin gene-related peptide receptor, was shown to be efficacious and safe for the prophylactic treatment of migraine in adults in randomized clinical trials. Large-scale, real-world evidence in multi-centre settings is still needed to confirm these results. Erenumab patient profiles outside clinical trials and physicians’ treatment patterns, as well as data from patients treated in Germany, a severely impacted population, are not published yet. Methods TELESCOPE was a multi-centre survey gathering real-world data from 45 German headache centres between July 2019 and December 2019. The project consisted of two parts. In the first part, treating physicians shared their experiences on current erenumab treatment with regard to patient profiles, treatment patterns and treatment responses. In the second part, a retrospective chart review was conducted of 542 migraine patients treated with erenumab for at least three months. Treatment responses focused on various aspects of patients’ quality of life. Results The analysis of 542 patients’ charts revealed that three-month treatment with erenumab significantly reduced monthly headaches, migraine and acute medication days. Furthermore, headache intensity and frequency were reduced in over 75 % and accompanying aura in 35 % of patients. The clinical global impression scale revealed a general improvement in 91 % of patients. According to the treating physicians’ professional judgement, 83 % of patients responded to erenumab and 80 % were satisfied with the treatment. Physicians evaluated restricted quality of life, the number of monthly migraine days and previous, prophylactic treatments as the main components of the current patient profile for monoclonal antibody recipients. Based on the assessment of physicians, erenumab reduced migraine symptoms in 65 % and increased quality of life in more than 75 % of their patients. Conclusions TELESCOPE confirms positive treatment responses with erenumab shown in clinical trials in a real-world multi-centre setting. The results show consistently positive experiences of physicians utilizing erenumab in clinical practice and underline that therapy with this monoclonal antibody is effective in migraine patients, particular in those, who have failed several prophylactic therapies.

Sign in / Sign up

Export Citation Format

Share Document