scholarly journals PNS183 WHAT METHODS ARE APPLIED IN ASSESSESSING THE CLINICAL AND COST EFFECTIVENESS OF HEALTH TECHNOLOGIES BASED ON THE USE OF SURROGATE OUTCOMES: A COMPARISON OF EVALUATION REPORTS ACROSS INTERNATIONAL HEALTH TECHNOLOGY ASSESSMENT AGENCIES

2019 ◽  
Vol 22 ◽  
pp. S316
Author(s):  
O. Ciani ◽  
B. Grigore ◽  
R. Taylor
2017 ◽  
Vol 41 (1) ◽  
pp. 19 ◽  
Author(s):  
Anna Mae Scott

Objective Health technology assessment (HTA) is a process of assessing evidence to inform policy decisions about public subsidy of new drugs and medical procedures. Where evidence is uncertain but the technology itself is promising, funders may recommend funding on an interim basis. It is unknown whether evidence from clinical registries is used to resolve uncertainties identified in interim-funded decisions made by Australian HTA bodies. Therefore, the present study evaluated the role of evidence from clinical registries in resolving evidence uncertainties identified by the Medical Services Advisory Committee (MSAC). Methods All HTAs considered by MSAC between 1998 and 2015 were reviewed and assessments that recommended interim funding were identified. The MSAC website was searched to identify reassessments of these recommendations and sources of evidence used to resolve the uncertainties were identified. Results Of 173 HTA reports considered by MSAC, 17 (10%) contained an interim funding recommendation. Eight recommendations cited uncertainty around safety, 15 cited uncertainty around clinical effectiveness and 13 cited uncertainty around economics (cost-effectiveness and/or budget impact). Of the 17 interim funding recommendations, 11 (65%) have been reassessed. Only two reassessments relied on clinical registry evidence to resolve evidence gaps identified at the time of the interim funding recommendation. Conclusions Clinical registries are underused as a source of evidence for resolving uncertainties around promising new health technologies in Australia. An open dialogue between stakeholders on the role of registries in this context is needed. What is known about the topic? HTA is a process of assessing the evidence to inform policy decisions about public subsidy of new health technologies (e.g. pharmaceuticals, diagnostic tests, medical procedures). Where evidence is uncertain but the technology under evaluation is promising, funders may recommend the funding of the technology on a temporary basis while additional evidence is collected. Clinical registries have been suggested as a means of collecting additional evidence in these situations. What is does this paper add? It is currently unknown whether evidence from clinical registries is used to resolve uncertainties identified at the time that temporary (interim) funding decisions are made by Australia’s HTA bodies, in particular MSAC. The present study found that MSAC rarely relies on the interim funding mechanism (17/173 assessments). Of the 11 subsequent reassessments of interim recommendations, two relied on registry evidence to provide Australian-specific data for addressing uncertainties around long-term safety, effectiveness and cost-effectiveness. These findings suggest that clinical registries, although a feasible source of evidence for HTAs, are rarely used for this purpose. What are the implications for practitioners? Given the registries’ ability to resolve both a wider range of questions than those typically addressed by randomised control trials and applicability to a wider group of patients (and, hence, providing estimates of outcomes that are more generalisable), the potential of clinical registries to resolve HTA issues needs more attention from both researchers and decision makers. Stakeholder collaboration to define the evidence requirements for new technologies early in their development phase would be valuable to determine the potential role for clinical registries.


2009 ◽  
Vol 25 (03) ◽  
pp. 315-322 ◽  
Author(s):  
Marcial Velasco Garrido ◽  
Sandra Mangiapane

Objectives:Our aim was to review the recommendations given by health technology assessment (HTA) institutions in their methodological guidelines concerning the use of surrogate outcomes in their assessments. In a second step, we aimed at quantifying the role surrogate parameters take in assessment reports.Methods:We analyzed methodological papers and guidelines from HTA agencies with International Network of Agencies for Health Technology Assessment membership as well as from institutions related to pharmaceutical regulation (i.e., reimbursement, pricing). We analyzed the use of surrogate outcomes in a sample of HTA reports randomly drawn from the HTA database. We checked methods, results (including evidence tables), and conclusions sections and extracted the outcomes reported. We report descriptive statistics on the presence of surrogate outcomes in the reports.Results:We identified thirty-four methodological guidelines, twenty of them addressing the issue of outcome parameter choice and the problematic of surrogate outcomes. Overall HTA agencies call on caution regarding the reliance on surrogate outcomes. None of the agencies has provided a list or catalog of acceptable and validated surrogate outcomes. We extracted the outcome parameter of 140 HTA reports. Only around half of the reports determined the outcomes for the assessment prospectively. Surrogate outcomes had been used in 62 percent of the reports. However, only 3.6 percent were based upon surrogate outcomes exclusively. All of them assessed diagnostic or screening technologies and the surrogate outcomes were predominantly test characteristics.Conclusions: HTA institutions seem to agree on a cautious approach to the use of surrogate outcomes in technology assessment. Thorough assessment of health technologies should not rely exclusively on surrogate outcomes.


2016 ◽  
Vol 7 (3) ◽  
Author(s):  
Paul C Langley

The European Network for Health Technology Assessment (EUnetHTA) guidelines for health economic evaluations represent a consolidated view of non-binding recommendations for assessments of the relative effectiveness of pharmaceuticals or other health technologies. EUnetHTA views itself as the scientific and technological backbone of the development of health technology assessment in the European Union and among its member states and other partners. Unfortunately, the standards for health technology assessment proposed by EUnetHTA do not meet the standards of normal science. They do not support credible claims for the clinical and comparative cost-effectiveness of pharmaceuticals. In rejecting the standards of normal science the guidelines put to one side the opportunity not only to re-assess and replicate clinical and cost-effectiveness claims but to provide meaningful feedback on claims assessment to health care decision makers. The purpose of this review is to make the case that, in failing to support standards for experimentation, EUnetHTA is advocating its partners support the creation of modeled or simulated imaginary or false worlds. While EUnetHTA is not alone in recommending the construction of imaginary worlds to support formulary decisions, there is still the opportunity to revisit these recommendations and decide whether or not to encourage a scientifically rigorous approach to health technology assessments - to abandon a commitment to intelligent design in favor of natural selection.  Conflict of Interest None   Type: Commentary  


Author(s):  
Julian Elston ◽  
Rod S. Taylor

Objectives:The aim of this study was to explore the use of surrogate outcomes—a substitute outcome that predicts final patient-related outcomes—in cost-effectiveness models (CEM) within health technology assessment (HTA) reports and provide guidance for their future use.Methods:Our sampling frame was all UK HTA Program monograph series reports published in 2005 and 2006. Reports were included if they addressed a treatment effectiveness/efficacy question and included a CEM based on a surrogate outcome. The two authors independently applied inclusion and exclusion criteria, and the following data was extracted from included reports: source of surrogate outcome, level of evidence for validation of the surrogate outcomes, methods used in report to quantify link between surrogate outcome and final outcome, and consideration of the uncertainty associated with using surrogate outcomes in the results or conclusions of report.Results:Of 100 HTA reports, 35 complied with the inclusion criteria. Of these, four (11 percent) reports included a CEM based on a surrogate outcome. All four reports sourced treatment-related changes in surrogate outcome through a systematic review of the literature. One provided Level 1 surrogate evidence (randomized controlled trial data showing a strong association between the change in surrogate outcome and change final outcome); two reported Level 2 evidence (observational study data); and one provided Level 3 evidence (disease natural/ history data). The transparency of quantification and exploration of uncertainty of the surrogate and final outcome relationship varied considerably across all four reports.Conclusions:Recommendations are made for the use of surrogate outcomes in future HTA reports.


2005 ◽  
Vol 29 (4) ◽  
pp. 395 ◽  
Author(s):  
Linda Mundy ◽  
Tracy L Merlin ◽  
Adriana Parrella ◽  
Wendy J Babidge ◽  
Dianne E Roberts ◽  
...  

UP UNTIL 1982, new health technologies, procedures or services were introduced into the health system in an uncontrolled, unregulated manner. This had the potential for wide-ranging impact on the public health care system including ballooning costs, a lack of preparedness by training and accreditation organisations, and consequent patient safety concerns. Health technology assessment was introduced into Australia in 1982 when the National Health Technology Assessment Panel was formed. This original panel has undergone numerous name changes and evolved into the Australian Government-funded Medical Services Advisory Committee (MSAC).1 The primary role of the MSAC is to inform the Federal Minister for Health and Ageing on the safety, effectiveness and costeffectiveness of new medical technologies and procedures using the available evidence.2 Assessments of the safety, effectiveness and cost-effectiveness of these technologies may occur only after the technology has diffused and is practised widely.3 Early identification of such technologies may avoid the detrimental consequences of their indiscriminate introduction and could result in the adoption of beneficial and cost-effective technologies and the elimination of technologies that are unsafe or for which there is no evidence of cost-effectiveness.4


2021 ◽  
pp. 0272989X2199455
Author(s):  
Oriana Ciani ◽  
Bogdan Grigore ◽  
Hedwig Blommestein ◽  
Saskia de Groot ◽  
Meilin Möllenkamp ◽  
...  

Background Surrogate endpoints (i.e., intermediate endpoints intended to predict for patient-centered outcomes) are increasingly common. However, little is known about how surrogate evidence is handled in the context of health technology assessment (HTA). Objectives 1) To map methodologies for the validation of surrogate endpoints and 2) to determine their impact on acceptability of surrogates and coverage decisions made by HTA agencies. Methods We sought HTA reports where evaluation relied on a surrogate from 8 HTA agencies. We extracted data on the methods applied for surrogate validation. We assessed the level of agreement between agencies and fitted mixed-effects logistic regression models to test the impact of validation approaches on the agency’s acceptability of the surrogate endpoint and their coverage recommendation. Results Of the 124 included reports, 61 (49%) discussed the level of evidence to support the relationship between the surrogate and the patient-centered endpoint, 27 (22%) reported a correlation coefficient/association measure, and 40 (32%) quantified the expected effect on the patient-centered outcome. Overall, the surrogate endpoint was deemed acceptable in 49 (40%) reports ( k-coefficient 0.10, P = 0.004). Any consideration of the level of evidence was associated with accepting the surrogate endpoint as valid (odds ratio [OR], 4.60; 95% confidence interval [CI], 1.60–13.18, P = 0.005). However, we did not find strong evidence of an association between accepting the surrogate endpoint and agency coverage recommendation (OR, 0.71; 95% CI, 0.23–2.20; P = 0.55). Conclusions Handling of surrogate endpoint evidence in reports varied greatly across HTA agencies, with inconsistent consideration of the level of evidence and statistical validation. Our findings call for careful reconsideration of the issue of surrogacy and the need for harmonization of practices across international HTA agencies.


Author(s):  
Marian Sorin Paveliu ◽  
Elena Olariu ◽  
Raluca Caplescu ◽  
Yemi Oluboyede ◽  
Ileana-Gabriela Niculescu-Aron ◽  
...  

Objective: To provide health-related quality of life (HRQoL) data to support health technology assessment (HTA) and reimbursement decisions in Romania, by developing a country-specific value set for the EQ-5D-3L questionnaire. Methods: We used the cTTO method to elicit health state values using a computer-assisted personal interviewing approach. Interviews were standardized following the most recent version of the EQ-VT protocol developed by the EuroQoL Foundation. Thirty EQ-5D-3L health states were randomly assigned to respondents in blocks of three. Econometric modeling was used to estimate values for all 243 states described by the EQ-5D-3L. Results: Data from 1556 non-institutionalized adults aged 18 years and older, selected from a national representative sample, were used to build the value set. All tested models were logically consistent; the final model chosen to generate the value set was an interval regression model. The predicted EQ-5D-3L values ranged from 0.969 to 0.399, and the relative importance of EQ-5D-3L dimensions was in the following order: mobility, pain/discomfort, self-care, anxiety/depression, and usual activities. Conclusions: These results can support reimbursement decisions and allow regional cross-country comparisons between health technologies. This study lays a stepping stone in the development of a health technology assessment process more driven by locally relevant data in Romania.


2014 ◽  
Vol 30 (2) ◽  
pp. 147-152 ◽  
Author(s):  
Sergei Muratov ◽  
David Hailey ◽  
Vicki Foerster ◽  
Bruce Brady ◽  
Don Juzwishin ◽  
...  

Objectives: The aim of this study was to assist in the development of a health technology assessment (HTA) program for the Ministry of Health (MOH) of the Republic of KazakhstanMethods: Mentoring of an initial HTA program in Kazakhstan was provided by the Canadian Society for International Health (CSIH) by means of a partnership with the Kazakhstan MOH. HTA materials, courses, and one-on-one support for the preparation of a series of initial HTA reports by MOH HTA staff were provided by a seven-member CSIH team over a 2.5-year project.Results: Guidance documents on HTA and institutional strengthening were prepared in response to an extensive set of deliverables developed by the MOH and the World Bank. Introductory and train-the-trainer workshops in HTA and economic evaluation were provided for MOH staff members, experts from Kazakhstan research institutes and physicians. Five short HTA reports were successfully developed by staff in the Ministry's HTA Unit with assistance from the CSIH team. Challenges that may be relevant to other emerging HTA programs included lack of familiarity with some essential underlying concepts, organization culture, and limited time for MOH staff to do HTA work.Conclusions: The project helped to define the need for HTA and mentored MOH staff in taking the first steps to establish a program to support health policy decision making in Kazakhstan. This experience offers practical lessons for other emerging HTA programs, although these should be tailored to the specific context.


Sign in / Sign up

Export Citation Format

Share Document