PP65 Methods Applied For Systematic Reviews Of Economic Evaluations In Health Technology Assessment

2019 ◽  
Vol 35 (S1) ◽  
pp. 49-50
Author(s):  
Miriam Luhnen ◽  
Barbara Prediger ◽  
Edmund A.M. Neugebauer ◽  
Tim Mathes

IntroductionWhen making decisions in health care, it is essential to consider economic evidence about an intervention. The objective of this study was to analyze the methods applied for systematic reviews of economic evaluations in Health Technology Assessment (HTA) and to identify common challenges.MethodsWe manually searched the webpages of HTA organizations and included HTA-reports published since 2015. Prerequisites for inclusion were the conduct of a systematic review of economic evaluations in at least one electronic database and the use of the English, German, French, or Spanish language. Methodological features were extracted in standardized tables. We prepared descriptive statistical (e.g., median, range) measures to describe the applied methods. Data were synthesized in a structured narrative way.ResultsEighty-three reports were included in the analysis. We identified inexplicable heterogeneity, particularly concerning literature search strategy, data extraction, assessment of quality, and applicability. Furthermore, process steps were often missing or reported in a nontransparent way. The use of a standardized data extraction form was indicated in one-third of reports (32 percent). Fifty-four percent of authors systematically appraised included studies. In 10 percent of reports, the applicability of included studies was assessed. Involvement of two reviewers was rarely reported for the study selection (43 percent), data extraction (28 percent), and quality assessment (39 percent).ConclusionsThe methods applied for systematic reviews of economic evaluations in HTA and their reporting quality are very heterogeneous. Efforts toward a detailed, standardized guidance for the preparation of systematic reviews of economic evaluations definitely seem necessary. A general harmonization and improvement of the applied methodology would increase their value for decision makers.

2018 ◽  
Vol 34 (6) ◽  
pp. 537-546 ◽  
Author(s):  
Miriam Luhnen ◽  
Barbara Prediger ◽  
Edmund A.M. Neugebauer ◽  
Tim Mathes

Objectives:When making decisions in health care, it is essential to consider economic evidence about an intervention. The objective of this study was to analyze the methods applied for systematic reviews of health economic evaluations (SR-HEs) in HTA and to identify common challenges.Methods:We manually searched the Web pages of HTA organizations and included HTA-reports published since 2015. Prerequisites for inclusion were the conduct of an SR-HE in at least one electronic database and the use of the English, German, French, or Spanish language. Methodological features were extracted in standardized tables. We prepared descriptive statistical (e.g., median, range) measures to describe the applied methods. Data were synthesized in a structured narrative way.Results:Eighty-three reports were included in the analysis. We identified inexplicable heterogeneity, particularly concerning literature search strategy, data extraction, assessment of quality, and applicability. Furthermore, process steps were often missing or reported in a nontransparent way. The use of a standardized data extraction form was indicated in one-third of reports (32 percent). Fifty-four percent of authors systematically appraised included studies. In 10 percent of reports, the applicability of included studies was assessed. Involvement of two reviewers was rarely reported for the study selection (43 percent), data extraction (28 percent), and quality assessment (39 percent).Conclusions:The methods applied for SR-HEs in HTA and their reporting quality are very heterogeneous. Efforts toward a detailed, standardized guidance for the preparation of SR-HEs definitely seem necessary. A general harmonization and improvement of the applied methodology would increase the value of SR-HE for decision makers.


2018 ◽  
Vol 34 (6) ◽  
pp. 547-554 ◽  
Author(s):  
Mick Arber ◽  
Julie Glanville ◽  
Jaana Isojarvi ◽  
Erin Baragula ◽  
Mary Edwards ◽  
...  

Objectives:This study investigated which databases and which combinations of databases should be used to identify economic evaluations (EEs) to inform systematic reviews. It also investigated the characteristics of studies not identified in database searches and evaluated the success of MEDLINE search strategies used within typical reviews in retrieving EEs in MEDLINE.Methods:A quasi-gold standard (QGS) set of EEs was collected from reviews of EEs. The number of QGS records found in nine databases was calculated and the most efficient combination of databases was determined. The number and characteristics of QGS records not retrieved from the databases were collected. Reproducible MEDLINE strategies from the reviews were rerun to calculate the sensitivity and precision for each strategy in finding QGS records.Results:The QGS comprised 351 records. Across all databases, 337/351 (96 percent) QGS records were identified. Embase yielded the most records (314; 89 percent). Four databases were needed to retrieve all 337 references: Embase + Health Technology Assessment database + (MEDLINE or PubMed) + Scopus. Four percent (14/351) of records could not be found in any database. Twenty-nine of forty-one (71 percent) reviews reported a reproducible MEDLINE strategy. Ten of twenty-nine (34.5 percent) of the strategies missed at least one QGS record in MEDLINE. Across all twenty-nine MEDLINE searches, 25/143 records were missed (17.5 percent). Mean sensitivity was 89 percent and mean precision was 1.6 percent.Conclusions:Searching beyond key databases for published EEs may be inefficient, providing the search strategies in those key databases are adequately sensitive. Additional search approaches should be used to identify unpublished evidence (grey literature).


2021 ◽  
Author(s):  
Alina Weise ◽  
Roland Brian Büchter ◽  
Dawid Pieper ◽  
Tim Mathes

Abstract Objective: For assessing cost-effectiveness, Health Technology Assessment (HTA) organisations may use primary economic evaluations (P-HEs) or Systematic Reviews of Health Economic evaluations (SR-HEs). The latter pose the question whether the results from existing P-HEs are transferable across decision contexts (e.g. jurisdictions). A particularly pertinent issue is the high variability of costs and resource needs across jurisdictions. Our objective was to review the methods documents of HTA organisations and compare their recommendations on considering transferability in SR-HE. Methods: We systematically hand searched the webpages of 158 HTA organisations for relevant methods documents from January to March 2019. Two independent reviewers performed searches and selected documents according to pre-defined criteria. One reviewer extracted data in standardised and piloted tables and a second reviewer checked them for accuracy. We synthesized data using tabulations and in a narrative way. Results: We identified 155 potentially relevant documents from 63 HTA organisations. Of these, 7 were included in the synthesis. The included organisations have different aims when preparing a SR-HE (e.g. to determine the need for conducting their own P-HE). The recommendations vary regarding the underlying terminology (e.g. transferability/generalisability), the assessment approaches (e.g. structure), the assessment criteria and the integration in the review process.Conclusion: Only few HTA organisations address the assessment of transferability in their methodological recommendations for SR-HEs. Transferability considerations are related to different purposes. The assessment concepts and criteria are heterogeneous. Developing standards to consider transferability in SR-HEs is desirable.


Author(s):  
Matheus O. de Almeida ◽  
Thais Montezuma ◽  
Haliton A. de Oliveira Júnior ◽  
Cleusa Pinheiro Ferri

Abstract Introduction Mini health technology assessment (HTA) reports have been used to support policy makers and health systems by providing a timely summary of scientific evidence. The objective of this meta-epidemiologic study was to evaluate the quality of reporting of mini-HTA reports published in Brazil. Methods An electronic search for all mini-HTA reports published between 2014 and March 2019 was conducted in the SISREBRATS and CONITEC databases. The study selection and data extraction were performed by two independent assessors. The following data were extracted: bibliographic data; research question; characteristics of the population, health technologies and outcomes assessed; eligibility criteria; information about searches and study selection; risk of bias assessment; quality of evidence assessment; synthesis of results; and recommendation about the technology evaluated. A descriptive analysis was used to summarize the information retrieved from all the included mini-HTA reports. Results We included 103 mini-HTA reports, the great majority of which (92.3 percent) focused on the coverage of the technologies in the healthcare system, with more than 60 percent being about drugs. Only five mini-HTA reports (4.8 percent) gave reasons for the choice of outcomes, and fifteen (14.5 percent) discriminated between primary and secondary outcomes. All mini-HTAs reported the databases searched and 99 percent of them reported using Medline. Sixty percent of the mini-HTA reported assessing the risk of bias, and 52 percent reported assessing the quality of evidence. Conclusion The quality of reporting of the mini-HTA reports performed in Brazil is insufficient and needs to be improved to guarantee transparency and replicability.


2018 ◽  
Vol 34 (S1) ◽  
pp. 47-48
Author(s):  
Erica Ell ◽  
Betânia Leite ◽  
Dalila Gomes ◽  
Daniela Rego ◽  
Lenilson Gonçalvez ◽  
...  

Introduction:In 2017 the Brazilian Ministry of Health (BMH), through the Department of Science and Technology (DECIT) and in partnership with the Hospital Alemão Oswaldo Cruz (HAOC), financially supported research activities focused on health technology assessment (HTA) on topics deemed important by the BMH. The aim was to help resolve the priority health problems of the Brazilian population and to strengthen the management of the Unified Health System, within the scope of HTA.Methods:A survey of HTA research needs was carried out in all BMH sectors through internal meetings conducted by representatives from each of the sectors. The problems and needs were then discussed, prioritized, and transformed into research lines in a workshop sponsored jointly by DECIT and the HAOC. Following this, a specific public call was made to the HTA community to comment on the prioritized research lines. The submitted research projects were then judged and selected by a committee of experts in the field. The approved projects were contracted, and when the projects were completed the results were presented and discussed by the researchers in a final seminar for representatives of the BMH technical areas.Results:A total of 135 research gaps were identified, of which forty-two lines of research were included in the research call after the prioritization workshop and the search for evidence in the literature. The call involved an amount of BRL one million (USD 280,442), and seventeen research projects were financed, including two systematic reviews, seven rapid reviews, and eight economic evaluations.Conclusions:The promotion of research by the BMH has enabled the search for scientific evidence to support public policies and decision making in health services.


Author(s):  
John Gillespie ◽  
Sebnem Erdol ◽  
Chris Foteff ◽  
Liesl Strachan

Introduction:Health Technology Assessment (HTA) considers the question of whether evaluated technologies are cost-effective in real world settings. As observed in HTA conducted by the Australian Medical Services Advisory Committee (MSAC), questions regarding the validity of data inputs to economic analyses that reflect real-world practice is a common reason for uncertainty on the cost effectiveness of new technologies. In addition to resource use and costs, there may be other uncertainties regarding the eligible patient population, patient management pathways and comparator selection. Our objective in this study was to present case studies from Australia where real world linked datasets could be better utilized to inform HTA conducted by the MSAC.Methods:For selected therapy areas, assessment reports and public summary documents of HTA conducted by the MSAC published between January 2015 and November 2017 were reviewed. Our analysis identified HTAs where uncertainties around the inputs for health economic evaluations, as well as uncertainties in defining eligible patient numbers or current patient pathways of care were shown to exist. We then explored whether these uncertainties could have been addressed through real world linked datasets.Results:Our preliminary investigations identified two assessments: MSAC assessment of capsule endoscopy and transcatheter aortic valve implantation - where availability of real world linked data could have addressed uncertainties around the inputs required for the health economic evaluations.Conclusions:Australia has a range of real world datasets with the potential to be used to inform HTA conducted by the MSAC. This can only be achieved if the datasets could be better linked and accessible for use by key stakeholders in the MSAC HTA process (e.g. industry, clinician, patient societies). Use of these data sets in HTA will enable timelier patient access to cost-effective technologies and more effective implementation and review of technologies after adoption into clinical practice.


2000 ◽  
Vol 16 (2) ◽  
pp. 520-531 ◽  
Author(s):  
Manuela Mota Pinto ◽  
Francisco Ramos ◽  
João Pereira

The Portuguese healthcare system is often portrayed as a National Health Service (NHS) model, characterized by universal coverage, comprehensive benefits, nearly free services, national tax financing, and public ownership or control of the factors of production. However, in reality the system fails to accomplish these features in a complete way. There coexist a number of occupation-related health insurance schemes that were originally intended to be integrated into the NHS. In addition, in key areas the NHS does not provide the wide range of services it promises. The public sector has a predominant role in the provision of hospital stays and general practitioner consultations, but the private sector provides a major portion of specialist consultations, dental consultations, and diagnostic services. Major problems in the system led to health reforms in the 1990s. New reform proposals include some specific steps concerning health technology, including standards for medical equipment based on quality, geographic distribution, sustainability, and cost-effectiveness. A new National Plan of Health Equipment was completed in 1998, aimed at improving the distribution of equipment. Despite reforms, healthcare expenditures continue to rise. There is general agreement that gains in efficiency could be made. This situation is beginning to encourage interest in health technology assessment (HTA) in Portugal, although these activities are not yet very developed. Recently, legislation requiring presentation of economic evaluations for new pharmaceutical products was enacted. Present plans also call for the creation in the future of a national agency for HTA.


Sign in / Sign up

Export Citation Format

Share Document