Consolidated health economic evaluation reporting standards 2022 (CHEERS 2022) statement: updated reporting guidance for health economic evaluations

Health economic evaluations are comparative analyses of alternative courses of action in terms of their costs and consequences. The Consolidated Health Economic Evaluation Reporting Standards (CHEERS) statement, published in 2013, was created to ensure health economic evaluations are identifiable, interpretable, and useful for decision making. It was intended as guidance to help authors report accurately which health interventions were being compared and in what context, how the evaluation was undertaken, what the findings were, and other details that may aid readers and reviewers in interpretation and use of the study. The new CHEERS 2022 statement replaces previous CHEERS reporting guidance. It reflects the need for guidance that can be more easily applied to all types of health economic evaluation, new methods and developments in the field, as well as the increased role of stakeholder involvement including patients and the public. It is also broadly applicable to any form of intervention intended to improve the health of individuals or the population, whether simple or complex, and without regard to context (such as health care, public health, education, social care, etc.). This summary article presents the new CHEERS 2022 28-item checklist and recommendations for each item. The CHEERS 2022 statement is primarily intended for researchers reporting economic evaluations for peer-reviewed journals, as well as the peer reviewers and editors assessing them for publication. However, we anticipate familiarity with reporting requirements will be useful for analysts when planning studies. It may also be useful for health technology assessment bodies seeking guidance on reporting, as there is an increasing emphasis on transparency in decision making.

Glycated hemoglobin as a surrogate for evaluating the effectiveness of drugs in diabetes mellitus trials: a systematic review and trial-level meta-analysis

Objective The objective of this study was to investigate whether glycated hemoglobin (HbA1c) is a valid surrogate for evaluating the effectiveness of antihyperglycemic drugs in diabetes mellitus (DM) trials. Methods We conducted a systematic review of placebo-controlled randomized clinical trials (RCTs) evaluating the effect of a treatment on HbA1c (mean difference between groups) and clinical outcomes (relative risk of mortality, myocardial infarction, stroke, heart failure, and/or kidney injury) in patients with DM. Then, we investigated the association between treatment effects on HbA1c and clinical outcomes using regression analysis at the trial level. Lastly, we interpreted the correlation coefficients (R) using the cut-off points suggested by the Institute for Quality and Efficiency in Healthcare (IQWiG). HbA1c was considered a valid surrogate if it demonstrated a strong association: lower limit of the 95 percent confidence interval (95 percent CI) of R greater than or equal to .85. Results Nineteen RCTs were identified. All studies included adults with type 2 DM. None of the associations evaluated was strong enough to validate HbA1c as a surrogate for any clinical outcome: mortality (R = .34; 95 percent CI −.14 to .69), myocardial infarction (R = .20; −.30 to .61), heart failure (R = .08; −.40 to .53), kidney injury (R = −.04; −.52 to .47), and stroke (R = .81; .54 to .93). Conclusions The evidence from multiple placebo-controlled RCTs does not support the use of HbA1c as a surrogate to measure the effectiveness of antihyperglycemic drugs in DM studies.

Medicine characteristics affecting the time to guidance publication by National Institute for Health and Care Excellence in the single technology appraisal process

Objective In England, the time gap between marketing authorization (MA) and guidance publication by National Institute for Health and Care Excellence (NICE) can limit patients’ access to new medicines. In this study, our aim was to identify medicine characteristics associated with the long time gap between MA and guidance publication and explore the influencing factors. Methods We identified 116 single technology appraisals from 2016 to 2020 using publicly available data, and extracted information on the year of appraisal completion, application type, experiences of similar appraisals, orphan medicinal products (OMPs), cancer medicines, and accelerated assessment. Multiple regression analyses were performed to analyze the associations between the medicine characteristics and key time periods related to health technology assessment and MA processes. Results OMPs were associated with a long period between MA and guidance publication. Specifically, OMPs and cancer medicines were associated with slow guidance publication after the final scope (FS) development. However, there was no association between OMPs and the period between validation of MA application and FS development. Non-double-blinded randomized clinical trials and the use of comparators not specified in the FS were associated with slow guidance publication after the FS development. Conclusions Our results demonstrate that OMPs are associated with a longer period between MA and guidance publication by the NICE than non-OMPs; this may be attributed to the slow guidance publication after the FS development. These findings indicate the necessity to shorten the appraisal process for OMPs.

Bridging health technology assessment and healthcare quality improvement using international consortium of health outcomes measurement standard sets

Objective Although health technology assessment (HTA) and healthcare quality improvement are distinct processes, a greater level of alignment in outcome measures used may increase the quality and efficiency of data collection. This study evaluates the agreement in outcome measures used in oncology for healthcare quality improvement and HTAs, and how these align to the International Consortium for Health Outcomes Measurement (ICHOM) standard sets. Methods We conducted a cross-sectional comparative analysis of ICHOM sets focusing on oncological indications and publicly available measures for healthcare quality and HTA reports published by the National Health Care Institute from the Netherlands and the National Institute for Health and Care Excellence from the United Kingdom. Results All ICHOM sets and HTAs used overall survival, whereas quality improvement used different survival estimates. Different progression estimates for cancer were used in HTAs, ICHOM sets, and quality improvement. Data on health-related quality of life (HRQoL) was recommended in all ICHOM sets and all HTAs, but selectively for quality improvement. In HTAs, generic HRQoL questionnaires were preferred, whereas, in quality improvement and ICHOM sets, disease-specific questionnaires were recommended. Unfavorable outcomes were included in all HTAs and all ICHOM sets, but not always for quality improvement. Conclusions Although HTA and quality improvement use outcome measures from the same domains, a greater level of alignment seems possible. ICHOM may provide input on standardized outcome measures to support this alignment. However, residual discrepancies will remain due to the different objectives of HTA and quality improvement.

Exploring facilitators and barriers to introducing health technology assessment: a systematic review

Objective This study aims to identify and codify the facilitators and barriers to help implementing partners institutionalize health technology assessment (HTA) successfully and navigate complex systems for health-related policy making. Methods We searched for peer-reviewed and gray literature articles examining HTA programs globally using six databases. Keywords used as a guide for capturing articles included “health technology assessment,” “barrier,” and “facilitator” and their synonyms. Search results were scrutinized for duplicates and screened through a review of titles and abstracts. A full-text review was conducted exploring articles’ coverage of twenty-seven evaluation criteria across four primary areas of interest: barriers/facilitators, motivations, guidelines, and institutional frameworks. Results A total of 18,599 records were identified for duplication check, title, and abstract review. A total of 1,594 articles underwent full-text review, leading to a final synthesis of 262 studies. We found that ninety-seven articles discussed barriers/facilitators, with fifty-three of those discussing local capacity and unavailable human resources. Out of the sixty-six articles discussing motivations, forty-two cited the interest in supporting the decision-making process for, and promoting, appropriate resource allocation. Of the sixty-one articles that discussed guidelines and institutional framework, twenty-one articles described HTA as an independent national unit, and sixteen described their HTA unit as a unit within the Ministry of Health (MOH). Conclusions This systematic review unpacks the dynamic and relevant contexts for understanding the HTA institutionalization process to help policy makers and practitioners achieve tangible progress in confronting the most critical issues facing priority setting and HTA institutionalization.

Economic evaluation guidelines in low- and middle-income countries: a systematic review

Objectives To systematically identify the latest versions of official economic evaluation guidelines (EEGs) in low- and middle-income countries (LMICs) and explore similarities and differences in their content. Methods We conducted a systematic search in MEDLINE (Ovid), PubMed, EconLit, Embase (Ovid), the Cochrane Library, and the gray literature. Using a predefined checklist, we extracted the key features of economic evaluation and the general characteristics of EEGs. We conducted a comparative analysis, including a summary of similarities and differences across EEGs. Results Thirteen EEGs were identified, three pertaining to lower-middle-income countries (Bhutan, Egypt, and Indonesia), nine to upper-middle-income countries (Brazil, China, Colombia, Cuba, Malaysia, Mexico, Russian Federation, South Africa, and Thailand), in addition to Mercosur, and none to low-income countries. The majority (n = 12) considered cost–utility analysis and health-related quality-of-life outcome. Half of the EEGs recommended the societal perspective, whereas the other half recommended the healthcare perspective. Equity considerations were required in ten EEGs. Most EEGs (n = 11) required the incremental cost-effectiveness ratio and recommended sensitivity analysis, as well as the presentation of a budget impact analysis (n = 10). Seven of the identified EEGs were mandatory for pharmacoeconomics submission. Methodological gaps, contradictions, and heterogeneity in terminologies used were identified within the guidelines. Conclusion As the importance of health technology assessment is increasing in LMICs, this systematic review could help researchers explore key aspects of existing EEGs in LMICs and explore differences among them. It could also support international organizations in guiding LMICs to develop their own EEGs and improve the methodological framework of existing ones.

A review of audiovisual telemedicine utilization and satisfaction assessment during the COVID-19 pandemic

Introduction The use of telemedicine has broadened as technology that both restores continuity of care during disruptions in healthcare delivery and routinely provides primary care alone or in combination with in-person care. During the Covid-19 outbreak, the use of telemedicine as a routine care modality further accelerated. Methods A review of scientific studies that used telemedicine to provide care from December 2019 to December 2020 is presented. From an initial set of 2,191 articles, 36 studies are analyzed. Evidence is organized and evaluated according to the country of study, the clinical specialty, the technology platform used, and satisfaction and utilization outcomes. Results Thirty-one studies reported high patient satisfaction scores. Eight studies reported satisfaction from both providers and patients with no uniformly accepted assessment instrument. Eight studies conducted a descriptive analysis of telemedicine use and patient adoption patterns. Less than one-third of studies were controlled before/after studies. Most studies were conducted in the USA followed by Europe. Conclusions Reported satisfaction rates are high, consistent with previously documented research, whereas utilization rates increased significantly compared with the prepandemic period. Future work in developing standardized uniform assessment instruments, embedded with each telemedicine system, would increase versatility and agility in the assessment, boosting statistical power and the interpretation of results.

Opportunities to improve reporting of rapid response in health technology assessment

Introduction Mini health technology assessment (HTA) reports have been used to support policy makers and health systems by providing a timely summary of scientific evidence. The objective of this meta-epidemiologic study was to evaluate the quality of reporting of mini-HTA reports published in Brazil. Methods An electronic search for all mini-HTA reports published between 2014 and March 2019 was conducted in the SISREBRATS and CONITEC databases. The study selection and data extraction were performed by two independent assessors. The following data were extracted: bibliographic data; research question; characteristics of the population, health technologies and outcomes assessed; eligibility criteria; information about searches and study selection; risk of bias assessment; quality of evidence assessment; synthesis of results; and recommendation about the technology evaluated. A descriptive analysis was used to summarize the information retrieved from all the included mini-HTA reports. Results We included 103 mini-HTA reports, the great majority of which (92.3 percent) focused on the coverage of the technologies in the healthcare system, with more than 60 percent being about drugs. Only five mini-HTA reports (4.8 percent) gave reasons for the choice of outcomes, and fifteen (14.5 percent) discriminated between primary and secondary outcomes. All mini-HTAs reported the databases searched and 99 percent of them reported using Medline. Sixty percent of the mini-HTA reported assessing the risk of bias, and 52 percent reported assessing the quality of evidence. Conclusion The quality of reporting of the mini-HTA reports performed in Brazil is insufficient and needs to be improved to guarantee transparency and replicability.

Application of a health technology assessment framework to digital health technologies that manage chronic disease: a systematic review

Background As health services increasingly make investment decisions in digital health technologies (DHTs), a DHT-specific and comprehensive health technology assessment (HTA) process is crucial in assessing value-for-money. Research in DHTs is ever-increasing, but whether it covers the content required for HTA is unknown. Objectives To summarize current trends in primary research on DHTs that manage chronic disease at home, particularly the coverage of content recommended for DHT-specific and comprehensive HTA. Methods Medline, Embase, Econlit, CINAHL, and The Cochrane Library (1 January 2015 to 20 March 2020) were searched for primary research studies using keywords related to DHT and HTA domains. Studies were assessed for coverage of the most frequently recommended content to be considered in a nine domain DHT-specific HTA previously developed. Results A total of 178 DHT interventions were identified, predominantly randomized controlled trials targeting cardiovascular disease/diabetes in high- to middle-income countries. A coverage assessment of the cardiovascular and diabetes DHT studies (112) revealed less than half covered DHT-specific content in all but the health problem domain. Content common to all technologies but essential for DHTs was covered by more than half the studies in all domains except for the effectiveness and ethical analysis domains. Conclusions Although DHT research is increasing, it is not covering all the content recommended for a DHT-specific and comprehensive HTA. The inability to conduct such an HTA may lead to health services making suboptimal investment decisions. Measures to increase the quality of trial design and reporting are required in DHT primary research.

Optimizing red blood cell transfusion practices in the intensive care unit: a multi-phased health technology reassessment

Background Health technology reassessment (HTR) is a process to manage existing health technologies to ensure ongoing optimal use. A model to guide HTR was developed; however, there is limited practical experience. This paper addresses this knowledge gap through the completion of a multi-phase HTR of red blood cell (RBC) transfusion practices in the intensive care unit (ICU). Objective The HTR consisted of three phases and here we report on the final phase: the development, implementation, and evaluation of behavior change interventions aimed at addressing inappropriate RBC transfusions in an ICU. Methods The interventions, comprised of group education and audit and feedback, were co-designed and implemented with clinical leaders. The intervention was evaluated through a controlled before-and-after pilot feasibility study. The primary outcome was the proportion of potentially inappropriate RBC transfusions (i.e., with a pre-transfusion hemoglobin of 70 g/L or more). Results There was marked variability in the monthly proportion of potentially inappropriate RBC transfusions. Relative to the pre-intervention phase, there was no significant difference in the proportion of potentially inappropriate RBC transfusions post-intervention. Lessons from this work include the importance of early and meaningful engagement of clinical leaders; tailoring the intervention modalities; and, efficient access to data through an electronic clinical information system. Conclusions It was feasible to design, implement, and evaluate a tailored, multi-modal behavior change intervention in this small-scale pilot study. However, early evaluation of the intervention revealed no change in technology use leading to reflection on the important question of how the HTR model needs to be improved.