Comparison of three instruments assessing the quality of economic evaluations: A practical exercise on economic evaluations of the surgical treatment of obesity

2008 ◽  
Vol 24 (03) ◽  
pp. 318-325 ◽  
Author(s):  
Sophie Gerkens ◽  
Ralph Crott ◽  
Irina Cleemput ◽  
Jean-Paul Thissen ◽  
Marie-Christine Closon ◽  
...  
Keyword(s):  
Health Economic ◽  
Correlation Coefficient ◽  
Rank Correlation ◽  
Economic Evaluations ◽  
Rater Agreement ◽  
Check List ◽  
Treatment Of Obesity ◽  
Test Retest Reliability ◽  
Surgical Treatment Of Obesity

Objectives:The increasing use of full economic evaluations has led to the development of various instruments to assess their quality. The purpose of this study was to compare the frequently usedBritish Medical Journal(BMJ) check-list and two new instruments: the Consensus Health Economic Criteria (CHEC) list and the Quality of Health Economic Studies (QHES) instrument. The analysis was based on a practical exercise on economic evaluations of the surgical treatment of obesity.Methods:The quality of nine selected studies was assessed independently by two health economists. To compare instruments, the Spearman rank correlation coefficient was calculated for each assessor. Moreover, the test–retest reliability for each instrument was assessed with the intraclass correlation coefficient (ICC) (3,1). Finally, the inter-rater agreement for each instrument was estimated at two levels: comparison of the total score of each article by the ICC(2,1) and comparison of results per item by kappa values.Results:The Spearman's rank correlation coefficient between instruments was usually high (rho > 0.70). Furthermore, test–retest reliability was good for every instruments, that is, 0.98 (95 percent CI, 0.86–0.99) for the BMJ check-list, 0.97 (95 percent CI, 0.73–0.98) for the CHEC list, and 0.95 (95 percent CI, 0.75–0.99) for the QHES instrument. However, inter-rater agreement was poor (kappa < 0.40 for most items and ICC(2,1) ≤ 0.5).Conclusions:The study shows that the results of the quality assessment of economic evaluations are not so much influenced by the instrument used but more by the assessor. Therefore, quality assessments should be performed by at least two independent experts and final scoring based on consensus.

scholarly journals Psychometric evaluation of a brazilian portuguese version of the spitzer quality of life index in patients with low back pain

2008 ◽  
Vol 16 (6) ◽  
pp. 943-950 ◽  
Author(s):  
Rafaela Cunha Matheus Rodrigues Toledo ◽  
Neusa Maria Costa Alexandre ◽  
Roberta Cunha Matheus Rodrigues
Keyword(s):  
Quality Of Life ◽  
Low Back Pain ◽  
Back Pain ◽  
Correlation Coefficient ◽  
Low Back ◽  
Life Index ◽  
Sf 36 ◽  
Quality Of Life Index ◽  
Test Retest Reliability

The purpose of this study was to adapt the Spitzer Quality of Life Index and evaluate its reliability in patients with low back pain. The following steps were followed: translation, back-translation, evaluation by a committee, and pretest. The reliability was estimated through stability and homogeneity assessment. The validity was tested comparing scores of the Spitzer (QLI) with the SF-36 and the Roland-Morris. The psychometric properties were evaluated by the self-application on 120 patients. Results showed that the Cronbach's Alpha was 0.77. Intraclass correlation coefficient for test-retest reliability was 0.960 (p<0.001; IC95%: 0.943; 0.972). Spearman´s correlation coefficient for test-retest reliability was 0.937 (p<0.001). There was significant correlation between the Spitzer (QLI) scores and the dimensions of the SF-36. A significant negative correlation was found between the Spitzer (QLI) and the Roland-Morris scores (r = - 0.730). The adaptation process was conducted successfully and the questionnaire presented reliable psychometric measures.

scholarly journals Criteria list for assessment of methodological quality of economic evaluations: Consensus on Health Economic Criteria

2005 ◽  
Vol 21 (2) ◽  
pp. 240-245 ◽  
Author(s):  
Silvia Evers ◽  
Mariëlle Goossens ◽  
Henrica de Vet ◽  
Maurits van Tulder ◽  
André Ament
Keyword(s):  
Health Economic ◽  
Systematic Reviews ◽  
Methodological Quality ◽  
Economic Evaluations ◽  
Delphi Panel ◽  
Policy Makers ◽  
Core Set ◽  
International Experts ◽  
Economic Criteria

Objectives:The aim of the Consensus on Health Economic Criteria (CHEC) project is to develop a criteria list for assessment of the methodological quality of economic evaluations in systematic reviews. The criteria list resulting from this CHEC project should be regarded as a minimum standard.Methods:The criteria list has been developed using a Delphi method. Three Delphi rounds were needed to reach consensus. Twenty-three international experts participated in the Delphi panel.Results:The Delphi panel achieved consensus over a generic core set of items for the quality assessment of economic evaluations. Each item of the CHEC-list was formulated as a question that can be answered by yes or no. To standardize the interpretation of the list and facilitate its use, the project team also provided an operationalization of the criteria list items.Conclusions:There was consensus among a group of international experts regarding a core set of items that can be used to assess the quality of economic evaluations in systematic reviews. Using this checklist will make future systematic reviews of economic evaluations more transparent, informative, and comparable. Consequently, researchers and policy-makers might use these systematic reviews more easily. The CHEC-list can be downloaded freely fromhttp://www.beoz.unimaas.nl/chec/.

scholarly journals Investigating the health-economic profiles of biomarker-driven immunosuppresion (BIO-DrIM) following solid organ transplantation

2016 ◽  
Vol 1 (1) ◽  
pp. 48 ◽  
Author(s):  
Simon A Weber ◽  
Malte Pietzsch ◽  
Oriol Bestard ◽  
Josep M Grinyo ◽  
Ondrej Viklicky ◽  
...  
Keyword(s):  
Health Economic ◽  
Economic Evaluation ◽  
Organ Transplantation ◽  
Clinical Success ◽  
Solid Organ Transplantation ◽  
Economic Evaluations ◽  
Test Accuracy ◽  
Solid Organ ◽  
Economic Study

Immunosuppression (IS) following solid organ transplantation is indicated to avoid rejection but puts a sig-nificant burden on patients and healthcare systems due to life-long medication dependency and associated costs. Or-gan-tolerance with low or no IS medication has been observed, and might be forecasted with the help of appropriate biomarkers. Individualized treatments raise the question whether benefits of individualization outweigh the costs of stratification. This article outlines the importance of early economic evaluation in the context of biomarker-guided IS and discusses challenges that an economic evaluation should address, using the BIO-DrIM project as a reference exam-ple. We report on design aspects and health-economic study integration into several newly designed biomarker trials. In these studies, health-economic endpoints were defined to measure benefits of individualization and to compare them to the costs associated with stratification. Key economic outcomes to be collected are resource consumption and patient quality of life. Test accuracy of the biomarker-stratification is critical for the clinical success and the health-economic viability of an individualized reduced IS regime. However, IS regimes are not well standardized, rendering comparator choice difficult. The multi-national character of the trials adds further complexity that needs to be addressed. Develop-ers of biomarker tests should stress the importance of integrating health-economic evaluations early into prod-uct-development.

scholarly journals Costs and Health-Related Quality of Life in Relation to Caries

2019 ◽  
Author(s):  
Lisa Kastenbom ◽  
Alexandra Falsen ◽  
Pernilla Larsson ◽  
Karin Sunnegårdh-Grönberg ◽  
Thomas Davidson
Keyword(s):  
Quality Of Life ◽  
Health Economic ◽  
Treatment Costs ◽  
Active Group ◽  
Economic Evaluations ◽  
Age Group ◽  
Health Related Quality ◽  
Related Quality ◽  
Health Related

Abstract Background Dental caries remains a common and expensive disease for both society and affected individuals. Furthermore, caries often affect individuals’ health-related quality of life (HRQoL). Health economic evaluations are needed to understand how to efficiently distribute dental care resources. This study aims to evaluate treatment costs and QALY weights for caries active and inactive adult individuals, and to test whether the generic instrument EQ-5D-5L can distinguish differences in this population. Methods A total of 1200 randomly selected individuals from dental clinics in Västerbotten County, Sweden, were invited to participate. Of these, 79 caries active and 179 caries inactive patients agreed to participate (response rate of 21.7%). Inclusion criteria were participants between 20-65 years old and same caries risk group categorization in two consecutive check-ups between 2014 and 2017. Results Treatment costs showed to be twice as high in the caries active group compared to the caries inactive group and were three times higher in the caries active age group 20-29 compared to the caries inactive age group 20-29. Differences between the groups was found for number of intact teeth according to age groups. In the EQ-5D-5L instrument, more problems relating to the dimension anxiety/depression was seen in the caries active group. QALY weights showed tendencies (non-significant) to be lower in the caries active group. Conclusions These findings highlight the need for efficient treatments and prevention strategies as well as adequate money allocation within dentistry. However, further research is needed to assess appropriate instruments for health economic evaluations.

scholarly journals Intradialytic Complication and Associated Factors among Patients Undergoing Hemodialysis

2021 ◽  
Vol 8 (3) ◽  
pp. 378-385
Author(s):  
Yeni Kartika Sari ◽  
Ning Arti Wulandari ◽  
Sandi Alfa Wiga Arsa ◽  
Iwit Rata Ari Dewi
Keyword(s):  
Correlation Coefficient ◽  
Linear Regression Analysis ◽  
Rank Correlation ◽  
Multiple Linear Regression Analysis ◽  
Management Options ◽  
Life Threatening ◽  
Stage Renal Disease ◽  
End Stage ◽  
Spearman Rank Correlation Test

Hemodialysis is one of the vital management options for end-stage renal disease (ERDS) patients. Adequate hemodialysis can make a good quality of patient life. Hemodialysis patient commonly has experienced intradialytic complications, and it can be life-threatening. ESRD patients who are not compliant with fluid and dietary restrictions raised Intradialytic weight gain (IDWG), and blood pressure leads to intradialytic complications. This study aimed to determine factors associated with intradialytic complications among undergoing hemodialytic patients in Blitar. The data analysis used Multiple linear regression analysis to ascertain the possible factors that influence intradialytic complications. The sample was 55 hemodialysis patients with intradialytic complications. Based on this study, the Spearman Rank correlation test results, the factor that correlated with intradialytic complications was patient compliance with a Sig (2-tailed) value of 0.016 with a correlation coefficient value of -0.26. The correlation coefficient in the results above was negative, namely -0.263 so that the correlation between the two variables was not unidirectional. The higher compliance showed, the lower the intradialytic complications. The odds ratio (OR) value between adherence and the occurrence of intradialytic complications was 3,229. That value meant that patients with kidney failure who do not comply with the diet will have a 3-fold risk of intradialytic complications compared to patients with renal failure who comply. This result emphasizes the need for constant motivation and education at frequent intervals to ensure better adherence.

scholarly journals Activity Recommendation Model Using Rank Correlation for Chronic Stress Management

2019 ◽  
Vol 9 (20) ◽  
pp. 4284 ◽  
Author(s):  
Ji-Soo Kang ◽  
Dong-Hoon Shin ◽  
Ji-Won Baek ◽  
Kyungyong Chung
Keyword(s):  
Stress Management ◽  
Correlation Coefficient ◽  
Chronic Stress ◽  
Rank Correlation ◽  
Korean People ◽  
Spearman’S Rank Correlation ◽  
Spearman’S Rank Correlation Coefficient ◽  
Proposed Model ◽  
Basic Rank

Korean people are exposed to stress due to the constant competitive structure caused by rapid industrialization. As a result, there is a need for ways that can effectively manage stress and help improve quality of life. Therefore, this study proposes an activity recommendation model using rank correlation for chronic stress management. Using Spearman’s rank correlation coefficient, the proposed model finds the correlations between users’ Positive Activity for Stress Management (PASM), Negative Activity for Stress Management (NASM), and Perceived Stress Scale (PSS). Spearman’s rank correlation coefficient improves the accuracy of recommendations by putting a basic rank value in a missing value to solve the sparsity problem and cold-start problem. For the performance evaluation of the proposed model, F-measure is applied using the average precision and recall after five times of recommendations for 20 users. As a result, the proposed method has better performance than other models, since it recommends activities with the use of the correlation between PASM and NASM. The proposed activity recommendation model for stress management makes it possible to manage user’s stress effectively by lowering the user’s PSS using correlation.

Quality of economic evaluations of ventricular assist devices: A systematic review

2020 ◽  
Vol 36 (4) ◽  
pp. 380-387
Author(s):  
Sarah Fontenay ◽  
Lionel Catarino ◽  
Soumeya Snoussi ◽  
Hélène van den Brink ◽  
Judith Pineau ◽  
...  
Keyword(s):  
Systematic Review ◽  
Health Economic ◽  
Economic Evaluation ◽  
Cost Effectiveness ◽  
Health Economic Evaluation ◽  
Ventricular Assist Devices ◽  
Economic Evaluations ◽  
Level Of Evidence ◽  
Ventricular Assist

ObjectiveBecause of a lack of suitable heart donors, alternatives to transplantation are required. These alternatives can have high costs. The aim of this study was to perform a systematic review of cost-effectiveness studies of ventricular assist devices (VADs) and to assess the level of evidence of relevant studies. The purpose was not to present economic findings.MethodsA systematic review was performed using four electronic databases to identify health economic evaluation studies dealing with VADs. The methodological quality and reporting quality of the studies was assessed using three different tools, the Drummond, Cooper, and CHEERS (Consolidated Health Economic Evaluation Reporting Standards) checklists.ResultsOf the 1,258 publications identified, thirteen articles were included in this review. Twelve studies were cost–utility analyses and one was a cost-effectiveness analysis. According to the Cooper hierarchy scale, the quality of the data used was heterogeneous. The level of evidence used for clinical effect sizes, safety data, and baseline clinical data was of poor quality. In contrast, cost data were of high quality in most studies. Quality of reporting varied between studies, with an average score of 17.4 (range 15–19) according to the CHEERS checklist.ConclusionThe current study shows that the quality of clinical data used in economic evaluations of VADs is rather poor in general. This is a concern that deserves greater attention in the process of health technology assessment of medical devices.

Improved Temporal Pooling for Perceptual Video Quality Assessment Using VMAF

2020 ◽  
Vol 2020 (11) ◽  
pp. 68-1-68-6
Author(s):  
Sophia Batsi ◽  
Lisimachos P. Kondi
Keyword(s):  
Correlation Coefficient ◽  
Quality Of Experience ◽  
Video Sequence ◽  
Pearson Correlation ◽  
Video Quality ◽  
Rank Correlation ◽  
Arithmetic Mean ◽  
Perceptual Video Quality ◽  
Multimethod Assessment

The Video Multimethod Assessment Fusion (VMAF) method, proposed by Netflix, offers an automated estimation of perceptual video quality for each frame of a video sequence. Then, the arithmetic mean of the per-frame quality measurements is taken by default, in order to obtain an estimate of the overall Quality of Experience (QoE) of the video sequence. In this paper, we validate the hypothesis that the arithmetic mean conceals the bad quality frames, leading to an overestimation of the provided quality. We also show that the Minkowski mean (appropriately parametrized) approximates well the subjectively measured QoE, providing superior Spearman Rank Correlation Coefficient (SRCC), Pearson Correlation Coefficient (PCC), and Root-Mean-Square-Error (RMSE) scores.

Sign in / Sign up

Export Citation Format

Share Document