scholarly journals RELIABILITY AND VALIDITY OF HYPOTHETICAL SCENARIOS FOR ESTIMATING WILLINGNESS TO PAY (WTP) PER QUALITY ADJUSTED LIFE YEAR (QALY) IN INDONESIA SETTING

Author(s):  
Susi Ari Kristina ◽  
Dwi Endarti ◽  
Tri Murti Andayani ◽  
M. Rifqi Rokhman

Objective: To estimate validity and reliability of WTP questionnaire which WTP value can be taken as an indication of the monetary value of health gains, which may carry information regarding the appropriate height of the cost-effectiveness threshold.Methods: Three hundred respondents, in Yogyakarta province, Indonesia, were interviewed during June 2017. We examine a value of WTP associated with the following scenarios: 1) improving moderate condition; 2) extending life during terminal illness, and 3) lifesaving. The interview ascertained maximum hypothetical WTP for one QALY using a dichotomous bidding format with an open-ended final question, along with questions about the socio-economic factors. Concerning validity, the WTP of the 3 versions of hypothetical scenarios were compared as known-group validity and analysis of the sensitivity and specificity was performed. Test-retest reliability and alpha Cronbach were employed to measure internal consistency.Results: Analysis generally confirmed the validity and reliability of the WTP hypothetical scenarios. In terms of known group validity, there was significant difference across two scenarios (treatment v. s lifesaving), but no significant difference between mean WTP for treatment and terminal illness was found. Mean WTP for terminal illness (38 Million IDR) and lifesaving scenario (16 Million IDR) was significantly higher than that of treatment scenario (14 Million IDR). The WTP instrument showed good convergent validity (r=0.784), when comparing correlation between WTP value and utility score. Estimation of scenario’s sensitivity and specificity in deriving expected WTP were 70.33 % and 38.98 %, respectively. The positive and negative predictive values were 64 % and 46 %. The test-retest reliability of WTP values indices excellent stability and reliability of the instrument with Spearman’s rank correlation coefficient of 0.816 (p<0.001)Conclusion: This study demonstrated that the WTP instrument is feasible and relatively reliable for measuring the WTP values in Indonesia. For wider application of the instrument, its validity should be investigated further. Meanwhile, adoption of WTP as an empirical evidence of societal values is encouraged. 

2021 ◽  
Author(s):  
Qi Zhang ◽  
Ke Zhang ◽  
Miao Li ◽  
Jiaxin Gu ◽  
Xintong Li ◽  
...  

Abstract Objectives To examine the validity and reliability of the Mandarin version of the Treatment Burden Questionnaire (TBQ) among stroke patients. Background Stroke patients need long-term management of symptoms and life situation, and treatment burden has recently emerged as a new concept that can influence the health outcomes during the rehabilitation process. Methods The convenience sampling method was used to recruit 187 cases of stroke patients in a tertiary grade hospital in Tianjin for a formal investigation. Item analysis, reliability and validity tests were carried out. The reliability test included internal consistency and test–retest reliability. And as well as content, structure and convergent validity were performed for the validity test. Results Of the 187 completed questionnaires, only 180 (96.3%) were suitable for analysis. According to the experts’ evaluation, the I-CVI of each item was from 0.833 to 1.000, and the S-CVI was 0.967. The exploratory factor analysis yielded three-factor components with a cumulative variation of 53.054%. Convergent validity was demonstrated using measures of Morisky’s Medication Adherence Scale 8 (r = –0.450, P &lt; 0.01). All correlations between items and global scores ranged from 0.403 to 0.638. Internal consistency reliability and test–retest reliability were found to be acceptable, as indicated by a Cronbach’s α of 0.824 and an intraclass correlation coefficient of 0.846, respectively. Conclusions The Mandarin TBQ had acceptable validity and reliability. The use of TBQ in the assessment of treatment burden of stroke survivor may benefit health resources allocation and provide tailor therapeutic interventions to construct minimally disruptive care.


2021 ◽  
pp. 1-8
Author(s):  
Yasemin Eskigülek ◽  
Sultan Kav

Abstract Objective The aim of this study was to investigate the validity and reliability of the Patient Dignity Inventory (PDI) in the Turkish society, which was developed to evaluate dignity-related distress in palliative care patients. Methods One hundred and twenty-seven adults with advanced cancer hospitalized in several clinics of two university hospitals were included in the study. The patients whose Palliative Performance Scale score was at least 40% were recruited to study. The data were collected with a patient demographic form, the Turkish version of Hospital Anxiety and Depression Scale (HADS-TR), and the Turkish version of the PDI (PDI-TR). The PDI-TR was finalized and back-translated after translating into Turkish and obtaining 10 expert opinions. Exploratory and confirmatory factor analysis, internal consistency, concurrent validity, and test–retest reliability analysis were performed. Results The Cronbach's α coefficient of PDI-TR was 0.94. Factor analysis resulted in a five-factor solution, and all items were loaded on factors. Factors were labeled as symptom distress, existential distress, self-confidence, dependency, and supportive care needs and accounted for 68.70% of the overall variance. The model's normed fit index, comparative fit index, and X2/SD were found between acceptable range (0.90, 0.93, and 2.64, respectively). A positive and strong correlation was found between subdimension scores of HADS-TR and the total score of PDI-TR (r = 0.70 for anxiety subdimension; r = 0.73 for depression subdimension). The test–retest reliability was conducted with 32 patients within the sample two weeks after the first application, and no significant difference was found between the two application scores as the result of paired-sample t-test (p > 0.05). An intraclass correlation coefficient of test–retest reliability was r = 0.855. Significance of results PDI-TR was found to be a valid and reliable tool in palliative care patients in Turkish society.


2021 ◽  
Vol 34 (13) ◽  
Author(s):  
Mário Pereira Pinto ◽  
Sónia Martins ◽  
Edgar Mesquita ◽  
Lia Fernandes

Introduction: This study aims to describe the translation and adaptation of the European Portuguese Clinical Frailty Scale and assess its convergent validity and test-retest reliability.Material and Methods: This validation study included a sample of elderly people admitted in two convalescence units from the National Network of Integrated Continuous Care in Northern Portugal and followed in two outpatient clinics of social solidarity institutions. Convergent validity of the scale was evaluated, against Tilburg Frailty Indicator. Test-retest reliability, sensitivity and specificity were assessed.Results: Overall, 51 patients were included (mean age = 78 years old). The Clinical Frailty Scale identified 43.1% patients with frailty. Kappa values for test-retest reliability (non-frail/frail) was 1.00. The intraclass correlation coefficient for the 9-point total scale was 0.999. A correlation between Clinical Frailty Scale and Tilburg Frailty Indicator was also found (rs = 0.683; p < 0.001). The Cohen’s kappa coefficient was 0.423 in the agreement analysis between these scales. The results for sensitivity and specificity defined that 62.0% of patients were true positives and 81.8% true negatives. The scale accuracy determined by the receiver operating characteristics curve analysis was 0.782.Discussion: This scale showed an excellent test-retest reliability. Robust results on convergent validity were also achieved, with a moderate correlation and agreement with the Tilburg Frailty Indicator, showing good sensitivity and accuracy, as well as high specificity.Conclusion: This version has an excellent test-retest reliability and good convergent validity, and is both a reliable and valid test for application in clinical practice for assessing Portuguese elderly population admitted in convalescence units and outpatient clinics.


2020 ◽  
pp. 156918612094453
Author(s):  
Eris CM Ho ◽  
Mona Dür ◽  
Tanja Stamm ◽  
Andrew MH Siu

Background Occupational balance, a fundamental concept in occupational therapy, is the arrangement of right amount and variety of occupations contributes to a person’s health and well-being. This study was aimed to investigate the reliability and validity of the Chinese version of the Occupational Balance Questionnaire (OB-Quest) for people with insomnia. Methods The OB-Quest was translated into traditional Chinese and reviewed by an expert panel for content validity, cultural relevance and translation accuracy. Internal consistency, factor analysis and convergent validity, as well as test–retest reliability, were explored. Results The participants (n = 205), 115 adults with insomnia and 90 adults without insomnia, completed a survey of demographic background, the Chinese version of OB-Quest and the Chinese Insomnia Severity Index (C-ISI). The Chinese version of OB-Quest demonstrated excellent test–retest reliability (ICC= 0.98) and good internal consistency (Cronbach’s α  =  0.80). Factor analysis indicated that a single-factor solution explained 42% of the variance, and 9 out of 10 items had a factor loading of 0.4 or above. The Chinese version of OB-Quest had significant correlations with C-ISI (r = –0.88; p < 0.001). A significant difference was found in occupational balance between groups with different levels of insomnia severity and without insomnia (F = 169.72; p < 0.001). As in a previous study, age, living environment and life role had no significant relationship with occupational balance. Conclusion The Chinese version of OB-Quest is a short, easy to understand and culturally relevant assessment for Chinese. It demonstrates satisfactory psychometric properties and had significant correlations with insomnia.


Author(s):  
J Baker ◽  
JR Paturel ◽  
K Kimpinski

Background: To develop a scale to quantify and discriminate orthostatic from non-orthostatic symptoms. We present initial validation and reliability of orthostatic and non-orthostatic symptom scores taken from the Orthostatic Discriminate and Severity Scale (ODSS). Methods: Validity and reliability were assessed in participants with and without orthostatic intolerance. Convergent validity was assessed by correlating symptoms scores with previously validated tools (Autonomic Symptom Profile (ASP) and the Orthostatic Hypotension Questionnaire (OHQ)). Clinical validity was assessed by correlating scores against standardized autonomic testing. Test-retest reliability was calculated using an intra-class correlation coefficient. Results:Convergent Validity: Orthostatic (OS) and Non-Orthostatic (NS) Symptom Scores from 77 controls and 67 patients with orthostatic intolerance were highly correlated with both the Orthostatic Intolerance index of the ASP (OS:r=0.903;NS:r=0.651; p<0.001) and the OHQ: (OS:r=0.800;NS:r=0.574; p<0.001). Clinical Validity: Symptom Scores were significantly correlated with the blood pressure change during head-up tilt (OS:r=-0.445;NS:r=-0.354; p<0.001). Patients with orthostatic intolerance had significantly higher symptom scores compared to controls (OS:66.5±18.1 vs. 17.4±12.9; NS:19.9±11.3 vs. 10.2±6.8; p<0.001, respectively). Test-retest reliability: Both symptom scores were highly reliable (OS:r=0.956;NS:r=0.574, respectively; p<0.001) with an internal consistency of 0.978 and 0.729, respectively. Conclusions: Our initial results demonstrate that the ODSS is capable of producing valid and reliable Orthostatic and Non-Orthostatic Symptom Scores.


2014 ◽  
Vol 94 (6) ◽  
pp. 866-874 ◽  
Author(s):  
Judit Takacs ◽  
S. Jayne Garland ◽  
Mark G. Carpenter ◽  
Michael A. Hunt

Background There is a high incidence of falls in older adults with knee osteoarthritis (OA). Adequate dynamic balance and mobility reduce the risk of falls; however, there are currently no validated, advanced tests of dynamic balance and mobility for individuals with knee OA. Objective The purpose of this study was to determine the convergent validity, known-groups validity, and test-retest reliability of a dynamic test of balance and mobility, the Community Balance and Mobility Scale (CB&M), in a knee OA population. Design A cross-sectional design was used. Methods Twenty-five individuals aged 50 years and older with medial knee OA and an equal number of healthy controls completed the CB&M and other tests of balance and mobility, including the Berg Balance Scale, the Timed “Up & Go” Test, a test of maximal single-leg stance time, and the 10-Meter Walk Test (self-selected and fast walking speed). Convergent validity of balance tests with the CB&M was assessed using Pearson product moment correlation coefficients, and known-groups validity was assessed using independent t tests. Test-retest reliability of the CB&M was assessed using intraclass correlation coefficients (ICCs) and standard error of measurement (SEM). Results Scores on the CB&M were significantly correlated with all measures of balance and mobility for those with knee OA. There were significant differences in CB&M scores between groups. Scores on the CB&M were highly reliable in people with knee OA (ICC=.95, 95% confidence interval [95% CI]=0.70 to 0.99; SEM=3, 95% CI=2.68 to 4.67). Limitations Few participants had severe knee OA. Conclusions The CB&M displayed moderate convergent validity, excellent known-groups validity, and high test-retest reliability. The CB&M can be used as a valid and reliable tool to assess dynamic balance and mobility deficits in people with knee OA.


Author(s):  
J Baker ◽  
J Racosta ◽  
K Kimpinski

Background: Orthostatic symptoms including dizziness, light-headedness and syncope can be major causes of disability in patients with dysautonomia. Currently there is no validated tool capable of discriminating orthostatic from non-orthostatic constitutional symptoms. Therefore, we developed the Orthostatic Discriminant and Severity Scale (ODSS) to help make this distinction. Objective: Demonstrate validity and reliability of the ODSS. Methods: Convergent and clinical validity were assessed by correlating Orthostatic scores with previously validated tools (Autonomic Symptom Profile (ASP), composite scores of the Orthostatic Hypotension Questionnaire and the total Composite Autonomic Severity Score (tCASS), respectively). Test-retest reliability was calculated using an intra-class correlation coefficient. Results: Orthostatic scores from 23 controls and 5 patients were highly correlated with both the Orthostatic Intolerance index of the ASP (r=0.724;p<0.01) and the composite OHDAS and OHSAS (r=0.552;p<0.01 and r=0.753;p<0.01, respectively), indicating good convergent validity. Orthostatic scores were significantly correlated with tCASS (r=0.568;p<0.01), and the systolic blood pressure change during head-up tilt (r=-0.472;p=0.013). In addition, patients with Neurogenic Orthostatic Hypotension had significantly higher Orthostatic scores than controls (p<0.01) indicating good clinical validity. Test-retest reliability was strong (r=0.954;p<0.01) with an internal consistency of 0.978. Conclusions: Our results, though preliminary, provide empiral evidence that the ODSS is capable of producing a valid and reliable orthostatic score.


2022 ◽  
Vol 2022 ◽  
pp. 1-7
Author(s):  
Yonghong Ma ◽  
Jiao Tan ◽  
Zhijun Tan ◽  
Lei Shang

Background. Considering the lack of valid and reliable food frequency questionnaires (FFQs) for nutritional epidemiological studies in China, it is necessary to develop an effective one for assessing nutrient intake among preschool children. The aim of this study was to evaluate the validity and reliability of newly developed FFQs for assessing food and nutrient intakes among preschool children in Northwest China. Methods. Semiquantitative 67-item FFQs were developed and validated. In total, 326 children (aged 2–6 years) were recruited from three different cities in Northwest China. All subjects were asked to complete the FFQs twice with a six-month interval period for test-retest reliability. Apart from the FFQs, a 3-day food record (3-DFR) was also carried out to evaluate the validity of the FFQs. Results. There was no significant difference in the nutrient intakes of preschool children between the two FFQs ( P > 0.05 ), and these two FFQs demonstrated a positive correlation ( P < 0.05 ). Spearman’s coefficient correlation values ranged from 0.222 (“Selenium”) to 0.832 (“Energy”). The intraclass correlation coefficient values ranged from 0.282 (“Selenium”) to 0.882 (“Energy”). With regards to the validity of FFQs, nutrient intakes from FFQs were greater than 3DR dietary recalls ( P < 0.05 ). After adjusting for total energy and intraindividual variation, all nutrient intakes showed a positive correlation ( P < 0.05 ), and these correlations became stronger. According to the quartiles of nutrient intakes, the exact agreement between the FFQs and 3DR dietary recalls ranged between 40% (“Selenium”) and 70% (“Energy”), and grossly misclassified was low (12.5%). Conclusions. The findings of this study indicate that the designed FFQs exhibit good test-retest reliability and moderate relative validity. Hence, the FFQs can serve as an important tool for the large-scale assessment of food and nutrient intakes among preschool children (in the mentioned areas of China).


2021 ◽  
Author(s):  
Mikiyas Amare Getu ◽  
Panpan Wang ◽  
Eva Johanna Kantelhardt ◽  
Edom Seife ◽  
Changying Chen ◽  
...  

Abstract Objective This study aimed to examine the validity and reliability of the EORTC QLQ-BR45 questionnaire.Methods This study included 248 breast cancer patients who completed the QLQ-BR45 and QLQ-C30 questionnaires. The internal reliability, test-retest reliability, and the content, concurrent, convergent, divergent, and clinical validity of the tool were examined. The statistical analyses included Cronbach’s α coefficient, Pearson’s correlation coefficient, standardised response mean residual (SRMR), comparative fit index (CFI), t-test, and root mean square error of approximation (RMSEA). Result All items were marked as relevant, and item-level content validity index (I-CVI) scores ranged from 0.83 to 1. The Cronbach’s α coefficient was 0.80 for all domains. All subscales met the minimal standards of reliability except the arm symptom scale (0.66). The test-retest reliability coefficient was 0.77 for all domains. Seven out of the 12 hypothesised scales showed positive correlations (r > 0.40) between the QLQ-BR45 and QLQ-C30 scales. Multitrait scaling analysis showed that the item-scale correlations exceeded the 0.40 criterion for item-convergent validity for 11 of the 12 hypothesised scales. The correlation coefficients between an item and its own subscale were significantly higher than with other subscales.Conclusion The EORTC QLQ-BR45 had good reliability and validity, and it can be used to measure the quality of life of breast cancer patients in Ethiopia.


2021 ◽  
Vol 2021 ◽  
pp. 1-5
Author(s):  
Mohammad Taghi Joghataei ◽  
Seyed-Mohammad Fereshtehnejad ◽  
Maryam Mehdizadeh ◽  
Sepideh Goudarzi ◽  
Sayed Amir Hasan Habibi ◽  
...  

Objective. Sleep problems are nonmotor symptoms in Parkinson’s disease that should be carefully evaluated for better management and treatment. Parkinson’s Disease Sleep Scale (PDSS-2) is one of the most reliable tools for measuring sleep difficulties in people with Parkinson’s disease. This study investigated the psychometric properties of the Persian version of PDSS-2. Methods. Four hundred and fifty-six people with Parkinson’s disease with a mean age ±standard deviation of 60.7 ± 11.3 years were engaged in this study. Acceptability was assessed by floor and ceiling effects. Dimensionality was measured by exploratory factor analysis. The convergent validity of PDSS-2 with the Hospital Anxiety and Depression Scale (HADS) was assessed. Internal consistency and test-retest reliability were assessed with Cronbach’s alpha and intraclass correlation coefficient (ICC), respectively. Results. No noticeable ceiling and floor effect was detected. The dimensionality analysis showed three factors. A high correlation was obtained between PDSS-2 and HADS (anxiety subscale). Excellent internal consistency with α = 0.94, and good test-retest reliability with ICC = 0.89 were obtained. Conclusion. This study showed that the Persian version of Parkinson’s Disease Sleep Scale has acceptable validity and reliability for measuring sleep disturbances in people with Parkinson’s disease.


Sign in / Sign up

Export Citation Format

Share Document