scholarly journals Reliability and validity of the Patient Benefit Assessment Scale for Hospitalised Older Patients (P-BAS HOP)

2020 ◽  
Author(s):  
Maria van der Kluit ◽  
Geke Dijkstra ◽  
Sophia de Rooij
Keyword(s):  
Construct Validity ◽  
Correlation Coefficient ◽  
Older Patients ◽  
Reliability And Validity ◽  
Weighted Kappa ◽  
Assessment Scale ◽  
Benefit Assessment ◽  
Patient Benefit ◽  
Important Benefit

Abstract Background: The Patient Benefit Assessment Scale for Hospitalised Older Patients (P-BAS HOP) is a tool which is capable of both identifying the priorities of the individual patient and measuring the outcomes relevant to him, resulting in a Patient Benefit Index (PBI) with range 0-3, indicating how much benefit the patient had experienced from the admission. The aim of this study was to evaluate the reliability, validity, responsiveness and interpretability of the P-BAS HOP.Methods: A longitudinal study among hospitalised older patients with a baseline interview during hospitalisation and a follow-up by telephone three months after discharge. Test-retest reliability of the baseline and follow-up questionnaire were tested. Percentage of agreement, Cohen’s kappa with quadratic weighting and maximum attainable kappa were calculated per item. The PBI was calculated for both test and retest of baseline and follow-up and compared with Intraclass Correlation Coefficient (ICC). Construct validity was tested by evaluating pre-defined hypotheses comparing the priority of goals with experienced symptoms or limitations at admission and the achievement of goals with progression or deterioration of other constructs. Responsiveness was evaluated by correlating the PBI with the anchor question ‘How much did you benefit from the admission?’. This question was also used to evaluate the interpretability of the PBI with the visual anchor-based minimal important change distribution method.Results: Reliability was tested with 53 participants at baseline and 72 at follow-up. Mean weighted kappa of the baseline items was 0.38. ICC between PBI of the test and retest was 0.77.Mean weighted kappa of the follow-up items was 0.51. ICC between PBI of the test and retest was 0.62.For the construct validity, tested in 451 participants, all baseline hypotheses were confirmed. From the follow-up hypotheses, tested in 344 participants, five of seven were confirmed. The Spearman’s correlation coefficient between the PBI and the anchor question was .51.The optimal cut-off point was 0.7 for ‘no important benefit’ and 1.4 points for ‘important benefit’ on the PBI. Conclusions: Although the concept seems promising, the reliability and validity of the P-BAS HOP appeared to be not yet satisfactory. We therefore recommend adapting the P-BAS HOP.

scholarly journals Reliability and validity of the Patient Benefit Assessment Scale for Hospitalised Older Patients (P-BAS HOP)

2021 ◽  
Vol 21 (1) ◽  
Author(s):  
Maria Johanna van der Kluit ◽  
Geke J. Dijkstra ◽  
Sophia E. de Rooij
Keyword(s):  
Construct Validity ◽  
Correlation Coefficient ◽  
Older Patients ◽  
Reliability And Validity ◽  
Weighted Kappa ◽  
Assessment Scale ◽  
Benefit Assessment ◽  
Patient Benefit ◽  
Important Benefit

Abstract Background The Patient Benefit Assessment Scale for Hospitalised Older Patients (P-BAS HOP) is a tool which is capable of both identifying the priorities of the individual patient and measuring the outcomes relevant to him/her, resulting in a Patient Benefit Index (PBI) with range 0–3, indicating how much benefit the patient had experienced from the admission. The aim of this study was to evaluate the reliability, validity, responsiveness and interpretability of the P-BAS HOP. Methods A longitudinal study among hospitalised older patients with a baseline interview during hospitalisation and a follow-up by telephone 3 months after discharge. Test-retest reliability of the baseline and follow-up questionnaire were tested. Percentage of agreement, Cohen’s kappa with quadratic weighting and maximum attainable kappa were calculated per item. The PBI was calculated for both test and retest of baseline and follow-up and compared with Intraclass Correlation Coefficient (ICC). Construct validity was tested by evaluating pre-defined hypotheses comparing the priority of goals with experienced symptoms or limitations at admission and the achievement of goals with progression or deterioration of other constructs. Responsiveness was evaluated by correlating the PBI with the anchor question ‘How much did you benefit from the admission?’. This question was also used to evaluate the interpretability of the PBI with the visual anchor-based minimal important change distribution method. Results Reliability was tested with 53 participants at baseline and 72 at follow-up. Mean weighted kappa of the baseline items was 0.38. ICC between PBI of the test and retest was 0.77. Mean weighted kappa of the follow-up items was 0.51. ICC between PBI of the test and retest was 0.62. For the construct validity, tested in 451 participants, all baseline hypotheses were confirmed. From the follow-up hypotheses, tested in 344 participants, five of seven were confirmed. The Spearman’s correlation coefficient between the PBI and the anchor question was 0.51. The optimal cut-off point was 0.7 for ‘no important benefit’ and 1.4 points for ‘important benefit’ on the PBI. Conclusions Although the concept seems promising, the reliability and validity of the P-BAS HOP appeared to be not yet satisfactory. We therefore recommend adapting the P-BAS HOP.

scholarly journals Adaptation of the Patient Benefit Assessment Scale for Hospitalised Older Patients: development, reliability and validity of the P-BAS picture version

2022 ◽  
Vol 22 (1) ◽  
Author(s):  
Maria Johanna van der Kluit ◽  
Geke J. Dijkstra ◽  
Sophia E. de Rooij
Keyword(s):  
Construct Validity ◽  
Older Patients ◽  
Assessment Scale ◽  
Benefit Assessment ◽  
Step Test ◽  
Minimal Important Change ◽  
Patient Benefit ◽  
Smallest Detectable Change ◽  
The Individual

Abstract Background The Patient Benefit Assessment Scale for Hospitalised Older Patients (P-BAS HOP) is a tool developed to both identify the priorities of the individual patient and to measure the outcomes relevant to him/her, resulting in a Patient Benefit Index (PBI), indicating how much benefit the patient had experienced from the hospitalisation. The reliability and the validity of the P-BAS HOP appeared to be not yet satisfactory and therefore the aims of this study were to adapt the P-BAS HOP and transform it into a picture version, resulting in the P-BAS-P, and to evaluate its feasibility, reliability, validity, responsiveness and interpretability. Methods Process of instrument development and evaluation performed among hospitalised older patients including pilot tests using Three-Step Test-Interviews (TSTI), test-retest reliability on baseline and follow-up, comparing the PBI with Intraclass Correlation Coefficient (ICC), and hypothesis testing to evaluate the construct validity. Responsiveness of individual P-BAS-P scores and the PBI with two different weighing schemes were evaluated using anchor questions. Interpretability of the PBI was evaluated with the visual anchor-based minimal important change (MIC) distribution method and computation of smallest detectable change (SDC) based on ICC. Results Fourteen hospitalised older patients participated in TSTIs at baseline and 13 at follow-up after discharge. After several adaptations, the P-BAS-P appeared feasible with good interviewer’s instructions. The pictures were considered relevant and helpful by the participants. Reliability was tested with 41 participants at baseline and 50 at follow-up. ICC between PBI1 and PBI2 of baseline test and retest was 0.76, respectively 0.73. At follow-up 0.86, respectively 0.85. For the construct validity, tested in 169 participants, hypotheses regarding importance of goals were confirmed. Regarding status of goals, only the follow-up status was confirmed, baseline and change were not. The responsiveness of the individual scores and PBI were weak, resulting in poor interpretability with many misclassifications. The SDC was larger than the MIC. Conclusions The P-BAS-P appeared to be a feasible instrument, but there were methodological barriers for the evaluation of the reliability, validity, and responsiveness. We therefore recommend further research into the P-BAS-P.

scholarly journals Adaptation of the Patient Benefit Assessment Scale for Hospitalised Older Patients: Development, Reliability and Validity of the P-BAS Picture Version

2021 ◽  
Author(s):  
Maria Johanna van der Kluit ◽  
Geke J. Dijkstra ◽  
Sophia E. de Rooij
Keyword(s):  
Construct Validity ◽  
Older Patients ◽  
Assessment Scale ◽  
Benefit Assessment ◽  
Step Test ◽  
Minimal Important Change ◽  
Patient Benefit ◽  
Smallest Detectable Change ◽  
The Individual

Abstract Background: The Patient Benefit Assessment Scale for Hospitalised Older Patients (P-BAS HOP) is a tool developed to both identify the priorities of the individual patient and to measure the outcomes relevant to him/her, resulting in a Patient Benefit Index (PBI), indicating how much benefit the patient had experienced from the hospitalisation. The reliability and the validity of the P-BAS HOP appeared to be not yet satisfactory and therefore the aims of this study were to adapt the P-BAS HOP and transform it into a picture version, resulting in the P-BAS-P, and to evaluate its feasibility, reliability, validity, responsiveness and interpretability.Methods: Process of instrument development and evaluation performed among hospitalised older patients including pilot tests using Three-Step Test-Interviews (TSTI), test-retest reliability on baseline and follow-up, comparing the PBI with Intraclass Correlation Coefficient (ICC), and hypothesis testing to evaluate the construct validity. Responsiveness of individual P-BAS-P scores and the PBI with two different weighing schemes were evaluated using anchor questions. Interpretability of the PBI was evaluated with the visual anchor-based minimal important change (MIC) distribution method and computation of smallest detectable change (SDC) based on ICC.Results: Fourteen hospitalised older patients participated in TSTIs at baseline and thirteen at follow-up after discharge. After several adaptations, the P-BAS-P appeared feasible with good interviewer’s instructions. The pictures were considered relevant and helpful by the participants. Reliability was tested with 41 participants at baseline and 50 at follow-up. ICC between PBI1 and PBI2 of baseline test and retest was 0.76, respectively 0.73. At follow-up 0.86, respectively 0.85.For the construct validity, tested in 169 participants, hypotheses regarding importance of goals were confirmed. Regarding status of goals, only the follow-up status was confirmed, baseline and change were not. The responsiveness of the individual scores and PBI were weak, resulting in poor interpretability with many misclassifications. The SDC was larger than the MIC.Conclusions: The P-BAS-P appeared to be a feasible instrument, but there were methodological barriers for the evaluation of the reliability, validity, and responsiveness. We therefore recommend further research into the P-BAS-P.

scholarly journals Development of a new tool for the assessment of patient-defined benefit in hospitalised older patients: the Patient Benefit Assessment Scale for Hospitalised Older Patients (P-BAS HOP)

BMJ Open ◽  
2020 ◽  
Vol 10 (11) ◽  
pp. e038203
Author(s):  
Maria Johanna van der Kluit ◽  
Geke J Dijkstra ◽  
Barbara C van Munster ◽  
Sophia De Rooij
Keyword(s):  
Field Test ◽  
Teaching Hospital ◽  
Older Patients ◽  
Community Dwelling ◽  
Assessment Scale ◽  
Benefit Assessment ◽  
Step Test ◽  
Patient Benefit ◽  
Evaluation Questionnaire ◽  
Baseline Questionnaire

ObjectivesTo support the shift from disease-oriented towards goal-oriented care, we aimed to develop a tool which is capable both to identify priorities of an individual older hospitalised patient and to measure the outcomes relevant to him.DesignMixed-methods design with open interviews, three step test interviews (TSTIs) and a quantitative field test.SettingUniversity teaching hospital and a regional teaching hospital.ParticipantsHospitalised patients ages 70 years and older.ResultsThe Patient Benefit Assessment Scale for Hospitalised Older Patients (P-BAS HOP) consists of a baseline questionnaire and an evaluation questionnaire. Items were based on 15 qualitative interviews with hospitalised older patients. Feedback from a panel of four community-dwelling older persons resulted in some adaptations to wording and one additional item. Twenty-six hospitalised older patients participated in TSTIs with Version 1 of the baseline questionnaire, revealing indications for a good content validity and barriers in completion behaviour, global understanding and understanding of individual items, which were solved with several adaptations. Four additions were made by participants. After TSTIs with ten patients with the evaluation questionnaire, one adaptation was made. A field test with 91 hospitalised older patients revealed a small number of missing values.To enhance the feasibility, the number of items was reduced from 32 to 22, based on correlations and mean impact score. The field test was repeated with 104 other patients in a regional teaching hospital. To enhance the understanding, the tool was split into two phases. This version was tested with TSTIs with eight patients and appeared to be understandable. The final version was an interview-based tool and took about 11 min to complete.ConclusionsThe P-BAS HOP is a potentially suitable tool to identify priorities and relevant outcomes of the individual patient. Further research is needed to investigate its validity, reliability and responsiveness.

Development and Validation of a Questionnaire to Measure Attitude change in Health Professionals after Completion of an Aboriginal Health and Cultural Safety Training Programme

2017 ◽  
Vol 48 (01) ◽  
pp. 24-38 ◽  
Author(s):  
Courtney Ryder ◽  
Tamara Mackean ◽  
Shahid Ullah ◽  
Heather Burton ◽  
Heather Halls ◽  
...  
Keyword(s):  
Health Professional ◽  
Correlation Coefficient ◽  
Intraclass Correlation Coefficient ◽  
Attitude Change ◽  
Focal Point ◽  
Intraclass Correlation ◽  
Reliability And Validity ◽  
Weighted Kappa ◽  
Aboriginal Health ◽  
Cultural Safety

Socially accountable health curricula, designed to decrease Aboriginal health inequities through the transformation of health professional students into culturally safe practitioners, has become a focal point for health professional programmes. Despite this inclusion in health curricula there remains the question of how to best assess students in this area in relation to the concept, of cultural safety and transformative unlearning, to facilitate attitudinal change. To address this question, this study developed a research questionnaire to measure thematic areas of transformative unlearning, cultural safety and critical thinking in Aboriginal Health for application on undergraduate and postgraduate students and faculty staff. The Likert-scale questionnaire was developed and validated through face and content validity. Test–retest methodology was utilised to determine stability and reliability of the questionnaire with 40 participants. The extent of agreement and reliability were determined through weighted kappa and intraclass correlation coefficient. Exploratory factor analysis was calculated to determine construct validity for questionnaire items. For the overall population subset the tool met good standards of reliability and validity, with 11 of the 15 items reaching moderate agreement (κ > 0.6) and an intraclass correlation coefficient of 0.72, suggesting substantial agreement. Cronbach's alpha was calculated above 0.7 for the thematic areas. The majority of items provided high factor loadings, low loading items will be reviewed to strengthen the tool, where validations of the revised tool with a larger cohort will allow future use to compare and determine effective teaching methodologies in Aboriginal health and cultural safety curricula.

scholarly journals FFQ for the adult population of the capital of Ecuador (FFQ-Quito): development, reliability and validity

2015 ◽  
Vol 18 (14) ◽  
pp. 2540-2549 ◽  
Author(s):  
Katherine M Silva-Jaramillo ◽  
Marilda B Neutzling ◽  
Michele Drehmer
Keyword(s):  
Correlation Coefficient ◽  
Nutrient Intake ◽  
Communicable Disease ◽  
Pearson Correlation ◽  
Adult Population ◽  
Reliability And Validity ◽  
Correlation Coefficients ◽  
Weighted Kappa ◽  
Nutrient Intakes ◽  
Relative Validity

AbstractObjectiveTo assess the reliability and validity of a semi-quantitative FFQ designed to evaluate the usual nutrient intake of adults in Quito, Ecuador.DesignDietary data using 24 h recalls (24hR) were used to design a list of commonly consumed foods. The relative validity of a 111-item FFQ was evaluated by comparing nutrient intakes against three non-consecutive 24hR. All nutrients were energy-adjusted. Reliability was assessed using two FFQ (FFQ1 and FFQ2) and assessed by the intra-class correlation coefficient. The comparisons between the FFQ and the 24hR were assessed by the de-attenuated Pearson correlation coefficient, weighted kappa and by Bland–Altman plots.SettingQuito, Ecuador.SubjectsOverall, 345 adults were enrolled in the present study. Two hundred and fifty participated in FFQ development and ninety-five participated in the FFQ validity and reliability.ResultsThe FFQ produced higher energy and nutrient intakes. Reliability correlation coefficients after adjusting for energy ranged from 0·62 to 0·88 for protein and Ca, respectively. For the validity study, energy-adjusted and de-attenuated correlation coefficients between the questionnaire and the 24hR ranged from 0·21 for fat to 0·65 for Ca. Only 4 % of the participants were grossly misclassified and 46 % had weighted kappa higher than 0·42. The Bland–Altman plot showed a constant bias with a tendency to increase according to the intake level.ConclusionsThe FFQ showed reasonably good relative validity and reliable measurements, especially for nutrients considered protective and risk markers of non-communicable disease, and can be used to assess usual nutrient intake in this population.

The Benzodiazepine Dependence Questionnaire: Development, Reliability and Validity

1996 ◽  
Vol 169 (3) ◽  
pp. 276-281 ◽  
Author(s):  
Andrew J. Baillie ◽  
Richard P. Mattick
Keyword(s):  
Construct Validity ◽  
Internal Consistency ◽  
Temporal Stability ◽  
Reliability And Validity ◽  
Questionnaire Development ◽  
Self Report ◽  
Withdrawal Symptoms ◽  
Benzodiazepine Dependence ◽  
Good Internal Consistency

BackgroundA short self-report questionnaire was developed to assess dependence on benzodiazepines (BZDs), the Benzodiazepine Dependence Questionnaire (BDEPQ). The BDEPQ is the first scale to assess dependence on BZDs comprehensively, as all existing scales focus exclusively on withdrawal symptoms.MethodTo evaluate its internal consistency and construct validity, 302 regular BZD users were recruited from media advertisements and assessed on a number of measures. The BDEPQ was compared with measures of depression, anxiety, sleep quality, BZD withdrawal symptoms and neuroticism to assess its construct validity. A 3–4 month follow-up was conducted to assess the ability of the BDEPQ to predict changes in BZD consumption and future BZD withdrawal.ResultsThe BDEPQ was found to have high internal consistency and to be relatively stable over the follow-up period. Three subscales were identified, each with good internal consistency and temporal stability. The BDEPQ was able to predict the severity of withdrawal symptoms.ConclusionThe BDEPQ was found to be a reliable and valid self-report instrument for the assessment of BZD dependence in samples approximating the general population of people using BZDs.

scholarly journals Reliability and Validity of Trunk Assessment for People With Multiple Sclerosis

2006 ◽  
Vol 86 (1) ◽  
pp. 66-76 ◽  
Author(s):  
Geert Verheyden ◽  
Godelieve Nuyens ◽  
Alice Nieuwboer ◽  
Pol Van Asch ◽  
Piet Ketelaer ◽  
...  
Keyword(s):  
Multiple Sclerosis ◽  
Construct Validity ◽  
Intraclass Correlation ◽  
Reliability And Validity ◽  
Correlation Coefficients ◽  
Weighted Kappa ◽  
Altman Analysis ◽  
Bland Altman Analysis ◽  
Intraclass Correlation Coefficients ◽  
Test Retest Reliability

Abstract Background and Purpose. Standardized scales are a prerequisite for rehabilitation and research. This study was designed to determine the reliability and validity of scores on items of the trunk assessment of the Melsbroek Disability Scoring Test (MDST) and Trunk Impairment Scale (TIS) in people with multiple sclerosis (MS). Subjects. Thirty people with MS participated in the study. Methods. Interrater and test-retest reliability and construct validity were assessed. Results. Kappa and weighted kappa values for the items of the trunk assessment of the MDST ranged from .74 to .95, and the kappa and weighted kappa values for the TIS items ranged from .46 to 1.00. Intraclass correlation coefficients for interrater and test-retest agreement were .93 and .92, respectively, for the trunk assessment of the MDST and .97 and .95, respectively, for the TIS. Bland-Altman analysis showed consistency of scores without observer bias. Construct validity was established. Discussion and Conclusion. The MDST and TIS provide reliable assessments of the trunk and are valid scales for measuring trunk performance in people with MS. [Verheyden G, Nuyens G, Nieuwboer A, et al. Reliability and validity of trunk assessment for people with multiple sclerosis.

The Windows Computer Experience Questionnaire

1996 ◽  
Vol 40 (20) ◽  
pp. 1027-1031
Author(s):  
Laura A. Miller ◽  
Kay M. Stanney
Keyword(s):  
Construct Validity ◽  
Internal Consistency ◽  
Reliability And Validity ◽  
Computer Experience ◽  
Follow Up Study ◽  
Reliable Tool ◽  
High Internal Consistency ◽  
Validity Studies ◽  
Experience Questionnaire

Windows environments are growing increasingly popular in both academia and industry. Despite the proliferation of these software programs, however, means of systematically determining an individual's experience in a Windows environment are seemingly non-existent. To address this problem we have developed the Windows Computer Experience Questionnaire (WCEQ). This paper describes the questionnaire and the procedures used to establish reliability and validity for the WCEQ. The WCEQ was administered to 82 participants and then re-administered 1-week later. The questionnaire was easy and quick to administer. It also provided a range of results reflecting the inherent diversity in computer experience of the group studied. Split-half and test-retest results indicated that the WCEQ has high internal consistency and is a reliable tool for measuring a user's knowledge of Windows environments. Furthermore, initial validity studies in a follow-up study provided evidence of the instrument's construct validity.

scholarly journals The reliability and validity of PHQ-9 in patients with major depressive disorder in psychiatric hospital

2019 ◽  
Author(s):  
Yue Sun ◽  
Zhaoyan Fu ◽  
Qijing Bo ◽  
Zhen Mao ◽  
Xin Ma ◽  
...  
Keyword(s):  
Major Depressive Disorder ◽  
Depressive Disorder ◽  
Construct Validity ◽  
Correlation Coefficient ◽  
Psychiatric Hospital ◽  
Intraclass Correlation ◽  
Reliability And Validity ◽  
Correlation Coefficients ◽  
Hamilton Depression Scale ◽  
Major Depressive

Abstract Background: To assess the reliability and validity of Patient Health Questionnaire-9 (PHQ-9) for patients with major depressive disorder (MDD) and to assess the feasibility of its use in psychiatric hospitals in China. Methods: 109 outpatients or inpatients with MDD who qualified the Diagnostic and Statistical Manual of Mental Disorders, fourth edition (DSM-IV) criteria completed PHQ-9 and Hamilton Depression Scale (HAMD-17). Two weeks after the initial evaluation, 54 randomly selected patients underwent repeat assessment using PHQ-9. For validity analysis, the construct validity and criterion validity were assessed. The internal concordance coefficient and the test-retest correlation coefficients were used for reliability analysis. The correlation between total score and scores for each item and the correlation between scores for various items were evaluated using Spearman correlation coefficient. Results: Principal components factor analysis showed good construct validity of the PHQ-9. PHQ-9 total score showed a positive correlation with HAMD-17 total score (r=0.610, P<0.001). With HAMD as the standard, PHQ-9 depression scores of 7, 15, and 21 points were used as cut-offs for mild, moderate, and severe depression, respectively. Consistency assessment was conducted between the depression severity as assessed by PHQ-9 and HAMD (Kappa=0.229, P<0.001). Intraclass correlation coefficient between PHQ-9 total score and HAMD total score was 0.594 (95% confidence interval: 0.456–0.704, P<0.001). The Cronbach's α coefficient of PHQ-9 was 0.892. Correlation coefficients between each item score and the total score ranged from 0.567–0.789 (P<0.01); the correlation coefficient between various item scores ranged from 0.233–0.747. The test-retest correlation coefficient for total score was 0.737. Conclusions: PHQ-9 showed good reliability and validity, and high adaptability for patients with MDD in psychiatric hospital. It is a simple, rapid, effective, and reliable tool for screening and evaluation of the severity of depression.

Sign in / Sign up

Export Citation Format

Share Document