scholarly journals Intrarater reliability of the Abilitator—a self-report questionnaire on work ability and functioning aimed at the population in a weak labour market position: a test–retest study

BMJ Open ◽  
2021 ◽  
Vol 11 (12) ◽  
pp. e057295
Author(s):  
Miia Wikström ◽  
Anne Kouvonen ◽  
Matti Joensuu

ObjectivesThe Abilitator is a patient-reported outcome measure (PROM) of work ability and functioning of those in a weak labour market position. It covers items for work ability and self-rated health, for example, and summary scales for social, psychological, cognitive and physical functioning, as well as everyday skills. The aim of this study was to evaluate the intrarater test–retest reliability, internal consistency and basic psychometric properties of the Finnish version of the Abilitator.Design, setting and outcomeThe test–retest study was conducted in European Social Fund projects in 2018–2019. The participants completed two Abilitator questionnaires over 7–14 days. The internal consistency analysis was based on data collected in 2017–2019 in services for the long-term unemployed. The reliability was assessed using correlations (r, rs, intraclass correlation coefficient (ICC)), agreement with Bland-Altman analysis and internal consistency with Cronbach’s alpha.ParticipantsThe test–retest study had 67 participants (52% men, mean age 43.9 years) and the internal consistency study 10 923 (48% men, mean age 38.58 years), respectively. Of all the participants, 80% had been unemployed for over a year.ResultsThe test–retest r or rs ranged from 0.71 to 0.93 and ICC from 0.74 to 0.93 for the items and summary scales. An exception was the life satisfaction item, with an rs of 0.60 and ICC of 0.45. A statistically significant difference was observed in the summary scale for social functioning (t=−2.01, p=0.049). Agreement was observed for all variables except social functioning. Alphas for summary scales ranged from 0.74 to 0.91.ConclusionsThe Finnish version of the Abilitator is a reliable PROM for the target group and has acceptable to excellent intrarater test–retest reliability and internal consistency, apart from the life satisfaction item. Further testing is needed for the social functioning summary scale.

2020 ◽  
Author(s):  
Miia Wikström ◽  
Heidi Anttila ◽  
Minna Savinainen ◽  
Anne Kouvonen ◽  
Matti Joensuu

Abstract Background: The unemployed have lower work ability and poorer health than the employed. This situation deteriorates when unemployment continues. The long-term unemployed often have co-morbidities and face many other challenges. This increases the need for a multidimensional assessment of work ability and functioning in different service settings. In this study, we describe the development and analyse the content validity of the Abilitator, a self-report questionnaire on work ability and functioning for those in a weak labour market position. Methods: The Abilitator was developed in 2014–2017. Its construct was assessed by members of academic expert panels (n=30), practical expert panels of professionals (n=700) and target group clients (n=28). The structure and the content of the questionnaire was co-developed in 29 workshops and adjusted twice based on the expert panels’ feedback. The Abilitator was also implemented among target group clients (n=3360) in different services and projects. During its development the Abilitator was linked to the International Classification of Functioning, Disability and Health (ICF). The content validation process followed the guidelines recommended by the Consensus-based Standards for the selection of health Measurement Instruments (COSMIN) panel. Results: The construct of the Abilitator combines the multidimensional and biopsychosocial models of work ability and functioning. It also includes aspects of social inclusion and employability. It evaluates social, psychological, cognitive and physical functioning, and the ability to cope with everyday life. The content of these concepts was validated by the academic and practical expert panels. The Abilitator’s 79 ICF codes covered 57% of the Generic, 77% of the Brief Vocational Rehabilitation, and 8% of the Minimal Environmental ICF Core Sets. When compared with the Work Ability Index (WAI) and the World Health Organization Disability Assessment Schedule (WHODAS 2.0), the direct equivalences of the ICF codes were 36% and 44%, respectively. Conclusion: The Abilitator sufficiently comprehensively covers the relevant aspects to enable the assessment of the overall work ability and functioning of the population in a weak labour market position.


2019 ◽  
Author(s):  
Miia Wikström ◽  
Heidi Anttila ◽  
Minna Savinainen ◽  
Anne Kouvonen ◽  
Matti Joensuu

Abstract Background The unemployed have lower work ability and poorer health than the employed. This situation deteriorates when unemployment continues. The long-term unemployed often have co-morbidities and face many other challenges. This increases the need for a multidimensional assessment of work ability and functioning in different service settings. In this study, we describe the development and analyse the content validity of the Abilitator, a self-report questionnaire on work ability and functioning for those in a weak labour market position. Methods The Abilitator was developed in 2014–2017. Its construct was assessed by the members of academic expert panels (n=30), practical expert panels of service actors (n=700) and target group clients (n=28). The structure and the content of the questionnaire was co-developed in 29 workshops and adjusted twice based on the expert panels’ feedback. The Abilitator was also implemented among target group clients (n=3360) in different services and projects. During its development the Abilitator was linked to the International Classification of Functioning, Disability and Health (ICF). The content validation process followed the guidelines recommended by the Consensus-based Standards for the selection of health Measurement Instruments (COSMIN) panel. Results The construct of the Abilitator combines the multidimensional and bio-psycho-social models of work ability and functioning. It also includes aspects of social inclusion and employability. It evaluates social, psychological, cognitive and physical functioning, and the ability to cope with everyday life. The content of these concepts was validated by the academic and practical expert panels. The Abilitator’s 79 ICF codes covered 50% of the Generic, 73% of the Brief Vocational Rehabilitation, and 17% of the Minimal Environmental ICF Core Sets. When compared with the Work Ability Index (WAI) and the World Health Organization Disability Assessment Schedule (WHODAS 2.0), the direct equivalences of the ICF codes were 29% and 39%, respectively. Conclusions The Abilitator covers the relevant aspects sufficiently comprehensively to enable the assessment of the overall work ability and functioning of the population with weak position in the labour market.


2019 ◽  
Author(s):  
Miia Wikström ◽  
Heidi Anttila ◽  
Minna Savinainen ◽  
Anne Kouvonen ◽  
Matti Joensuu

Abstract Abstract Background The unemployed have lower work ability and poorer health than the employed. This situation deteriorates when unemployment continues. The long-term unemployed often have co-morbidities and face many other challenges. This increases the need for a multidimensional assessment of work ability and functioning in different service settings. In this study, we describe the development and analyse the content validity of the Abilitator, a self-report questionnaire on work ability and functioning for those in a weak labour market position. Methods The Abilitator was developed in 2014–2017. Its construct was assessed by the members of academic expert panels (n=30), practical expert panels of service actors (n=700) and target group clients (n=28). The structure and the content of the questionnaire was co-developed in 29 workshops and adjusted twice based on the expert panels’ feedback. The Abilitator was also implemented among target group clients (n=3360) in different services and projects. During its development the Abilitator was linked to the International Classification of Functioning, Disability and Health (ICF). The content validation process followed the guidelines recommended by the Consensus-based Standards for the selection of health Measurement Instruments (COSMIN) panel. Results The construct of the Abilitator combines the multidimensional and bio-psycho-social models of work ability and functioning. It also includes aspects of social inclusion and employability. It evaluates social, psychological, cognitive and physical functioning, and the ability to cope with everyday life. The content of these concepts was validated by the academic and practical expert panels. The Abilitator’s 79 ICF codes covered 50% of the Generic, 73% of the Brief Vocational Rehabilitation, and 17% of the Minimal Environmental ICF Core Sets. When compared with the Work Ability Index (WAI) and the World Health Organization Disability Assessment Schedule (WHODAS 2.0), the direct equivalences of the ICF codes were 29% and 39%, respectively. Conclusions The Abilitator covers the relevant aspects sufficiently comprehensively to enable the assessment of the overall work ability and functioning of the population with weak position in the labour market.


2020 ◽  
Author(s):  
Miia Wikström ◽  
Heidi Anttila ◽  
Minna Savinainen ◽  
Anne Kouvonen ◽  
Matti Joensuu

Abstract Background: The unemployed have lower work ability and poorer health than the employed. This situation deteriorates when unemployment continues. The long-term unemployed often have co-morbidities and face many other challenges. This increases the need for a multidimensional assessment of work ability and functioning in different service settings. In this study, we describe the development and analyse the content validity of the Abilitator, a self-report questionnaire on work ability and functioning for those in a weak labour market position. Methods: The Abilitator was developed in 2014–2017. Its construct was assessed by members of academic expert panels (n=30), practical expert panels of professionals (n=700) and target group clients (n=28). The structure and the content of the questionnaire was co-developed in 29 workshops and adjusted twice based on the expert panels’ feedback. The Abilitator was also implemented among target group clients (n=3360) in different services and projects. During its development the Abilitator was linked to the International Classification of Functioning, Disability and Health (ICF). The content validation process followed the guidelines recommended by the Consensus-based Standards for the selection of health Measurement Instruments (COSMIN) panel. Results: The construct of the Abilitator combines the multidimensional and biopsychosocial models of work ability and functioning. It also includes aspects of social inclusion and employability. It evaluates social, psychological, cognitive and physical functioning, and the ability to cope with everyday life. The content of these concepts was validated by the academic and practical expert panels. The Abilitator’s 79 ICF codes covered 57% of the Generic, 77% of the Brief Vocational Rehabilitation, and 8% of the Minimal Environmental ICF Core Sets. When compared with the Work Ability Index (WAI) and the World Health Organization Disability Assessment Schedule (WHODAS 2.0), the direct equivalences of the ICF codes were 36% and 44%, respectively. Conclusion: The Abilitator sufficiently comprehensively covers the relevant aspects to enable the assessment of the overall work ability and functioning of the population in a weak labour market position.


2021 ◽  
Vol 22 (1) ◽  
Author(s):  
Amin Kordi Yoosefinejad ◽  
Fatemeh Karjalian ◽  
Marzieh Momennasab ◽  
Shahrokh Ezzatzadegan Jahromi

Abstract Background Hemodialysis is considered a major therapeutic method for patients with chronic kidney disease. Pruritus is a common complaint of hemodialysis patients. The 5-D pruritus scale is amongst the most common tools to evaluate several dimensions of itch. Psychometric properties of the 5-D scale have not been evaluated in Persian speaking population with hemodialysis; hence, the objective of this study was to assess reliability and validity of the Persian version of the scale. Methods Ninety hemodialysis patients (men: 50, women: 40, mean age: 54.4 years) participated in this cross-sectional study. The final Persian version of 5-D scale was given to the participants. Tests Compared: One-third of the participants completed the scale twice within 3–7 days apart to evaluate test- retest reliability. Other psychometric properties including internal consistency, absolute reliability, convergent, discriminative and construct validity, floor/ceiling effects were also evaluated. Results The Persian 5-D scale has strong test-retest reliability (ICC= 0.98) and internal consistency (Cronbach’s alpha= 0.99). Standard error of measurement and minimal detectable change were 0.33 and 0.91, respectively. Regarding convergent validity, the scale had moderate correlation with numeric rating scale (r =0.67) and quality of life questionnaire related to itch (r = 0.59). Exploratory factor analysis revealed two factors within the scale. No floor or ceiling effect was found for the scale. Conclusion The Persian version of 5-D the itching scale is a brief instrument with acceptable reliability and validity. Therefore, the scale could be used by experts, nurses, and other health service providers to evaluate pruritus among Persian speaking hemodialysis patients.


2021 ◽  
Vol 21 (1) ◽  
Author(s):  
Liyuan Cui ◽  
Yaxin Zhu ◽  
Jinglou Qu ◽  
Liming Tie ◽  
Ziqi Wang ◽  
...  

Abstract Background Critical thinking disposition helps medical students and professionals overcome the effects of personal values and beliefs when exercising clinical judgment. The lack of effective instruments to measure critical thinking disposition in medical students has become an obstacle for training and evaluating students in undergraduate programs in China. The aim of this study was to evaluate the psychometric properties of the CTDA test. Methods A total of 278 students participated in this study and responded to the CTDA test. Cronbach’s α coefficient, internal consistency, test-retest reliability, floor effects and ceiling effects were measured to assess the reliability of the questionnaire. Construct validity of the pre-specified three-domain structure of the CTDA was evaluated by explanatory factor analysis (EFA) and confirmatory factor analysis (CFA). The convergent validity and discriminant validity were also analyzed. Results Cronbach’s alpha coefficient for the entire questionnaire was calculated to be 0.92, all of the domains showed acceptable internal consistency (0.81–0.86), and the test-retest reliability indicated acceptable intra-class correlation coefficients (ICCs) (0.93, p < 0.01). The EFA and the CFA demonstrated that the three-domain model fitted the data adequately. The test showed satisfactory convergent and discriminant validity. Conclusions The CTDA is a reliable and valid questionnaire to evaluate the disposition of medical students towards critical thinking in China and can reasonably be applied in critical thinking programs and medical education research.


2021 ◽  
Author(s):  
Qi Zhang ◽  
Ke Zhang ◽  
Miao Li ◽  
Jiaxin Gu ◽  
Xintong Li ◽  
...  

Abstract Objectives To examine the validity and reliability of the Mandarin version of the Treatment Burden Questionnaire (TBQ) among stroke patients. Background Stroke patients need long-term management of symptoms and life situation, and treatment burden has recently emerged as a new concept that can influence the health outcomes during the rehabilitation process. Methods The convenience sampling method was used to recruit 187 cases of stroke patients in a tertiary grade hospital in Tianjin for a formal investigation. Item analysis, reliability and validity tests were carried out. The reliability test included internal consistency and test–retest reliability. And as well as content, structure and convergent validity were performed for the validity test. Results Of the 187 completed questionnaires, only 180 (96.3%) were suitable for analysis. According to the experts’ evaluation, the I-CVI of each item was from 0.833 to 1.000, and the S-CVI was 0.967. The exploratory factor analysis yielded three-factor components with a cumulative variation of 53.054%. Convergent validity was demonstrated using measures of Morisky’s Medication Adherence Scale 8 (r = –0.450, P &lt; 0.01). All correlations between items and global scores ranged from 0.403 to 0.638. Internal consistency reliability and test–retest reliability were found to be acceptable, as indicated by a Cronbach’s α of 0.824 and an intraclass correlation coefficient of 0.846, respectively. Conclusions The Mandarin TBQ had acceptable validity and reliability. The use of TBQ in the assessment of treatment burden of stroke survivor may benefit health resources allocation and provide tailor therapeutic interventions to construct minimally disruptive care.


2021 ◽  
Vol 19 (1) ◽  
Author(s):  
Marco Monticone ◽  
Cristiano Sconza ◽  
Igor Portoghese ◽  
Tomohiko Nishigami ◽  
Benedict M. Wand ◽  
...  

Abstract Background and aim Growing attention is being given to utilising physical function measures to better understand and manage knee osteoarthritis (OA). The Fremantle Knee Awareness Questionnaire (FreKAQ), a self-reported measure of body-perception specific to the knee, has never been validated in Italian patients. The aims of this study were to culturally adapt and validate the Italian version of the FreKAQ (FreKAQ-I), to allow for its use with Italian-speaking patients with painful knee OA. Methods The FreKAQ-I was developed by means of forward–backward translation, a final review by an expert committee and a test of the pre-final version to evaluate its comprehensibility. The psychometric testing included: internal structural validity by Rasch analysis; construct validity by assessing hypotheses of FreKAQ correlations with the knee injury and osteoarthritis outcome score (KOOS), a pain intensity numerical rating scale (PI-NRS), the pain catastrophising scale (PCS), and the Hospital anxiety and depression score (HADS) (Pearson’s correlations); known-group validity by evaluating the ability of FreKAQ scores to discriminate between two groups of participants with different clinical profiles (Mann–Whitney U test); reliability by internal consistency (Cronbach’s alpha) and test–retest reliability (intraclass correlation coefficient, ICC2.1); and measurement error by calculating the minimum detectable change (MDC). Results It took one month to develop a consensus-based version of the FreKAQ-I. The questionnaire was administered to 102 subjects with painful knee OA and was well accepted. Internal structural validity confirmed the substantial unidimensionality of the FreKAQ-I: variance explained was 53.3%, the unexplained variance in the first contrast showed an eigenvalue of 1.8, and no local dependence was detected. Construct validity was good as all of the hypotheses were met; correlations: KOOS (rho = 0.38–0.51), PI-NRS (rho = 0.35–0.37), PCS (rho = 0.47) and HADS (Anxiety rho = 0.36; Depression rho = 0.43). Regarding known-groups validity, FreKAQ scores were significantly different between groups of participants demonstrating high and low levels of pain intensity, pain catastrophising, anxiety, depression and the four KOOS subscales (p ≤ 0.004). Internal consistency was acceptable (α = 0.74) and test–retest reliability was excellent (ICC = 0.92, CI 0.87–0.94). The MDC95 was 5.22 scale points. Conclusion The FreKAQ-I is unidimensional, reliable and valid in Italian patients with painful knee OA. Its use is recommended for clinical and research purposes.


Sign in / Sign up

Export Citation Format

Share Document