scholarly journals An item analysis according to the Rasch model of the German 12-item WHO Disability Assessment Schedule (WHODAS 2.0)

Author(s):  
Lusine Vaganian ◽  
Sonja Bussmann ◽  
Maren Boecker ◽  
Michael Kusch ◽  
Hildegard Labouvie ◽  
...  

Abstract Purpose The World Health Organization Disability Assessent Schedule 2.0 (WHODAS 2.0) assesses disability in individuals irrespective of their health condition. Previous studies validated the usefulness of the WHODAS 2.0 using classical test theory. This study is the first investigating the psychometric properties of the 12-items WHODAS 2.0 in patients with cancer using item analysis according to the Rasch model. Methods In total, 350 cancer patients participated in the study. Rasch analysis of the 12-items version of the WHODAS 2.0 was conducted and included testing unidimensionality, local independence, and testing for differential item functioning (DIF) with regard to age, gender, type of cancer, presence of metastases, psycho-oncological support, and duration of disease. Results After accounting for local dependence, which was mainly found across items of the same WHODAS domain, satisfactory overall fit to the Rasch model was established (χ2 = 36.14, p = 0.07) with good reliability (PSI = 0.82) and unidimensionality of the scale. DIF was found for gender (testlet ‘Life activities’) and age (testlet ‘Getting around/Self-care’), but the size of DIF was not substantial. Conclusion Overall, the analysis results according to the Rasch model support the use of the WHODAS 2.0 12-item version as a measure of disability in cancer patients.

2021 ◽  
Author(s):  
Lusine Vaganian ◽  
Sonja Bussmann ◽  
Maren Boecker ◽  
Michael Kusch ◽  
Hildegard Labouvie ◽  
...  

Abstract Purpose: The World Health Organization Disability Assessment Schedule 2.0 (WHODAS 2.0) assesses disability in individuals irrespective of their health condition. Previous studies validated the usefulness of the WHODAS 2.0 using classical test theory (CTT). This study is the first investigating the psychometric properties of the 12-items WHODAS 2.0 in patients with cancer using item response theory (IRT), i.e., item analysis according to the Rasch model. Methods: In total, 350 cancer patients participated in the study. Rasch analysis of the 12-items version of the WHODAS 2.0 included testing unidimensionality, local independence, and testing for differential item functioning (DIF) with regard to age, gender, type of cancer, presence of metastases, psycho-oncological support, and duration of disease. Results: After accounting for local dependence, which was mainly found across items of the same WHODAS-domain, satisfactory overall fit to the Rasch model was established (χ2 = 36.14, p = 0.07) with good reliability (PSI = 0.82) and unidimensionality of the scale. DIF was found for gender (testlet ‘Life activities’) and age (testlet ‘Getting around/Self-care’), but the size of DIF was not substantial. Conclusion: Overall, the analysis results according to the Rasch model support the use of the WHODAS 2.0 12-item version as a measure of disability in cancer patients.


Author(s):  
Geum-Hee Jeong ◽  
Mi Kyoung Yim

To test the applicability of item response theory (IRT) to the Korean Nurses' Licensing Examination (KNLE), item analysis was performed after testing the unidimensionality and goodness-of-fit. The results were compared with those based on classical test theory. The results of the 330-item KNLE administered to 12,024 examinees in January 2004 were analyzed. Unidimensionality was tested using DETECT and the goodness-of-fit was tested using WINSTEPS for the Rasch model and Bilog-MG for the two-parameter logistic model. Item analysis and ability estimation were done using WINSTEPS. Using DETECT, Dmax ranged from 0.1 to 0.23 for each subject. The mean square value of the infit and outfit values of all items using WINSTEPS ranged from 0.1 to 1.5, except for one item in pediatric nursing, which scored 1.53. Of the 330 items, 218 (42.7%) were misfit using the two-parameter logistic model of Bilog-MG. The correlation coefficients between the difficulty parameter using the Rasch model and the difficulty index from classical test theory ranged from 0.9039 to 0.9699. The correlation between the ability parameter using the Rasch model and the total score from classical test theory ranged from 0.9776 to 0.9984. Therefore, the results of the KNLE fit unidimensionality and goodness-of-fit for the Rasch model. The KNLE should be a good sample for analysis according to the IRT Rasch model, so further research using IRT is possible.


2016 ◽  
Vol 14 (1) ◽  
Author(s):  
Kalliopi Vrotsou ◽  
Ricardo Cuéllar ◽  
Félix Silió ◽  
Miguel Ángel Rodriguez ◽  
Daniel Garay ◽  
...  

2021 ◽  
Vol 10 (3) ◽  
pp. 345-356
Author(s):  
Zetra Hainul Putra ◽  
Neni Hermita ◽  
Jesi Alexander Alim

AbstrakPengetahuan matematika, didaktika, dan teknologi yang harus dimilik oleh calon guru dan guru, sebelumnya diukur dengan metode classical test theory (CTT), namun memiliki keterbatasan. Penelitian bertujuan mengetahui pengetahuan tersebut dengan metode yang diprekdiksi lebih akurat yaitu item response theory (IRT) dari rasch model. Metode penelitian meliputi survey pengetahuan matematika dan didaktika serta survey pengetahuan teknologi menggunakan angket. Subjek penelitian yaitu 38 mahasiswa tahun kedua calon guru sekolah dasar dari sebuah institusi pendidikan guru sekolah dasar di Pekanbaru. Hasil studi menunjukkan calon guru sekolah dasar memiliki pengetahuan matematika dan teknologi cukup baik, namun pengetahuan didaktika sangat rendah. Analisis pengetahuan calon guru menggunkan rasch model mampu memberikan gambaran tingkat kesulitan soal/item yang diberikan, tingkat pengetahuan responden, dan interaksi antar responden dan antar soal. Institusi pendidikan perlu mengembangkan pembelajaran bagi calon guru sekolah dasar yang mampu mendukung penguatan dan pengembangan pengetahuan matematika, didaktika, dan teknologi. Prospective Elementary Teachers’ Mathematical, Didactic, and Technological Knowledge Using Rasch Model Analysis AbstractKnowledge of mathematics, didactics, and technology that must be owned by pre-service and in-service teachers, previously measured by the classical test theory (CTT), but has limitations. Study aims to determine that knowledge with a more accurate prediction method using the item response theory (IRT) from the Rasch model. Study used a survey of mathematical and didactic knowledge, and a survey of technological knowledge with a scale. The subjects were 38 second-year students from an elementary school teacher education institution in Pekanbaru. This study indicates that pre-service teachers have relatively sufficient mathematics and technological knowledge, but they were lack of didactic knowledge. Analysis of pre-service teachers’ knowledge using the Rasch model can provide an overview of the difficulty level of the items given, the level of pre-service teachers’ knowledge, and the interaction between respondents and between questions. Institutions need to develop learning instruction for pre-service teachers that can support the strengthening and development of their mathematical, didactic, and technological knowledge.


2022 ◽  
Author(s):  
Lusine Vaganian ◽  
Maren Boecker ◽  
Sonja Bussmann ◽  
Michael Kusch ◽  
Hildegard Labouvie ◽  
...  

Abstract Background: The investigation of patient-reported outcomes and psycho-oncological interventions mainly focuses on psychological distress or psychopathology. However, the recognition of the equal importance of positive mental health (PMH) has increased lately. The PMH-scale is a brief questionnaire allowing to assess well-being in individuals in the general population and in patients. Previous studies evaluated the psychometric properties of the PMH-scale using classical test theory (CTT). This study is the first to investigate the PMH-scale in patients with cancer using item analysis according to the Rasch model. Methods: In total, N = 357 cancer patients participated in the study. A Rasch analysis of the PMH-scale was conducted including testing of unidimensionality, local independence, homogeneity and differential item functioning (DIF) with regard to age, gender, type of cancer, the presence of metastases, psycho-oncological support, and duration of disease. Additionally, the ordering of the item thresholds as well as the targeting of the scale were investigated.Results: After excluding one misfitting item and accounting for local dependence by forming superitems, a satisfactory overall fit to the Rasch model was established (χ2 = 30.34, p = 0.21). The new PMH-8 scale proved to be unidimensional, and homogeneity of the scale could be inferred. All items showed ordered thresholds, there was no further item misfit. DIF was found for age, but as the impact of DIF was not substantial, no adjustment related to the age-DIF had to be made. The Person Separation Index (PSI = 0.89) was excellent, indicating excellent discriminatory power between different levels of positive mental health. Overall, the targeting of the PMH-8 was good for the majority of the present sample. However, at both ends of the scale item thresholds are missing as indicated by a slight floor effect (1.4%) and a considerable ceiling effect (9.8%). Conclusion: Overall, the results of the analysis according to the Rasch model support the use of the revised PMH-scale in a psycho-oncological context.


2019 ◽  
Vol 43 (7) ◽  
pp. 1284-1301
Author(s):  
Xinghua Wang

Purpose The purpose of this paper is to develop a mobile social networking service (SNS) addiction scale to measure respondents’ addiction levels. Design/methodology/approach Drawing on the existing literature on the components model of addiction by Griffiths (2005) and mobile SNS addiction, an initial scale in a five-point Likert-format was developed. It was refined through the pilot study with 100 participants and the main study with 423 participants utilizing factor analysis and Rasch analysis. Findings Mobile SNS addiction as a behavioral addiction, demonstrated six addiction symptoms: modification, salience, tolerance, withdrawal, conflict and relapse, which were interrelated with each other. The mobile SNS addiction scale developed in this study was found to be psychometrically robust and unidimensional. Practical implications The mobile SNS addiction scale consists of nine items, thus making it easier and more convenient to be applied to academic research and clinical practice. Originality/value The combined use of factor analysis and the Rasch model could largely reduce potential negative effects associated with limitations of classical test theory and improve the chance of developing a psychometrically robust instrument. The mobile SNS addiction scale covers a range of types of SNSs, thus being more generic. The items in the scale are unidimensionally loaded on the latent construct of mobile SNS addiction and demonstrate measurement invariance across respondents of different demographics.


2015 ◽  
Vol 12 (2) ◽  
pp. 29
Author(s):  
Rahmat Aziz

This research aims to examine the validity and reliability of mental health scale in the workplace by using the Rasch model approach as well as compare the results of analysis with classical test theory approach. The subject were 60 employees at the State Islamic University Malang. The analysis showed that the mental health scale in the workplace is declared valid and reliable either by using the approach of Rasch model and classical test theory. This means that both approaches are able to find the same results on the test of mental health scale in the workplace.


Author(s):  
Philip Jefferies ◽  
Emily Bremer ◽  
Tanya Kozera ◽  
John Cairney ◽  
Dean Kriellaars

PLAYself is a tool designed for self-description of physical literacy in children and youth. We examined the tool using both the Rasch model and Classical Test Theory to explore its psychometric properties. A random selection of 300 children aged 8-14 (47.3% female) from a dataset of 8,513 Canadian children were involved in the Rasch analysis. The three subscales of the measure demonstrated good fit to the Rasch model, satisfying requirements of unidimensionality, having good fit statistics (item and person fit residuals =-.17-1.47) and internal reliability (PSI=.70-.82), and a lack of item bias and problematic local dependency. In a separate comparable sample, 297 children also aged 8-14 (53.9% female) completed the PLAYfun, Physical Self-Description Questionnaire (PSDQ), Physical Activities Measure-Revised (MPAM-R), a physical activity inventory (PLAYinventory), and repeated the PLAYself seven days later. The tests with this sample confirmed test-retest reliability (ICC=.81-.84), and convergent and construct validity consistent with contemporary physical literacy definitions. Overall, the PLAYself demonstrated robust psychometric properties, and is recommended for researchers and practitioners who are interested in assessing self-reported physical literacy. Novelty bullets: • The PLAYself is a self-reported measure of physical literacy • This study validates the measure using the Rasch model and classical test theory • The PLAYself was found to have strong psychometric properties


2020 ◽  
Vol 34 (1) ◽  
pp. 52-67 ◽  
Author(s):  
Igor Himelfarb ◽  
Margaret A. Seron ◽  
John K. Hyland ◽  
Andrew R. Gow ◽  
Nai-En Tang ◽  
...  

Objective: This article introduces changes made to the diagnostic imaging (DIM) domain of the Part IV of the National Board of Chiropractic Examiners examination and evaluates the effects of these changes in terms of item functioning and examinee performance. Methods: To evaluate item function, classical test theory and item response theory (IRT) methods were employed. Classical statistics were used for the assessment of item difficulty and the relation to the total test score. Item difficulties along with item discrimination were calculated using IRT. We also studied the decision accuracy of the redesigned DIM domain. Results: The diagnostic item analysis revealed similarity in item function across test forms and across administrations. The IRT models found a reasonable fit to the data. The averages of the IRT parameters were similar across test forms and across administrations. The classification of test takers into ability (theta) categories was consistent across groups (both norming and all examinees), across all test forms, and across administrations. Conclusion: This research signifies a first step in the evaluation of the transition to digital DIM high-stakes assessments. We hope that this study will spur further research into evaluations of the ability to interpret radiographic images. In addition, we hope that the results prove to be useful for chiropractic faculty, chiropractic students, and the users of Part IV scores.


Sign in / Sign up

Export Citation Format

Share Document