scholarly journals Applicability of Item Response Theory to the Korean Nurses' Licensing Examination

2005 ◽  
Vol 2 ◽  
pp. 23 ◽  
Author(s):  
Geum-Hee Jeong ◽  
Mi Kyoung Yim
Keyword(s):  
Rasch Model ◽  
Logistic Model ◽  
Goodness Of Fit ◽  
Item Analysis ◽  
Classical Test Theory ◽  
Test Theory ◽  
Classical Test ◽  
Licensing Examination ◽  
The Rasch Model ◽  
Two Parameter

To test the applicability of item response theory (IRT) to the Korean Nurses' Licensing Examination (KNLE), item analysis was performed after testing the unidimensionality and goodness-of-fit. The results were compared with those based on classical test theory. The results of the 330-item KNLE administered to 12,024 examinees in January 2004 were analyzed. Unidimensionality was tested using DETECT and the goodness-of-fit was tested using WINSTEPS for the Rasch model and Bilog-MG for the two-parameter logistic model. Item analysis and ability estimation were done using WINSTEPS. Using DETECT, Dmax ranged from 0.1 to 0.23 for each subject. The mean square value of the infit and outfit values of all items using WINSTEPS ranged from 0.1 to 1.5, except for one item in pediatric nursing, which scored 1.53. Of the 330 items, 218 (42.7%) were misfit using the two-parameter logistic model of Bilog-MG. The correlation coefficients between the difficulty parameter using the Rasch model and the difficulty index from classical test theory ranged from 0.9039 to 0.9699. The correlation between the ability parameter using the Rasch model and the total score from classical test theory ranged from 0.9776 to 0.9984. Therefore, the results of the KNLE fit unidimensionality and goodness-of-fit for the Rasch model. The KNLE should be a good sample for analysis according to the IRT Rasch model, so further research using IRT is possible.

scholarly journals An item analysis according to the Rasch model of the German 12-item WHO Disability Assessment Schedule (WHODAS 2.0)

2021 ◽  
Author(s):  
Lusine Vaganian ◽  
Sonja Bussmann ◽  
Maren Boecker ◽  
Michael Kusch ◽  
Hildegard Labouvie ◽  
...  
Keyword(s):  
Cancer Patients ◽  
Rasch Model ◽  
Item Analysis ◽  
Classical Test Theory ◽  
Health Condition ◽  
Test Theory ◽  
World Health ◽  
Good Reliability ◽  
Whodas 2.0 ◽  
The Rasch Model

Abstract Purpose The World Health Organization Disability Assessent Schedule 2.0 (WHODAS 2.0) assesses disability in individuals irrespective of their health condition. Previous studies validated the usefulness of the WHODAS 2.0 using classical test theory. This study is the first investigating the psychometric properties of the 12-items WHODAS 2.0 in patients with cancer using item analysis according to the Rasch model. Methods In total, 350 cancer patients participated in the study. Rasch analysis of the 12-items version of the WHODAS 2.0 was conducted and included testing unidimensionality, local independence, and testing for differential item functioning (DIF) with regard to age, gender, type of cancer, presence of metastases, psycho-oncological support, and duration of disease. Results After accounting for local dependence, which was mainly found across items of the same WHODAS domain, satisfactory overall fit to the Rasch model was established (χ2 = 36.14, p = 0.07) with good reliability (PSI = 0.82) and unidimensionality of the scale. DIF was found for gender (testlet ‘Life activities’) and age (testlet ‘Getting around/Self-care’), but the size of DIF was not substantial. Conclusion Overall, the analysis results according to the Rasch model support the use of the WHODAS 2.0 12-item version as a measure of disability in cancer patients.

scholarly journals Patient self-report section of the ASES questionnaire: a Spanish validation study using classical test theory and the Rasch model

2016 ◽  
Vol 14 (1) ◽  
Author(s):  
Kalliopi Vrotsou ◽  
Ricardo Cuéllar ◽  
Félix Silió ◽  
Miguel Ángel Rodriguez ◽  
Daniel Garay ◽  
...  
Keyword(s):  
Rasch Model ◽  
Validation Study ◽  
Classical Test Theory ◽  
Test Theory ◽  
Self Report ◽  
Classical Test ◽  
Spanish Validation ◽  
The Rasch Model

scholarly journals Analisis Pengetahuan Matematika, Didaktika, dan Teknologi Calon Guru Sekolah Dasar Menggunakan Rasch Model

2021 ◽  
Vol 10 (3) ◽  
pp. 345-356
Author(s):  
Zetra Hainul Putra ◽  
Neni Hermita ◽  
Jesi Alexander Alim
Keyword(s):  
Item Response Theory ◽  
Item Response ◽  
Rasch Model ◽  
Classical Test Theory ◽  
Technological Knowledge ◽  
Test Theory ◽  
Response Theory ◽  
Classical Test ◽  
Didactic Knowledge ◽  
The Rasch Model

AbstrakPengetahuan matematika, didaktika, dan teknologi yang harus dimilik oleh calon guru dan guru, sebelumnya diukur dengan metode classical test theory (CTT), namun memiliki keterbatasan. Penelitian bertujuan mengetahui pengetahuan tersebut dengan metode yang diprekdiksi lebih akurat yaitu item response theory (IRT) dari rasch model. Metode penelitian meliputi survey pengetahuan matematika dan didaktika serta survey pengetahuan teknologi menggunakan angket. Subjek penelitian yaitu 38 mahasiswa tahun kedua calon guru sekolah dasar dari sebuah institusi pendidikan guru sekolah dasar di Pekanbaru. Hasil studi menunjukkan calon guru sekolah dasar memiliki pengetahuan matematika dan teknologi cukup baik, namun pengetahuan didaktika sangat rendah. Analisis pengetahuan calon guru menggunkan rasch model mampu memberikan gambaran tingkat kesulitan soal/item yang diberikan, tingkat pengetahuan responden, dan interaksi antar responden dan antar soal. Institusi pendidikan perlu mengembangkan pembelajaran bagi calon guru sekolah dasar yang mampu mendukung penguatan dan pengembangan pengetahuan matematika, didaktika, dan teknologi. Prospective Elementary Teachers’ Mathematical, Didactic, and Technological Knowledge Using Rasch Model Analysis AbstractKnowledge of mathematics, didactics, and technology that must be owned by pre-service and in-service teachers, previously measured by the classical test theory (CTT), but has limitations. Study aims to determine that knowledge with a more accurate prediction method using the item response theory (IRT) from the Rasch model. Study used a survey of mathematical and didactic knowledge, and a survey of technological knowledge with a scale. The subjects were 38 second-year students from an elementary school teacher education institution in Pekanbaru. This study indicates that pre-service teachers have relatively sufficient mathematics and technological knowledge, but they were lack of didactic knowledge. Analysis of pre-service teachers’ knowledge using the Rasch model can provide an overview of the difficulty level of the items given, the level of pre-service teachers’ knowledge, and the interaction between respondents and between questions. Institutions need to develop learning instruction for pre-service teachers that can support the strengthening and development of their mathematical, didactic, and technological knowledge.

scholarly journals Item development process and analysis of 50 case-based items for implementation on the Korean Nursing Licensing Examination

2017 ◽  
Vol 14 ◽  
pp. 20
Author(s):  
In Sook Park ◽  
Yeon Ok Suh ◽  
Hae Sook Park ◽  
So Young Kang ◽  
Kwang Sung Kim ◽  
...  
Keyword(s):  
Item Response ◽  
Content Validity ◽  
Goodness Of Fit ◽  
Item Difficulty ◽  
Classical Test Theory ◽  
Test Theory ◽  
Goodness Of Fit Test ◽  
Classical Test ◽  
Licensing Examination ◽  
Case Based

Purpose: The purpose of this study was to improve the quality of items on the Korean Nursing Licensing Examination by developing and evaluating case-based items that reflect integrated nursing knowledge.Methods: We conducted a cross-sectional observational study to develop new case-based items. The methods for developing test items included expert workshops, brainstorming, and verification of content validity. After a mock examination of undergraduate nursing students using the newly developed case-based items, we evaluated the appropriateness of the items through classical test theory and item response theory.Results: A total of 50 case-based items were developed for the mock examination, and content validity was evaluated. The question items integrated 34 discrete elements of integrated nursing knowledge. The mock examination was taken by 741 baccalaureate students in their fourth year of study at 13 universities. Their average score on the mock examination was 57.4, and the examination showed a reliability of 0.40. According to classical test theory, the average level of item difficulty of the items was 57.4% (80%–100% for 12 items; 60%–80% for 13 items; and less than 60% for 25 items). The mean discrimination index was 0.19, and was above 0.30 for 11 items and 0.20 to 0.29 for 15 items. According to item response theory, the item discrimination parameter (in the logistic model) was none for 10 items (0.00), very low for 20 items (0.01 to 0.34), low for 12 items (0.35 to 0.64), moderate for 6 items (0.65 to 1.34), high for 1 item (1.35 to 1.69), and very high for 1 item (above 1.70). The item difficulty was very easy for 24 items (below −2.0), easy for 8 items (−2.0 to −0.5), medium for 6 items (−0.5 to 0.5), hard for 3 items (0.5 to 2.0), and very hard for 9 items (2.0 or above). The goodness-of-fit test in terms of the 2-parameter item response model between the range of 2.0 to 0.5 revealed that 12 items had an ideal correct answer rate.Conclusion: We surmised that the low reliability of the mock examination was influenced by the timing of the test for the examinees and the inappropriate difficulty of the items. Our study suggested a methodology for the development of future case-based items for the Korean Nursing Licensing Examination.

scholarly journals An Item Analysis according to the Rasch Model of the German 12-item WHO Disability Assessment Schedule (WHODAS 2.0)

2021 ◽  
Author(s):  
Lusine Vaganian ◽  
Sonja Bussmann ◽  
Maren Boecker ◽  
Michael Kusch ◽  
Hildegard Labouvie ◽  
...  
Keyword(s):  
Cancer Patients ◽  
Rasch Model ◽  
Item Analysis ◽  
Classical Test Theory ◽  
Test Theory ◽  
World Health ◽  
Disability Assessment ◽  
Good Reliability ◽  
Whodas 2.0 ◽  
The Rasch Model

Abstract Purpose: The World Health Organization Disability Assessment Schedule 2.0 (WHODAS 2.0) assesses disability in individuals irrespective of their health condition. Previous studies validated the usefulness of the WHODAS 2.0 using classical test theory (CTT). This study is the first investigating the psychometric properties of the 12-items WHODAS 2.0 in patients with cancer using item response theory (IRT), i.e., item analysis according to the Rasch model. Methods: In total, 350 cancer patients participated in the study. Rasch analysis of the 12-items version of the WHODAS 2.0 included testing unidimensionality, local independence, and testing for differential item functioning (DIF) with regard to age, gender, type of cancer, presence of metastases, psycho-oncological support, and duration of disease. Results: After accounting for local dependence, which was mainly found across items of the same WHODAS-domain, satisfactory overall fit to the Rasch model was established (χ2 = 36.14, p = 0.07) with good reliability (PSI = 0.82) and unidimensionality of the scale. DIF was found for gender (testlet ‘Life activities’) and age (testlet ‘Getting around/Self-care’), but the size of DIF was not substantial. Conclusion: Overall, the analysis results according to the Rasch model support the use of the WHODAS 2.0 12-item version as a measure of disability in cancer patients.

scholarly journals Aplikasi Model RASCH dalam Pengujian Alat Ukur Kesehatan Mental di Tempat Kerja

2015 ◽  
Vol 12 (2) ◽  
pp. 29
Author(s):  
Rahmat Aziz
Keyword(s):  
Mental Health ◽  
Rasch Model ◽  
Classical Test Theory ◽  
Test Theory ◽  
Theory Approach ◽  
Validity And Reliability ◽  
Mental Health Scale ◽  
Classical Test ◽  
The Subject ◽  
The Rasch Model

This research aims to examine the validity and reliability of mental health scale in the workplace by using the Rasch model approach as well as compare the results of analysis with classical test theory approach. The subject were 60 employees at the State Islamic University Malang. The analysis showed that the mental health scale in the workplace is declared valid and reliable either by using the approach of Rasch model and classical test theory. This means that both approaches are able to find the same results on the test of mental health scale in the workplace.

Psychometric properties and construct validity of PLAYself: a self-reported measure of physical literacy for children and youth

2020 ◽  
Author(s):  
Philip Jefferies ◽  
Emily Bremer ◽  
Tanya Kozera ◽  
John Cairney ◽  
Dean Kriellaars
Keyword(s):  
Construct Validity ◽  
Psychometric Properties ◽  
Rasch Model ◽  
Classical Test Theory ◽  
Test Theory ◽  
Children And Youth ◽  
Physical Literacy ◽  
Internal Reliability ◽  
Classical Test ◽  
The Rasch Model

PLAYself is a tool designed for self-description of physical literacy in children and youth. We examined the tool using both the Rasch model and Classical Test Theory to explore its psychometric properties. A random selection of 300 children aged 8-14 (47.3% female) from a dataset of 8,513 Canadian children were involved in the Rasch analysis. The three subscales of the measure demonstrated good fit to the Rasch model, satisfying requirements of unidimensionality, having good fit statistics (item and person fit residuals =-.17-1.47) and internal reliability (PSI=.70-.82), and a lack of item bias and problematic local dependency. In a separate comparable sample, 297 children also aged 8-14 (53.9% female) completed the PLAYfun, Physical Self-Description Questionnaire (PSDQ), Physical Activities Measure-Revised (MPAM-R), a physical activity inventory (PLAYinventory), and repeated the PLAYself seven days later. The tests with this sample confirmed test-retest reliability (ICC=.81-.84), and convergent and construct validity consistent with contemporary physical literacy definitions. Overall, the PLAYself demonstrated robust psychometric properties, and is recommended for researchers and practitioners who are interested in assessing self-reported physical literacy. Novelty bullets: • The PLAYself is a self-reported measure of physical literacy • This study validates the measure using the Rasch model and classical test theory • The PLAYself was found to have strong psychometric properties

Conditional Reasoning: An Integrated Approach to Item Analysis

2019 ◽  
Vol 23 (1) ◽  
pp. 124-153 ◽  
Author(s):  
Daniel R. Smith ◽  
Michael E. Hoffman ◽  
James M. LeBreton
Keyword(s):  
Item Analysis ◽  
Classical Test Theory ◽  
Integrated Approach ◽  
Conditional Reasoning ◽  
Test Theory ◽  
Analytic Framework ◽  
Test Items ◽  
Classical Test ◽  
Reasoning Test ◽  
Unique Nature

This article provides a review of the approach that James used when conducting item analyses on his conditional reasoning test items. That approach was anchored in classical test theory. Our article extends this work in two important ways. First, we offer a set of test development protocols that are tailored to the unique nature of conditional reasoning tests. Second, we further extend James’s approach by integrating his early test validation protocols (based on classical test theory) with more recent protocols (based on item response theory). We then apply our integrated item analytic framework to data collected on James’s first test, the conditional reasoning test for relative motive strength. We illustrate how this integrated approach furnishes additional diagnostic information that may allow researchers to make more informed and targeted revisions to an initial set of items.

Sign in / Sign up

Export Citation Format

Share Document