scholarly journals Validation of technical and vocational teachers’ competency evaluation instrument using the rasch model

2019 ◽  
Vol 9 (1) ◽  
pp. 18-25
Author(s):  
Nor Fatimah A Aziz ◽  
Hishamuddin Ahmad ◽  
Irdayanti Mat Nashir

This pilot study was conducted with the aim to validate the instrument used in evaluating the competency of teachers in the field of technical and vocational education. This instrument consists of 45 items and is administered to 53 teachers from a selected vocational college. The Rasch Model with the help of the Winstep Version 3.72.3 software has been used in this study for the purpose of checking the functionality of the item and the validity of the instrument. An analysis has been made based on the suitability of items in measuring the construct, item and person reliability and separation index, polarity and residual correlation value. The Rasch analysis showed that the item reliability was valued at 0.92 while the person reliability valued at 0.96 with their item MNSQ between overfit (<0.6) and misfit (>1.4). Based on the findings, there are three items that were dropped because of failing to meet the inspection criteria. The finalized instrument consists of 42 items, in which it is suitable for evaluating the four constructs in the competency evauation of technical and vocational teachers in vocational colleges.

2018 ◽  
Vol 25 (13-14) ◽  
pp. 2388-2395
Author(s):  
Rebecca F Berenbon

The Everyday Discrimination Scale (EDS) is a widely used measure of discrimination. Rasch analysis was used to examine the psychometric properties of the EDS based on a national sample ( N = 2666). Items largely fit the Rasch model and yielded excellent separation and item reliability. However, severe floor effects were observed. Implications are discussed for use of the scale in populations that experience low levels of discrimination. An ordinal-to-interval conversion table for the EDS is also provided.


2013 ◽  
Vol 93 (11) ◽  
pp. 1507-1519 ◽  
Author(s):  
Clayon B. Hamilton ◽  
Bert M. Chesworth

Background The original 20-item Upper Extremity Functional Index (UEFI) has not undergone Rasch validation. Objective The purpose of this study was to determine whether Rasch analysis supports the UEFI as a measure of a single construct (ie, upper extremity function) and whether a Rasch-validated UEFI has adequate reproducibility for individual-level patient evaluation. Design This was a secondary analysis of data from a repeated-measures study designed to evaluate the measurement properties of the UEFI over a 3-week period. Methods Patients (n=239) with musculoskeletal upper extremity disorders were recruited from 17 physical therapy clinics across 4 Canadian provinces. Rasch analysis of the UEFI measurement properties was performed. If the UEFI did not fit the Rasch model, misfitting patients were deleted, items with poor response structure were corrected, and misfitting items and redundant items were deleted. The impact of differential item functioning on the ability estimate of patients was investigated. Results A 15-item modified UEFI was derived to achieve fit to the Rasch model where the total score was supported as a measure of upper extremity function only. The resultant UEFI-15 interval-level scale (0–100, worst to best state) demonstrated excellent internal consistency (person separation index=0.94) and test-retest reliability (intraclass correlation coefficient [2,1]=.95). The minimal detectable change at the 90% confidence interval was 8.1. Limitations Patients who were ambidextrous or bilaterally affected were excluded to allow for the analysis of differential item functioning due to limb involvement and arm dominance. Conclusion Rasch analysis did not support the validity of the 20-item UEFI. However, the UEFI-15 was a valid and reliable interval-level measure of a single dimension: upper extremity function. Rasch analysis supports using the UEFI-15 in physical therapist practice to quantify upper extremity function in patients with musculoskeletal disorders of the upper extremity.


2019 ◽  
Vol 29 (04) ◽  
pp. 224-232 ◽  
Author(s):  
Roxanne Maritz ◽  
Alan Tennant ◽  
Carolina Saskia Fellinghauer ◽  
Gerold Stucki ◽  
Birgit Prodinger ◽  
...  

Abstract Background The Extended Barthel Index (EBI), consisting of the original Barthel Index plus 6 cognitive items, provides a tool to monitor patients’ outcomes in rehabilitation. Whether the EBI provides a unidimensional metric, thus can be reported as a valid sum-score, remains to be examined. Objective To examine whether the EBI can be reported as unidimensional interval-scaled metric for neurological and musculoskeletal rehabilitation. Methods Rasch analysis of a calibration sample of 800 cases from neurological or musculoskeletal rehabilitation in 2016 in Switzerland. Results In the baseline analysis no fit to the Rasch Model was achieved. When accommodating local dependencies with a testlet approach satisfactory fit to the Rasch Model was achieved, and an interval scale transformation table was created. Conclusion The results support the reporting of adapted EBI total scores for both rehabilitation groups by applying the interval scaled transformation table presented in this study.


2018 ◽  
Vol 27 (4) ◽  
pp. 579-593
Author(s):  
Sergio L. Peral ◽  
Madelyn Geldenhuys

A Rasch validation was performed on the Tims, Bakker, and Derks’s Job Crafting Scale (JCS) in the South African working context. The JCS, which has been linked to employee well-being and career-related outcomes, continues to be the most widely used measure of job crafting behavior. Data obtained from the JCS generally showed good fit to the Rasch model. Four items were flagged during the analysis for displaying misfit (1 item) or differential item functioning (3 items), warranting further research attention. The study disclosed the dimensionality of the JCS, the hierarchical ordering and fit of the items, the functionality of the response format, and the ability of the JCS to measure invariantly across men and women, yielding new and interesting insights into the psychometric properties of the scale. The study contributes to research concerning the validity of the JCS in a non-European context, particularly through the use of Rasch analysis as a validation technique.


2017 ◽  
Vol 9 (3-2) ◽  
Author(s):  
Samah Ali Mohsen Mofreh ◽  
Mohamed Najib Abul Gafar ◽  
Abdul Hafidz Hj Omar ◽  
Adibah Abdul Latif ◽  
Dayang Hjh Tiawa Awg Hj Hamid

This study aims to explore a set of items measuring the lecturers’ teaching practice for developing a true scale of teaching practice. Rasch Model is applied to produce specific measurements on the lecturers’ teaching practice in order to generalize results and inferential studies. The items proved to measure a single dimension of lecturers’ teaching practice. The developed instrument termed LTP covers five dimensions. Construct validity was achieved through the Rasch Model Analysis using the dimensionality, item fit, and item polarity parameters. The reliability of the instrument was achieved by conducting person and item separation analysis, Cronbach alpha, and calculated person and item reliability estimates. The results of Rasch Model Analysis show that the items of LTP fit the model appropriately.


2020 ◽  
Author(s):  
Montana Buntragulpoontawee ◽  
Jeeranan Khunachiva ◽  
Patreeya Euawongyarti ◽  
Nahathai Wongpakaran ◽  
Tinakon Wongpakaran ◽  
...  

Abstract Background: This study investigated the ArmA-TH measurement properties based on item response theory, using the Rasch model. Methods: Patients with upper limb hemiplegia resulting from cerebrovascular and other brain disorders were asked to completed the ArmA-TH questionnaire. Rasch analysis was performed to test how well the ArmA-TH passive and active function sub-scales fit the Rasch model by investigating unidimensionality, response category functioning, reliability of the person and item, and differential item functioning (DIF) for age, sex and education. Results: Participants had stroke or other acquired brain injury (n=185) and the majority were men 126(68.1%), with a mean age of 55(SD 22). Most patients 91(49.2%) graduated elementary/primary school. For the ArmA-TH passive function scale, all items had acceptable fit statistics. The scale’s unidimensionality, and local independence were supported. The reliability was acceptable. Disordered threshold was found in five items, none was DIF. For the ArmA-TH active function scale, one item was misfitting and three were locally dependent. The reliability was good. DIF was not found. All items had disordered thresholds, and data fitted the Rasch model better after rescoring.Conclusions: Both sub-scales of ArmA-TH fitted the Rasch model, and are valid and reliable. The disordered thresholds should be further investigated.


BMC Neurology ◽  
2020 ◽  
Vol 20 (1) ◽  
Author(s):  
Leire Ambrosio ◽  
Carmen Rodriguez-Blazquez ◽  
Alba Ayala ◽  
Maria João Forjaz

Abstract Background Neurologists play an essential role in facilitating the patient’s process of living with Parkinson’s disease (PD). The Living with Chronic Illness Scale-PD (LW-CI-PD) is a unique available clinical tool that evaluates how the patient is living with PD. The objective of the study was to analyse the LW-CI-PD properties according to the Rasch model. Methods An open, international, cross-sectional study was carried out in 324 patients with Parkinson’s disease from four Latin American countries and Spain. Psychometric properties of the LW-CI-PD were tested using Rasch analysis: fit to the Rasch model, item local independency, unidimensionality, reliability, and differential item functioning by age and gender. Results Original LW-CI-PD do not fit Rasch model. Modifications emerged included simplifying the response scale and deleting misfit items, the dimensions Acceptance, Coping and Integration showed a satisfactory fit to the Rasch model, with reliability indices greater than 0.70. The dimensions Self-management and Adjustment to the disease did not reach fit to the Rasch model. Conclusion Suggestions for improving the LW-CI-PD include a multidimensional and shorter scale with 12 items grouped in three subscales with a simpler response scheme. The final LW-CI-PD Scale version is a reliable scale, with good internal construct validity, that provides Rasch transformed results on linear metric scale.


Sign in / Sign up

Export Citation Format

Share Document