scholarly journals Evaluating Construct Validity and Reliability of Intention to Transfer Training Conduct Instrument Using Rasch Model Analysis

2021 ◽  
Vol 29 (2) ◽  
Author(s):  
Shaliza Shafie ◽  
Faizah Abd Majid ◽  
Teoh Sian Hoon ◽  
Siti Maftuhah Damio
Keyword(s):  
Construct Validity ◽  
Rasch Model ◽  
Mean Square ◽  
Validity And Reliability ◽  
Self Assessment ◽  
New Instrument ◽  
Transfer Training ◽  
Point Measure ◽  
The Impact ◽  
The Rasch Model

The impact of the Industry Revolution 4.0 (IR4.0) in the workplace requires organisations to ensure clerical employees can effectively transfer their newly acquired knowledge and skills learned in training back into the workplace. Hence, an instrument is required to identify factors influencing the intention to transfer training conduct amongst clerical employees. Thus, this paper presents the evaluation of construct validity and reliability of the new instrument to confirm its objectivity and clarity in measuring the constructs under study as intended. This four-point Likert-type scale instrument consists of 72 self-assessment items that represent 12 constructs. The Rasch Model was then employed to analyse the construct validity and reliability by evaluating the suitability of items in the respective constructs on the instrument. The item and person reliability and strata indices, point-measure correlation, and outfit mean square values were examined. The analysis found that three constructs in the item and person reliability index and eight constructs in the item and person reliability strata index were low but adequate and met the Rasch Model measurement acceptable level. Meanwhile, point-measure correlation values for all constructs fulfilled the criteria. Finally, the outfit mean square values established that 65 items in the constructs were found to be fit, whereas seven items were misfits which require improvement. Subsequently, the seven misfit items were improved as the item and person reliability values could be increased, thus the items were retained. Thereafter, the instrument was ready to be used for data collection in the actual study.

scholarly journals Evaluation of Hajj Instrument (HAJI) Psychometric Properties Using Rasch Measurement

2016 ◽  
Vol 12 (8) ◽  
pp. 212
Author(s):  
Muhammad Iqbal Tariq Idris ◽  
Abdul Hafidz Omar ◽  
Dayang Hjh Tiawa Awang Hj Hamid ◽  
Fahmi Bahri Sulaiman
Keyword(s):  
Physical Activity ◽  
Psychometric Properties ◽  
Healthy Eating ◽  
Rasch Model ◽  
Rasch Measurement ◽  
Mental Toughness ◽  
Validity And Reliability ◽  
Item Fit ◽  
The Rasch Model ◽  
Physical Care

<p>Hajj Instrument (HAJI) was developed to determine hajj pilgrim’s wellness. This study used Rasch measurement to evaluate the psychometric properties including validity and reliability of the HAJI. The respondents involved in this study were 300 comprised of Malaysian hajj pilgrims. HAJI consists of eight constructs namely physical care, physical activity, healthy eating, knowledge, mental toughness, intrapersonal, interpersonal and relationship with Creator and natures. Validity of each construct and content was determined through dimensionality, item fit and item polarity while the reliability was achieved by administered person and item separation. The results showed that the reliability for both item and person were 0.99 and 0.96 respectively. Besides, there were no items need to be dropped based on PTMEA CORR and INFIT MNSQ results. The study revealed that the items of HAJI fit the Rasch model as well as able to measure hajj pilgrim’s wellness. </p>

scholarly journals THE USE OF THE RASCH MODEL IN ANALYSING THE VALIDITY AND RELIABILITY OF STUDENTS’ COPING STRATEGY SCALE

2021 ◽  
Vol 7 (2) ◽  
pp. 110-119
Author(s):  
Maya Oktaviani ◽  
Uswatun Hasanah ◽  
Muhammad Faesal ◽  
Elmanora ◽  
Vania Zulfa
Keyword(s):  
Coping Strategy ◽  
Rasch Model ◽  
Content Validity ◽  
Three Dimensions ◽  
Validity And Reliability ◽  
Empirical Validity ◽  
Validity Analysis ◽  
Validity Coefficient ◽  
The Rasch Model ◽  
Model Approach

This research is part of the standardization of the Students' Coping Strategy Scale (SCSS). This study aims to reveal the content validity, empirical validity, and reliability of the SCSS. The non-test instrument consisting of 42 statements from three dimensions: problem-focused coping, emotion-focused coping, and seeking social support. Content validity analysis was carried out by experts to obtain Gregory's content validity coefficient, while the empirical validity and reliability analysis by empirically testing the instrument on 211 respondents and analyzed using the Rasch model approach. The results show that Gregory's content validity coefficient is 0.714, so it needs improvement on some items that are considered unsuitable. Empirical validity analysis using WINSTEPS software shows that three items do not fit the model. The reliability coefficient of the SCSS is 0.99. Thus, the remaining 39 items are appropriate to be used to measure students' coping strategies.

scholarly journals The direction of the response scale matters – accounting for the unit of measurement

2019 ◽  
Vol 53 (5) ◽  
pp. 871-891
Author(s):  
Thomas Salzberger ◽  
Monika Koller
Keyword(s):  
Rasch Model ◽  
Measurement Theory ◽  
Measurement Precision ◽  
Spatial Proximity ◽  
Validity And Reliability ◽  
Measurement Instruments ◽  
Response Scale ◽  
Content Type ◽  
Unit Of Measurement ◽  
The Rasch Model

Purpose Psychometric analyses of self-administered questionnaire data tend to focus on items and instruments as a whole. The purpose of this paper is to investigate the functioning of the response scale and its impact on measurement precision. In terms of the response scale direction, existing evidence is mixed and inconclusive. Design/methodology/approach Three experiments are conducted to examine the functioning of response scales of different direction, ranging from agree to disagree versus from disagree to agree. The response scale direction effect is exemplified by two different latent constructs by applying the Rasch model for measurement. Findings The agree-to-disagree format generally performs better than the disagree-to-agree variant with spatial proximity between the statement and the agree-pole of the scale appearing to drive the effect. The difference is essentially related to the unit of measurement. Research limitations/implications A careful investigation of the functioning of the response scale should be part of every psychometric assessment. The framework of Rasch measurement theory offers unique opportunities in this regard. Practical implications Besides content, validity and reliability, academics and practitioners utilising published measurement instruments are advised to consider any evidence on the response scale functioning that is available. Originality/value The study exemplifies the application of the Rasch model to assess measurement precision as a function of the design of the response scale. The methodology raises the awareness for the unit of measurement, which typically remains hidden.

scholarly journals The BETA® nursing measure: Calibrating construct validity with Rasch analyses*

2015 ◽  
Vol 20 (1) ◽  
Author(s):  
Hendrik J. Loubser ◽  
Daleen Casteleijn ◽  
Judith C. Bruce
Keyword(s):  
Construct Validity ◽  
Activities Of Daily Living ◽  
Nursing Care ◽  
Rasch Model ◽  
Daily Living ◽  
Successful Outcome ◽  
Direct Result ◽  
Specific Reference ◽  
Rasch Analyses ◽  
The Rasch Model

Background: The BETA nursing measure has been introduced as a tool to routinely measure and monitor the outcomes of patients' activities of daily living in a restorative nursing care context.Objectives: To investigate the BETA's construct validity using the Rasch model with specific reference to the BETA's potential to be used as an interval scale providing metric or interval data.Method: A quantitative analytical design was followed using Rasch analyses whereby BETA raw data was collected from patients (n = 4235) receiving nursing care in 28 South African sub-acute and non-acute nursing facilities. The data was prepared for Rasch analyses and imported into WINSTEP® Software version 3.70.1.1 (2010). Final results were shown by means of figures and graphs.Results: A successful outcome was achieved by dividing the BETA into four subscales. In this process one of the original BETA items was omitted and seven other items required collapsing of their categories before the four subscales achieved a satisfactory fit to the Rasch model.Conclusion: The four BETA subscales achieved “very well” to “excellent” levels of fit to the Rasch model. This finding thus creates an opportunity to convert the BETA's Likert qualities into an interval measure to calculate change in patients' activities of daily living metric allyas a direct result of effective restorative nursing.

The Toileting Habit Profile Questionnaire (THPQ): Examining Construct Validity Using the Rasch Model

2019 ◽  
Vol 73 (4_Supplement_1) ◽  
pp. 7311500055p1
Author(s):  
Isabelle Beaudry-Bellefeuille ◽  
Shelly Lane ◽  
Anita Bundy ◽  
Alison Lane ◽  
Eduardo Ramos-Polo
Keyword(s):  
Construct Validity ◽  
Rasch Model ◽  
The Rasch Model

scholarly journals A Competency-Based Approach to Pass/Fail Decisions: An Observational Study

2021 ◽  
Author(s):  
Nazdar E. Alkhateeb ◽  
Ali Al-Dabbagh ◽  
Yaseen Mohammed ◽  
Mohammed Ibrahim
Keyword(s):  
Observational Study ◽  
Rasch Model ◽  
Standard Setting ◽  
Careful Consideration ◽  
Validity And Reliability ◽  
High Stakes ◽  
High Stakes Assessment ◽  
Sufficient Degree ◽  
Competency Based ◽  
The Rasch Model

Any high-stakes assessment that leads to an important decision requires careful consideration in determining whether a student passes or fails. Despite the implementation of many standard-setting methods in clinical examinations, concerns remain about the reliability of pass/fail decisions in high stakes assessment, especially clinical assessment. This observational study proposes a defensible pass/fail decision based on the number of failed competencies. In the study conducted in Erbil, Iraq, in June 2018, results were obtained for 150 medical students on their final objective structured clinical examination. Cutoff scores and pass/fail decisions were calculated using the modified Angoff, borderline, borderline-regression, and holistic methods. The results were compared with each other and with a new competency method using Cohen’s kappa. Rasch analysis was used to compare the consistency of competency data with Rasch model estimates. The competency method resulted in 40 (26.7%) students failing, compared with 76 (50.6%), 37 (24.6%), 35 (23.3%), and 13 (8%) for the modified Angoff, borderline, borderline regression, and holistic methods, respectively. The competency method demonstrated a sufficient degree of fit to the Rasch model (mean outfit and infit statistics of 0.961 and 0.960, respectively). In conclusion, the competency method was more stringent in determining pass/fail, compared with other standard-setting methods, except for the modified Angoff method. The fit of competency data to the Rasch model provides evidence for the validity and reliability of pass/fail decisions.

scholarly journals Development and validation of an instrument to evaluate medical students' lifestyle

Medwave ◽  
2021 ◽  
Vol 21 (07) ◽  
pp. e8434-e8434
Author(s):  
Jhony de la Cruz Vargas ◽  
Daniel Orejón ◽  
Luis Roldan ◽  
Lucy Correa-López ◽  
Alonso Soto
Keyword(s):  
Factor Analysis ◽  
Medical Students ◽  
Construct Validity ◽  
Health Science ◽  
Validity And Reliability ◽  
Cronbach’S Alpha ◽  
Cronbach's Alpha ◽  
Sphericity Test ◽  
Final Questionnaire ◽  
The Impact

Introduction It is required to have validated instruments in health science students that identify unhealthy habits and assess the impact of educational interventions and programs aimed at promoting a healthy lifestyle. Objective To evaluate the validity and reliability of an instrument to measure medical students' lifestyles. Methods A lifestyle questionnaire was developed using the Delphi technique by a group of experts. The final questionnaire was applied to 332 students of the School of Medicine of the Ricardo Palma University in 2017. A preliminary examination was carried out to assess preconditions for construct validity—including the correlation matrix, the Kaiser Meyer Olkin statistic, and the Bartlett sphericity test. Factor analysis was used for construct validity, and the possible resulting factors were extracted through the principal component analysis. Cronbach's alpha coefficient was calculated to assess the instrument reliability. Results In this study, 41.6% of participants were men with a mean age of 20 years (standard deviation = 3). The preconditions for the factor analysis were a Kaiser Meyer Olkin coefficient = 0.773 and a significant Bartlett sphericity test. For the 47 items of the final questionnaire, the factor analysis showed an explained variance of 56.7% with eigenvalues greater than one. Cronbach's alpha was 0.78. The final questionnaire could assume values between -23 to 151 points. Based on a cut point of 71 points, the prevalence of students with an unhealthy lifestyle was 73.6%. Conclusion The developed instrument has acceptable validity and reliability to measure lifestyle in medical students. For external validation, studies in other university populations are suggested.

scholarly journals Self-Reflection Assessment in Vertebrate Zoology (SRAVZ) Using Rasch Analysis

2021 ◽  
Vol 10 (1) ◽  
pp. 35-47
Author(s):  
W. L. Yuhanna ◽  
M. H. I. Al Muhdhar ◽  
A. Gofur ◽  
Z. Hassan
Keyword(s):  
Rasch Model ◽  
Difficulty Level ◽  
Mean Square ◽  
Design Development ◽  
Self Reflection ◽  
Vertebrate Zoology ◽  
The Mean ◽  
High Consistency ◽  
High Level ◽  
The Rasch Model

Instruments that are valid, reliable, and have high consistency are needed to measure students’ self-reflection. The Self-Reflection Assessment in Vertebrate Zoology (SRAVZ) was developed to explore students’ self-reflection and abilities in the vertebrate zoology course. It is essential to test the instrument’s validity before measuring students’ abilities so that data bias does not occur. This study aims to determine the validity, whether the items are fit or misfit, and the difficulty level of SRAVZ items. SRAVZ is developed by ADDIE (Analysis, Design, Development, Implementation, Evaluation). The SRAVZ consists of 24 items tested on 135 students who have taken the vertebrate zoology course. Analysis of the Rasch model using Winstep version 4.5.2. The Rasch model shows the item reliability value at 0.97. The Cronbach alpha value at 0.94 with PTMEA Corr shows a positive value, unidimensional 48.1%. The separation index of 5.6 means that the level of grouping the items is very good. The mean square infit for SRAVZ was 0.59-1.96, and the mean square outfit value is 0.59-2.16. Data analysis shows that 24 SRAVZ items have 22 fit items and two misfit items (S3 and S5). Item numbers S3 and S5 must be excluded from the SRAVZ construction. Total items used to measure students’ self-reflection in the vertebrate zoology course were 22 items. The most difficult item is S3, and the easiest item is S6. Thus, the data indicate that the valid and reliable SRAVZ is in the good, effective, and high level of consistency category

scholarly journals Psychometric Evaluation of the Positive Mental Health (PMH) Scale Using Item Analysis According to the Rasch Model

2022 ◽  
Author(s):  
Lusine Vaganian ◽  
Maren Boecker ◽  
Sonja Bussmann ◽  
Michael Kusch ◽  
Hildegard Labouvie ◽  
...  
Keyword(s):  
Mental Health ◽  
Rasch Model ◽  
Item Analysis ◽  
Well Being ◽  
Positive Mental Health ◽  
Test Theory ◽  
Present Sample ◽  
Patient Reported ◽  
The Impact ◽  
The Rasch Model

Abstract Background: The investigation of patient-reported outcomes and psycho-oncological interventions mainly focuses on psychological distress or psychopathology. However, the recognition of the equal importance of positive mental health (PMH) has increased lately. The PMH-scale is a brief questionnaire allowing to assess well-being in individuals in the general population and in patients. Previous studies evaluated the psychometric properties of the PMH-scale using classical test theory (CTT). This study is the first to investigate the PMH-scale in patients with cancer using item analysis according to the Rasch model. Methods: In total, N = 357 cancer patients participated in the study. A Rasch analysis of the PMH-scale was conducted including testing of unidimensionality, local independence, homogeneity and differential item functioning (DIF) with regard to age, gender, type of cancer, the presence of metastases, psycho-oncological support, and duration of disease. Additionally, the ordering of the item thresholds as well as the targeting of the scale were investigated.Results: After excluding one misfitting item and accounting for local dependence by forming superitems, a satisfactory overall fit to the Rasch model was established (χ2 = 30.34, p = 0.21). The new PMH-8 scale proved to be unidimensional, and homogeneity of the scale could be inferred. All items showed ordered thresholds, there was no further item misfit. DIF was found for age, but as the impact of DIF was not substantial, no adjustment related to the age-DIF had to be made. The Person Separation Index (PSI = 0.89) was excellent, indicating excellent discriminatory power between different levels of positive mental health. Overall, the targeting of the PMH-8 was good for the majority of the present sample. However, at both ends of the scale item thresholds are missing as indicated by a slight floor effect (1.4%) and a considerable ceiling effect (9.8%). Conclusion: Overall, the results of the analysis according to the Rasch model support the use of the revised PMH-scale in a psycho-oncological context.

scholarly journals Improving Safety through Non-Technical Skills in Chemical Plants: The Validity of a Questionnaire for the Self-Assessment of Workers

2019 ◽  
Vol 16 (6) ◽  
pp. 992 ◽  
Author(s):  
Marco Mariani ◽  
Michela Vignoli ◽  
Rita Chiesa ◽  
Francesco Violante ◽  
Dina Guglielmi
Keyword(s):  
Decision Making ◽  
Construct Validity ◽  
Stress Management ◽  
Situational Awareness ◽  
Technical Skills ◽  
The Self ◽  
Chemical Plants ◽  
Validity And Reliability ◽  
Self Assessment ◽  
Organizational Hierarchy

This research is aimed at developing a questionnaire for the self-assessment of non-technical skills (NTS) leading to safety in the chemical sector and at analysing the properties of its scales in terms of construct validity. The research involved 269 Italian employees from three chemical plants of an international company, who occupied low–medium levels in the organizational hierarchy. Results showed a good level of validity and reliability of the instrument and suggested that communication, situational awareness, decision-making, and fatigue/stress management are the four most important NTS for safety in the chemical sector.

Sign in / Sign up

Export Citation Format

Share Document