Validity and Reliability of Green Competencies Instrument for Automobile Technology Programme Using Rasch Model

2021 ◽  
Vol 5 (2) ◽  
Author(s):  
Igogbe Regina Onyilo ◽  
Mahyuddin Arsat ◽  
Nor Fadila Amin
Keyword(s):  
Rasch Model ◽  
Point Of View ◽  
Validity And Reliability ◽  
Automobile Engineering ◽  
Engineering Technology ◽  
Fit Statistics ◽  
Item Fit ◽  
Point Measure ◽  
Technology Programme ◽  
Automobile Technology

This article aims to determine the validity of developed constructs and check the reliability of the newly developed instrument named as Questionnaire on Green Competencies for Automobile Engineering Technology (QGCAET) for the Automobile Technology Programme in Nigerian Universities. The instrument consists of 170 elements measuring four constructs namely Technical Green Competencies; Managerial Green Competencies; Personal Green Competencies and Social Green Competencies and was administered to 299 respondents made of Lecturers, Technologists and Final- Year Students of Automobile Engineering and Technology programme in Nigeria universities. The Rasch model was used to examine the validity and reliability of the items. From the analysis point of view, the polarity of the elements indicates that the correlation of the point measure (PTMEA CORR) of 170 elements of green competencies is between 0.00 and 0.55. The summary statistics show that the reliability of the items and the separation of the items of the green competencies instrument are 0.98 and 6.46, respectively. Similarly, the item reliability of each construct is between 0.96 and 0.99, and the reliability of the person is between 0.79 and 1.97, respectively. In terms of item fit statistics, a total of 157 items are found to be fit to achieve the objectives of the study. The result also indicates that the range of fit for the four (4) identified green competencies constructs is between 0.61 and 1.49 signifying that all the constructs are in harmony in measuring the items in the constructs, so suitable in achieving the objectives of the research.

scholarly journals Evaluation of Hajj Instrument (HAJI) Psychometric Properties Using Rasch Measurement

2016 ◽  
Vol 12 (8) ◽  
pp. 212
Author(s):  
Muhammad Iqbal Tariq Idris ◽  
Abdul Hafidz Omar ◽  
Dayang Hjh Tiawa Awang Hj Hamid ◽  
Fahmi Bahri Sulaiman
Keyword(s):  
Physical Activity ◽  
Psychometric Properties ◽  
Healthy Eating ◽  
Rasch Model ◽  
Rasch Measurement ◽  
Mental Toughness ◽  
Validity And Reliability ◽  
Item Fit ◽  
The Rasch Model ◽  
Physical Care

<p>Hajj Instrument (HAJI) was developed to determine hajj pilgrim’s wellness. This study used Rasch measurement to evaluate the psychometric properties including validity and reliability of the HAJI. The respondents involved in this study were 300 comprised of Malaysian hajj pilgrims. HAJI consists of eight constructs namely physical care, physical activity, healthy eating, knowledge, mental toughness, intrapersonal, interpersonal and relationship with Creator and natures. Validity of each construct and content was determined through dimensionality, item fit and item polarity while the reliability was achieved by administered person and item separation. The results showed that the reliability for both item and person were 0.99 and 0.96 respectively. Besides, there were no items need to be dropped based on PTMEA CORR and INFIT MNSQ results. The study revealed that the items of HAJI fit the Rasch model as well as able to measure hajj pilgrim’s wellness. </p>

scholarly journals Evaluating Construct Validity and Reliability of Intention to Transfer Training Conduct Instrument Using Rasch Model Analysis

2021 ◽  
Vol 29 (2) ◽  
Author(s):  
Shaliza Shafie ◽  
Faizah Abd Majid ◽  
Teoh Sian Hoon ◽  
Siti Maftuhah Damio
Keyword(s):  
Construct Validity ◽  
Rasch Model ◽  
Mean Square ◽  
Validity And Reliability ◽  
Self Assessment ◽  
New Instrument ◽  
Transfer Training ◽  
Point Measure ◽  
The Impact ◽  
The Rasch Model

The impact of the Industry Revolution 4.0 (IR4.0) in the workplace requires organisations to ensure clerical employees can effectively transfer their newly acquired knowledge and skills learned in training back into the workplace. Hence, an instrument is required to identify factors influencing the intention to transfer training conduct amongst clerical employees. Thus, this paper presents the evaluation of construct validity and reliability of the new instrument to confirm its objectivity and clarity in measuring the constructs under study as intended. This four-point Likert-type scale instrument consists of 72 self-assessment items that represent 12 constructs. The Rasch Model was then employed to analyse the construct validity and reliability by evaluating the suitability of items in the respective constructs on the instrument. The item and person reliability and strata indices, point-measure correlation, and outfit mean square values were examined. The analysis found that three constructs in the item and person reliability index and eight constructs in the item and person reliability strata index were low but adequate and met the Rasch Model measurement acceptable level. Meanwhile, point-measure correlation values for all constructs fulfilled the criteria. Finally, the outfit mean square values established that 65 items in the constructs were found to be fit, whereas seven items were misfits which require improvement. Subsequently, the seven misfit items were improved as the item and person reliability values could be increased, thus the items were retained. Thereafter, the instrument was ready to be used for data collection in the actual study.

scholarly journals Student Awareness of Space Science: Rasch Model Analysis for Validity and Reliability

2020 ◽  
Vol 10 (3) ◽  
pp. 170
Author(s):  
Roslinda Rosli ◽  
Mardina Abdullah ◽  
Nur Choiro Siregar ◽  
Nurul Shazana Abdul Hamid ◽  
Sabirin Abdullah ◽  
...  
Keyword(s):  
Rasch Model ◽  
Ionospheric Disturbance ◽  
Model Analysis ◽  
Space Science ◽  
Outreach Program ◽  
Validity And Reliability ◽  
School Students ◽  
Polarity Items ◽  
Item Fit ◽  
Conducting Research

Validity and reliability are crucial when conducting research to ensure the truthfulness of an instrument. This study investigated the measurement functioning of an instrument on students' awareness of space science. The instrument was administered to 206 secondary school students involved in the Sudden Ionospheric Disturbance π outreach program. Two experts evaluated the content validity of the instrument. Data were analyzed using the Winsteps 3.71.0.1 software to obtain the Rasch model analysis (RMA) on item reliability and persons' separation, item measure, item fit based on PTMEA CORR, polarity items, misfit items, unidimensionality, and a person-item map. The findings revealed that the items are valid, reliable, and appropriate to measure awareness of space science.

scholarly journals Fitting Rasch Model using Appropriateness Measure Statistics

2005 ◽  
Vol 8 (1) ◽  
pp. 100-110 ◽  
Author(s):  
José Antonio López Pina ◽  
M. Dolores Hidalgo Montesinos
Keyword(s):  
Standard Deviation ◽  
Rasch Model ◽  
Mean Square ◽  
Sample Sizes ◽  
Fit Statistics ◽  
Item Fit ◽  
Estimated Parameters ◽  
Distributional Properties ◽  
Expected Values

In this paper, the distributional properties and power rates of the Lz, Eci2z, and Eci4z statistics when they are used as item fit statistics were explored. The results were compared to t-transformation of Outfit and Infit mean square. Four sample sizes were selected: 100, 250, 500, and 1000 examinees. The abilities were uniform and normal with mean 0 and standard deviation 1, and uniform and normal with mean –1 and standard deviation 1. The pseudo-guessing parameter was fixed at .25. Two ranges of difficulty parameters were selected: ±1 logits and ±2 logits. Two test lengths were selected: 15 and 30 items. The results showed important differences between the T-infit, T-outfit, Lz, Eci2z, and Eci4z statistics. The T-oufit, T-infit, and Lz statistics showed poor standardization with estimated parameters because their distributional properties were not close to the expected values. However, the Eci2z and Eci4z statistics showed satisfactory standardization on all conditions. Further, the power rates of Eci2z and Eci4z were 5% to 10% higher than the power rates of Lz, T-outfit, and T-infit to detect items that do not fit Rasch model.

scholarly journals Validity and Reliability of Students Perceptions on OBE Approach in Malaysian VC Using Rasch Model

2021 ◽  
Vol 2 (2) ◽  
pp. 44-50
Author(s):  
Shuhada Abdul Raof ◽  
Aede Hatib Musta’amal ◽  
Farid Kamil Zamzuri ◽  
Mohammad Hafiz Salleh
Keyword(s):  
Rasch Model ◽  
Validity And Reliability ◽  
Polarity Item ◽  
Vocational College ◽  
Item Fit ◽  
Outcome Based Education ◽  
Northern Zone ◽  
The Individual ◽  
High Level ◽  
Model Measurement

This pilot study aims to produce empirical evidence regarding the validity and reliability of instrument of the perception of vocational college diploma students towards the Outcome Based Education (OBE) approach. Validity and reliability were analysed using Rasch Model Measurement assisted by Winsteps 3.72 software. This research instrument contained 26 items and was distributed to 60 diploma students of vocational college at the Northern Zone. Validity analysis of the instrument was done through four functional testings. For reliability and separation of respondents, it was found that the individual reliability value was 0.91, while that for items demonstrated an item value of 0.94 and item separation index of 3.90. Results from the analysis of polarity item found that 25 items had a positive PMC value between 0.52-0.83. Meanwhile, analysis on item fit found 23 items with an outfit mean-square value between 0.41 and 1.24. This situation suggested three items that require attention. In the analysis on local dependence that determines dependent items based on the standardised residual correlation value, it was shown that the correlation value for the items used did not overlap with that of other items. These findings provided the evidence that the instrument of perception of vocational college diploma students on OBE approach has a high level of validity and reliability to be used in actual studies.                                                                                                                 

scholarly journals Evaluating the Impact of Multidimensionality on Type I and Type II Error Rates Using the Q-Index Item Fit Statistic for the Rasch Model

2021 ◽  
Author(s):  
Samantha Estrada
Keyword(s):  
Rasch Model ◽  
Error Rates ◽  
Type I ◽  
Type Ii ◽  
Type Ii Error ◽  
Fit Indices ◽  
Fit Statistics ◽  
Item Fit ◽  
Q Index ◽  
The Rasch Model

To understand the role of fit statistics in Rasch measurement is simple: applied researchers can only benefit from the desirable properties of the Rasch model when the data fit the model. The purpose of the current study was to assess the Q-Index robustness (Ostini and Nering, 2006), and its performance was compared to the current popular fit statistics known as MSQ Infit, MSQ Outfit, and standardized Infit and Outfit (ZSTDs) under varying conditions of test length, sample size, item difficulty (normal and uniform), and dimensionality utilizing a Monte Carlo simulation. The Type I and Type II error rates are also examined across fit indices. This study provides applied researchers guidelines the robustness and appropriateness of the use of the Q-Index, which is an alternative to the currently available item fit statistics. The Q-Index was slightly more sensitive to the levels of multidimensionality set in the study while MSQ Infit, Outfit, and standardized Infit and Outfit (ZSTDs) failed to identify the multidimensional conditions. The Type I error rate of the Q-Index was lower than the rest of the fit indices; however, the Type II error rate was higher than the anticipated β=.20 across all fit indices.

scholarly journals Evidencias de Validez Diagnóstica de la Escala Detectaweb-Malestar

2020 ◽  
Vol 25 (3) ◽  
pp. 161
Author(s):  
José A. Piqueras ◽  
Mariola García-Olcina ◽  
María Rivera-Riquelme ◽  
David Pineda
Keyword(s):  
Children And Adolescents ◽  
Emotional Disorders ◽  
Depressive Disorders ◽  
Point Of View ◽  
Diagnostic Process ◽  
Diagnostic Validity ◽  
Validity And Reliability ◽  
Palabras Clave ◽  
Anxiety Depression ◽  
Distress Scale

Evidence of diagnostic validity of the DetectaWeb-Distress ScaleAbstract: The DetectaWeb-Distress Scale is a web-based scale for screening and detecting internalizing disorder symptoms (anxiety, depression, posttraumatic stress, obsessions and compulsions, and suicidality) in children and adolescents. Previous studies examined the validity and reliability of the scale, however, there are no data on its diagnostic validity. The objective of this study was to examine the evidence of diagnostic validity of the DetectaWeb-Distress scale in a sample of 244 children and adolescents from clinical (n = 51) and community (n = 193) settings, all of them with the diagnostic process completed. The results indicated that the DetectaWeb-Distress scale is a useful measure from a diagnostic point of view, as it discriminates between people with emotional disorders such as anxiety and depressive disorders and suicidality, and those without, presenting ROC values of approximately .80 and good sensitivity and specificity for detecting the main emotional disorders. The DetectaWeb-Distress Scale is a valid measure and diagnostically useful for detecting and identifying children and adolescents with anxiety disorders, depression and suicidality, with the advantage that it is a short measure, specifically developed for Internet use, especially relevant in the era of COVID-19.Keywords: DetectaWeb-Distress; assessment, anxiety, depression, children, adolescents.Evidencias de Validez Diagnóstica de la Escala Detectaweb-Malestar Resumen: La Escala DetectaWeb-Malestar es una escala de detección del malestar emocional a través de internet que evalúa síntomas de trastornos interiorizados (ansiedad, depresión, estrés postraumático, obsesiones y compulsiones y suicidalidad) en niños y adolescentes. Estudios anteriores han examinado la validez y fiabilidad de la escala, sin embargo, no cuenta con datos relativos a su validez diagnóstica. El objetivo de este estudio es examinar las evidencias de validez diagnóstica de la escala DetectaWeb-Malestar en una muestra de 244 niños y adolescentes procedentes de contextos clínico (n = 51) y comunitario (n = 193), todos con un proceso diagnóstico completado. Los resultados indicaron que la escala DetectaWeb-Malestar es una medida útil desde el punto de vista diagnóstico, ya que discrimina entre personas con trastornos de emocionales, como son los de ansiedad, depresión y suicidalidad y los que no lo padecen, presentando valores ROC en torno a .80 y adecuada sensibilidad y especificidad para detectar los principales trastornos emocionales. La escala DetectaWeb-Malestar es una medida válida y útil desde el punto de vista diagnóstico para detectar e identificar niños y adolescentes con problemas de ansiedad, depresión y suicidalidad, con la ventaja de que es una medida breve y desarrollada específicamente para su uso a través de Internet, especialmente relevante en la era de la COVID-19.Palabras clave: DetectaWeb-Malestar; evaluación; ansiedad; depresión; niños y adolescentes.

Sign in / Sign up

Export Citation Format

Share Document