scholarly journals Student Awareness of Space Science: Rasch Model Analysis for Validity and Reliability

2020 ◽  
Vol 10 (3) ◽  
pp. 170
Author(s):  
Roslinda Rosli ◽  
Mardina Abdullah ◽  
Nur Choiro Siregar ◽  
Nurul Shazana Abdul Hamid ◽  
Sabirin Abdullah ◽  
...  
Keyword(s):  
Rasch Model ◽  
Ionospheric Disturbance ◽  
Model Analysis ◽  
Space Science ◽  
Outreach Program ◽  
Validity And Reliability ◽  
School Students ◽  
Polarity Items ◽  
Item Fit ◽  
Conducting Research

Validity and reliability are crucial when conducting research to ensure the truthfulness of an instrument. This study investigated the measurement functioning of an instrument on students' awareness of space science. The instrument was administered to 206 secondary school students involved in the Sudden Ionospheric Disturbance π outreach program. Two experts evaluated the content validity of the instrument. Data were analyzed using the Winsteps 3.71.0.1 software to obtain the Rasch model analysis (RMA) on item reliability and persons' separation, item measure, item fit based on PTMEA CORR, polarity items, misfit items, unidimensionality, and a person-item map. The findings revealed that the items are valid, reliable, and appropriate to measure awareness of space science.

scholarly journals Evaluation of Hajj Instrument (HAJI) Psychometric Properties Using Rasch Measurement

2016 ◽  
Vol 12 (8) ◽  
pp. 212
Author(s):  
Muhammad Iqbal Tariq Idris ◽  
Abdul Hafidz Omar ◽  
Dayang Hjh Tiawa Awang Hj Hamid ◽  
Fahmi Bahri Sulaiman
Keyword(s):  
Physical Activity ◽  
Psychometric Properties ◽  
Healthy Eating ◽  
Rasch Model ◽  
Rasch Measurement ◽  
Mental Toughness ◽  
Validity And Reliability ◽  
Item Fit ◽  
The Rasch Model ◽  
Physical Care

<p>Hajj Instrument (HAJI) was developed to determine hajj pilgrim’s wellness. This study used Rasch measurement to evaluate the psychometric properties including validity and reliability of the HAJI. The respondents involved in this study were 300 comprised of Malaysian hajj pilgrims. HAJI consists of eight constructs namely physical care, physical activity, healthy eating, knowledge, mental toughness, intrapersonal, interpersonal and relationship with Creator and natures. Validity of each construct and content was determined through dimensionality, item fit and item polarity while the reliability was achieved by administered person and item separation. The results showed that the reliability for both item and person were 0.99 and 0.96 respectively. Besides, there were no items need to be dropped based on PTMEA CORR and INFIT MNSQ results. The study revealed that the items of HAJI fit the Rasch model as well as able to measure hajj pilgrim’s wellness. </p>

scholarly journals THE DEVELOPMENT OF A CURIOSITY TOWARDS PRIMARY STEM EDUCATION QUESTIONNAIRE INSTRUMENT

2021 ◽  
Vol 6 (40) ◽  
pp. 274-292
Author(s):  
Jamilah Ahmad ◽  
Nyet Moi Siew
Keyword(s):  
Stem Education ◽  
Primary Schools ◽  
High Reliability ◽  
Measurement Model ◽  
Validity And Reliability ◽  
School Students ◽  
Item Fit ◽  
Primary Stem ◽  
Item Reliability ◽  
Variance Explained

The Curiosity towards STEM Education Questionnaire Instrument (CQI-STEM) was developed to measure the level of curiosity towards STEM education among primary school students. CQI-STEM consisted of 10 items measuring the two constructs of curiosity towards STEM, namely stretching, and embracing. A total of 166 years five students aged 10 to 11 years enrolled in five urban schools in the Tawau district, Sabah was involved as a research sample. Rasch Measurement Model was applied to determine the validity and reliability of CQI-STEM. The results of the validity analysis found that the polarity of the items through the PTMEA-CORR values showed that all 10 items were > .00 (+). Through item fit analysis, all items were retained because items meet the requirements of the range in MNSQ outfit, ZSTD outfit, and PTMEA-CORR. The value of Raw Variance Explained by Measures was 63.1% (excellent) and the value of Unexplained variance in the first contrast was below 15%, showing that the instrument had strong dimensionality and high construct validity. The CQI-STEM instrument was found to have high reliability with a Cronbach’s alpha value (KR-20) of .93. Results also showed that CQI-STEM has excellent item reliability and moderate-high item separation value of .96 and 4.83 respectively. CQI-STEM also has high person reliability and person separation value of .92 and 3.48 respectively. In conclusion, CQI-STEM has good validity and high reliability in measuring curiosity towards STEM Education among year five students in primary schools.

scholarly journals Validation of Instrument on Teaching Practices Among Lecturers at Community Colleges, Yemen

2017 ◽  
Vol 9 (3-2) ◽  
Author(s):  
Samah Ali Mohsen Mofreh ◽  
Mohamed Najib Abul Gafar ◽  
Abdul Hafidz Hj Omar ◽  
Adibah Abdul Latif ◽  
Dayang Hjh Tiawa Awg Hj Hamid
Keyword(s):  
Community Colleges ◽  
Rasch Model ◽  
Teaching Practice ◽  
Model Analysis ◽  
Five Dimensions ◽  
Item Fit ◽  
Reliability Estimates ◽  
The Rasch Model ◽  
Polarity Parameters ◽  
Item Reliability

This study aims to explore a set of items measuring the lecturers’ teaching practice for developing a true scale of teaching practice. Rasch Model is applied to produce specific measurements on the lecturers’ teaching practice in order to generalize results and inferential studies. The items proved to measure a single dimension of lecturers’ teaching practice. The developed instrument termed LTP covers five dimensions. Construct validity was achieved through the Rasch Model Analysis using the dimensionality, item fit, and item polarity parameters. The reliability of the instrument was achieved by conducting person and item separation analysis, Cronbach alpha, and calculated person and item reliability estimates. The results of Rasch Model Analysis show that the items of LTP fit the model appropriately.

scholarly journals VALIDITAS DAN RELIABILITAS INSTRUMEN PENGETAHUAN PEMBELAJARAN AKTIF, KREATIF DAN MENYENANGKAN (PAKEM) MENGGUNAKAN MODEL RASCH

2016 ◽  
Vol 16 (2) ◽  
pp. 169
Author(s):  
Salma Hayati ◽  
Lailatussaadah Lailatussaadah
Keyword(s):  
Learning Strategies ◽  
Reliability Index ◽  
Model Analysis ◽  
Survey Study ◽  
Residual Variance ◽  
Mean Square ◽  
Validity And Reliability ◽  
Polarity Items ◽  
Point Correlation ◽  
Standard Value

Instruments of Active, Creative, Effective and Fun learning (PAKEM) were created to measure teachers' knowledge about the PAKEM’s concept as a form of learning strategies implemented in teaching in schools and madrasahs. This study was conducted to produce empirical evidence on the validity and reliability of the PAKEM instrument using the RaschMeasurement Model analysis. A Survey study has been conducted on 30 teachers fromMadrasah Ibtidaiyah School (MI) in the Aceh Districts. The validity and reliability of the PAKEM instrumentswere tested with the Rasch.Measurement Model analysis usingthe Winsteps program. The unidimensionality test conducted showed standarlized residual variance of 37.9 % which is almost to the point of at least 40.0 % points desired by Rasch models . The Rasch Model analysis showed person reliability index of 0.77 and the item reliability index of 0.88 . In terms of polarity items showed that all the items have value Point Correlation Measure ( PMC ) positive means there is no conflict between the items and the constructs being measured . Value Mean Square also showed that all the items have a mean square less than 1.5 , which means the value of the measurement of productive unless the item Peng10 (2.21) and item Peng1 (3.88). For both of these items need to be re- examined because it has a problem in measuring validity. The results of this study have proved that PAKEM instrument has a standard value of validity and reliability to be usedin measuring knowledge PAKEM strategis for teachers.

scholarly journals Development of Mathematical Anxiety Instruments with a Rasch Model Analysis

2020 ◽  
Vol 13 (1) ◽  
pp. 181-192
Author(s):  
Karlimah Karlimah ◽  
Dewi Andriani ◽  
Dodi Suryana
Keyword(s):  
Rasch Model ◽  
Descriptive Analysis ◽  
Model Analysis ◽  
Female Students ◽  
School Students ◽  
Cross Sectional ◽  
Mathematical Anxiety ◽  
Unpleasant Feeling ◽  
Cross Sectional Design ◽  
Maximum Reliability

Background: This study was motivated by a large number of students who feel anxious when dealing with mathematics, which is an unpleasant feeling characterized by the presence of worry, anxiety, confusion, and stress. Objective: This study aims to test the instruments of mathematical anxiety using Rasch Model analysis. Materials and Methods: The study used descriptive analysis with a cross-sectional design. Subjects of the study were elementary school students in grade VI SDN Margarahayu, 13 male and 5 female students in grade VI A, 9 male and 3 female students in grade VI B. Results: The results of the analysis show that the instrument has a poor or not maximum reliability value (α = 0.56). Likewise, the respondent's reliability value (α = 0.49) is in the weak category and the item reliability (α = 0.93) is in the excellent category. Conclusion: The analysis of the instrument shows that 2 items do not meet the standard criteria for the measurement, including number 16 as bias genders are more profitable for female students, and number 9 misfits because it is too difficult for most students to agree on. 3 items are categorized as very difficult, including item number P13, P11, and P12. There are 5 items in difficult category, which include numbers P9, P15, P14, P16, and P10. There are 4 items in the easy category, including P6, P5, P4, and P3. While the very easy category has 4 items, including numbers P1, P7, P2, and P8.

scholarly journals Developing FD-MT to investigate students’ mental model on fluid dynamic concept: a Rasch model analysis

2021 ◽  
Vol 2098 (1) ◽  
pp. 012020
Author(s):  
F H Dewi ◽  
A Samsudin ◽  
D T Chandra
Keyword(s):  
Fluid Dynamics ◽  
High School ◽  
Mental Models ◽  
Rasch Model ◽  
Mental Model ◽  
Research Method ◽  
Fluid Dynamic ◽  
Model Analysis ◽  
Differential Item Function ◽  
Item Fit

Abstract Fluid dynamics has some complex and unobservable concept, however, tests are rarely developed to measure students’ understanding of these concepts. This condtion make a difficulty to map students’ mental models with existing instruments. Based on that problem, this study aims to develop FD-MT (fluid dynamic-multi tier test) as a diagnostic test for measure students’ mental model on fluid dynamic concept. The ADDIE (Analyzing, Designing, Developing, Implementing, Evaluating) is a research method that used in this study. The data were collected by FD-MT will be analyzed by rasch model analysis, include the reliability, the validity, item fit and the differential item function. Student mental model clasified as Scientific, Synthesis-A (Sy-A), Synthesis-B(Sy-B), Syinthesis-C (Sy-C), Synthesis-D(Sy-D), and Initial. The participant of this study are 20 students in the eleventh grade (9 boys and 11 girls, 16-17 age in average) at high school in Bandung. Based on result study shows that students’ mental model mostly in mental Sc (8.18%), Sy-A (3.18%), Sy-B (21.36%), Sy-C (19.09%), Sy-D (38.18%) and In (10%), and incompleted answer (Nr = 0%). This conclude that, FD-MT is able to measureing students’ mental model on fluid dynamic concept.

Validity and Reliability of Green Competencies Instrument for Automobile Technology Programme Using Rasch Model

2021 ◽  
Vol 5 (2) ◽  
Author(s):  
Igogbe Regina Onyilo ◽  
Mahyuddin Arsat ◽  
Nor Fadila Amin
Keyword(s):  
Rasch Model ◽  
Point Of View ◽  
Validity And Reliability ◽  
Automobile Engineering ◽  
Engineering Technology ◽  
Fit Statistics ◽  
Item Fit ◽  
Point Measure ◽  
Technology Programme ◽  
Automobile Technology

This article aims to determine the validity of developed constructs and check the reliability of the newly developed instrument named as Questionnaire on Green Competencies for Automobile Engineering Technology (QGCAET) for the Automobile Technology Programme in Nigerian Universities. The instrument consists of 170 elements measuring four constructs namely Technical Green Competencies; Managerial Green Competencies; Personal Green Competencies and Social Green Competencies and was administered to 299 respondents made of Lecturers, Technologists and Final- Year Students of Automobile Engineering and Technology programme in Nigeria universities. The Rasch model was used to examine the validity and reliability of the items. From the analysis point of view, the polarity of the elements indicates that the correlation of the point measure (PTMEA CORR) of 170 elements of green competencies is between 0.00 and 0.55. The summary statistics show that the reliability of the items and the separation of the items of the green competencies instrument are 0.98 and 6.46, respectively. Similarly, the item reliability of each construct is between 0.96 and 0.99, and the reliability of the person is between 0.79 and 1.97, respectively. In terms of item fit statistics, a total of 157 items are found to be fit to achieve the objectives of the study. The result also indicates that the range of fit for the four (4) identified green competencies constructs is between 0.61 and 1.49 signifying that all the constructs are in harmony in measuring the items in the constructs, so suitable in achieving the objectives of the research.

scholarly journals Construct Validity for Measuring Entrepreneurial Readiness Among Malaysian Higher Education Students: A Stochastic Measurement Model Approach

2018 ◽  
Vol 150 ◽  
pp. 06044
Author(s):  
M.S. Jusoh ◽  
M.S. Hj Din ◽  
Hazliza ◽  
T. Suriani
Keyword(s):  
Construct Validity ◽  
Descriptive Analysis ◽  
Reliability And Validity ◽  
Measurement Model ◽  
Validity And Reliability ◽  
Item Fit ◽  
The Difference ◽  
Entrepreneurial Readiness ◽  
Conducting Research ◽  
The One

Instrument construct is one of the most important issues in conducting research. Without proper consideration in tackling the issue, it is difficult for the instrument to be considered as valid and reliable. If construct validity is accurate, then it will provide a clearer and more precise descriptive analysis on the concepts being investigated. The most important criteria that need to be considered in answering the construct validity are reliability and validity. In traditional measurement model, the understanding of reliability and validity is totally different from the one offered by Rasch model. Regardless of the difference, an internal consistency is still widely being used as the primary method to measure the item sampling. Using this model, local dependence and item fit are most considered in getting valid, reliable, and consistent, hence its significance. Finally the study applies goodness of measure purposely to answer issues related to validity and reliability tests. Principal components analysis was carried out to test the construct of questionnaires used in the study.

Sign in / Sign up

Export Citation Format

Share Document