Development of the Paranormal and Supernatural Beliefs Scale using classical and modern test theory

Background This study describes the construction and validation of a new scale for measuring belief in paranormal phenomena. The work aims to address psychometric and conceptual shortcomings associated with existing measures of paranormal belief. The study also compares the use of classic test theory and modern test theory as methods for scale development. Method We combined novel items and amended items taken from existing scales, to produce an initial corpus of 29 items. Two hundred and thirty-one adult participants rated their level of agreement with each item using a seven-point Likert scale. Results Classical test theory methods (including exploratory factor analysis and principal components analysis) reduced the scale to 14 items and one overarching factor: Supernatural Beliefs. The factor demonstrated high internal reliability, with an excellent test–retest reliability for the total scale. Modern test theory methods (Rasch analysis using a rating scale model) reduced the scale to 13 items with a four-point response format. The Rasch scale was found to be most effective at differentiating between individuals with moderate-high levels of paranormal beliefs, and differential item functioning analysis indicated that the Rasch scale represents a valid measure of belief in paranormal phenomena. Conclusions The scale developed using modern test theory is identified as the final scale as this model allowed for in-depth analyses and refinement of the scale that was not possible using classical test theory. Results support the psychometric reliability of this new scale for assessing belief in paranormal phenomena, particularly when differentiating between individuals with higher levels of belief.

The Development and Initial Validation of a Self-Report Job Precariousness Scale Suitable for Use With Young Adults Who Study and Work

Precarious employment has been increasing worldwide. Yet there are few scales suitable to assess it, and no scales to measure perceived job precariousness in working students who are particularly vulnerable. Using classic test theory, we generated 21 job precariousness items and had them reviewed by experts. In Study 1 ( N = 282, 63% female, mean age 22 years), exploratory factor analysis yielded four factors of job conditions, security, remuneration, and flexibility, each with 3 items. In Study 2 ( N = 211, 75% female, mean age 22 years), confirmatory factor analysis confirmed that this four-factor model was the best fit compared to unidimensional, second-order, and bifactor models. Cronbach’s α coefficients for all factors and the full-scale score were sound (all >.78). Validity was supported by showing that precariousness was related negatively to life satisfaction and employer support and positively to job insecurity, financial strain, and subjective social status. Precariousness was unrelated to age, sex, and hours worked. The Job Precariousness Scale has the potential to promote research into the effects of precarious employment on working students’ current and future functioning and achievement and how experiences of precariousness influence the development of a precarity identity.

The Characteristics of the Nature of Science (NOS)-based Instruments in Newton Law Using Rasch Model Analysis

The objective of this research is to find out the characteristic of each test item with NOS-based instruments which is analysed based on validity and reliability level using Rasch model (RM). A test using NOS-based instruments was used to collect the data. This research is categorized as descriptive with quantitative using statistic from RM through QUEST program. There are 104 students participated as the subject of this research. The result, which is based on validity of each test item using RM analysis, shows that 25 test items are considered fit or accepted. Based on the estimate of item reliability, NOS-based instrument has reliability coefficiency at 0.96. Based on difficulty items 2 test items declared not good, namely test item number 19 and item test number 4. Based on the analysis according to Classic Test Theory of RM, the NOS instrument can be used to measure senior high school students' science literacy on Newton Law.

KUALITAS SOAL UJIAN SEKOLAH MATEMATIKA PROGRAM IPA DAN KONTRIBUSINYA TERHADAP HASIL UJIAN NASIONAL

Penelitian ini bertujuan untuk mendeskripsikan kualitas soal Ujian Sekolah Matematika program IPA dan kontribusi skor Ujian Sekolah terhadap nilai Ujian Nasional. Jenis penelitian ini deskriptif eksploratif dengan pendekatan survei. Populasi penelitian ini adalah enam SMA Swasta Yayasan Katolik di Kota Yogyakarta. Sampel adalah lima SMA yang representatif dalam menggambarkan ciri populasi. Naskah soal ditelaah tiga orang ahli untuk analisis kualitas soal secara kualitatif. Jawaban siswa dianalisis secara Teori Tes Klasik dan Teori Respons Butir untuk mengetahui kualitas soal secara kuantitatif. Skor Ujian Sekolah dikorelasikan terhadap nilai Ujian Nasional untuk mengukur kontribusinya. Hasil penelitian: (1) kualitas soal secara kualitatif adalah sangat baik (satu SMA), baik (dua SMA), cukup baik (satu SMA), dan kurang baik (satu SMA); (2) secara kuantitatif menurut Teori Tes Klasik adalah cukup baik (satu SMA), kurang baik (tiga SMA), dan tidak baik (satu SMA), dengan reliabilitas Alpha termasuk reliabel; (3) secara kuantitatif menurut Teori Respons Butir adalah baik (tiga SMA), cukup baik (satu SMA), dan kurang baik (satu SMA); (4) Indeks konsistensi analisis butir soal termasuk cukup konsisten; (5) korelasi skor Ujian Sekolah terhadap nilai Ujian Nasional termasuk kategori besar; (6) berdasarkan telaah validitas isi perangkat, lebih dari 90% soal valid dan skor Ujian Sekolah valid/akurat dalam memprediksi hasil Ujian Nasional.Kata kunci: kualitas soal, ujian sekolah, matematika, ujian nasional THE QUALITY OF MATHEMATICS SCHOOL EXAMINATION OF SCIENCE MAJOR AND ITS CONTRIBUTION TO THE RESULT OF NATIONAL EXAMINATIONAbstractThe purpose of this research is to describe the quality of Mathematics School Examination of Science Major and the contribution of School Examination scores to the result of National Examination. This research is a descriptive explorative research with survey approach. The population in this research are six Senior High Schools in Yogyakarta. The samples are five representative senior high schools to describe the characteristics of the population. The test was analyzed by three experts to find out the test quality qualitatively. The students’ answer was analyzed with Classic Test Theory and Item Response Theory to find out the test quality quantitatively. The School Examination score was correlated with the National Examination score to measure their contribution. The research result: (1) the school exam quality is very good (one school), good (two schools), quite good (one school), and not so good (one school); (2) Quantitatively based on Classic Test Theory are quite good (one school), not so good (three schools), dan poor (one school), by Alpha reliability is reliable; (3) Quantitatively based on Item Response Theory are good (three schools), quite good (one school), and not so good (one school); (4) The test item index consistency are quite consistent; (5) The correlation of the School Examination scores with the result of National Examination is in large categories; (6) Based on content validity study, more than 90% items are valid and scores of School Examination is valid/accurate in predicting the result of the National Examination.Keywords: the test quality, school examination, mathematics, national examination