scholarly journals The characteristics of chemistry test items on nationally-standardized school examination in Yogyakarta City

2021 ◽  
Vol 7 (1) ◽  
Author(s):  
Ummul Karimah ◽  
Heri Retnawati ◽  
Deni Hadiana ◽  
Pujiastuti Pujiastuti ◽  
Eri Yusron

AbstractThis study aimed to describe the characteristics of chemistry test items in Nationally Standardized School Examination or Ujian Sekolah Berstandar Nasional (USBN), consisted of discrimination index, difficulty index, and question reliability. The data was collected by using documentation of the answers of 194 students. The type of research was descriptive exploratory with quantitative and qualitative approaches. Quantitative data analysis was performed by using classical test theory approach and item response theory with 1 logistical parameter. Meanwhile, qualitative data analysis was conducted in order to describe the items that were categorized as difficult and bad categories. The results showed that according to classical test theory, USBN Chemistry item test had an average level of difficulty of 0.57 which was categorized as moderate. Regarding to the discrimination index, the average of different test power obtained were equal to 0.146, and belonged to the good category. Based on the item response theory, the average of difficulty index of -0,00086 was categorized as moderate. The results of the estimated reliability of the questions amounted to 0.48 included in the moderate category. The results of the qualitative analysis showed that the items which belonged to difficult category were the items on salt hydrolysis material, acid-base titration, the concept of periodicity, manufacture and use of chemical compounds according to classical test theory. Meanwhile, according to the theory of response, items which belonged to difficult category were found in acid-base titration material, the solution colligative phenomenon, and the concept of periodicity of the main metal elements.

Author(s):  
Eun Young Lim ◽  
Jang Hee Park ◽  
ll Kwon ◽  
Gue Lim Song ◽  
Sun Huh

The results of the 64th and 65th Korean Medical Licensing Examination were analyzed according to the classical test theory and item response theory in order to know the possibility of applying item response theory to item analys and to suggest its applicability to computerized adaptive test. The correlation coefficiency of difficulty index, discriminating index and ability parameter between two kinds of analysis were got using computer programs such as Analyst 4.0, Bilog and Xcalibre. Correlation coefficiencies of difficulty index were equal to or more than 0.75; those of discriminating index were between - 0.023 and 0.753; those of ability parameter were equal to or more than 0.90. Those results suggested that the item analysis according to item response theory showed the comparable results with that according to classical test theory except discriminating index. Since the ability parameter is most widely used in the criteria-reference test, the high correlation between ability parameter and total score can provide the validity of computerized adaptive test utilizing item response theory.


2011 ◽  
Vol 16 (2) ◽  
pp. 109
Author(s):  
Mr Nahadi ◽  
Mrs Wiwi Siswaningsih ◽  
Mr Ana Rofiati

This research is title “Test Development and Analysis of First Grade Senior High School Final Examination in chemistry Based on Classical Test Theory and Item Response Theory”. This research is conducted to develop a standard test instrument for final examination in senior high school at first grade using analysis based on classical test theory and item response theory. The test is a multiple choice test which consists of 75 items. Each item has five options. The research method is research and development method to get a product of test items which fulfill item criterion such as validity, reliability, item discrimination, item difficulty and distracting options quality based on classical test theory and validity, reliability, item discrimination, item difficulty and pseudo-guessing based on item response theory. The three parameter item response theory model is used in this research. Research and development method is conducted until preliminary field test to 102 first grade students in senior high school. Based on the research result, the test fulfills criterion as a good instrument based on classical test theory and item response theory. The final examination test items have vary of item quality so that some of them need a revision to make them better either for the stem and the options. From the total of 75 test items, 21 test items are declined and 54 test items are accepted.


2019 ◽  
Vol 5 (2) ◽  
pp. 169-182
Author(s):  
Badrun Kartowagiran ◽  
Djemari Mardapi ◽  
Dian Normalitasari Purnama ◽  
Kriswantoro Kriswantoro

This research aims to prove that a parallel test can be constructed by randomizing the test item numbers and or alternative answers' order. This study used the experimental method with a post-test only non-equivalent control group design, involving junior high schools students in Yogyakarta City with a sample of 320 students of State Junior High School (SMPN) 5 Yogyakarta and 320 students of SMPN 8 Yogyakarta established using the stratified proportional random sampling technique. The instrument used is a mathematics test in the form of an objective test consisting of a five-question package and each package contains 40 items with four alternatives. The test package is randomized in the item numbers' order from the smallest to the largest and vice versa. The options in each item are also randomized from A to D and vice versa. Each item is analyzed using the Classical Test Theory and Item Response Theory approaches, while data analysis is done using the discrimination index with Kruskal-Wallis test technique to see the differences among the five-question packages. The study reveals that the result of item analysis using the Classical Test Theory and Item Response Theory approaches shows no significant difference in the difficulty index among Package 1 until Package 5. Nevertheless, according to the Classical Test Theory, there is a category shift of the difficulty index of Package 2 until Package 5 when compared to Package 1 – the original package – which is, in general, not a good package, because it contains too easy items.


Sign in / Sign up

Export Citation Format

Share Document