scholarly journals An assessment of functioning and non-functioning distractors in multiple-choice questions: a descriptive analysis

2009 ◽  
Vol 9 (1) ◽  
Author(s):  
Marie Tarrant ◽  
James Ware ◽  
Ahmed M Mohammed
2014 ◽  
Vol 2 (4) ◽  
pp. 148 ◽  
Author(s):  
HamzaMohammad Abdulghani ◽  
Farah Ahmad ◽  
Abdulmajeed Aldrees ◽  
MahmoudS Khalil ◽  
GomindaG Ponnamperuma

2019 ◽  
Vol 8 (1) ◽  
pp. 57-68
Author(s):  
Anetha L. F. Tilaar ◽  
Hasriyanti Hasriyanti

Abstract The results of the initial interview, it was revealed that every time the final school exam was conducted, the questions tested had not been analyzed as a whole, so the quality of the questions was unknown. Therefore this study aims to analyze the odd semester final exam items in mathematics in SMP Negeri 4 Pineleng in the 2018/2019 school year in terms of reliability, validity, distinguishing features, level of difficulty and effectiveness of deceivers (specifically multiple choice questions). This type of research is a descriptive analysis with a quantitative approach. The number of subjects in this study were 97 students consisting of all VIII grade students of SMP Negeri 4 Pineleng in the 2018/2019 school year. The data collection technique used is documentation. The data is processed manually with the help of the excel program and uses the help of the Anatest Version 4 program specifically to analyze effectiveness. From the results of the analysis it can be concluded that the final semester exams for the mathematics students of SMP Negeri 4 Pineleng in the 2018/2019 school year: (1) Types of multiple choice questions, 5 questions or 16.67% have very good quality so they can be stored in the question bank for reuse , 15 questions or 50.00% still need to be revised and 10 questions or 33.33% have very poor quality so that they cannot be stored in the question bank. (2) The types of description questions, 2 questions or 40.00% have good quality, 2 questions or 40.00% need to be revised, 1 problem or 20.00% have bad quality.AbstrakHasil wanwancara awal, terungkap bahwa setiap pelaksanaan ujian akhir sekolah, soal yang diujikan belum dianalisis secara keseluruhan, sehingga kualitas soal tersebut tidak diketahui. Oleh karena itu penelitian ini bertujuan untuk menganalisis butir soal ujian akhir semester ganjil mata pelajaran matematika SMP Negeri 4 Pineleng tahun ajaran 2018/2019 ditinjau dari reliabilitas, validitas, daya pembeda soal, tingkat kesukaran dan efektifitas pengecoh (khusus soal pilihan ganda). Jenis penelitian ini adalah analisis deskriptif dengan pendekatan kuantitatif. Jumlah subjek dalam penelitian ini adalah 97 siswa terdiri dari seluruh siswa kelas VIII SMP Negeri 4 Pineleng tahun ajaran 2018/2019. Teknik pengumpulan data yang digunakan adalah dokumentasi. Data diolah secara manual dengan bantuan program excel dan menggunakan bantuan program Anatest Versi 4 khusus untuk menganalisis efektifitas. Dari hasil analisis dapat disimpulkan bahwa ujian akhir semester ganjil mata pelajarn matematika SMP Negeri 4 Pineleng tahun ajaran 2018/2019 : (1) Jenis soal pilihan ganda, 5 soal atau 16.67% memiliki kualitas sangat baik sehingga dapta disimpan di bank soal untuk dapat digunakan kembali, 15 soal atau 50.00% masih perlu direvisi dan 10 soal atau 33.33% memiliki kualitas sangat tidak baik sehingga tidak dapat disimpan di bank soal. (2) Jenis soal uraian, 2 soal atau 40.00% memiliki kualitas baik, 2 soal atau 40.00% perlu direvisi, 1 soal atau 20,00% meiliki kualitas tidak baik. 


2017 ◽  
Vol 24 (09) ◽  
pp. 1409-1414
Author(s):  
Muhammad Zafar Iqbal ◽  
Shumaila Irum ◽  
Muhammad Sohaib Yousaf

Objectives: The main objective of this study was to judge the quality of MCQs interms of their cognition level and item writing flaws, developed by the faculty of a public sectormedical college. Setting: This study was conducted in Sheikh Zayed Medical College, RahimYar Khan. Duration with Dates: Data was collected between June 2014 to March 2015 andthis study was completed in July 2016. Sample Size: A sample of 500 MCQs collected from25 faculty members were included in the study. Study Design: Quantitative method. StudyType: Cross sectional descriptive analysis. Material and Methods: This quantitative study wasconducted in Sheikh Zayed Medical College Rahim Yar Khan over six months period after theapproval of the study proposal. Every faculty member is supposed to write 25 MCQs in order tobecome supervisor. I collected 500 multiple choice questions from 25 faculty members readyfor submission to CPSP. The quality of all MCQs was checked in terms of item writing flawsand cognition level by panel of experts. Results: Absolute terms were observed in 10(2%),vague terms in 15(3%), implausible distracters in 75(15%), extra detail in correct option 15(3%),unfocused stem 63(12.6%), grammatical clues 39(7.8%), logical clues 18(3.6%), word repeats19(3.8%), >then one correct answer 21(4.2%), unnecessary information in stem 37(7.4%),lost sequence in data 15(3%), all of above16(3.2%), none of above 12(2.4%) and negativestem 23(4.6%). Cognition level l (recall) was observed in 363(72.6%), level ll (interpretation) in115(23%) and level lll (problem solving) in 22(4.4%) items. Total 378(75.6%) flaws were identifiedand four commonest flaws were implausible distracter 75(15%), unfocused stem 63(12.6%),grammatical clues 39(7.8%) and unnecessary information in stem 37(7.4%). Conclusion: It isconcluded that assessment of medical students is very demanding and need of the time. A wellconstructed,peer-reviewed single best type MCQ is best one to complete this task becauseof cost effectiveness, better reliability and computerized marking. It is very important to startfaculty development program in order to decrease the number of item writing flaws and improvecognition level towards problem solving and application of knowledge.


2019 ◽  
Vol 5 (2) ◽  
pp. 163-168
Author(s):  
Ani Rahmawati ◽  
Nur Lailatin Nisfah ◽  
Sentot Kusairi

The study aims to determine student’s High Order Thinking Skills (HOTS) and to find out the causes of student’s HOTS on dynamic electricity material. The number of samples involved 59 students consisting of 30 students from the excellence class and 29 students from the regular class. The research instrument used consisted of 8 Multiple Choice Questions (MCQs). Questions have been validated, and reliability has been tested in the medium category (Alpha Cronbachs: 0.44). The data analyzed using descriptive analysis. The average student’s HOTS is 59.98% indicating the medium category. The results of the student’s HOTS on the analysis provided by students from excellence classes are 71.25% indicating high category and regular class 48.71% indicating medium category. The results of the analysis show that student’s HOTS is on medium category because students having difficulty in making connection one concept to another concept and using mathematics as a tool in solving physics problems. The results as a reference for improving student’s HOTS. This research can be developed by increasing the sample and expanding the material being tested.


Informatica ◽  
2017 ◽  
Vol 28 (4) ◽  
pp. 609-628
Author(s):  
Ali Fahmi ◽  
Cengiz Kahraman

2017 ◽  
Vol 32 (4) ◽  
pp. 1-17 ◽  
Author(s):  
Dianne Massoudi ◽  
SzeKee Koh ◽  
Phillip J. Hancock ◽  
Lucia Fung

ABSTRACT In this paper we investigate the effectiveness of an online learning resource for introductory financial accounting students using a suite of online multiple choice questions (MCQ) for summative and formative purposes. We found that the availability and use of an online resource resulted in improved examination performance for those students who actively used the online learning resource. Further, we found a positive relationship between formative MCQ and unit content related to challenging financial accounting concepts. However, better examination performance was also linked to other factors, such as prior academic performance, tutorial participation, and demographics, including gender and attending university as an international student. JEL Classifications: I20; M41.


Sign in / Sign up

Export Citation Format

Share Document