scholarly journals Development of test instruments to measure high level thinking ability of two linear variable equations system

2021 ◽  
Vol 1 (2) ◽  
pp. 91
Author(s):  
Anggit Prabowo ◽  
Puspa Puspa ◽  
Fariz Setyawan
Keyword(s):  
High Reliability ◽  
Multiple Choice ◽  
Expert Judgment ◽  
Design Development ◽  
Multiple Choice Questions ◽  
Test Instrument ◽  
Thinking Ability ◽  
Difficulty Index ◽  
High Level ◽  
High Level Thinking

This study aims to develop a test instrument to measure the high-level thinking ability of the two-variable linear equation system material. This research is a Research and Development using the ADDIE development model consisting of steps of analysis, design, development, implementation, and evaluation. The test subjects in this study were students of class VIII of SMP Negeri 3 Payung. The instruments used in this study were validation sheets and documentation. Data collection techniques through expert judgment and tests. This research has succeeded in developing a test instrument to measure the high-level thinking ability of two-variable linear equations system material. The test developed consists of 10 multiple choice items and 5 description items that have been declared valid by expert judgment. The trial results show from the difficulty index analysis of multiple-choice questions was obtained as much as 1 item in the easy category, 9 questions in the moderate category, the analysis of the difficulty index for the essay obtained by 2 items in the medium category, 3 questions in the difficult category. In the analysis of discriminant index of multiple-choice questions, there were 1 question in the bad category, 3 questions with enough categories, and 6 questions in the good category. In the analysis of the difference in power, 2 questions were categorized as bad, 1 question was categorized as sufficient, 2 questions were categorized as good. Based on the analysis of the function of the distractor, it was found that 1 question was not functioning properly, 9 questions were functioning properly. Finally, from the reliability analysis, it was obtained 0.73 for multiple choice questions and 0.716 for essay questions with high reliability interpretation.

scholarly journals The Dimension of the Higher Order Thinking Cognitive Process in Indonesian Language Teaching Textbook for Senior High School Students

2021 ◽  
Vol 8 (12) ◽  
pp. 65
Author(s):  
Tiya Agustina ◽  
Sarwiji Suwandi ◽  
Suyitno Suyitno
Keyword(s):  
High School Students ◽  
Data Analysis ◽  
Multiple Choice ◽  
Higher Order Thinking ◽  
Thinking Skills ◽  
Higher Order ◽  
Analysis Model ◽  
Multiple Choice Questions ◽  
High Level ◽  
High Level Thinking

An increasing advanced civilization requires educational institutions to be more adaptive. This challenge is realized by revising the 2013 curriculum, which integrates higher-order thinking skills. This study aims to describe the cognitive dimensions of higher-order thinking in textbooks on the aspects of analyzing (C4), evaluating (C5), and creating (C6). This study used descriptive qualitative method. The data source used in this study is the Indonesian language textbook for Class XI SMA published by Erlangga. Data collection techniques in this study are content analysis, reading and note-taking techniques. The data validity technique in this study used theoretical triangulation and expert judgement. The data analysis technique used an interactive data analysis model. The results of this study showed that in the Indonesian language textbook XI grade published by Erlangga, there were 170 questions that lead to the cognitive dimension of high-level thinking dominated by analyzing skills of 63 with a percentage of 37.06%, 55 questions evaluating with a percentage of 32.36%, and 52 questions of creating skill with a percentage of 30.59%. In general, the form of questions in the book is dominated by description questions and a few multiple choices. Even though it is presented with multiple choice questions, it does not eliminate the cognitive element of high-level thinking skills. Type of multiple choice questions can be used to assess low to high levels of cognition. 

SBA MCQs for the MRCS Part A

2012 ◽  
Author(s):  
Sri G. Thrumurthy ◽  
Tania Samantha De Silva ◽  
Zia Moinuddin ◽  
Stuart Enoch
Keyword(s):  
Clinical Case ◽  
Multiple Choice ◽  
Surgical Anatomy ◽  
Surgical Patients ◽  
Multiple Choice Questions ◽  
Basic Sciences ◽  
Self Assessment ◽  
High Level ◽  
Factual Recall ◽  
Selection Of

Specifically designed to help candidates revise for the MRCS exam, this book features 350 Single Best Answer multiple choice questions, covering the whole syllabus. Containing everything candidates need to pass the MRCS Part A SBA section of the exam, it focuses intensively on the application of basic sciences (applied surgical anatomy, physiology, and pathology) to the management of surgical patients. The high level of detail included within the questions and their explanations allows effective self-assessment of knowledge and quick identification of key areas requiring further attention. Varying approaches to Single Best Answer multiple choice questions are used, giving effective exam practice and guidance through revision and exam technique. This includes clinical case questions, 'positively-worded' questions, requiring selection of the most appropriate of relatively correct answers; 'two-step' or 'double-jump' questions, requiring several cognitive steps to arrive at the correct answer; as well as 'factual recall' questions, prompting basic recall of facts.

CORRELATION OF DIFFICULTY INDEX AND DISCRIMINATING INDEX IN MEDICAL STUDENT’S ASSESSMENT.

2021 ◽  
pp. 9-10
Author(s):  
Bhoomika R. Chauhan ◽  
Jayesh Vaza ◽  
Girish R. Chauhan ◽  
Pradip R. Chauhan
Keyword(s):  
Medical Students ◽  
Formative Assessment ◽  
Item Difficulty ◽  
Multiple Choice ◽  
Multiple Choice Questions ◽  
Discriminating Power ◽  
Good Discriminator ◽  
Difficulty Index ◽  
The Relationship

Multiple choice questions are nowadays used in competitive examination and formative assessment to assess the student's eligibility and certification.Item analysis is the process of collecting,summarizing and using information from students' responses to assess the quality of test items.Goal of the study was to identify the relationship between the item difficulty index and item discriminating index in medical student's assessment. 400 final year medical students from various medical colleges responded 200 items constructed for the study.The responses were assessed and analysed for item difficulty index and item discriminating power. Item difficulty index an item discriminating power were analysed by statical methods to identify correlation.The discriminating power of the items with difficulty index in 40%-50% was the highest. Summary and Conclusion:Items with good difficulty index in range of 30%-70% are good discriminator.

scholarly journals Item analysis of multiple choice questions of undergraduate pharmacology examinations in a medical college in Belagavi, Karnataka, India

2018 ◽  
Vol 7 (10) ◽  
pp. 1917
Author(s):  
Netravathi B. Angadi ◽  
Amitha Nagabhushana ◽  
Nayana K. Hashilkar
Keyword(s):  
Simple Procedure ◽  
Item Analysis ◽  
Multiple Choice ◽  
Reliability And Validity ◽  
Incorrect Response ◽  
Test Construction ◽  
Multiple Choice Questions ◽  
Course Content ◽  
Medical College ◽  
Difficulty Index

Background: Multiple choice questions (MCQs) are a common method of assessment of medical students. The quality of MCQs is determined by three parameters such as difficulty index (DIF I), discrimination index (DI), and Distractor efficiency (DE). Item analysis is a valuable yet relatively simple procedure, performed after the examination that provides information regarding the reliability and validity of a test item. The objective of this study was to perform an item analysis of MCQs for testing their validity parameters.Methods: 50 items consisting of 150 distractors were selected from the formative exams. A correct response to an item was awarded one mark with no negative marking for incorrect response. Each item was analysed for three parameters such as DIF I, DI, and DE.Results: A total of 50 items consisting of 150 Distractor s were analysed. DIF I of 31 (62%) items were in the acceptable range (DIF I= 30-70%) and 30 had ‘good to excellent’ (DI >0.25). 10 (20%) items were too easy and 9 (18%) items were too difficult (DIF I <30%). There were 4 items with 6 non-functional Distractor s (NFDs), while the rest 46 items did not have any NFDs.Conclusions: Item analysis is a valuable tool as it helps us to retain the valuable MCQs and discard or modify the items which are not useful. It also helps in increasing our skills in test construction and identifies the specific areas of course content which need greater emphasis or clarity.

scholarly journals Development of Misconception Diagnostic Test in Momentum and Impulse Using Isomorphic Problem

2017 ◽  
Vol 1 (2) ◽  
pp. 145
Author(s):  
Nadiyah El-Haq Diyanahesa ◽  
Sentot Kusairi ◽  
Eny Latifah
Keyword(s):  
Diagnostic Test ◽  
Multiple Choice ◽  
Diagnostic Instrument ◽  
Design Development ◽  
Test Analysis ◽  
Is Research ◽  
Test Instrument ◽  
Student Misconceptions ◽  
Analysis Design ◽  
Addie Model

Preconception of the students influences to construct knowledge. They entered the classroom with conception formed from daily life. If their conception are not accordance with scientific concepts it’s  called misconceptions. Misconception is believed by students and used consistently. Teachers need to find out information on a student misconceptions by providing diagnostic tests immedietly. Diagnostic instrument that measure more accurately concepts understanding is isomorphic. Problem isomorphic composed of several question in different context and representation, but solved by the same principles. The goal of this study developing a multiple-choice diagnostic test instrument isomorphic to diagnose misconception of students on momentum and impulse. This study is research and development using ADDIE model (Analysis, Design, Development or Production, Implementation or Delivery and Evaluations). Development steps consist of: (1) Analysis, (2) Design, (3) Develop, and (4) Implement. Before  Implement steps, test instrument validated by lecture and two teachers. The instrument have been revised administered to students of class XI MIA 4 MAN Tlogo Blitar and  X MIA U1 MAN 1 Tulungagung. Results of this study are 15 items multiple choice diagnostic instruments isomorphic belongs five indicators. Based on the validation by two physics teachers and lecturers, instrument accordance used as a diagnostic instrument capable to distinguish between students misconceptions and naive concept. Around 67.8% of students who have answered the description are still misconceptions. Based on the test analysis accordance with open ended question instrument test diagnostic isomorphic produce higher accuracy by taking two of the three questions the answers provided.

scholarly journals Assessment of Global Health Education: The Role of Multiple-Choice Questions

2021 ◽  
Vol 9 ◽  
Author(s):  
Nathan T. Douthit ◽  
John Norcini ◽  
Keren Mazuz ◽  
Michael Alkan ◽  
Marie-Therese Feuerstein ◽  
...  
Keyword(s):  
Health Education ◽  
Global Health ◽  
Multiple Choice ◽  
International Health ◽  
Biomedical Science ◽  
Multiple Choice Questions ◽  
Global Health Education ◽  
Item Writing ◽  
Difficulty Index

Introduction: The standardization of global health education and assessment remains a significant issue among global health educators. This paper explores the role of multiple choice questions (MCQs) in global health education: whether MCQs are appropriate in written assessment of what may be perceived to be a broad curriculum packed with fewer facts than biomedical science curricula; what form the MCQs might take; what we want to test; how to select the most appropriate question format; the challenge of quality item-writing; and, which aspects of the curriculum MCQs may be used to assess.Materials and Methods: The Medical School for International Health (MSIH) global health curriculum was blue-printed by content experts and course teachers. A 30-question, 1-h examination was produced after exhaustive item writing and revision by teachers of the course. Reliability, difficulty index and discrimination were calculated and examination results were analyzed using SPSS software.Results: Twenty-nine students sat the 1-h examination. All students passed (scores above 67% - in accordance with University criteria). Twenty-three (77%) questions were found to be easy, 4 (14%) of moderate difficulty, and 3 (9%) difficult (using examinations department difficulty index calculations). Eight questions (27%) were considered discriminatory and 20 (67%) were non-discriminatory according to examinations department calculations and criteria. The reliability score was 0.27.Discussion: Our experience shows that there may be a role for single-best-option (SBO) MCQ assessment in global health education. MCQs may be written that cover the majority of the curriculum. Aspects of the curriculum may be better addressed by non-SBO format MCQs. MCQ assessment might usefully complement other forms of assessment that assess skills, attitude and behavior. Preparation of effective MCQs is an exhaustive process, but high quality MCQs in global health may serve as an important driver of learning.

scholarly journals Development of multiple choice question bank in otorhinolaryngology by item analysis: a cross-sectional study

2019 ◽  
Vol 5 (2) ◽  
pp. 449
Author(s):  
Ajeet Kumar Khilnani ◽  
Rekha Thaddanee ◽  
Gurudas Khilnani
Keyword(s):  
Item Analysis ◽  
Multiple Choice ◽  
Cross Sectional Study ◽  
Low Achievers ◽  
Discrimination Index ◽  
High Achievers ◽  
Multiple Choice Questions ◽  
Cross Sectional ◽  
The Mean ◽  
Difficulty Index

<p class="abstract"><strong>Background:</strong> Multiple choice questions (MCQs) are routinely used for formative and summative assessment in medical education. Item analysis is a process of post validation of MCQ tests, whereby items are analyzed for difficulty index, discrimination index and distractor efficiency, to obtain a range of items of varying difficulty and discrimination indices. This study was done to understand the process of item analysis and analyze MCQ test so that a valid and reliable MCQ bank in otorhinolaryngology is developed.</p><p class="abstract"><strong>Methods:</strong> 158 students of 7<sup>th</sup> Semester were given an 8 item MCQ test. Based on the marks achieved, the high achievers (top 33%, 52 students) and low achievers (bottom 33%, 52 students) were included in the study. The responses were tabulated in Microsoft Excel Sheet and analyzed for difficulty index, discrimination index and distractor efficiency.  </p><p class="abstract"><strong>Results:</strong> The mean (SD) difficulty index (Diff-I) of 8 item test was 61.41% (11.81%). 5 items had a very good difficulty index (41% to 60%), while 3 items were easy (Diff-I &gt;60%). There was no item with Diff-I &lt;30%, i.e. a difficult item, in this test. The mean (SD) discrimination index (DI) of the test was 0.48 (0.15), and all items had very good discrimination indices of more than 0.25. Out of 24 distractors, 6 (25%) were non-functional distractors (NFDs). The mean (SD) distractor efficiency (DE) of the test was 74.62% (23.79%).</p><p class="abstract"><strong>Conclusions:</strong> Item analysis should be an integral and regular activity in each department so that a valid and reliable MCQ question bank is developed.</p>

scholarly journals Quality of multiple choice questions in undergraduate pharmacology assessments in a teaching hospital of Kerala, India: an item analysis

2017 ◽  
Vol 6 (6) ◽  
pp. 1265
Author(s):  
Manju K. Nair ◽  
Dawnji S. R.
Keyword(s):  
Item Analysis ◽  
Multiple Choice ◽  
Discrimination Index ◽  
Response Type ◽  
Multiple Choice Questions ◽  
Microsoft Excel ◽  
Best Response ◽  
Difficulty Index ◽  
Upper Third

Background: Carefully constructed, high quality multiple choice questions can serve as effective tools to improve standard of teaching. This item analysis was performed to find the difficulty index, discrimination index and number of non functional distractors in single best response type questions.Methods: 40 single best response type questions with four options, each carrying one mark for the correct response, was taken for item analysis. There was no negative marking. The maximum marks was 40. Based on the scores, the evaluated answer scripts were arranged with the highest score on top and the least score at the bottom. Only the upper third and lower third were included. The response to each item was entered in Microsoft excel 2010. Difficulty index, Discrimination index and number of non functional distractors per item were calculated.Results: 40 multiple choice questions and 120 distractors were analysed in this study. 72.5% items were good with a difficulty index between 30%-70%. 25% items were difficult and 2.5% items were easy. 27.5% items showed excellent discrimination between high scoring and low scoring students. One item had a negative discrimination index (-0.1). There were 9 items with non functional distractors.Conclusions: This study emphasises the need for improving the quality of multiple choice questions. Hence repeated evaluation by item analysis and modification of non functional distractors may be performed to enhance standard of teaching in Pharmacology.

scholarly journals Item analysis as tool to validate multiple choice question bank in pharmacology

2019 ◽  
Vol 8 (9) ◽  
pp. 1999
Author(s):  
Amit P. Date ◽  
Archana S. Borkar ◽  
Rupesh T. Badwaik ◽  
Riaz A. Siddiqui ◽  
Tanaji R. Shende ◽  
...  
Keyword(s):  
Item Analysis ◽  
Multiple Choice ◽  
Incorrect Response ◽  
Cross Sectional Study ◽  
Discrimination Index ◽  
Multiple Choice Questions ◽  
Medical Sciences ◽  
Cross Sectional ◽  
Lower Ability ◽  
Difficulty Index

Background: Multiple choice questions (MCQs) are a common method for formative and summative assessment of medical students. Item analysis enables identifying good MCQs based on difficulty index (DIF I), discrimination index (DI), distracter efficiency (DE). The objective of this study was to assess the quality of MCQs currently in use in pharmacology by item analysis and develop a MCQ bank with quality items.Methods: This cross-sectional study was conducted in 148 second year MBBS students at NKP Salve institute of medical sciences from January 2018 to August 2018. Forty MCQs twenty each from the two term examination of pharmacology were taken for item analysis A correct response to an item was awarded one mark and each incorrect response was awarded zero. Each item was analyzed using Microsoft excel sheet for three parameters such as DIF I, DI, and DE.Results: In present study mean and standard deviation (SD) for Difficulty index (%) Discrimination index (%) and Distractor efficiency (%) were 64.54±19.63, 0.26±0.16 and 66.54±34.59 respectively. Out of 40 items large number of MCQs has acceptable level of DIF (70%) and good in discriminating higher and lower ability students DI (77.5%). Distractor efficiency related to presence of zero or 1 non-functional distrator (NFD) is 80%.Conclusions: The study showed that item analysis is a valid tool to identify quality items which regularly incorporated can help to develop a very useful, valid and a reliable question bank.

Sign in / Sign up

Export Citation Format

Share Document