scholarly journals Writing multiple-choice questions to access the higher levels of Bloom’s taxonomy

Author(s):  
Chris Adams

I report the implementation of an activity in which students are asked to write multiple-choice questions (MCQs) on the subject of ‘orbitals’ in order to consolidate their learning on the subject. This was facilitated using the online system PeerWise, which allows students to upload MCQs that they have written and to then answer those authored by their peers. The process of writing questions accesses the upper levels of Bloom’s taxonomy, and the discussions incorporated within the activity allow for socially constructed learning as part of the pedagogy of constructive evaluation.

2021 ◽  
pp. 1-12
Author(s):  
Seetha U. Monrad ◽  
Nikki L. Bibler Zaidi ◽  
Karri L. Grob ◽  
Joshua B. Kurtz ◽  
Andrew W. Tai ◽  
...  

Author(s):  
J. K. Stringer ◽  
Sally A. Santen ◽  
Eun Lee ◽  
Meagan Rawls ◽  
Jean Bailey ◽  
...  

Abstract Background Analytic thinking skills are important to the development of physicians. Therefore, educators and licensing boards utilize multiple-choice questions (MCQs) to assess these knowledge and skills. MCQs are written under two assumptions: that they can be written as higher or lower order according to Bloom’s taxonomy, and students will perceive questions to be the same taxonomical level as intended. This study seeks to understand the students’ approach to questions by analyzing differences in students’ perception of the Bloom’s level of MCQs in relation to their knowledge and confidence. Methods A total of 137 students responded to practice endocrine MCQs. Participants indicated the answer to the question, their interpretation of it as higher or lower order, and the degree of confidence in their response to the question. Results Although there was no significant association between students’ average performance on the content and their question classification (higher or lower), individual students who were less confident in their answer were more than five times as likely (OR = 5.49) to identify a question as higher order than their more confident peers. Students who responded incorrectly to the MCQ were 4 times as likely to identify a question as higher order than their peers who responded correctly. Conclusions The results suggest that higher performing, more confident students rely on identifying patterns (even if the question was intended to be higher order). In contrast, less confident students engage in higher-order, analytic thinking even if the question is intended to be lower order. Better understanding of the processes through which students interpret MCQs will help us to better understand the development of clinical reasoning skills.


Author(s):  
J. Robert Loftis ◽  

Multiple-choice questions have an undeserved reputation for only being able to test student recall of basic facts. In fact, well-crafted mechanically gradable questions can measure very sophisticated cognitive skills, including those engaged at the highest level of Benjamin Bloom’s taxonomy of outcomes. In this article, I argue that multiple-choice questions should be a part of the diversified assessment portfolio for most philosophy courses. I present three arguments broadly related to fairness. First, multiple-choice questions allow one to consolidate subjective decision making in a way that makes it easier to manage. Second, multiple-choice questions contribute to the diversity of an evaluation portfolio by balancing out problems with writing-based assessments. Third, by increasing the diversity of evaluations, multiple-choice questions increase the inclusiveness of the course. In the course of this argument, I provide examples of multiple-choice questions that measure sophisticated learning and advice for how to write good multiple-choice questions.


2015 ◽  
Vol 8 (2) ◽  
pp. 125-144 ◽  
Author(s):  
Godson Ayertei Tetteh ◽  
Frederick Asafo-Adjei Sarpong

Purpose – The purpose of this paper is to explore the influence of constructivism on assessment approach, where the type of question (true or false, multiple-choice, calculation or essay) is used productively. Although the student’s approach to learning and the teacher’s approach to teaching are concepts that have been widely researched, few studies have explored how the type of assessment (true or false, multiple-choice, calculation or essay questions) and stress would manifest themselves or influence the students’ learning outcome to fulfill Bloom’s taxonomy. Multiple-choice questions have been used for efficient assessment; however, this method has been criticized for encouraging surface learning. And also some students complain of excelling in essay questions and failing in multiple-choice questions. A concern has arisen that changes may be necessary in the type of assessment that is perceived to fulfill Bloom’s taxonomy. Design/methodology/approach – Students’ learning outcomes were measured using true or false, multiple-choice, calculations or essay questions to fulfill Bloom’s taxonomy and the students’ reaction to the test questionnaire. To assess the influence of the type of assessment and the stress level factors of interest, MANOVA was used to identify whether any differences exist and to assess the extent to which these differences are significantly different, both individually and collectively. Second, to assess if the feedback information given to respondents after the mid-semester assessment was effective, the one-way ANOVA procedure was used to test the equality of means and the differences in means of the mid-semester assessment scores and the final assessment scores. Findings – Results revealed that the type of questions (true or false, multiple-choice, calculations or essay) will not significantly affect the learning outcome for each subgroup. The ANOVA results, comparing the mid-semester and final assessments, indicated that there is sufficient evidence means are not equal. Thus, the feedback given to respondents after the mid-semester assessment had a positive impact on the final assessment to actively improve student learning. Research limitations/implications – This study is restricted to students in a particular university in Ghana, and may not necessarily be applicable universally. Practical implications – The practical implications of this research is that assessments for learning, and the importance of assessment impact not only on students, but also on teachers and the literature. Originality/value – This study contributes to the literature by examining how the combination of the type of assessment (true or false, multiple-choice, calculation or essay) and stress contributes to the learning outcome.


2011 ◽  
Vol 2 (2) ◽  
Author(s):  
Amy M. Tiemeier ◽  
Zachary A. Stacy ◽  
John M. Burke

Objective: To evaluate the results of a prospectively developed plan for using multiple choice questions (MCQs) developed at defined Bloom's levels to assess student performance across a Therapeutics sequence. Methods: Faculty were prospectively instructed to prepare a specific number of MCQs for exams in a Therapeutics sequence. Questions were distributed into one of three cognitive levels based on a modified Bloom's taxonomy, including recall, application, and analysis. Student performance on MCQs was compared between and within each Bloom's level throughout the Therapeutics sequence. In addition, correlations between MCQ performance and case performance were assessed. Results:A total of 168 pharmacy students were prospectively followed in a Therapeutics sequence over two years. The overall average MCQ score on 10 exams was 68.8%. A significant difference in student performance was observed between recall, application, and analysis domain averages (73.1%, 70.2% and 60.1%; p Conclusions: As students progress through the curriculum, faculty may need to find ways to promote recall knowledge for more advanced topics while continuing to develop their ability to apply and analyze information. Exams with well-designed MCQs that prospectively target various cognitive levels can facilitate assessment of student performance.   Type: Original Research


Author(s):  
Siti Nursaila Alias ◽  
Faridah Ibrahim

To improve students’ conceptual understanding depends on the question types asked by the teachers. This paper investigates to examine form four students’ cognitive levels in Newton’s Law based on Bloom’s Taxonomy. The study sample consisted of 189 science stream students from three secondary schools in Kuala Kangsar, Perak. Researcher implemented Newton’s Law questions as instrument to determine the three cognitive levels of the respondent which namely Knowledge, Comprehension and Application. The paper-pencil test was developed and administered on the subject. The data were collected and analyzed using the Statistical Packages for Social Science for Windows release 21 (SPSS Software). The findings show that the mean of the Knowledge, Comprehension and Application level is moderate.


Author(s):  
Ali Imran Sinaga ◽  
Salamuddin ◽  
Alnida Azty

The purpose of this study was to analyze the theoretical quality of the subjects of Islamic Education class V SDS Budi Mulia is based on Higher Order Thinking Skill (HOTS) based on aspects of material, construction, language and based on HOTS based on Bloom's Taxonomy of cognitive domains. This research was conducted at SDS Budi Mulia Medan Tanjung Mulia Hilir District Medan North Sumatra Province and the subject and object of research are Islamic Education teacher class V and Islamic Education questions in semester I Class V. The research method used is to use a qualitative approach and use the instrument of semester I Islamic Education questions and interviews with Islamic Education teachers to theoretically analyze the quality of items based on material, construction and language aspects and based on quality analysis of HOTS-based items. The results of the study of 35 multiple choice questions obtained the following results: (1) based on the analysis of the item quality aspects of the material feasibility of 91.42% (32 questions) worth using, there are some questions that do not meet the criteria such as material that is not in accordance with the composition, answer choices which is not homogeneous and logical and the existence of questions that do not have the answer key, (2) based on the analysis of the quality of the aspects of the construction feasibility of 88.57% (31 questions) are suitable to be used, there are some questions that do not meet the criteria such as the subject still gives clues to the answer key and the length of the choice of money answers are not the same, (3) based on the analysis of items about the aspect of language worthiness of 42.85% (20 questions) worth using, there are some questions that do not meet the criteria such as using language that is not in accordance with Indonesian language rules, and the choice of answers repeat the same word / group of words, and (4) Based on an analysis of the quality of items according to the Bloom domain's taxonomy cognitive can be concluded from 35 multiple choice questions obtained that there are 17 questions (48.6%) including the LOTS questions category with details C1 (remembering) = 8 questions (22.8%), C2 (understanding) = 3 questions (8 , 7%), C3 (applying) = 6 questions (17.1%). While the rest included in the HOTS questions category, however all of them were in the C4 criteria (Analysis) = 18 questions (51.4%) while none of the questions were in C5 and C6.


2021 ◽  
Vol 2 (1) ◽  
pp. 123-131
Author(s):  
Salha U. Amil

This study investigated the perception on Multiple Choice Questions: Its challenges and implications among Grade 12 Senior High Students of Mindanao State University-Sulu. Descriptive survey method was used in this study. Random sampling was used to select 100 students, 50 from GAS strand and 50 from STEM strand Grade 12 Senior high school students. The researcher prepared a survey questionnaire to obtain the necessary data. Mean was used to analyze the perceived challenges and implication while an independent T-test sample was used to test the hypotheses at alpha level of 0.05.The following were the highlight of the study: Multiple Choice Questions is a test format only used as an assessment tool during their Quarterly Examinations and it was revealed that MCQ is challenging foremost due to the need to answer critically under time pressure. Consequently, they need to manage their time in order to answer every subject. The challenge of MCQ also lies in the difficulty of the subject Also, the result revealed the implications of MCQ tends to urge students to answer each subject at limited time pressure students that they experience test anxiety. Meanwhile, there is a need to look into the level of difficulty of the subject matter which requires student rigorous preparation before exam. More so, MCQ develop student’s analysis on problem solving which provides them a real time experience of taking major exams and develop time management in studying and strategies in answering as it encourages them to answer with persistence and resilience. The study recommended that the school administration should encourage the applicability of this test format to other colleges in the institution that require licensure examination, Setting programs and intervention for the improvements of this endeavour  and Creating more research studies.


2012 ◽  
Vol 76 (6) ◽  
pp. 114 ◽  
Author(s):  
Myo-Kyoung Kim ◽  
Rajul A. Patel ◽  
James A. Uchizono ◽  
Lynn Beck

Sign in / Sign up

Export Citation Format

Share Document