scholarly journals Developing Test Blueprint Template- Part 1: Multiple Choices Questions

2020 ◽  
pp. 1-7
Author(s):  
Dania Sabbahi
Keyword(s):  
Learning Outcomes ◽  
Content Validity ◽  
Multiple Choice ◽  
The Other ◽  
Multiple Choice Questions ◽  
High Quality ◽  
Academic Achievements ◽  
Test Specifications ◽  
Threats To Validity ◽  
Solid Foundation

Introduction: Having a well-constructed blueprint, also known as tables of specifications or test specifications, for assessments makes them defensible indicators for students’ gain of the course learning outcomes. Furthermore, it ensures content validity of a test which is a requirement for any evaluation that measures academic achievements. Aim: This paper describes a template that was developed for developing blueprint and shows step by step the guidance on how to use the developed template. Developing the template: The template was designed on an excel software with preset formulae and linked cells to enable academician to construct an exam blueprint in an easy and simple way. It is composed of 2 main sheets: “mother-sheet” which considered as the database for the course specifications and a feeder to all other sheets, the other component is the “exam blueprint sheet” which is specific for each test. Using the exam blueprint template: Following simple steps of filling-up specific cells in the mother and exam blueprint sheet will enable the users to produce a well-constructed plan for the exam. Summary: The aim of blueprinting is to reduce any threats to validity, yet the preparation of high quality blueprint might be a huge task for most faculty. Using this template is a solid foundation for developing any multiple choice questions tests in an easy and simple way.

E- Assessment with Multiple-Choice Questions: A 5 Year Study of Students’ Opinions and Experience

10.28945/4491 ◽  
2020 ◽  
Vol 19 ◽  
pp. 001-029
Author(s):  
Rosalina Babo ◽  
Lurdes V. Babo ◽  
Jarkko T Suhonen ◽  
Markku Tukiainen
Keyword(s):  
Higher Education ◽  
Learning Outcomes ◽  
Multiple Choice ◽  
Assessment Method ◽  
The Other ◽  
Assessment Process ◽  
Difficulty Level ◽  
Computer Assisted ◽  
Multiple Choice Questions ◽  
Classical Computer

Aim/Purpose: The aim of this study is to understand student’s opinions and perceptions about e-assessment when the assessment process was changed from the traditional computer assisted method to a multiple-choice Moodle based method. Background: In order to implement continuous assessment to a large number of students, several shifts are necessary, which implies as many different tests as the number of shifts required. Consequently, it is difficult to ensure homogeneity through the different tests and a huge amount of grading time is needed. These problems related to the traditional assessment based on computer assisted tests, lead to a re-design of the assessment resulting in the use of multiple-choice Moodle tests. Methodology: A longitudinal, concurrent, mixed method study was implemented over a five-year period. A survey was developed and carried out by 815 undergraduate students who experienced the electronic multiple-choice questions (eMCQ) assessment in the courses of the IS department. Qualitative analyses included open-ended survey responses and interviews with repeating students in the first year. Contribution: This study provides a reflection tool on how to incorporate frequent moments of assessment in courses with a high number of students without overloading teachers with a huge workload. The research analysed the efficiency of assessing non-theoretical topics using eMCQ, while ensuring the homogeneity of assessment tests, which needs to be complemented with other assessment methods in order to assure that students develop and acquire the expected skills and competencies. Findings: The students involved in the study appreciate the online multiple-choice quiz assessment method and perceive it as fair but have a contradictory opinion regarding the preference of the assessment method, throughout the years. These changes in perception may be related to the improvement of the question bank and categorisation of questions according to difficulty level, which lead to the nullification of the ‘luck factor’. Other major findings are that although the online multiple-choice quizzes are used with success in the assessment of theoretical topics, the same is not in evidence regarding practical topics. Therefore, this assessment needs to be complemented with other methods in order to achieve the expected learning outcomes. Recommendations for Practitioners: In order to be able to evaluate the same expected learning outcomes in practical topics, particularly in technology and information systems subjects, the evaluator should complement the online multiple-choice quiz assessment with other approaches, such as a PBL method, homework assignments, and/or other tasks performed during the semester. Recommendation for Researchers: This study explores e-assessment with online multiple-choice quizzes in higher education. It provides a survey that can be applied in other institutions that are also using online multiple-choice quizzes to assess non-theorical topics. In order to better understand the students’ opinions on the development of skills and competencies with online multiple-choice quizzes and on the other hand with classical computer assisted assessment, it would be necessary to add questions concerning these aspects. It would then be interesting to compare the findings of this study with the results from other institutions. Impact on Society: The increasing number of students in higher education has led to a raised use of e-assessment activities, since it can provide a fast and efficient manner to assess a high number of students. Therefore, this research provides meaningful insight of the stakeholders’ perceptions of online multiple-choice quizzes about practical topics. Future Research: An interesting study, in the future, would be to obtain the opinions of a particular set of students on two tests, one of the tests using online multiple-choice quizzes and the other through a classical computer assisted assessment method. A natural extension of the present study is a comparative analysis regarding the grades obtained by students who performed one or another type of assessment (online multiple-choice quizzes vs. classical computer assisted assessment).

Best of Five MCQs for the Acute Medicine SCE

2016 ◽  
Keyword(s):  
Multiple Choice ◽  
Multiple Choice Questions ◽  
Self Assessment ◽  
High Quality ◽  
High Stakes ◽  
Acute Medicine ◽  
Acute Conditions

Best of Five MCQs for the Acute Medicine SCE is a new revision resource designed specifically for this high-stakes exam. Containing over 350 Best of Five multiple choice questions, this dedicated guide will help candidates to prepare successfully. The content mirrors the SCE in Acute Medicine Blueprint to ensure candidates are fully prepared for all the topics that may appear in the exam. Topics range from how to manage acute problems in cardiology or neurology to managing acute conditions such as poisoning. All answers have full explanations and further reading to ensure high quality self-assessment and quick recognition of areas that require further study.

SBAs in Sport, Exercise, and Musculoskeletal Medicine

2021 ◽  
Keyword(s):  
Learning Experience ◽  
Multiple Choice ◽  
Structured Learning ◽  
Subject Matter Experts ◽  
Multiple Choice Questions ◽  
High Quality ◽  
Musculoskeletal Medicine ◽  
Knowledge Based ◽  
Exercise Medicine ◽  
Mri Scans

‘Multiple Choice Questions in Musculoskeletal, Sport & Exercise Medicine’ is a compilation of 400 multiple choice questions (MCQs), where the format is that of single best answer from a choice of five options. The book closely follows the curriculum of the ‘Membership of Faculty of Sport & Exercise Medicine’ (MFSEM) examination, with some questions being clinically oriented and others being knowledge based. This book is not intended to be a substitute for extensive clinical reading but instead to complement the learning process. Questions in this book have been carefully curated by 92 reputable subject matter experts across ten countries and are intended to provide a structured learning experience. The book is comprised of 46 chapters, where the first 23 ask questions and the next 23 provide answers. The answer to each question has a short explanation with a reference, which is intended to stimulate discussion, research and further learning. There is a total of 33 high quality images (MRI scans, plain radiographs, ECGs, ultrasound scans and photographs), 18 tables and 5 diagrams in the book.

scholarly journals Are multiple-choice questions a good tool for the assessment of clinical competence in Internal Medicine?

2018 ◽  
Vol 12 (2) ◽  
pp. 88 ◽  
Author(s):  
Flavio Tangianu ◽  
Antonino Mazzone ◽  
Franco Berti ◽  
Giuliano Pinna ◽  
Irene Bortolotti ◽  
...  
Keyword(s):  
Internal Medicine ◽  
Clinical Practice ◽  
Clinical Competence ◽  
Reliable Method ◽  
Professional Competence ◽  
Multiple Choice ◽  
Multiple Choice Questions ◽  
High Quality ◽  
Good Tool ◽  
Design Review

There are many feasible tools for the assessment of clinical practice, but there is a wide consensus on the fact that the simultaneous use of several different methods could be strategic for a comprehensive overall judgment of clinical competence. Multiple-choice questions (MCQs) are a well-established reliable method of assessing knowledge. Constructing effective MCQ tests and items requires scrupulous care in the design, review and validation stages. Creating high-quality multiple-choice questions requires a very deep experience, knowledge and large amount of time. Hereby, after reviewing their construction, strengths and limitations, we debate their completeness for the assessment of professional competence.

scholarly journals Peningkatan Motivasi dan Prestasi Belajar Menulis Teks Narasi dengan Teknik Student Teams-Achievement Devisions (STAD) Peserta Didik Kelas XA SMA Negeri 5 Kota Magelang

2018 ◽  
Vol 2 (2) ◽  
pp. 173
Author(s):  
Eva Ratihwulan
Keyword(s):  
Student Learning ◽  
Learning Outcomes ◽  
Multiple Choice ◽  
Student Learning Outcomes ◽  
Research Data ◽  
Learning Motivation ◽  
Multiple Choice Questions ◽  
High Category ◽  
Student Questionnaire ◽  
Category Score

<p>This research is aimed to improve students' motivation and learning outcomes. The action used in improving the two things is the learning process with STAD technique. This study uses three stages: Pre Cycle, Cycle I, and Cycle II, each cycle using two meetings. Research data were obtained from a student questionnaire and test with multiple choice questions. Questionnaire to know the development of learning motivation, while the test with multiple choice questions to know the development of learning outcomes. The research data is analyzed descriptively-qualitative. The results of the study explain that the implementation of learning with STAD techniques can improve student's motivation and achievement. Learning motivation in Pre Cycle obtained an average of 23.47 (medium category). While in Cycle I the average learning motivation increased to 26.57 (medium category). Percentage of students achieved high category score of 4 students (13%). Furthermore, in cycle II the average learning motivation of 33.87 (high category). Percentage of students obtained a great and very high category score of 22 students (73.3%). Thus until the end of Cycle II, learning motivation has increased. While the results of learning on the Precycle obtained an average of 61.93 (enough category), in the first cycle increased to 69.53 (enough class), in Cycle II obtained an average of 78.77 (right type). Furthermore, it is known that the percentage of learning mastery in the Pre Cycle of 3%, Cycle I of 31%, then in cycle II the rate of learning mastery increased to 86.66%. Thus until the end of Cycle II, student learning outcomes have increased. Based on the above data can be concluded that the implementation of learning STAD technique can improve learning motivation and student learning outcomes.</p>

Experience Versus Potential of Multiple-Choice Tests in Marketing Courses

1979 ◽  
Vol 1 (2) ◽  
pp. 24-33 ◽  
Author(s):  
James R. McMillan
Keyword(s):  
Multiple Choice ◽  
Multiple Choice Questions ◽  
High Quality ◽  
Test Form ◽  
Multiple Choice Tests ◽  
Choice Tests ◽  
Classroom Evaluation ◽  
Quality Objective ◽  
Multiple Choice Items

Most educators agree that classroom evaluation practices need improvement. One way to improve testing is to use high-quality objective multiple-choice exams. Almost any understanding or ability which can be tested by another test form can also be tested by means of multiple-choice items. Based on a survey of 173 respondents, it appears that marketing teachers are disenchanted with multiple-choice questions and use them sparingly. Further, their limited use is largely in the introductory marketing course even though there are emerging pressures for universities to take a closer look at the quality of classroom evaluation at all levels.

De validiteit van luistertoetsen Moderne Vreemde Talen

1978 ◽  
Vol 5 ◽  
pp. 59-74
Author(s):  
H.W.M. van den Nieuwenhof
Keyword(s):  
Content Validity ◽  
Listening Comprehension ◽  
Multiple Choice ◽  
Test Results ◽  
Multiple Choice Questions ◽  
Relative Difficulty ◽  
Test Form ◽  
Multiple Choice Tests ◽  
Choice Tests ◽  
Testing Techniques

For ten years now multiple choice tests have been used in the Dutch school system to measure listening comprehension of English, French and German. The tests were developed in a research program, conducted at the Insitute of Applied Linguistics by Dr. ? Groot. Now that the tests have been in use for 10 years we are confronted with the following questions. Are the tests still reliable, as they were 10 years ago? In how far does the multiple choice technique give a true picture of the listening comprehension of students? Does the multiple choice technique help studens to cope with language material that they could not have coped with otherwise, in other words, to what extent does the language material used in tests suggest a higher level of listening comprehension than the students actually have? An experiment has been carried out at C.I.T.O. (Central Institute for Test Development). Students had to answer both multiple choice questions and open ended questions concerning the same language material. The results suggested that the language material used in tests was verydifficult for students to handle in an open ended question test form. The results also suggested that various levels of difficulty of the langua material used within a single test was reflected in the open ended test results, but not in the results of the multiple choice tests. The multiple choice technique seems to obscure the relative difficulty of the various test components. It has been found that an appropriate use of the multiple choice technique can cover only a restricted range of language material. The measuring technique must not restrict the choice of language material, and thereby influence content validity. A possible solution to the problem would be the development of a new kind of test. In this test a great variety of language material should be tested with a great variety of testing techniques: a great variety of language material in order to improve the content validity of the test, a great variety of testing techniques in order to reduce, as much as possi ble, the disadvantages of every single testing technique by itself.

scholarly journals The effect of ethnobotanic activities on learning performance of pre-service teachers about plants’ classification

2019 ◽  
Vol 14 (3) ◽  
pp. 384-400
Author(s):  
Selami Yangın
Keyword(s):  
Experimental Model ◽  
Research Design ◽  
Multiple Choice ◽  
The Other ◽  
Learning Performance ◽  
Multiple Choice Questions ◽  
Comprehensive Knowledge ◽  
Quasi Experimental ◽  
Subjective Views ◽  
Experimental Group

This study analyses the effectiveness of ethnobotanic activities on learning performance of pre-service teachers about plants’ classification. The research design was a quasi-experimental model. The results of the study revealed that the experimental group in which ethnobotanical activities were carried out was more successful for answers given to the interview form. On the other hand, there was no difference between the groups in multiple-choice questions. In other words, ethnobotanical practices have developed the subjective views of the students so they could have more comprehensive knowledge of the plants. These results suggest that ethnobotanic activities encourage pre-service teachers to think and talk through how to solve more open-ended problems that require making connections between analytical and practical components. This study also suggests the need to rethink how we teach botany to pre-service teachers, and how to help them learn the content better and establish more accurate conceptions of the biology content. Keywords: Ethnobotanic activities, learning performance, pre-service teachers.

scholarly journals STUDENTS’ GEOMETRIC THINKING BASED ON VAN HIELE’S THEORY

2018 ◽  
Vol 7 (1) ◽  
pp. 53
Author(s):  
Harina Fitriyani ◽  
Sri Adi Widodo ◽  
Aan Hendroanto
Keyword(s):  
Qualitative Research ◽  
Mathematics Education ◽  
Multiple Choice ◽  
The Other ◽  
Multiple Choice Questions ◽  
Education Department ◽  
Development Level ◽  
Geometric Thinking ◽  
Transition Level ◽  
Development Levels

The current study aims to identify the development level of students’ geometric thinking in mathematics education department, Universitas Ahmad Dahlan based on van Hiele’s theory. This is a descriptive qualitative research using a test consisting of 25 multiple choice questions. The data is analyzed by using Milles and Huberman model. The result shows that there were 30,65% of students in pre-visualization level, 21,51% of students in visualizes level, and 29,03% of students in analyze level, 16,67% of students in informal deduction level, 2,15% of students in deduction level, and 0,00% of student in rigor level. Furthermore, findings indicated a transition level among development levels of geometric thinking in pre-analyze, pre-informal deduction, pre-deduction, and pre-rigor that were 20%; 13,44%; 6,45%; 1,08% respectively. The other findings were 40,32% of students were difficult to determine and 4,3% of students cannot be identified. 

scholarly journals Evaluating the Validity, Reliability and Authenticity of English Achievement Test for the Twelfth Grade Students of SMAN 4 Tebo, Jambi

2021 ◽  
Vol 11 (1) ◽  
pp. 130-138
Author(s):  
Muncar Winarti ◽  
Abdurrachman Faridi ◽  
Fahrur Rozi
Keyword(s):  
Construct Validity ◽  
Content Validity ◽  
Standardized Test ◽  
Multiple Choice ◽  
Achievement Test ◽  
Reading Test ◽  
Multiple Choice Questions ◽  
Good Test ◽  
Twelfth Grade ◽  
English Achievement

This study aims to investigate the implementation of the English achievement test for the twelfth-grade students at SMAN 4 Tebo, Jambi in the academic year 2019/2020. This study was a contenr analyis. The objects of this study were English achievement test items. It consisted of 40 multiple-choice questions and 5 essay questions. The data collection method was a document analysis checklist. In this study, the researcher analyzed the data from English achievement test for validity aspects such as content validity and construct validity, the degree of reliability, and the implementation of language authenticity criteria. The findings of this study revealed that; (1) the content validity shows 76% valid, and the construct validity shows 60% valid; (2) the reliability shows coefficient 0.281 for multiple-choice items and 0,554 for essay items, and it is reliable; (3) the results of analyzing the authenticity shows that the listening items, reading test and essay writing are authentic. However, each part has some weaknesses. Especially in the reading test, most of the passages use in reading tests failed to represent the world context even though the topics of the passages are rational and based on the real context. Nevertheless, the English teacher who constructed the English achievement test did not mention the sources from which the passages were taken. Next, the samples of the format letter, announcement, and pamphlet look unnatural view from the format and design. Moreover, the English Achievement Test for twelfth-grade students of SMAN 4 Tebo, Jambi has fulfilled the characteristics of validity, reliability, and authenticity as a good test or standardized test.

Sign in / Sign up

Export Citation Format

Share Document