Development and Application of a Concept Test on the Subject of Stars

2020 ◽  
Author(s):  
Ebru EZBERCI-CEVIK ◽  
Mehmet Altan KURNAZ
Keyword(s):  
Quantitative Research ◽  
Quantitative Methods ◽  
Model Analysis ◽  
Validity And Reliability ◽  
Multiple Choice Questions ◽  
Schools Of Education ◽  
Test Items ◽  
Alpha Reliability ◽  
The Subject ◽  
The Mean

The aim of this study is to develop a concept test on the subject of stars that is suitable for model analysis and to evaluate the conformity of this model. The study was performed using a screening model, which is a type of quantitative research method. The study also tried to fill the gap in the existing literature regarding the use of quantitative methods. To develop the test, existing studies on stars were first examined; interviews with candidates who were teachers were conducted; and finally, necessary amendments to test items were made after referring to experts’ opinions. To assure its validity and reliability, the test was applied to a total of 175 candidates who were studying at schools of education in the departments of science teaching of three different universities to become teachers; all candidates took astronomy courses and were educated on the subject matter. The final form of the test comprised of 26 multiple-choice questions, each with 5 possible answers. The Cronbach’s alpha reliability coefficient of the test was calculated to be 0.735. In addition, the mean strength of the test was found to be 0.370 and the distinctiveness was found to be 0.390. Statistical analyses revealed that the concept test developed in this study is a valid and reliable test that conforms to the model analysis.

scholarly journals An Analysis of Validity and Reliability of a Teacher-Made Test

2019 ◽  
Vol 3 (4) ◽  
pp. 522-532
Author(s):  
Agung Setiabudi ◽  
Mulyadi Mulyadi ◽  
Hilda Puspita
Keyword(s):  
Data Analysis ◽  
Key Words ◽  
Research Finding ◽  
Quantitative Research ◽  
Reliability Test ◽  
English Teacher ◽  
Validity And Reliability ◽  
Reliable Test ◽  
The Subject ◽  
Multiple Choice Items

The aim of this research was to find out the validity and reliability of a teacher-made test in SMAN 6 Bengkulu. This research was a descriptive quantitative research. The subject of this research was an English teacher-made test for eleventh grade students of SMAN 6 Bengkulu. There were 40 items of the test consist of 35 multiple choice items and 5 essay items. There were two research instruments used in this research, observation checklist and documentation. Based on the data analysis, it was found that the  percentage of the validity score was 60% or 0.60. It means that the test was valid but in the intermediate category. The r-obtained for reliability test was 0.62 and it was considered to be reliable but was in the intermediate level of reliability.  From the research finding, it can be concluded that the test was valid and reliable but both were in the intermediate category. It means that the test still need some revision and improvement in order to be a good, valid, and reliable test. Key Words : Validity, Reliability, Teacher-made test  

scholarly journals The impact of independent learning on students’ accounting learning outcomes at vocational high school

2019 ◽  
Vol 9 (2) ◽  
pp. 141-150
Author(s):  
Ery Novita Sari ◽  
Zamroni Zamroni
Keyword(s):  
Learning Outcomes ◽  
Quantitative Research ◽  
Positive Influence ◽  
Independent Learning ◽  
Difficulty Level ◽  
Validity And Reliability ◽  
Multiple Choice Questions ◽  
Ex Post ◽  
The Right ◽  
The Impact

The independence of student learning in recent years was discussed in several articles. Through the development of an independent attitude in learning, students can diagnose learning difficulties and find the right solution to solve them. This study was aimed at finding out how the influence of learning independence on students' accounting learning outcomes. The type of research used is ex-post facto quantitative research. The population of the research is all students of class XI of Public Middle School in the city of Yogyakarta, with a total of 156 students. The instruments used were questionnaires and multiple-choice questions (MCQs). Validity and reliability of the questionnaire were measured using Confirmatory Factor Analysis (CFA) through the Lisrel 8.80 application, while the validity and reliability of MCQs were measured using Rasch approach through the Quest application. Several questionnaires in the form of questionnaires and documentation were used on the testing instrument. The number of instruments for learning independence was 19 statements. The closed statement form used a Likert scale consisting of five alternative answers. The number of MCQs is 18 questions. There were 18 valid statements found after going through the calculation of validation, reliability, difficulty level of the question, and distinguishing power. Simple regression was used for the data analysis technique. The results of the study show that the learning independence variable has a significant and positive influence. It can be seen from the learning independence variable, which has a value of 2.187 and a significance value smaller than 0.05 (0.030 <0.05).

scholarly journals THE USE OF TRANSLATION ACTIVITY TO IMPROVE THE STUDENTS’ VOCABULARY MASTERY

2019 ◽  
Vol 7 (2) ◽  
Author(s):  
Iin Widya Lestari ◽  
Adi Isma
Keyword(s):  
High School ◽  
High School Students ◽  
Action Research ◽  
Senior High School ◽  
Social Program ◽  
School Students ◽  
Test Items ◽  
The Subject ◽  
The Mean ◽  
Senior High School Students

Teaching English is very challenging nowadays. Senior high school students urgently are needed to be communicative in using English well. They need to be able to develop their English skills well. Dealing with mastering English skills, vocabulary is one of the crucial language components in learning English. In fact, most of the students faced difficulty in acquiring and mastering English vocabulary to support and develop their English skills. English teachers need to apply the appropriate strategy and activity to improve students’ vocabulary. This research aimed to know the process of improving students’ vocabulary mastery by using translation activity for Senior High school students at SMAN 3 Bojonegoro. This research used classroom action research. The subject of this research was students of Social Program at 11 B. In collecting the data, the writers used test items and observation sheets. The test was given pre-test, test 1 and test 2. Then the writers analyzed the mean score of each test to find out the improvement of students’ vocabulary mastery after the action was done. The result shows that there is an improvement in students’ vocabulary mastery. It could be seen from the score of the pretest is 42, posttest 1 is 47,8 and posttest 2 is 61. After conducting action research, it shows that students made good improvements in learning vocabulary. Based on the result of the research, it can be concluded that using translation activity can improve students’ vocabulary mastery.

scholarly journals Aplicación de un calendario de pruebas de evaluación continua en la asignatura “Obstetricia” en sexto de Medicina

2020 ◽  
Vol 1 (2) ◽  
pp. 45-52
Author(s):  
Carlos Santiago Piñel Pérez ◽  
María José Gómez-Roso Jareño ◽  
Juan José López Galián
Keyword(s):  
Continuous Assessment ◽  
Multiple Choice Questions ◽  
Final Exam ◽  
Assessment Tests ◽  
Negative Score ◽  
Group A ◽  
The Subject ◽  
The Mean ◽  
Los Grupos ◽  
De Medicina

Introducción. Con el objetivo de promover y motivar al aprendizaje continuo durante el curso de la asignatura de Obstetricia (6º Medicina), se diseñó un calendario de “Pruebas de Evaluación Continua” (PEC). Este aprendizaje progresivo permite interiorizar conceptos, mejor seguimiento de las clases sucesivas y facilita el estudio, mejorando el rendimiento final. Métodos. Se diseñaron 4 PEC voluntarias, una por bloque del temario, con 10 preguntas tipo test sin puntuación negativa por error, para estimular al alumnado a pensar en cada una de las cuestiones y tomar decisiones. Las PEC se realizaron en los últimos 10 minutos de la última clase de cada bloque. Medicina tiene cinco grupos, uno por hospital docente. Esta iniciativa se realizó sólo en uno de los grupos (grupo A). Resultados. Se presentaron a las PEC el 90,9% de los alumnos matriculados. En la primera PEC la calificación media fue 68% (máximo 90%; mínimo 50%; moda 70%), en la segunda 88% (máximo 100%; mínimo 60%; moda 90%), en la tercera 95% (máximo 100%; mínimo 80%; moda 100%) y en la cuarta 99% (máximo 100%; mínimo 90%, moda 100%). La calificación media en el examen final de la asignatura (común a los 5 grupos) del grupo A fue de 7,300 (sobre 10), superior a la de los grupos B (6,886), C (6,592), D (6,572) y E (6,463). Conclusiones. Se objetivó un aumento del rendimiento progresivo grupal e individual. Los resultados de la primera PEC fueron más dispersos, y posteriormente se fueron homogeneizando. El grupo en el que se realizaron las PEC obtuvo mejor resultado en el examen final que los otros grupos. Abstract: Introduction. We designed a “Continuous Assessment Tests” (CAT) for promoting and motivating continuous learning during the course of the subject “Obstetrics” (6th year of Medicine). This progressive learning enables concepts to be internalized, better monitoring of successive classes and facilitates study, improving results. Methods. Four voluntary CAT were designed, one per block of the subject, with 10 multiple choice questions without negative score by mistake to stimulate students to think about each of the questions and make decisions. The CAT were performed in the last 10 minutes of the last class of each block. Medicine has five groups, one per teaching hospital. This initiative was carried out in only one of the groups (group A). Results. 90.9% of the enrolled students attended the CAT. In the first CAT the mean score was 68% (maximum 90%; minimum 50%; mode 70%), in the second 88% (maximum 100%; minimum 60%; mode 90%), in the third 95% (maximum 100%; minimum 80%; mode 100%) and in the fourth 99% (maximum 100%; minimum 90%, mode 100%). The mean score in the final exam of the subject (common to the 5 groups) of group A was 7,300 (out of 10), higher than that of groups B (6,886), C (6,592), D (6,572) and E (6,463). Conclusions. An increase in group and individual progressive yield was observed. The results of the first CAT were more dispersed, and later they were homogenized. The group in which the CAT were performed got better yield in the final exam than the other groups.

scholarly journals Impact of distractors in item analysis of multiple choice questions

2019 ◽  
Vol 7 (4) ◽  
pp. 1136
Author(s):  
Ismail Burud ◽  
Kavitha Nagandla ◽  
Puneet Agarwal
Keyword(s):  
Quality Assurance ◽  
Statistical Significance ◽  
Item Analysis ◽  
Validity And Reliability ◽  
Multiple Choice Questions ◽  
Test Items ◽  
Difficulty Index ◽  
The Individual ◽  
Discriminatory Index

Background: Item analysis is a quality assurance of examining the performance of the individual test items that measures the validity and reliability of exams. This study was performed to evaluate the quality of the test items with respect to their performance on difficulty index (DFI), Discriminatory index (DI) and assessment of functional and non-functional distractors (FD and NFD).Methods: This study was performed on the summative examination undertaken by 113 students. The analyses include 120 one best answers (OBAs) and 360 distractors.Results: Out of the 360 distractors, 85 distractors were chosen by less than 5% with the distractor efficiency of 23.6%. About 47 (13%) items had no NFDs while 51 (14%), 30 (8.3%), and 4 (1.1%) items contained 1, 2, and 3 NFDs respectively. Majority of the items showed excellent difficulty index (50.4%, n=42) and fair discrimination (37%, n=33). The questions with excellent difficulty index and discriminatory index showed statistical significance with 1NFD and 2 NFD (p=0.03).Conclusions: The post evaluation of item performance in any exam in one of the quality assurance method of identifying the best performing item for quality question bank. The distractor efficiency gives information on the overall quality of item.

scholarly journals AN ANALYSIS OF STUDENTS READING FINAL EXAMINATION BY USING ITEM ANALYSIS PROGRAM ON ELEVENTH GRADE OF SMA NEGERI 8 MEDAN

2019 ◽  
Vol 1 (1) ◽  
pp. 13-19
Author(s):  
Dewi Manalu ◽  
Kammer Tuahman Sipayung ◽  
Febrika Dwi Lestari
Keyword(s):  
Quantitative Research ◽  
Item Analysis ◽  
Multiple Choice ◽  
Final Examination ◽  
Multiple Choice Questions ◽  
Discrimination Power ◽  
Reliability Level ◽  
The Subject ◽  
Program Version

The purpose of this study was to determine the quality of the reading final examination in SMA N8 Medan grade eleventh in terms of reliability, level difficulty, discrimination power and level of distractor. This research is qualitative-quantitative research. The subject of research are the grade XI of SMA N8 Medan. Data is analyzed by ANATES program version 4.0.9. The analysis shows that: (1) items of multiple choice question that can be said as valid are 14 items ( 56%), while the invalid items amounted to 11 items ( 44%). (2) Items mutiple choice question can said as reliable because it equal 0,90 so it can said reliable. (3) items of multiple choice questions that categorized easy are 3 items (12%), satisfactory category 7 ( 28%) difficult category 2 (8%) and the other calculate categorized very easy 3 items (12%) and very difficult 3 (12%). (4) items of multiple choice questions that categorized poor are 12 items (48%),average category are 2 items (8%), good items category 1 items (4%) and excellent items are 8 items (32%).

scholarly journals IMPROVING STUDENTS’ MASTERY OF VOCABULARY THROUGH THE USE OF GLOSSING TECHNIQUE ( A Study conducted at SMP Anugrah Tondano )

2021 ◽  
Vol 8 (2) ◽  
pp. 129-144
Author(s):  
Niveyla Mamaghe ◽  
Paula Rombepajung ◽  
Paula Hampp
Keyword(s):  
Quantitative Research ◽  
Second Grade ◽  
Test Design ◽  
Second Grade Students ◽  
Post Test ◽  
Reading Text ◽  
The Subject ◽  
The Mean ◽  
Reading Activity ◽  
Academic Year

The aim of the research is to improve the students’ vocabulary through the use of Glossing technique. The design of this research is quantitative research through pre-experimental design with pre-test and post-test design This study was conducted at SMP Anugrah  Tondano. The subject of the research was the second grade students in academic year of 2019/2020. The writer used reading text of Narrative text .The result of the data analysis showed that there was an increase between the pre-test and post-test. It can be seen from 10 students showed that the mean score of  pre-test was 53 and  post-test was 74 score. Based  on this finding from this study, it can be concluded that having more vocabulary significantly affects the comprehension of the students reading activity. Moreover by having many vocabulary the students can easily get the information and can enrich their knowledge by reading a lot of book. Finally, this research proved that theGlossing technique effective to improve student’s vocabulary in reading comprehension.

scholarly journals Item and distracter analysis of multiple choice questions (MCQs) from a preliminary examination of undergraduate medical students

2017 ◽  
Vol 5 (12) ◽  
pp. 5351 ◽  
Author(s):  
Durgesh Prasad Sahoo ◽  
Rakesh Singh
Keyword(s):  
Multiple Choice ◽  
Discrimination Index ◽  
Difficulty Level ◽  
Validity And Reliability ◽  
Multiple Choice Questions ◽  
Undergraduate Medical Students ◽  
Test Items ◽  
Preliminary Examination ◽  
High Discrimination ◽  
Difficulty Index

Background: Multiple choice questions (MCQs) or Items forms an important part to assess students in different educational streams. It is an objective mode of assessment which requires both the validity and reliability depending on the characteristics of its items i.e. difficulty index, discrimination index and distracter efficiency. To evaluate MCQs or items and build a bank of high-quality test items by assessing with difficulty index, discrimination index and distracter efficiency and also to revise/store or remove errant items based on obtained results.Methods: A preliminary examination of Third MBBS Part-1 was conducted by Department of Community Medicine undertaken for 100 students. Two separate papers with total 30 MCQs or items and 90 distractors each in both papers were analyzed and compared. Descriptive as well as inferential statistics were used to analyze the data.Results: The findings show that most of the items were falling in acceptable range of difficulty level however some items were rejected due to poor discrimination index. Overall paper I was found to be more difficult and more discriminatory, but its distractor efficiency was slightly low as compared to paper II.Conclusions: The analysis helped us in selection of quality MCQs having high discrimination and average difficulty with three functional distractors. This should be incorporated into future evaluations to improve the test score and properly discriminate among the students.

scholarly journals Analisis sumbangan materi hidrokarbon terhadap keterampilan berpikir kritis siswa kelas XI MIA Tahun Ajaran 2018/2019 di SMAN 1 Lawang

2021 ◽  
Vol 1 (6) ◽  
Author(s):  
Reza Rewindi Amayliadevi ◽  
Herunata Herunata ◽  
Hayuni Retno Widarti
Keyword(s):  
Critical Thinking ◽  
Subject Matter ◽  
Quantitative Research ◽  
Chemical Properties ◽  
Thinking Skills ◽  
Critical Thinking Skills ◽  
Multiple Choice Questions ◽  
Research Subjects ◽  
Carbon Compounds ◽  
The Subject

In the 21st century, students need to have one of life skill that is critical thinking that can be develop and trained through various aspects and one of which is chemistry aspect. One of the materials in the chemistry aspect is a hydrocarbon material. The purpose of this study was to measure the percentage of hydrocarbon contribution towards student's critical thinking skills and to know the level of critical thinking skills in 11th MIA grade students 2018/2019 academic year at SMAN 1 Lawang. The study used a descriptive quantitative research design. The research subjects which amount to 133 students. Instrument for assessing critical thinking skills used in hydrocarbon material developed by Rodliyah (2018) with critical thinking indicators Ennis (2011). The results of the analysis of the level of critical thinking skills of students using the number of students who scored three on reasoned multiple choice questions and score four on the description questions divided by the total number of sample students, then categorized by percentage according to Karim (2015). The results showed that the hydrocarbon material taught by the teacher was able to bring up the students' critical thinking skills with a level of think critically which was still very low with an average of 1) organic and inorganic carbon compounds by 39.10 percent, 2) identification and source of carbon compounds by 13.53 percent, 3) specificity of carbon atoms by 27.82 percent, 4) nomenclature of hydrocarbon compounds by 16.29 percent, 5 ) isomer hydrocarbon compounds by 9.62 percent, 6) physical and chemical properties of hydrocarbons by 29.32 percent for the subject matter of the physical properties of hydrocarbons, the subject matter of the hydrocarbon compound combustion reaction by 5.71 percent, the subject of substitution reactions alkane compounds by 0.94 percent, the subject matter of the reaction of alkene compounds by 11.58 percent, the subject matter of the reaction of alkaline compounds by 3.57 percent, and the sub-topics of identification were saturated and unsaturated hydrocarbons by 0.75 percent, and 7) the use of hydrocarbons by 14.43 percent. Salah satu kecakapan hidup yang harus dimiliki siswa pada abad 21 adalah keterampilan berpikir kritis yang dapat dikembangkan dan dilatih melalui beragam bidang, salah satunya adalah bidang kimia yaitu pada materi hidrokarbon. Tujuan penelitian ini mengukur persentase sumbangan materi hidrokarbon terhadap kemampuan keterampilan berpikir kritis siswa dan mengetahui tingkat kemampuan keterampilan berpikir kritis siswa kelas XI MIA tahun ajaran 2018/2019 di SMAN 1 Lawang. Penelitian menggunakan rancangan penelitian kuantitatif deskriptif dengan subjek penelitian 133 siswa. Instrumen penilaian keterampilan berpikir kritis yang digunakan pada materi hidrokarbon yang dikembangkan oleh Rodliyah (2018) dengan indikator berpikir kritis Ennis (2011). Data berupa skor 3 pada soal pilihan ganda beralasan dan skor 4 pada soal uraian yang telah diperoleh dianalisis sesuai dengan pengelompokkan pokok bahasan pada materi hidrokarbon lalu dikategorikan berdasarkan jumlah persentase menurut Karim (2015). Hasil penelitian menunjukkan bahwa materi hidrokarbon yang diajarkan oleh guru mampu memunculkan kemampuan keterampilan berpikir kritis siswa dengan tingkat kemampuan keterampilan berpikir kritis yang masih tergolong sangat rendah dengan rata-rata antara lain 1) senyawa karbon organik dan anorganik sebesar 39,10 persen, 2) identifikasi dan sumber senyawa karbon sebesar 13,53 persen, 3) kekhasan atom karbon sebesar 27,82 persen, 4) tata nama senyawa hidrokarbon sebesar 16,29 persen, 5) isomer senyawa hidrokarbon sebesar 9,62 persen, 6) sifat fisika dan kimia senyawa hidrokarbon pada sub pokok bahasan sifat fisika senyawa hidrokarbon sebesar 29,32 persen, sub pokok bahasan reaksi pembakaran senyawa hidrokarbon sebesar 5,71 persen, sub pokok bahasan reaksi substitusi senyawa alkana sebesar 0,94 persen, sub pokok bahasan reaksi senyawa alkena sebesar 11,58 persen, sub pokok bahasan reaksi senyawa alkuna sebesar 3,57 persen, dan sub pokok bahasan identifikasi senyawa hidrokarbon jenuh dan tak jenuh sebesar 0,75 persen, dan 7) kegunaan senyawa hidrokarbon sebesar 14,43 persen.

scholarly journals DIFFICULTY AND DISCRIMINATION ANALYSIS OF END OF TERM MULTIPLE-CHOICE QUESTIONS AT COMMUNITY MEDICINE DEPARTMENT, WAH MEDICAL COLLEGE

2021 ◽  
Vol 71 (4) ◽  
pp. 1308-10
Author(s):  
Musarat Ramzan ◽  
Khola Waheed Khan ◽  
Saana Bibi ◽  
Shezadi Sabah Imran
Keyword(s):  
Multiple Choice ◽  
Cross Sectional Study ◽  
Community Medicine ◽  
Multiple Choice Questions ◽  
Cross Sectional ◽  
Medicine Department ◽  
Test Items ◽  
Medical College ◽  
The Mean ◽  
Difficulty Index

Objective: To perform post analysis of multiple-choice questions given in the 2nd term and send up examinations of the years 2016 to 2018, to establish relationship between difficulty (DF) and discrimination indices (DI) and to find out significant mean difference between the two. Study Design: Cross sectional study. Place and Duration of Study: Community Medicine Department, Wah Medical College, Wah, from Nov 2018 to Mar 2019. Methodology: A total of 390 Multiple-Choice Question of second term and send-up were taken for the study from the year 2016, 2017 and 2018. The response sheets were assessed by Optical Machine Reader (OMR) and the level of difficulty, power of discrimination and reliability were obtained. The data was entered in SPSS version 22. Results: A total of 315 test items were included. Results of the study showed that the reliability (KR20) for all the examined items was in the acceptable range i.e. ≥0.7 and there was no association was found between difficulty index and year p=0.310. The mean difficulty index was found to be 0.48 ± 0.22 and discrimination index as 0.24 ± 0.14. Conclusion: The analysis of 390 test items showed that most of the questions were acceptable in terms of difficulty and discrimination. There is still a need to modify and improve the testing ability of the MCQs with negative discrimination and higher difficulty index.

Sign in / Sign up

Export Citation Format

Share Document