scholarly journals Analysis of Language Literacy Skills in Biological Learning Contexts

BIOEDUSCIENCE ◽  
2020 ◽  
Vol 4 (2) ◽  
pp. 157-165
Author(s):  
Jihan Azhaar Ramadhanty ◽  
Vita Meylani ◽  
Edi Hernawan
Keyword(s):  
Mixed Methods Research ◽  
International Student ◽  
Student Assessment ◽  
Thinking Skills ◽  
Literacy Skills ◽  
International Student Assessment ◽  
Learning Contexts ◽  
Average Grade ◽  
Language Literacy ◽  
Biological Learning

Background: The results of PISA showed that Indonesian students' literacy skills in the field of science are still low. Until now, the cause of the problem is still little information reported. This study was conducted to analyze the language literacy skills of students in biological learning contexts. Methods: the methods used in the research is mixed methods research. This research involved 72 science program students who were selected by purposive sampling. The data were gained by observations, interviews and giving the posttest consisting of 17 questions of multiple-choice based on the Programme for International Student Assessment (PISA) indicator for language literacy in biological learning. Results: That the analysis of language literacy in the context of Biological learning has an excellent literacy with a high category. The research showed that the highest average grade of language literacy was in the integrate and interpret aspects of 75,00. Meanwhile, the lowest average grade in the reflect and evaluate aspects was 57,00. The average overall grade in the language literacy on Biological learning was 70,22. Conclusion: Sustainable literacy activities stimulate higher-order thinking skills, especially in the field of science, because language literacy skills can indirectly affect students' outcomes on scientific skills.    

scholarly journals An Investigation of Master Student Understanding on Mathematical Literacy Problems

2020 ◽  
Vol 5 (1) ◽  
pp. 1-7
Author(s):  
Al Jupri ◽  
Rizky Rosjanuardi
Keyword(s):  
Prospective Teachers ◽  
International Student ◽  
Online Survey ◽  
Student Assessment ◽  
Student Understanding ◽  
Literacy Skills ◽  
Mathematical Literacy ◽  
International Student Assessment ◽  
Problems And Solutions ◽  
Shape Uncertainty

Indonesian government has been promoting the National Literacy Movement since 2016 to response disappointing results of the Program for International Student Assessment on literacy and mathematical literacy skills of students. This movement involves many parties, including educational universities, to prepare mathematics education students of master level, as prospective teachers or lecturers, to understand mathematical literacy. To investigate this condition, this study aims to analyze master student understanding on mathematical literacy problems. To do so, we conducted an online survey via Google Form involving 32 master students from several universities in Bandung. In this survey, each master student was called for sending two mathematics problems and solutions that considered to be literacy problems. The results revealed that 17 (53%) involved master students understand mathematical literacy problems. The most frequent category of literacy problems to appear was Change and Relationship followed by categories of Space and Shape, Uncertainty and Data, and Quantity, respectively. Another result showed that word problems seemed to be regarded as the same as mathematical literacy problems by some students. We conclude that master student understanding of mathematical literacy needs to be improved for facing future educational careers.

scholarly journals PEMBERDAYAAN MASYARAKAT SEBAGAI UPAYA MENCIPTAKAN GENERASI MUDA BERDAYA LITERASI PADA KAMPUNG SINAU KOTA MALANG

Jurnal Akrab ◽  
2020 ◽  
Vol 11 (2) ◽  
pp. 30-41
Author(s):  
Nastiti Novitasari
Keyword(s):  
International Student ◽  
Student Assessment ◽  
Community Empowerment ◽  
Literacy Skills ◽  
Reading Literacy ◽  
International Student Assessment ◽  
Reading Activities ◽  
Literate Society ◽  
Education Process

Education is always related to reading activities. The ability to read is often referred to as literacy activities.  The reality in Indonesia so far is the low mastery of literacy, this is evidenced by the Program for International Student Assessment (PISA) survey. The survey in 2018 showed that for the reading / literacy competency score, Indonesia was ranked 72 out of 77 countries. To deal with this problem, many things can be applied in the education process, both from formal non-formal and informal channels.Kampung Sinau is a thematic village located in the Cemorokandang Malang City. Various learning activities are carried out in unique ways that can attract citizens, the younger generation in particular, to enrich literacy and make citizens literate, one of which is community empowerment activities. Researchers are interested in knowing how to optimize community empowerment in making generations young people with literacy skills in Kampung Sinau. The approach and type of research used by the researcher is a qualitative approach to the type of case study.  This research was conducted at the end of 2019 in Kampung Sinau, Malang City. The results of this study 1) Community participation is needed in the success of the empowerment program, 2) It takes stages to carry out community empowerment., 3) It takes collaboration and innovation to create a literate society. Suggestions from this study are that the results of this study can be used as a reference for evaluating and developing similar programs. AbstrakPendidikan selalu berkaitan erat dengan kegiatan membaca. Kegiatan ini selalu menjadi salah satu point utama yang mendukung lancarnya proses pendidikan. Kemampuan membaca sering disebut dengan kegiatan Literasi. Kenyataan yang dihadapi oleh Indonesia selama ini adalah rendahnya penguasaan literasi, dibuktikan melalui survei Programme for International Student Assessment (PISA). Survei pada tahun 2018 menunjukkan bahwa nilai kompetensi Membaca/literasi, Indonesia berada dalam peringkat 72 dari 77 negara. Kenyataan ini sangat bertentangan dengan keadaan Ideal yang seharusnya. Untuk menghadapi permasalahan, banyak hal yang dapat diterapkan dalam proses pendidikan, baik itu dari jalur formal nonformal maupun informal. Kampung sinau merupakan salah satu kampung tematik yang berada di  kawasan Cemorokandang Kota Malang. Kegiatan belajar dilaksanakan dengan unik yang dapat menarik generasi muda khususnya, agar memperkaya khasanah literasi dan menjadikannya berdaya literasi, dikemas dengan kegiatan pemberdayaan masyarakat. Oleh karena itu peneliti tertarik untuk mengetahui bagaimana pemberdayaan masyarakat dalam menjadikan generasi muda berdaya literasi di kampung sinau. Pendekatan dan jenis penelitian yang digunakan oleh penelliti yakni pendekatan kualitatif  jenis studi kasus. Peneliti melaksanakan proses penelitan secara mendalam melalui  penelitian deskriptif kualitatif dengan jenis studi kasus. Penelitian ini dilaksanakan pada akhir tahun 2019 di Kampung Sinau Kota Malang. Hasil dari penelitian ini 1) Partisipasi masyarakat sangat dibutuhkan dalam keberhasilan program pemberdayaan, 2) Diperlukan tahapan-tahapan untuk melaksanakan pemberdayaan Masyarakat., 3) Diperlukan kerjasama dan inovasi untuk menciptakan masyarakat yang berdaya literasi. Saran dari Penelitian ini yakni Sebaiknya hasil penelitian ini dapat dijadikan bahan acuan untuk melakukan evaluasi dan pengembangan terhadap program serupa.

scholarly journals Various English Literacy Activities in Bilingual Primary School

2021 ◽  
Vol 5 (1) ◽  
pp. 48
Author(s):  
Putu Indah Puspitasari ◽  
N.N. Padmadewi ◽  
L.P.E.S. Dewi
Keyword(s):  
Primary School ◽  
International Student ◽  
Student Assessment ◽  
English Teachers ◽  
Study Data ◽  
Literacy Skills ◽  
Thinking Aloud ◽  
International Student Assessment ◽  
Literacy Activities ◽  
English Literacy

The results of Program of International Student Assessment show that the literacy skills of Indonesian students was in the low level. This study aims to investigate English literacy activities in elementary schools. This research is a qualitative research with a case study method. There were three English teachers who teach on the 1st, 2nd, and 3rd grade assigned as the subjects of this study.  Data were collected using a questionnaire, interview guide, and checklist. The data collection procedure was carried out by distributing questionnaires, conducting interviews, and conducting classroom observations. Data were analyzed using data analysis methods from Cresswell which consisted of data organization, coding, description and developing themes, reporting findings, interpreting, and validating data. The results of this study indicate that there are eight literacy activities, namely Directed Reading-Thinking Activity, guided reading, reading with multimedia assistance, thinking aloud, reading aloud, dictating, recognizing letters, and writing. This study provides a description about English literacy activities in Primary School conducted by teachers. Therefore, a suggestion is directed to English teachers to teach literacy to students since the early age as literacy is an important basis for students’ future learning.

scholarly journals ANALISIS STRATEGI PEMBELAJARAN MATEMATIKA KURKULUM 2013 DALAM RANGKA MENINGKATKAN NILAI PISA MATEMATIKA

2018 ◽  
Vol 5 (1) ◽  
pp. 42-64
Author(s):  
Mochamad Soekardjo ◽  
Lipur Sugiyanta
Keyword(s):  
Elementary School ◽  
Critical Thinking ◽  
Creative Thinking ◽  
International Student ◽  
Mathematical Thinking ◽  
Student Assessment ◽  
Thinking Skills ◽  
Mathematical Concepts ◽  
International Student Assessment ◽  
Level 1

Mathematics courses are given to students from elementary school to higher education which equip them with logical, analytical, systematic, critical, and creative thinking skills, as well as the ability to work together. According to the Organization for Economics Cooperation and Development (OECD) year 2013, the concep of mathematical literacy in Programme for International Student Assessment (PISA) supports the importance of developing strong understanding of pure mathematical concepts and the benefits involved in exploration in the abstract world of mathematics. This research produces a Mathematics strategic learning analysis of grade IX that supports high-order mathematical thinking skills (HOMT). Two (2) parts of the materials will be discussed more focused, ie (a) learning materials and (b) learning strategies. With a learning syllabus that supports the HOMT, the opportunity to increase the value of Mathematics education is greater, one of which is formulate challenging questions. Challenging Mathematical questions will meet the criteria of high-level questions (PISA has a level of questions from level 1 to level 6). HOMT supports the development of a strong understanding of pure mathematical concepts and is useful in exploration in the abstract world of mathematics. The sources of data used in the preparation of this reseach are the results of the PISA survey in 2006 and 2012 and the 2013 curriculum book sourced from the Ministry of Education and Culture.  Keywords: Mathematics grade IX, 2013 curriculum, PISA, HOMT   Abstrak Mata pelajaran Matematika diberikan kepada semua peserta didik mulai dari sekolah dasar untuk membekali peserta didik dengan kemampuan berpikir logis, analitis, sistematis, kritis, dan kreatif, serta kemampuan bekerja sama. Menurut Organization for Economics Coopration and Development (OECD) tahun 2013, konsepsi literasi matematika dalam Program for International Student Assessment PISA mendukung pentingnya siswa mengembangkan pemahaman yang kuat tentang konsep-konsep matematika murni dan manfaat yang terlibat dalam eksplorasi dalam dunia abstrak matematika. Penelitian ini menghasilkan sebuah analisis trategi pembelajaran matematika Kelas IX yang mendukung kemampuan berpikir tingkat tinggi matematika (HOMT). Dua (2) bagian dari materi akan dibahas lebih fokus, yaitu (a) materi pembelajaran dan (b) strategi pembelajaran. Dengan silabus pembelajaran yang mendukung HOMT tersebut maka peluang untuk meningkatkan nilai pendidikan Matematika lebih besar, salah satu di antaranya adalah dapat disusunnya soal-soal yang menantang. Soal-soal matematika yang menantang akan memenuhi kriteria soal level tinggi (PISA memiliki tingkatan soal dari level 1 hingga level 6). HOMT mendukung pengembangan pemahaman yang kuat tentang konsep-konsep matematika murni dan bermanfaat dalam eksplorasi dalam dunia abstrak matematika. Sumber data yang digunakan dalam penyusunan buku penelitian  ini adalah hasil survey PISA tahun 2006 dan 2012 dan buku kurikulum 2013 yang bersumber dari Kementerian Pendidikan dan Kebudayaan. Kata Kunci: Matematika kelas IX, Kurikulum 2013, PISA, HOMT   References B. Johnson. 2002. Contextual Teaching and Learning: What it is and why it’s here to stay. Corwin Press,Inc. California. A. Dahlan. 2009. Pengembangan model computer based e-learning untuk meningkatkan kemampuan high order mathematical thinking siswa SMA. LPPM UPI. Bandung. Watson and E. M. Glaser. 1980. Critical Thinking Appraisal. Harcourt Brace Jovanovich, Inc. New York. Hakim. 2016. Analisis Gambaran Kompetensi Guru Terhadap Prestasi Belajar Siswa SMP            Pada Ujian Nasional Tahun 2015 Provinsi Daerah Istimewa Yogyakarta. Pusat                    Data dan Statistik Pendidikan dan Kebudayaan. Jakarta. Abdurrahman. 2003. Pendidikan Bagi Anak Berkesulitan Belajar. Rineka Cipta. Jakarta. Nata. 2009. Perspektif Islam Tentang Strategi Pembelajaran. Kencana Prenada Media              Group. Jakarta. Purwanto. 2004. Psikologi Pendidikan. Remaja Rosdakarya. Bandung OECD. 2012. OECD Programme for International Student Assessment 2012. OECD.                      Westat. OECD. 2006. OECD Programme for International Student Assessment 2006. OECD.                      Westat. P. P. Kemdikbud. 2016. Penilaian yang Berkualitas untuk Pendidikan yang Berkualitas [Online]. Available:http://litbang.kemdikbud.go.id/pengumuman/Mengenal%20Puspendik%205%20Jan %202015-2.pdf. [Accessed 07 Feb 2016]. K. d. Perbukuan. 2015. Buku Guru Matematika Kelas IX SMP/MTs. Kementerian Pendidikan dan Kebudayaan. Jakarta. H. Ennis. 1985. Critical Thinking. University of lllinois. New Jersey: Prentice Hall. W. Weisberg. 2006. Expertise and Reason in Creative Thinking: Evidence from Case Studies and the Laboratory. Cambridge University Press. Cambridge. Mariana. 2011. Penerapan pendekatan kontekstual dengan pemberian tugas mind map setelah pembelajaran terhadap peningkatan kemampuan koneksi matematis siswa SMP. Krulik and J. A. Rudnick. 1995. The New Sourcebook for Teaching Reasoning and Problem Solving in Elementary School. Allyn & Bacon. Needham Heights. Sardiman. 1987. Interaksi dan Motivasi Belajar Mengajar. Rajawali Pers. Jakarta. Suwarma and D. Mayadiana. 2009. Suatu Alternatif Pembelajaran Kemampuan                           Berpikir  Kritis Matematika. Cakrawala Maha Karya. Jakarta Gustiningsi. 2015. Pengembangan Soal Matematika Model Pisa Untuk Mengetahui Kemampuan Berpikir Kritis Matematis Siswa Kelas VII. Jurnal Pendidikan Matematika JPM RAFA , vol. Vol.1, no. No.1, September 2015. Y. E. Siswono. 2016. Berpikir Kritis dan Berpikir Kreatif sebagai Fokus Pembelajaran Matematika in Seminar Nasional Matematika Dan Pendidikan Matematika (1st SENATIK). Semarang.

scholarly journals THE EFFECTS OF USING BAR MODEL TOWARDS ALGEBRAIC THINKING SKILL IN ALGEBRAIC PROBLEM SOLVING AMONG STUDENTS

2021 ◽  
Vol 6 (44) ◽  
pp. 38-51
Author(s):  
Janet Jahudin ◽  
Nyet Moi Siew
Keyword(s):  
International Student ◽  
Student Assessment ◽  
Thinking Skills ◽  
Algebraic Thinking ◽  
International Student Assessment ◽  
Significant Difference ◽  
Post Test ◽  
Inference Test ◽  
Quasi Experimental ◽  
The Mean

Algebraic thinking skills are one of the elements emphasized in the benchmarking of PISA (Program for International Student Assessment). However, the algebraic thinking skills among students were found to be still at a very weak level. The purpose of this study was to look at the effect of the bar model method on students’ algebraic thinking skills. Pre-test and post -test were used as research instruments. The study was an experimental study conducted on 90 Form One students from a school in Tuaran District, Sabah. This study used a quasi-experimental design of pre-and post-test. The sample was divided into 3 groups, namely the group of learning methods i) Bar Model (MB, n = 30), ii) Bar Model and Cooperative Learning (MBPK, n = 30), and conventional (TR, n = 30). Statistical inference test, One-way Analysis of Variances Test (ANOVA) was used to analyze the findings of this study. The results of one-way ANOVA analysis showed that there was a significant difference in the mean score of the post-test between the MB group, MBPK group, and TR group (F (2, 87) = 9.316, p <.05). Significant differences in mean scores for post-test could only be seen between TR group with MB group (P = 0.019) and between TR group with MBPK group (P = 0.000) while insignificant differences were shown between MB and MBPK group (P = 0.304). Therefore, it is suggested that mathematics teachers use the Bar Model as a teaching aid to improve students' algebraic thinking skills.

scholarly journals ANALISIS KEMAMPUAN BERPIKIR REFLEKTIF DAN ANALITIK PESERTA DIDIK SMP DALAM MENYELESAIKAN SOAL MODEL PROGRAMME FOR INTERNATIONAL STUDENT ASSESSMENT (PISA)

2020 ◽  
Vol 2 (2) ◽  
pp. 46-59
Author(s):  
Hasan Bashri Hadimu ◽  
Theresia Laurens ◽  
La Moma
Keyword(s):  
High School ◽  
Junior High School ◽  
International Student ◽  
Reflective Thinking ◽  
Student Assessment ◽  
Thinking Skills ◽  
International Student Assessment ◽  
Analytical Skills ◽  
Analytical Thinking ◽  
Thinking Ability

During this time, reflective thinking and analytical skills have not been one of the objectives of mathematics and learners have not demonstrated reflective activity and analytic learning. The ability of the students ' reflective thinking and analytics is an important aspect to be examined and developed so that the learner's math learning is more optimal. The study aims to describe the ability of the students ' reflective thinking and analytic of junior high school in solving the Programme for International Student Assessment (PISA) model. This research is a qualitative descriptive study describing the reflective thinking skills and analytical students of junior high school in solving the Programme for International Student Assessment (PISA) model. The subject in this study is a class IX student consisting of three learners with the details of each of the 1 learners with reflective thinking skills, 1 student with analytic thinking skills and 1 student with reflective and analytical thinking skills. The data collection techniques used are tests of reflective thinking and analytical skills as well as interviews. Test Data and interviews are analyzed based on indicators that meet the ability of reflective thinking and analytical thinking skills. Data analysis techniques refer to the Miles and Hiberman concepts which include data reduction, data presentation, and conclusion withdrawal. Data validity techniques use observer persistence, triangulation time and peer checking. The results of the study provide conclusions: 1) Subject 1 meets the indicator of the reflective thinking ability, subject 1 able to the reacting phase, comparing, less in the contemplating phase: 2) Subject 2 meets the analytical thinking ability indicator, subject 2 is capable at would phase, organizing and attributing: 3) Subject 3 meets the indicator of reflective thinking capabilities capable of the reacting, comparing, contemplating and subject 3, organizing and attributing

scholarly journals The strategy of Science Learning in Curriculum 2013 to Increase the Value of Science’s Program for International Student Assessment (PISA)

2022 ◽  
Vol 8 (1) ◽  
pp. 79-85
Author(s):  
Hartono Hartono ◽  
Ratu Ilma Indra Putri ◽  
Rita Inderawati ◽  
Melly Ariska
Keyword(s):  
Science Education ◽  
Learning Strategies ◽  
Creative Thinking ◽  
Science Learning ◽  
International Student ◽  
Student Assessment ◽  
Thinking Skills ◽  
Pure Science ◽  
International Student Assessment ◽  
High Level

Natural Science subjects consisting of Physics, Chemistry and Biology are given to all students starting from elementary school to equip students with logical, analytical, systematic, critical, and creative thinking skills, as well as the ability to work together. According to the Organization for Economics Cooperation and Development (OECD) in 2013, the conception of Science literacy in the PISA (Program for International Student Assessment) supports the importance of students developing a solid understanding of the concepts of pure science and science education and the benefits involved in exploration in the abstract world that exists. on the universe. This study resulted in an analysis of science learning strategies for students of the Department of Science Education that support higher order thinking skills in Science. Two (2) parts of the material will be discussed more focused, namely (a) learning materials and (b) learning strategies. With the learning syllabus that supports the High Order Thinking Skills (HOTS) questions, the opportunity to increase the value of Science education (Physics, Chemistry, Biology) is greater, one of which is the preparation of challenging questions. Challenging science questions will meet the criteria for high-level questions (PISA has question levels from level 1 to level 6). HOTS questions support the development of a solid understanding of pure Science and Science Education concepts. The data sources used in the preparation of this research are the results of the 2000, 2003, 2006, 2009, 2012, 2015 and 2018. PISA surveys and the 2013 curriculum book sourced from the Ministry of Education and Culture.

scholarly journals KARAKTERISTIK SOAL LITERASI MEMBACA PADA PROGRAM PISA

LITERA ◽  
2018 ◽  
Vol 17 (1) ◽  
Author(s):  
Titik Harsiati
Keyword(s):  
Reading Ability ◽  
International Student ◽  
Student Assessment ◽  
Multiple Choice ◽  
Thinking Skills ◽  
International Perspective ◽  
Test Items ◽  
International Student Assessment ◽  
A Minor ◽  
Literacy Test

Studi Programme for International Student Assessment (PISA) bertujuan untuk mengetahui efektivitas sistem pendidikan dalam perspektif internasional dengan berfokus pada hasil asesmen Sains, Matematika, dan Literasi Membaca. Penelitian ini bertujuan menelaah karakteristik soal membaca PISA pada empat kali pelaksanaan, yaitu soal membaca sebagai bahan uji mayor 2000-2009 dan sebagai bahan uji minor 2003-2006. Penelitian ini adalah penelitian kualitatif dengan teknik analisis isi. Data yang digunakan adalah hasil PISA tahun 2000-2009. Hasil analisis menunjukkan bahwa soal literasi membaca PISA didominasi keterampilan berpikir tingkat tinggi berupa kemampuan interpretasi, refleksi, dan evaluasi. Kemampuan membaca yang diujikan adalah mengungkapkan kembali informasi, mengembangkan interpretasi dan mengintegrasikan, dan merefleksikan dan mengevaluasi teks. Soal cenderung menggunakan wacana panjang (135-630 kata) dan kalimat pertanyaan cenderung kompleks. Ragam tes yang digunakan meliputi pilihan ganda, pilihan ganda kompleks, jawaban singkat, esai tertutup, dan esai terbuka. Karakteristik konteks diklasifikasikan empat kategori, yaitu pendidikan, pekerjaan, personal, dan masyarakat. Isi kutipan bertema keselamatan keamanan diri, bermasyarakat, cara menyelesaikan pendidikan dan IPTEK, cerita personal berisi nilai moral untuk meningkatkan kualitas hidup.Kata kunci: literasi, kemampuan membaca, sistem pendidikan, karakteristik soal  THE CHARACTERISTICS OF LITERACY TEST ITEMS IN PISAAbstractA study of the Program for International Student Assessment (PISA) aimed to investigate the effectiveness of the education system in an international perspective by focusing on the results of the science, mathematics, and literacy assessments. This study aimed to examine the characteristics of PISA reading test items from four administrations, namely reading as a major test in 2000-2009 and as a minor test in 2003-2006. This was a qualitative study using content analysis. The data were the results of PISA in 2000-2009. The results of the analysis showed that the PISA literacy test items were dominated by those measuring high-order thinking skills in the form of the ability in interpretation, reflection, and evaluation. The reading ability tested was revealing information, developing and integrating interpretation, and reflecting and evaluating texts. The test items tended to be based on long discourses (135-630 words) and the questions tended to be complex. In terms of variety, the item tests included multiple choice, complex multiple choice, short answer, closed essay, and open essay items. The characteristics of the contexts were classified into four categories, namely education, employment, personal matters, and community. The contents of the citations comprised self-safety, community, ways of completing education, and science and technology. Personal stories contained moral values to improve the quality of life.Keywords: literacy, reading ability, educational system, characteristics of test items

Three Paradoxical Effects on Academic Self-Concept Across Countries, Schools, and Students

2019 ◽  
Vol 24 (3) ◽  
pp. 231-242 ◽  
Author(s):  
Herbert W. Marsh ◽  
Philip D. Parker ◽  
Reinhard Pekrun
Keyword(s):  
International Student ◽  
Student Assessment ◽  
Cross Cultural ◽  
Frame Of Reference ◽  
School Level ◽  
Self Concept ◽  
Positive Effects ◽  
International Student Assessment ◽  
Country Level ◽  
Starting School

Abstract. We simultaneously resolve three paradoxes in academic self-concept research with a single unifying meta-theoretical model based on frame-of-reference effects across 68 countries, 18,292 schools, and 485,490 15-year-old students. Paradoxically, but consistent with predictions, effects on math self-concepts were negative for: • being from countries where country-average achievement was high; explaining the paradoxical cross-cultural self-concept effect; • attending schools where school-average achievement was high; demonstrating big-fish-little-pond-effects (BFLPE) that generalized over 68 countries, Organisation for Economic Co-operation and Development (OECD)/non-OECD countries, high/low achieving schools, and high/low achieving students; • year-in-school relative to age; unifying different research literatures for associated negative effects for starting school at a younger age and acceleration/skipping grades, and positive effects for starting school at an older age (“academic red shirting”) and, paradoxically, even for repeating a grade. Contextual effects matter, resulting in significant and meaningful effects on self-beliefs, not only at the student (year in school) and local school level (BFLPE), but remarkably even at the macro-contextual country-level. Finally, we juxtapose cross-cultural generalizability based on Programme for International Student Assessment (PISA) data used here with generalizability based on meta-analyses, arguing that although the two approaches are similar in many ways, the generalizability shown here is stronger in terms of support for the universality of the frame-of-reference effects.

Are There Test Administrator Effects in Large-Scale Educational Assessments?

Methodology ◽  
2007 ◽  
Vol 3 (4) ◽  
pp. 149-159 ◽  
Author(s):  
Oliver Lüdtke ◽  
Alexander Robitzsch ◽  
Ulrich Trautwein ◽  
Frauke Kreuter ◽  
Jan Marten Ihme
Keyword(s):  
Large Scale ◽  
International Student ◽  
Student Assessment ◽  
Student Groups ◽  
Mathematics Scores ◽  
International Student Assessment ◽  
Sample Attrition ◽  
Educational Assessments ◽  
Test Administrator ◽  
Practical Implications

Abstract. In large-scale educational assessments such as the Third International Mathematics and Sciences Study (TIMSS) or the Program for International Student Assessment (PISA), sizeable numbers of test administrators (TAs) are needed to conduct the assessment sessions in the participating schools. TA training sessions are run and administration manuals are compiled with the aim of ensuring standardized, comparable, assessment situations in all student groups. To date, however, there has been no empirical investigation of the effectiveness of these standardizing efforts. In the present article, we probe for systematic TA effects on mathematics achievement and sample attrition in a student achievement study. Multilevel analyses for cross-classified data using Markov Chain Monte Carlo (MCMC) procedures were performed to separate the variance that can be attributed to differences between schools from the variance associated with TAs. After controlling for school effects, only a very small, nonsignificant proportion of the variance in mathematics scores and response behavior was attributable to the TAs (< 1%). We discuss practical implications of these findings for the deployment of TAs in educational assessments.

Sign in / Sign up

Export Citation Format

Share Document