Hypothetical Use of Multidimensional Adaptive Testing for the Assessment of Student Achievement in the Programme for International Student Assessment

2011 ◽  
Vol 71 (3) ◽  
pp. 503-522 ◽  
Author(s):  
Andreas Frey ◽  
Nicki-Nils Seitz
Author(s):  
S. Marshall Perry ◽  
Karen M. Sealy ◽  
Héctor X. Ramírez-Pérez ◽  
Thomas C. DeNicola ◽  
Yair Cohen

Connections between principal leadership activities, school context, and student achievement are examined within this paper. Data for this quantitative study are from the 2013 Teaching and Learning International Survey (TALIS) and the 2012 Programme for International Student Assessment (PISA). The eight countries of examination participated in both the TALIS and PISA and the researchers merged datasets, yielding a study sample of 1,301 schools. This paper supports a context-specific view of instructional leadership. When looking across countries, the researchers found different practices were more strongly associated with the academic achievement of students, and suggest that school leaders have a meaningful overall relationship with academic achievement, both directly and indirectly. This study therefore supports prior research about the direct and indirect effects of instructional leadership. Further study, which accounts for differences in family academic resources and school-level opportunities to learn, will better illuminate the connection between instructional leadership practices and academic achievement.


2019 ◽  
Vol 44 (6) ◽  
pp. 752-781
Author(s):  
Michael O. Martin ◽  
Ina V.S. Mullis

International large-scale assessments of student achievement such as International Association for the Evaluation of Educational Achievement’s Trends in International Mathematics and Science Study (TIMSS) and Progress in International Reading Literacy Study and Organization for Economic Cooperation and Development’s Program for International Student Assessment that have come to prominence over the past 25 years owe a great deal in methodological terms to pioneering work by National Assessment of Educational Progress (NAEP). Using TIMSS as an example, this article describes how a number of core techniques, such as matrix sampling, student population sampling, item response theory scaling with population modeling, and resampling methods for variance estimation, have been adapted and implemented in an international context and are fundamental to the international assessment effort. In addition to the methodological contributions of NAEP, this article illustrates how the large-scale international assessments go beyond measuring student achievement by representing important aspects of community, home, school, and classroom contexts in ways that can be used to address issues of importance to researchers and policymakers.


Author(s):  
S. Marshall Perry ◽  
Karen M. Sealy ◽  
Héctor X. Ramírez-Pérez ◽  
Thomas C. DeNicola ◽  
Yair Cohen

Connections between principal leadership activities, school context, and student achievement are examined within this paper. Data for this quantitative study are from the 2013 Teaching and Learning International Survey (TALIS) and the 2012 Programme for International Student Assessment (PISA). The eight countries of examination participated in both the TALIS and PISA and the researchers merged datasets, yielding a study sample of 1,301 schools. This paper supports a context-specific view of instructional leadership. When looking across countries, the researchers found different practices were more strongly associated with the academic achievement of students, and suggest that school leaders have a meaningful overall relationship with academic achievement, both directly and indirectly. This study therefore supports prior research about the direct and indirect effects of instructional leadership. Further study, which accounts for differences in family academic resources and school-level opportunities to learn, will better illuminate the connection between instructional leadership practices and academic achievement.


Author(s):  
Sedat Gümüş ◽  
Mehmet Şükrü Bellibaş ◽  
Sedat Şen ◽  
Philip Hallinger

Despite the growing scholarly interest in the effects of principal leadership on student achievement, empirical evidence concerning how principal qualifications might be related to student learning outcomes has been limited. This study investigates the relationship between different principal qualifications (prior experience in teaching, principalship and other school management roles, formal education, principal training, and professional development) and student achievement by analyzing cross-national teaching and learning international survey and program on international student assessment data from seven countries. The results showed that experience in principalship and other school management positions, principal training, and participation in networking activities and teaching/pedagogy-focused seminars had small but statistically significant associations with student achievement, though the results were not consistent across different subjects. Level of education and years of teaching experience did not, however, predict student achievement. Implications of the findings are offered for policy and further research.


2019 ◽  
Vol 7 (1-2019) ◽  
pp. 36-59
Author(s):  
Larry E. Suter

The Program for International Student Assessment (PISA) by the OECD measures student study time during formal school periods and during periods of out-of-school-time (OST). The purpose of these items is to account for differences in country to country achievement levels. However, analyses of the impact of additional study time on student achievement have produced conflicting results across countries. While more time given to a school subject within formal school is positively related to achievement in that topic, more time spent on OST is negatively related to average achievement between and within countries. The paper proposes a reconceptualization of OST and achievement by integrating theoretical frameworks of study time, student abilities, and student feelings of efficacy. The results of a descriptive and conceptual analysis of a set of new survey items in the 2015 PISA for 22 countries shows that students benefit from additional study time by having increased feelings of efficacy in a school subject (such as science) but not in measurable levels of achievement. While country to country levels OST participation rates are different, the patterns of relationships between OST participation, student achievement, and attitudes are similar.


Author(s):  
Christine Sälzer ◽  
Nina Roczen

International large-scale assessments such as the Programme for International Student Assessment (PISA) yield comparative indicators of student achievement in various competence domains. This article focuses on global competence as a suggested cross-curricular domain for the PISA 2018 study. The measurement of global competence is related to a number of challenges, which are elaborated, described and discussed. As these challenges have so far not been sufficiently targeted, Germany, among several other countries, has decided not to assess global competence in the upcoming PISA cycle. In conclusion, propositions are made regarding viable options to capture global competence in international comparative studies so that established quality standards can be met.


2020 ◽  
Vol 14 (1) ◽  
pp. 115
Author(s):  
Jutaro Sakamoto

Parent participation in school management has been promoted as a strategy for holding schools accountable for education quality and outcomes. However, the evidence has proven inconclusive and limited in explaining mechanisms to affect student achievement. By using public school student data derived from the Programme for International Student Assessment 2015, this study examines how 1) participation of a student’s own parents in school management, which would affect their learning support at home and 2) participation of a group of parents, which would influence school decisions and thus affect the learning environment at school, are associated with student achievement in Croatia, Georgia, Portugal, the Dominican Republic, Mexico, Korea, Hong Kong, and Macao. I found no evidence that parent participation in school management contributed to improving student achievement. Instead, depending on the country, a negative association is derived from either individual-level or school-level parent participation. The associations are not moderated by parents’ socioeconomic status but by school’s openness to parental engagement in some of the countries, indicating that what matters might not be participation per se but the degree of engagement. The findings underscore the importance of understanding mechanisms and conditions in which parent participation affects student learning in context to design effective participatory school governance.


2019 ◽  
Vol 24 (3) ◽  
pp. 231-242 ◽  
Author(s):  
Herbert W. Marsh ◽  
Philip D. Parker ◽  
Reinhard Pekrun

Abstract. We simultaneously resolve three paradoxes in academic self-concept research with a single unifying meta-theoretical model based on frame-of-reference effects across 68 countries, 18,292 schools, and 485,490 15-year-old students. Paradoxically, but consistent with predictions, effects on math self-concepts were negative for: • being from countries where country-average achievement was high; explaining the paradoxical cross-cultural self-concept effect; • attending schools where school-average achievement was high; demonstrating big-fish-little-pond-effects (BFLPE) that generalized over 68 countries, Organisation for Economic Co-operation and Development (OECD)/non-OECD countries, high/low achieving schools, and high/low achieving students; • year-in-school relative to age; unifying different research literatures for associated negative effects for starting school at a younger age and acceleration/skipping grades, and positive effects for starting school at an older age (“academic red shirting”) and, paradoxically, even for repeating a grade. Contextual effects matter, resulting in significant and meaningful effects on self-beliefs, not only at the student (year in school) and local school level (BFLPE), but remarkably even at the macro-contextual country-level. Finally, we juxtapose cross-cultural generalizability based on Programme for International Student Assessment (PISA) data used here with generalizability based on meta-analyses, arguing that although the two approaches are similar in many ways, the generalizability shown here is stronger in terms of support for the universality of the frame-of-reference effects.


Methodology ◽  
2007 ◽  
Vol 3 (4) ◽  
pp. 149-159 ◽  
Author(s):  
Oliver Lüdtke ◽  
Alexander Robitzsch ◽  
Ulrich Trautwein ◽  
Frauke Kreuter ◽  
Jan Marten Ihme

Abstract. In large-scale educational assessments such as the Third International Mathematics and Sciences Study (TIMSS) or the Program for International Student Assessment (PISA), sizeable numbers of test administrators (TAs) are needed to conduct the assessment sessions in the participating schools. TA training sessions are run and administration manuals are compiled with the aim of ensuring standardized, comparable, assessment situations in all student groups. To date, however, there has been no empirical investigation of the effectiveness of these standardizing efforts. In the present article, we probe for systematic TA effects on mathematics achievement and sample attrition in a student achievement study. Multilevel analyses for cross-classified data using Markov Chain Monte Carlo (MCMC) procedures were performed to separate the variance that can be attributed to differences between schools from the variance associated with TAs. After controlling for school effects, only a very small, nonsignificant proportion of the variance in mathematics scores and response behavior was attributable to the TAs (< 1%). We discuss practical implications of these findings for the deployment of TAs in educational assessments.


Sign in / Sign up

Export Citation Format

Share Document