A growing number of studies seek to evaluate the impact of school closures during the ongoing COVID-19 pandemic. While most studies reported severe learning losses in students, some studies found positive effects of school closures on academic performance. However, it is still unclear which factors contribute to the differential effects observed in these studies. In this article, we examine the impact of assignment strategies for problem sets on the academic performance of students (n 24,000 from classes 4-10 who calculated 560,000 problem sets) in an online learning environment for mathematics, during the first and second period of pandemic-related school closures in Germany. We observed that, if teachers repeatedly assigned single problem sets (i.e., a small chunk of on average eight mathematical problems) to their class, students’ performance increased significantly during both periods of school closures compared to the same periods in the previous year (without school closures). In contrast, our analyses also indicated that, if teachers assigned bundles of problem sets (i.e., large chunks) or when students self-selected problem sets, students’ performance did not increase significantly. Moreover, students’ performance was generally higher when single problem sets were assigned, compared to the other two assignment types. We conclude that teachers’ way of using the online learning environment in general, and their strategy of assigning problem sets in particular can have a positive effect on students’ performance in mathematics.
A Meta-Analysis of Scaffolding Effects in Online Learning in Higher Education
