scholarly journals Pan and Rickard (2018) Transfer of test-enhanced learning meta-analysis (preprint)

2018 ◽  
Author(s):  
Steven C. Pan

Attempting recall of information from memory, as occurs when taking a practice test, is one of the most potent training techniques known to learning science. However, does testing yield learning that transfers to different contexts? In the present article, we report the findings of the first comprehensive meta-analytic review into that question. Our review encompassed 192 transfer effect sizes extracted from 122 experiments and 67 published and unpublished articles (N = 10,382) comprising over 40 years of research. A random-effects model revealed that testing can yield transferrable learning as measured relative to a non-testing reexposure control condition (d = 0.40, 95% CI [0.31, 0.50]). That transfer of learning is greatest across test formats, to application and inference questions, to problems involving medical diagnoses, and to mediator and related word cues; it is weakest to rearranged stimulus-response items, to untested materials seen during initial study, and to problems involving worked examples. Moderator analyses further indicated that response congruency and elaborated retrieval practice, as well as initial test performance, strongly influence the likelihood of positive transfer. In two assessments for publication bias (using PET-PEESE and various selection methods), the moderator effect sizes were minimally affected. However, the intercept predictions were substantially reduced, often indicating no positive transfer when none of the aforementioned moderators are present. Overall, our results motivate a three-factor framework for transfer of test-enhanced learning and have practical implications for the effective use of practice testing in educational and other training contexts.


2021 ◽  
Author(s):  
Steven C. Pan ◽  
Faria Sana

The use of practice tests to enhance learning, or test-enhanced learning, ranks among the most effective of all pedagogical techniques. We investigated the relative efficacy of pretesting (i.e., errorful generation) and posttesting (i.e., retrieval practice), two of the most prominent practice test types in the literature to date. Pretesting involves taking tests before to-be-learned information is studied, whereas posttesting involves taking tests after information is studied. In five experiments (combined n = 1,573), participants studied expository text passages, each paired with a pretest or a posttest. The tests involved multiple-choice (Experiments 1-5) or cued recall format (Experiments 2-4) and were administered with or without correct answer feedback (Experiments 3-4). On a criterial test administered 5 minutes or 48 hours later, both test types enhanced memory relative to a no-test control, but pretesting yielded higher overall scores. That advantage held across test formats, in the presence or absence of feedback, at different retention intervals, and appeared to stem from enhanced processing of text passage content (Experiment 5). Thus, although the benefits of posttesting are more well-established in the literature, pretesting is highly competitive with posttesting and can yield similar, if not greater, pedagogical benefits. These findings have important implications for the incorporation of practice tests in education and training contexts.



Author(s):  
Mohan W. Gupta ◽  
Steven C. Pan ◽  
Timothy C. Rickard

AbstractIn three experiments we investigated how the level of study-based, episodic knowledge influences the efficacy of subsequent retrieval practice (testing) as a learning event. Possibilities are that the efficacy of a test, relative to a restudy control, decreases, increases, or is independent of the degree of prior study-based learning. The degree of study-based learning was manipulated by varying the number of item repetitions in the initial study phase between one and eight. Predictions of the dual-memory model of test-enhanced learning for the case of one study-phase repetition were used as a reference. Results support the hypothesis that the advantage of testing over restudy is independent of the degree of prior episodic learning, and they suggest that educators can apply cued-recall testing with the expectation that its efficacy is similar across varying levels of prior content learning. Implications for testing effect theory are discussed.



2018 ◽  
Vol 144 (7) ◽  
pp. 710-756 ◽  
Author(s):  
Steven C. Pan ◽  
Timothy C. Rickard


2012 ◽  
Author(s):  
Michael C. Mensink ◽  
Scott R. Hinze ◽  
Mark R. Lewis ◽  
Kirk Weishaar


2007 ◽  
Author(s):  
Henry L. Roediger ◽  
Mark A. McDaniel ◽  
Kathleen B. McDermott ◽  
Pooja K. Agarwal




2020 ◽  
Author(s):  
Sofia Persson ◽  
Alan Yates ◽  
Klaus Kessler ◽  
Ben Harkin

Even though memory performance is a commonly researched aspect of Obsessive-Compulsive Disorder (OCD), a coherent and unified explanation of the role of specific cognitive factors has remained elusive. To address this, the present meta-analysis examined the predictive validity of Harkin and Kessler’s (2011) Executive Function (E), Binding Complexity (B) and Memory Load (L) Classification System with regards to affected vs. unaffected memory performance in OCD. We employed a multi-level meta-analytic approach (Viechtbauer, 2010) to accommodate the interdependent nature of the EBL model and interdependency of effect sizes (305 effect sizes from 144 studies, including 4424 OCD patients). Results revealed that the EBL model predicted memory performance, i.e., as EBL demand increases, those with OCD performed progressively worse on memory tasks. Executive function was the driving mechanism behind the EBL’s impact on OCD memory performance and negated effect size differences between visual and verbal tasks in those with OCD. Comparisons of sub-task effect sizes were also generally in accord with the cognitive parameters of the EBL taxonomy. We conclude that standardised coding of tasks along individual cognitive dimensions and multi-level meta-analyses provides a new approach to examine multi-dimensional models of memory and cognitive performance in OCD and other disorders.



2021 ◽  
pp. 016264342198997
Author(s):  
Sojung Jung ◽  
Ciara Ousley ◽  
David McNaughton ◽  
Pamela Wolfe

In this meta-analytic review, we investigated the effects of technology supports on the acquisition of shopping skills for students with intellectual and developmental disabilities (IDD) between the ages of 5 and 24. Nineteen single-case experimental research studies, presented in 15 research articles, met the current study’s inclusion criteria and the What Works Clearinghouse (WWC) standards. An analysis of potential moderators was conducted, and we calculated effect sizes using Tau-U to examine the impact of age, diagnosis, and type of technology on the reported outcomes for the 56 participants. The results from the included studies provide evidence that a wide range of technology interventions had a positive impact on shopping performance. These positive effects were seen for individuals across a wide range of ages and disability types, and for a wide variety of shopping skills. The strongest effect sizes were observed for technologies that provided visual supports rather than just auditory support. We provide an interpretation of the findings, implications of the results, and recommended areas for future research.



Author(s):  
Jeanne Gubbels ◽  
Claudia E. van der Put ◽  
Geert-Jan J. M. Stams ◽  
Mark Assink

AbstractSchool-based programs seem promising for child abuse prevention. However, research mainly focused on sexual child abuse and knowledge is lacking on how individual program components contribute to the effectiveness of school-based prevention programs for any form of child abuse. This study aimed to examine the overall effect of these school-based programs on (a) children’s child abuse-related knowledge and (b) self-protection skills by conducting two three-level meta-analyses. Furthermore, moderator analyses were performed to identify how program components and delivery techniques were associated with effectiveness. A literature search yielded 34 studies (158 effect sizes; N = 11,798) examining knowledge of child abuse and 22 studies (99 effect sizes; N = 7804) examining self-protection skills. A significant overall effect was found of school-based programs on both knowledge (d = 0.572, 95% CI [0.408, 0.737], p < 0.001) and self-protection skills (d = 0.528, 95% CI [0.262, 0.794], p < 0.001). The results of the first meta-analysis on children’s child abuse knowledge suggest that program effects were larger in programs addressing social–emotional skills of children (d = 0.909 for programs with this component versus d = 0.489 for programs without this component) and self-blame (d = 0.776 versus d = 0.412), and when puppets (d = 1.096 versus d = 0.500) and games or quizzes (d = 0.966 versus d = 0.494) were used. The second meta-analysis on children’s self-protections skills revealed that no individual components or techniques were associated with increased effectiveness. Several other study and program characteristics did moderate the overall effects and are discussed. In general, school-based prevention programs show positive effects on both knowledge and self-protection skills, and the results imply that program effectiveness can be improved by implementing specific components and techniques.



Sign in / Sign up

Export Citation Format

Share Document