scholarly journals Working Memory Training Revisited: A Multi-Level Meta-Analysis of N-back Training Studies

2018 ◽  
Author(s):  
Anna Soveri ◽  
Jan Antfolk ◽  
Linda C. Karlsson ◽  
Benny Salo ◽  
Matti Laine
Keyword(s):  
Working Memory ◽  
Cognitive Control ◽  
Fluid Intelligence ◽  
Meta Analysis ◽  
Effect Sizes ◽  
Substantial Part ◽  
Training Dose ◽  
Multi Level ◽  
Training Studies ◽  
Meta Analyses

The efficacy of working memory (WM) training has been a controversial and hotly debated issue during the last years, and despite a large number of training studies and several meta-analyses, the matter has not yet been solved. We conducted a multi-level meta-analysis on the cognitive transfer effects in healthy adults who have been administered WM updating training with n-back tasks, the most common experimental WM training paradigm. Thanks to this methodological approach that has not been employed in previous meta-analyses in this field, we were able to include effect sizes from all relevant tasks used in the original studies. Altogether 203 effect sizes were derived from 33 published randomized controlled trials. In contrast to earlier meta-analyses, we separated task-specific transfer (here untrained n-back tasks) from other WM transfer tasks. Two additional cognitive domains of transfer that we analyzed consisted of fluid intelligence (Gf) and cognitive control tasks. A medium-sized transfer effect was observed to untrained n-back tasks. For other WM tasks, Gf, and cognitive control, the effect sizes were of similar size and very small. Moderator analyses showed no effects of age, training dose, training type (single vs. dual), or WM and Gf transfer task contents (verbal vs. visuospatial). We conclude that a substantial part of transfer following WM updating training with n-back is task-specific and discuss the implications of the results to WM training research.

Meta-Analyses as a Multi-Level Model

2019 ◽  
pp. 109442811985747
Author(s):  
Janaki Gooty ◽  
George C. Banks ◽  
Andrew C. Loignon ◽  
Scott Tonidandel ◽  
Courtney E. Williams
Keyword(s):  
Educational Psychology ◽  
Meta Analysis ◽  
Effect Sizes ◽  
Independence Assumption ◽  
The Social ◽  
Level Model ◽  
Multi Level ◽  
Meta Analyses ◽  
User Friendly ◽  
Organizational Sciences

Meta-analyses are well known and widely implemented in almost every domain of research in management as well as the social, medical, and behavioral sciences. While this technique is useful for determining validity coefficients (i.e., effect sizes), meta-analyses are predicated on the assumption of independence of primary effect sizes, which might be routinely violated in the organizational sciences. Here, we discuss the implications of violating the independence assumption and demonstrate how meta-analysis could be cast as a multilevel, variance known (Vknown) model to account for such dependency in primary studies’ effect sizes. We illustrate such techniques for meta-analytic data via the HLM 7.0 software as it remains the most widely used multilevel analyses software in management. In so doing, we draw on examples in educational psychology (where such techniques were first developed), organizational sciences, and a Monte Carlo simulation (Appendix). We conclude with a discussion of implications, caveats, and future extensions. Our Appendix details features of a newly developed application that is free (based on R), user-friendly, and provides an alternative to the HLM program.

scholarly journals The Relationship between Family Violence and Self-Control in Adolescence: A Multi-Level Meta-Analysis

2018 ◽  
Author(s):  
Yayouk E. Willems ◽  
Jian-bin Li ◽  
Anne M. Hendriks ◽  
Meike Bartels ◽  
Catrin Finkenauer
Keyword(s):  
Family Violence ◽  
Statistical Power ◽  
Meta Analysis ◽  
Self Control ◽  
Effect Sizes ◽  
Future Research ◽  
Cross Sectional ◽  
Multi Level ◽  
Meta Analyses ◽  
Low Self Control

Theoretical studies propose an association between family violence and low self-control in adolescence, yet empirical findings of this association are inconclusive. The aim of the present research was to systematically summarize available findings on the relation between family violence and self-control across adolescence. We included 27 studies with 143 effect sizes, representing more than 25,000 participants of eight countries from early to late adolescence. Applying a multi-level meta-analyses, taking dependency between effect sizes into account while retaining statistical power, we examined the magnitude and direction of the overall effect size. Additionally, we investigated whether theoretical moderators (e.g., age, gender, country), and methodological moderators (cross-sectional/longitudinal, informant) influenced the magnitude of the association between family violence and self-control. Our results revealed that family violence and self-control have a small to moderate significant negative association (r = -.191). This association did not vary across gender, country, and informants. The strength of the association, however, decreased with age and in longitudinal studies. This finding provides evidence that researchers and clinicians may expect low self-control in the wake of family violence, especially in early adolescence. Recommendations for future research in the area are discussed.

scholarly journals Working memory training revisited: A multi-level meta-analysis of n-back training studies

2017 ◽  
Vol 24 (4) ◽  
pp. 1077-1096 ◽  
Author(s):  
Anna Soveri ◽  
Jan Antfolk ◽  
Linda Karlsson ◽  
Benny Salo ◽  
Matti Laine
Keyword(s):  
Working Memory ◽  
Meta Analysis ◽  
Working Memory Training ◽  
Memory Training ◽  
Multi Level ◽  
Training Studies

The Orchard Plot: Cultivating a Forest Plot for Use in Ecology, Evolution and Beyond

2019 ◽  
Author(s):  
Shinichi Nakagawa ◽  
Malgorzata Lagisz ◽  
Rose E O'Dea ◽  
Joanna Rutkowska ◽  
Yefeng Yang ◽  
...  
Keyword(s):  
Meta Analysis ◽  
R Package ◽  
Effect Sizes ◽  
Forest Plot ◽  
Point Estimates ◽  
Aggregate Effect ◽  
The Individual ◽  
Meta Analyses ◽  
Heterogeneous Effect ◽  
Intuitive Interpretation

‘Classic’ forest plots show the effect sizes from individual studies and the aggregate effect from a meta-analysis. However, in ecology and evolution meta-analyses routinely contain over 100 effect sizes, making the classic forest plot of limited use. We surveyed 102 meta-analyses in ecology and evolution, finding that only 11% use the classic forest plot. Instead, most used a ‘forest-like plot’, showing point estimates (with 95% confidence intervals; CIs) from a series of subgroups or categories in a meta-regression. We propose a modification of the forest-like plot, which we name the ‘orchard plot’. Orchard plots, in addition to showing overall mean effects and CIs from meta-analyses/regressions, also includes 95% prediction intervals (PIs), and the individual effect sizes scaled by their precision. The PI allows the user and reader to see the range in which an effect size from a future study may be expected to fall. The PI, therefore, provides an intuitive interpretation of any heterogeneity in the data. Supplementing the PI, the inclusion of underlying effect sizes also allows the user to see any influential or outlying effect sizes. We showcase the orchard plot with example datasets from ecology and evolution, using the R package, orchard, including several functions for visualizing meta-analytic data using forest-plot derivatives. We consider the orchard plot as a variant on the classic forest plot, cultivated to the needs of meta-analysts in ecology and evolution. Hopefully, the orchard plot will prove fruitful for visualizing large collections of heterogeneous effect sizes regardless of the field of study.

Identification of and Correction for Publication Bias: Comment

2019 ◽  
Author(s):  
Amanda Kvarven ◽  
Eirik Strømland ◽  
Magnus Johannesson
Keyword(s):  
Publication Bias ◽  
False Positive ◽  
Large Scale ◽  
Meta Analysis ◽  
False Positive Rate ◽  
Effect Sizes ◽  
Replication Studies ◽  
Moderate Reduction ◽  
Positive Rate ◽  
Meta Analyses

Andrews & Kasy (2019) propose an approach for adjusting effect sizes in meta-analysis for publication bias. We use the Andrews-Kasy estimator to adjust the result of 15 meta-analyses and compare the adjusted results to 15 large-scale multiple labs replication studies estimating the same effects. The pre-registered replications provide precisely estimated effect sizes, which do not suffer from publication bias. The Andrews-Kasy approach leads to a moderate reduction of the inflated effect sizes in the meta-analyses. However, the approach still overestimates effect sizes by a factor of about two or more and has an estimated false positive rate of between 57% and 100%.

scholarly journals Effects of Sport-Based Interventions on Children’s Executive Function: A Systematic Review and Meta-Analysis

2021 ◽  
Vol 11 (6) ◽  
pp. 755
Author(s):  
Falonn Contreras-Osorio ◽  
Christian Campos-Jara ◽  
Cristian Martínez-Salazar ◽  
Luis Chirosa-Ríos ◽  
Darío Martínez-García
Keyword(s):  
Systematic Review ◽  
Working Memory ◽  
Executive Function ◽  
Inhibitory Control ◽  
Cognitive Flexibility ◽  
Meta Analysis ◽  
Scientific Evidence ◽  
Healthy Children ◽  
Meta Analyses ◽  
The Impact

One of the most studied aspects of children’s cognitive development is that of the development of the executive function, and research has shown that physical activity has been demonstrated as a key factor in its enhancement. This meta-analysis aims to assess the impact of specific sports interventions on the executive function of children and teenagers. A systematic review was carried out on 1 November 2020 to search for published scientific evidence that analysed different sports programs that possibly affected executive function in students. Longitudinal studies, which assessed the effects of sports interventions on subjects between 6 and 18 years old, were identified through a systematic search of the four principal electronic databases: Web of Science, PubMed, Scopus, and EBSCO. A total of eight studies, with 424 subjects overall, met the inclusion criteria and were classified based on one or more of the following categories: working memory, inhibitory control, and cognitive flexibility. The random-effects model for meta-analyses was performed with RevMan version 5.3 to facilitate the analysis of the studies. Large effect sizes were found in all categories: working memory (ES −1.25; 95% CI −1.70; −0.79; p < 0.0001); inhibitory control (ES −1.30; 95% CI −1.98; −0.63; p < 0.00001); and cognitive flexibility (ES −1.52; 95% CI −2.20; −0.83; p < 0.00001). Our analysis concluded that healthy children and teenagers should be encouraged to practice sports in order to improve their executive function at every stage of their development.

scholarly journals A protocol for the systematic review and meta-analysis of thigmotactic behaviour in the open field test in rodent models associated with persistent pain

2021 ◽  
Vol 5 (1) ◽  
pp. e100135
Author(s):  
Xue Ying Zhang ◽  
Jan Vollert ◽  
Emily S Sena ◽  
Andrew SC Rice ◽  
Nadia Soliman
Keyword(s):  
Systematic Review ◽  
Outcome Measure ◽  
Meta Analysis ◽  
Persistent Pain ◽  
Effect Sizes ◽  
Bias Assessment ◽  
Animal Pain ◽  
Trim And Fill ◽  
Meta Analyses ◽  
The Impact

ObjectiveThigmotaxis is an innate predator avoidance behaviour of rodents and is enhanced when animals are under stress. It is characterised by the preference of a rodent to seek shelter, rather than expose itself to the aversive open area. The behaviour has been proposed to be a measurable construct that can address the impact of pain on rodent behaviour. This systematic review will assess whether thigmotaxis can be influenced by experimental persistent pain and attenuated by pharmacological interventions in rodents.Search strategyWe will conduct search on three electronic databases to identify studies in which thigmotaxis was used as an outcome measure contextualised to a rodent model associated with persistent pain. All studies published until the date of the search will be considered.Screening and annotationTwo independent reviewers will screen studies based on the order of (1) titles and abstracts, and (2) full texts.Data management and reportingFor meta-analysis, we will extract thigmotactic behavioural data and calculate effect sizes. Effect sizes will be combined using a random-effects model. We will assess heterogeneity and identify sources of heterogeneity. A risk-of-bias assessment will be conducted to evaluate study quality. Publication bias will be assessed using funnel plots, Egger’s regression and trim-and-fill analysis. We will also extract stimulus-evoked limb withdrawal data to assess its correlation with thigmotaxis in the same animals. The evidence obtained will provide a comprehensive understanding of the strengths and limitations of using thigmotactic outcome measure in animal pain research so that future experimental designs can be optimised. We will follow the Preferred Reporting Items for Systematic Reviews and Meta-Analyses reporting guidelines and disseminate the review findings through publication and conference presentation.

scholarly journals Pre-post effect sizes should be avoided in meta-analyses

2016 ◽  
Vol 26 (4) ◽  
pp. 364-368 ◽  
Author(s):  
P. Cuijpers ◽  
E. Weitz ◽  
I. A. Cristea ◽  
J. Twisk
Keyword(s):  
Comparison Group ◽  
Meta Analysis ◽  
Effect Sizes ◽  
Behaviour Therapy ◽  
Natural Processes ◽  
Cognitive Behaviour ◽  
Post Test ◽  
The Difference ◽  
Meta Analyses ◽  
Highly Cited

AimsThe standardised mean difference (SMD) is one of the most used effect sizes to indicate the effects of treatments. It indicates the difference between a treatment and comparison group after treatment has ended, in terms of standard deviations. Some meta-analyses, including several highly cited and influential ones, use the pre-post SMD, indicating the difference between baseline and post-test within one (treatment group).MethodsIn this paper, we argue that these pre-post SMDs should be avoided in meta-analyses and we describe the arguments why pre-post SMDs can result in biased outcomes.ResultsOne important reason why pre-post SMDs should be avoided is that the scores on baseline and post-test are not independent of each other. The value for the correlation should be used in the calculation of the SMD, while this value is typically not known. We used data from an ‘individual patient data’ meta-analysis of trials comparing cognitive behaviour therapy and anti-depressive medication, to show that this problem can lead to considerable errors in the estimation of the SMDs. Another even more important reason why pre-post SMDs should be avoided in meta-analyses is that they are influenced by natural processes and characteristics of the patients and settings, and these cannot be discerned from the effects of the intervention. Between-group SMDs are much better because they control for such variables and these variables only affect the between group SMD when they are related to the effects of the intervention.ConclusionsWe conclude that pre-post SMDs should be avoided in meta-analyses as using them probably results in biased outcomes.

Meta-analysis of effect sizes reported at multiple time points: A multivariate approach

2012 ◽  
Vol 9 (5) ◽  
pp. 610-620 ◽  
Author(s):  
Thomas A Trikalinos ◽  
Ingram Olkin
Keyword(s):  
Random Effects ◽  
Treatment Effects ◽  
Multivariate Analyses ◽  
Meta Analysis ◽  
Effect Sizes ◽  
Multiple Time ◽  
Time Points ◽  
Fixed And Random Effects ◽  
Multiple Time Points ◽  
Meta Analyses

Background Many comparative studies report results at multiple time points. Such data are correlated because they pertain to the same patients, but are typically meta-analyzed as separate quantitative syntheses at each time point, ignoring the correlations between time points. Purpose To develop a meta-analytic approach that estimates treatment effects at successive time points and takes account of the stochastic dependencies of those effects. Methods We present both fixed and random effects methods for multivariate meta-analysis of effect sizes reported at multiple time points. We provide formulas for calculating the covariance (and correlations) of the effect sizes at successive time points for four common metrics (log odds ratio, log risk ratio, risk difference, and arcsine difference) based on data reported in the primary studies. We work through an example of a meta-analysis of 17 randomized trials of radiotherapy and chemotherapy versus radiotherapy alone for the postoperative treatment of patients with malignant gliomas, where in each trial survival is assessed at 6, 12, 18, and 24 months post randomization. We also provide software code for the main analyses described in the article. Results We discuss the estimation of fixed and random effects models and explore five options for the structure of the covariance matrix of the random effects. In the example, we compare separate (univariate) meta-analyses at each of the four time points with joint analyses across all four time points using the proposed methods. Although results of univariate and multivariate analyses are generally similar in the example, there are small differences in the magnitude of the effect sizes and the corresponding standard errors. We also discuss conditional multivariate analyses where one compares treatment effects at later time points given observed data at earlier time points. Limitations Simulation and empirical studies are needed to clarify the gains of multivariate analyses compared with separate meta-analyses under a variety of conditions. Conclusions Data reported at multiple time points are multivariate in nature and are efficiently analyzed using multivariate methods. The latter are an attractive alternative or complement to performing separate meta-analyses.

The effectiveness of serious games in improving memory among elderly people with cognitive impairment: A systematic review and meta-analysis (Preprint)

2021 ◽  
Author(s):  
Alaa Abd-alrazaq ◽  
Dari Alhuwail ◽  
Eiman Al-Jafar ◽  
Arfan Ahmed ◽  
Shuja Mohd Reagu ◽  
...  
Keyword(s):  
Systematic Review ◽  
Working Memory ◽  
Cognitive Impairment ◽  
Verbal Memory ◽  
Serious Games ◽  
Meta Analysis ◽  
The Elderly ◽  
Quality Of Evidence ◽  
Meta Analyses

BACKGROUND Memory, one of the main cognitive functions, is known to decline by age. Serious games have been used for improving memory among the elderly. The effectiveness of serious games in improving memory has been investigated by several systematic reviews; however, they are limited by design and methodological weaknesses. OBJECTIVE This study aims to assess the effectiveness of serious games in improving memory among the elderly with cognitive impairment. METHODS A systematic review of randomized controlled trials (RCTs) was carried out. The search sources included searching 8 databases, screening reference lists of the included studies and relevant reviews, and checking studies that cited the included studies. Two reviewers independently carried out the study selection, data extraction, risk of bias assessment, and quality of evidence appraisal. Extracted data were synthesized using a narrative approach and a statistical approach (i.e., meta-analysis), as appropriate. RESULTS Out of 466 citations retrieved, 18 studies met the eligibility criteria of this review. Of those, 15 RCTs were eventually included in 10 meta-analyses. We found that serious games are more effective than no or passive interventions in improving non-verbal memory (P=0.002) and working memory (P=0.02), but not verbal memory (P=0.13). The review also showed that serious games are more effective than conventional exercises in improving verbal memory (P=0.004), but not for non-verbal memory (P=0.12) and working memory (P=0.49). Serious games were as effective as conventional cognitive activities in improving verbal memory (P=0.07), non-verbal memory (P=0.94), and working memory (P=0.08) among the elderly with cognitive impairment. Lastly, the effect of adaptive serious games on working memory was comparable to non-adaptive serious games (P=0.08). CONCLUSIONS Serious games have the potential to improve verbal, non-verbal, and working memory among elderly people with cognitive impairment. However, our findings should be interpreted cautiously given that most meta-analyses were based on a few studies (≤3) and judged to have a low quality of evidence. Therefore, serious games should be offered as supplemental to existing proven and safe interventions, rather than a complete substitute until further, more robust evidence is available. Future studies should investigate the short and long-term effects of serious games on memory and other cognitive abilities among people from different age groups with or without cognitive impairment.

Sign in / Sign up

Export Citation Format

Share Document