scholarly journals From problem-solving to sensemaking: A comparative meta-analysis of preparatory approaches for future learning

2021 ◽  
Author(s):  
Tanmay Sinha ◽  
Manu Kapur
Keyword(s):  
Problem Solving ◽  
Meta Analysis ◽  
Effect Sizes ◽  
Bayesian Analyses ◽  
Ps I ◽  
Significant Difference ◽  
Small Effect Size ◽  
Moderate Effect ◽  
The Difference ◽  
Future Learning

Against the backdrop of a growing body of research showing the effectiveness of problem-solving activities followed by instruction (PS-I), we report a meta-analysis of the effectiveness of three broad categories of preparatory activities on future learning from instruction: (a) problem-solving followed by instruction (PS-I), (b) scaffolded problem-solving followed by instruction (+PS-I), or (c) an alternative sensemaking activity followed by instruction (!PS-I)? We examined 118 experimental comparisons spanning 33 articles that compared PS-I with +PS-I and !PS-I designs. Although scaffolding was descriptively associated with a small effect size, there was no significant difference relative to PS-I (Hedge’s g -0.08 [95% CI -0.20, 0.04]). Additionally, PS-I exhibited a non-significant moderate effect (Hedge’s g 0.22 [95% CI -0.06, 0.51]) compared to !PS-I. Bayesian analyses strongly favored the null hypothesis for the comparison of PS-I with +PS-I (suggesting a 99% probability of the difference in effect between these designs being less than 0.2), while it suggested a 40.37% probability of at least a moderate effect favoring PS-I relative to !PS-I. Further, the estimation of true effect sizes after accounting for the publication bias suggested moderate effect sizes in favor of PS-I, when considering both comparison conditions +PS-I (Hedge’s g 0.55) and !PS-I (Hedge’s g 0.64).

scholarly journals When Problem Solving Followed by Instruction Works: Evidence for Productive Failure

2021 ◽  
pp. 003465432110191
Author(s):  
Tanmay Sinha ◽  
Manu Kapur
Keyword(s):  
Problem Solving ◽  
Meta Analysis ◽  
Effect Sizes ◽  
Productive Failure ◽  
Ps I ◽  
Initial Learning ◽  
Younger Age ◽  
Quasi Experimental ◽  
General Skills ◽  
Passionate Debate

When learning a new concept, should students engage in problem solving followed by instruction (PS-I) or instruction followed by problem solving (I-PS)? Noting that there is a passionate debate about the design of initial learning, we report evidence from a meta-analysis of 53 studies with 166 comparisons that compared PS-I with I-PS design. Our results showed a significant, moderate effect in favor of PS-I (Hedge’s g 0.36 [95% confidence interval 0.20; 0.51]). The effects were even stronger (Hedge’s g ranging between 0.37 and 0.58) when PS-I was implemented with high fidelity to the principles of Productive Failure (PF), a subset variant of PS-I design. Students’ grade level, intervention time span, and its (quasi-)experimental nature contributed to the efficacy of PS-I over I-PS designs. Contrasting trends were, however, observed for younger age learners (second to fifth graders) and for the learning of domain-general skills, for which effect sizes favored I-PS. Overall, an estimation of true effect sizes after accounting for publication bias suggested a strong effect size favoring PS-I (Hedge’s g 0.87).

A-25 Paced Auditory Serial Addition Test in Individuals with Cocaine Versus Methamphetamine Dependence

2019 ◽  
Vol 34 (6) ◽  
pp. 884-884
Author(s):  
A Pollard ◽  
A Hauson ◽  
N Stelmach ◽  
S Sarkissians ◽  
A Walker ◽  
...  
Keyword(s):  
Neuropsychological Functioning ◽  
Meta Analysis ◽  
Effect Sizes ◽  
Data Synthesis ◽  
Methamphetamine Dependence ◽  
Significant Difference ◽  
Calculated Effect ◽  
Axis I ◽  
The Difference ◽  
Serial Addition

Abstract Objective Research suggests that cocaine and methamphetamine differ in their impact on executive functions (EF). The Paced Auditory Serial Addition Test (PASAT) is used to assess working memory; a component of EF. The purpose of this meta-analysis was to examine the difference between the effect of these two drugs on PASAT scores. Data Selection Three researchers independently searched nine databases (e.g., PsycINFO, Pubmed, ProceedingsFirst), extracted required data, and calculated effect sizes. Inclusion criteria identified studies that had (a) compared cocaine or methamphetamine dependent groups to healthy controls and (b) matched groups on either age, education, or IQ (at least 2 out of 3). Studies were excluded if participants were reported to have Axis I diagnoses (other than cocaine or methamphetamine dependence) or comorbidities known to impact neuropsychological functioning. Six articles were coded and analyzed for the current study. Data Synthesis Cocaine studies showed a medium statistically significant effect size (g = 0.370, p = 0.020), while methamphetamine did not (g = 0.198, p = 0.172). There was no heterogeneity in effect sizes for both drugs. Subgroup analysis found no significant difference between the two drugs on the PASAT (Q-between = 0.646, p = 0.421). Conclusions In contrast to methamphetamine, cocaine is associated with poorer performance on PASAT. This is in line with previous studies that found that cocaine had more significant impact on EF than methamphetamine. Given the preliminary nature of this meta-analysis and the small number of studies on the topic, future primary studies should directly contrast how these two drugs impact EF.

scholarly journals A meta-analysis of effects of Internet CBT for anxiety disorders: open community versus clinical service recruitment (Preprint)

2018 ◽  
Author(s):  
Geke Romijn ◽  
Neeltje Batelaan ◽  
Robin Kok ◽  
Jeroen Koning ◽  
Anton van Balkom ◽  
...  
Keyword(s):  
Anxiety Disorders ◽  
Effect Size ◽  
Meta Analysis ◽  
Behavioural Therapy ◽  
Routine Care ◽  
Clinical Service ◽  
Effect Sizes ◽  
Current Evidence ◽  
Significant Difference ◽  
Small Effect Size

BACKGROUND Ample studies show the high potential of Internet-delivered cognitive behavioural therapy (iCBT) for anxiety disorders. However, evidence for its effectiveness in routine care is scarce. We conducted a meta-analysis to compare results obtained in trials with open recruitment to results obtained in trials with clinical service recruitment and updated previous findings. OBJECTIVE The present study thus aims 1) to update the current evidence on iCBT for anxiety disorders by assessing overall efficacy and 2) to assess whether open recruitment results are comparable to those with recruitment in a routine care context. METHODS Randomised controlled trials were included in which the effects of iCBT for anxiety disorders were compared to wait-list controls (WLC) or face-to-face (f2f) CBT controls. Pooled effect sizes based on anxiety measures (primary outcome), depression and quality of life measures (secondary outcomes) were computed. RESULTS We included 42 studies with 53 comparisons (43 open recruitment comparisons and 10 clinical recruitment comparisons). Overall effect size of (1) iCBT versus WLC was g=0.72 (p<.001) and (2) iCBT versus f2f CBT g=0.12 (p=0.11). Subgroup analyses revealed (3) iCBT clinical recruitment studies with WLC as comparator: g=0.29 (p<0.01), while iCBT open recruitment studies with WLC comparators showed a higher significant effect of g=0.76 (p<0.001). (4) Clinical recruitment studies comparing iCBT to f2f CBT revealed a non-significant and small effect size g=0.06 (p=0.51) while open recruitment studies comparing iCBT to f2f CBT showed an effect of g=0.19 (p=0.09). Comparing clinical recruitment trials with open recruitment trials showed a significant difference in effect size (p<.001) based on WLC comparators, and no significant difference (p=0.38) based on f2f CBT comparators. CONCLUSIONS iCBT is effective in samples recruited in routine clinical practice, but effect sizes are smaller than those found in open recruitment trials. More studies with routine care populations are needed to further validate these findings.

scholarly journals Pre-post effect sizes should be avoided in meta-analyses

2016 ◽  
Vol 26 (4) ◽  
pp. 364-368 ◽  
Author(s):  
P. Cuijpers ◽  
E. Weitz ◽  
I. A. Cristea ◽  
J. Twisk
Keyword(s):  
Comparison Group ◽  
Meta Analysis ◽  
Effect Sizes ◽  
Behaviour Therapy ◽  
Natural Processes ◽  
Cognitive Behaviour ◽  
Post Test ◽  
The Difference ◽  
Meta Analyses ◽  
Highly Cited

AimsThe standardised mean difference (SMD) is one of the most used effect sizes to indicate the effects of treatments. It indicates the difference between a treatment and comparison group after treatment has ended, in terms of standard deviations. Some meta-analyses, including several highly cited and influential ones, use the pre-post SMD, indicating the difference between baseline and post-test within one (treatment group).MethodsIn this paper, we argue that these pre-post SMDs should be avoided in meta-analyses and we describe the arguments why pre-post SMDs can result in biased outcomes.ResultsOne important reason why pre-post SMDs should be avoided is that the scores on baseline and post-test are not independent of each other. The value for the correlation should be used in the calculation of the SMD, while this value is typically not known. We used data from an ‘individual patient data’ meta-analysis of trials comparing cognitive behaviour therapy and anti-depressive medication, to show that this problem can lead to considerable errors in the estimation of the SMDs. Another even more important reason why pre-post SMDs should be avoided in meta-analyses is that they are influenced by natural processes and characteristics of the patients and settings, and these cannot be discerned from the effects of the intervention. Between-group SMDs are much better because they control for such variables and these variables only affect the between group SMD when they are related to the effects of the intervention.ConclusionsWe conclude that pre-post SMDs should be avoided in meta-analyses as using them probably results in biased outcomes.

scholarly journals Limited Evidence for the Effect of Red Color on Cognitive Performance: A Meta-Analysis

2020 ◽  
Author(s):  
Timo Gnambs
Keyword(s):  
Test Performance ◽  
Meta Analysis ◽  
Effect Sizes ◽  
Limited Evidence ◽  
Cognitive Domains ◽  
Evidential Value ◽  
Red Color ◽  
Significant Difference ◽  
Color Priming ◽  
Different Populations

Red color supposedly affects cognitive functioning in achievement situations and impairs test performance. Although this has been shown for different cognitive domains in different populations and cultural contexts, recent studies including close replications failed to corroborate this effect. Reported here is a random-effects meta-analysis of 67 effect sizes (38 samples) that compared test performance after viewing red or a control color. For anagram tests and knowledge tests no significant difference between color conditions was found (Cohen’s d of -0.06 and -0.04); for reasoning tests the pooled effect of d = -0.34, 95% CI [-0.61, -0.06] indicated significantly lower scores in the red condition. The cumulative meta-analysis revealed substantially larger effects in initial studies as compared to subsequent research. After correcting for publication bias no evidential value for an effect of red color on intellectual performance was available. The review casts doubt on the existence of a robust color priming effect in achievement situations.

scholarly journals A-17 Category Test performance in individuals with alcohol versus methamphetamine dependence

2019 ◽  
Vol 34 (6) ◽  
pp. 876-876
Author(s):  
A Walker ◽  
A Hauson ◽  
S Sarkissians ◽  
A Pollard ◽  
C Flora-Tostado ◽  
...  
Keyword(s):  
Effect Size ◽  
Test Performance ◽  
Neuropsychological Functioning ◽  
Meta Analysis ◽  
Effect Sizes ◽  
Significant Heterogeneity ◽  
Category Test ◽  
Methamphetamine Dependence ◽  
Significant Difference ◽  
Axis I

Abstract Objective The Category Test (CT) has consistently been found to be sensitive at detecting the effects of alcohol on the brain. However, this test has not been as widely used in examining the effects of methamphetamine. The current meta-analysis compared effect sizes of studies that have examined performance on the CT in alcohol versus methamphetamine dependent participants. Data selection Three researchers independently searched nine databases (e.g., PsycINFO, Pubmed, ProceedingsFirst), extracted required data, and calculated effect sizes. Inclusion criteria identified studies that had (a) compared alcohol or methamphetamine dependent groups to healthy controls and (b) matched groups on either age, education, or IQ (at least 2 out of 3). Studies were excluded if participants were reported to have Axis I diagnoses (other than alcohol or methamphetamine dependence) or comorbidities known to impact neuropsychological functioning. Sixteen articles were coded and analyzed for the current study. Data synthesis Alcohol studies showed a large effect size (g = 0.745, p < 0.001) while methamphetamine studies evidenced a moderate effect size (g = 0.406, p = 0.001); both without statistically significant heterogeneity (I2 = 0). Subgroup analysis revealed a statistically significant difference between the effect sizes from alcohol versus methamphetamine studies (Q-between = 5.647, p = 0.017). Conclusions The CT is sensitive to the effects of both alcohol and methamphetamine and should be considered when examining dependent patients who might exhibit problem solving, concept formation, and set loss difficulties in everyday living.

HOW DO DIFFERENT FORMS OF GLOSSING CONTRIBUTE TO L2 VOCABULARY LEARNING FROM READING?

2020 ◽  
Vol 42 (2) ◽  
pp. 411-438 ◽  
Author(s):  
Akifumi Yanagisawa ◽  
Stuart Webb ◽  
Takumi Uchihara
Keyword(s):  
Vocabulary Learning ◽  
Meta Analysis ◽  
Effect Sizes ◽  
Inclusion Criteria ◽  
Learner Characteristics ◽  
Moderator Variables ◽  
Auditory Learning ◽  
Significant Difference ◽  
L2 Vocabulary ◽  
Potential Moderator

AbstractThis meta-analysis investigated the overall effects of glossing on L2 vocabulary learning from reading and the influence of potential moderator variables: gloss format (type, language, mode) and text and learner characteristics. A total of 359 effect sizes from 42 studies (N = 3802) meeting the inclusion criteria were meta-analyzed. The results indicated that glossed reading led to significantly greater learning of words (45.3% and 33.4% on immediate and delayed posttests, respectively) than nonglossed reading (26.6% and 19.8%). Multiple-choice glosses were the most effective, and in-text glosses and glossaries were the least effective gloss types. L1 glosses yielded greater learning than L2 glosses. We found no interaction between language (L1, L2) and proficiency (beginner, intermediate, advanced), and no significant difference among modes of glossing (textual, pictorial, auditory). Learning gains were moderated by test formats (recall, recognition, other), comprehension of text, and proficiency.

scholarly journals Waist height ratio predicts chronic kidney disease: a systematic review and meta-analysis, 1998–2019

2019 ◽  
Vol 77 (1) ◽  
Author(s):  
Ling Liu ◽  
Yanqiu Wang ◽  
Wanjun Zhang ◽  
Weiwei Chang ◽  
Yuelong Jin ◽  
...  
Keyword(s):  
Chronic Kidney Disease ◽  
Kidney Disease ◽  
Statistical Difference ◽  
Meta Analysis ◽  
Area Under The Curve ◽  
Cochrane Library ◽  
Height Ratio ◽  
Physical Measurements ◽  
Significant Difference ◽  
The Difference

Abstract Background The incidence of chronic kidney disease (CKD) increases each year, and obesity is an important risk factor for CKD. The main anthropometric indicators currently reflecting obesity are body mass index (BMI), waist circumference (WC), waist-to-hip ratio (WHR) and waist-to-height ratio (WHtR), but the rationality and merits of various indicators vary. This article aims to find whether the WHtR is a more suitable physical measurement that can predict CKD. Methods Pubmed, embase, the cochrane library, and web of science were systematically searched for articles published between 1998 and 2019 screening CKD through physical indicators. Two reviewers independently screened the literature according to the inclusion and exclusion criteria, extracted the data, and evaluated the quality of the methodology included in the study. Meta-analysis used the Stata 12.0 software. Results Nine studies were included, with a total of 202,283 subjects. Meta-analysis showed that according to the analysis of different genders in 6 studies, regardless of sex, WHtR was the area with the largest area under the curve (AUC). Except WHtR and visceral fat index (VFI) in women which showed no statistical difference, WHtR and other indicators were statistically different. In three studies without gender-based stratification, the area under the curve AUC for WHtR remained the largest, but only the difference between WHtR and BMI was statistically significant. When the Chinese population was considered as a subgroup, the area under the curve AUC for WHtR was the largest. Except for WHtR and VFI which showed no statistical difference in women, there was a statistically significant difference between WHtR and other indicators in men and women. Conclusion WHtR could be better prediction for CKD relative to other physical measurements. It also requires higher-quality prospective studies to verify the clinical application of WHtR.

scholarly journals The role of perineural invasion in penile cancer: a meta-analysis and systematic review

2018 ◽  
Vol 38 (5) ◽  
Author(s):  
Xiang Zhou ◽  
Feng Qi ◽  
Ruhua Zhou ◽  
Shangqian Wang ◽  
Yamin Wang ◽  
...  
Keyword(s):  
Systematic Review ◽  
Penile Cancer ◽  
Perineural Invasion ◽  
Meta Analysis ◽  
Oncologic Outcome ◽  
Cancer Specific Survival ◽  
Significant Difference ◽  
Predictive Role ◽  
The Difference

The significance of perineural invasion (PNI) present in penile cancer (PC) is controversial. In order to clarify the predictive role of PNI in the inguinal lymph node (ILN) metastases (ILNM) and oncologic outcome of patients, we performed this meta-analysis and systematic review. The search of PubMed, Embase, and Web of Science was conducted for appropriate studies, up to 20 January 2018. The pooled odds ratio (OR) and hazard ratio (HR) with their 95% confidence interval (CI) were applied to evaluate the difference in ILNM and oncologic outcome between patients present with PNI and those who were absent. A total of 298 in 1001 patients present with PNI were identified in current meta-analysis and systematic review. Significant difference was observed in ILNM between PNI present and absent from patients with PC (OR = 2.98, 95% CI = 2.00–4.45). Patients present with PNI had a worse cancer-specific survival (CSS) (HR = 3.58, 95% CI = 1.70–7.55) and a higher cancer-specific mortality (CSM) (HR = 2.20, 95% CI = 1.06–3.82) than those cases without PNI. This meta-analysis and systematic review demonstrated the predictive role of PNI in ILNM, CSS, and CSM for PC patients.

Velcro Ties in Early Postoperative Pediatric Tracheostomy Care: A Systematic Review and Meta-analysis

2020 ◽  
pp. 019459982096472
Author(s):  
Brent A. Chang ◽  
Joshua Gurberg ◽  
Erin Ware ◽  
Kimberly Luu
Keyword(s):  
Meta Analysis ◽  
Prospective Trial ◽  
Final Analysis ◽  
Cochrane Central Register ◽  
Limited Data ◽  
Cochrane Database ◽  
Central Register ◽  
Significant Difference ◽  
Randomized Prospective Trial ◽  
The Difference

Objective To systematically review the literature to determine the difference in complications between standard twill and Velcro ties following pediatric tracheostomy. Data Sources MEDLINE, Embase, the Cochrane Database of Systematic Reviews, the Cochrane Central Register of Controlled Trials, Web of Science, and CINAHL Plus were searched up to August 2020. Review Methods Two authors independently screened articles for eligibility. Retrospective and prospective studies were included as long as there was a direct comparison between twill and Velcro ties. Quantitative and qualitative analysis was performed. The main outcomes were skin-related complications and accidental decannulation. Results Three studies were included in the final analysis: 1 randomized prospective trial and 2 retrospective studies. There were 238 patients total (137 twill, 101 Velcro). Combined analysis showed skin-related complications in 23% of the Velcro group and 44% of the twill group. Meta-analysis for skin-related complications showed no significant difference when comparing Velcro with standard twill ties (risk ratio, 0.53 [95% CI, 0.24-1.17]; P = .12, n = 238 participants from 3 studies, I2 = 66%). Accidental decannulation rates were overall low and comparable between groups (1.0% of twill, 1.4% of Velcro). Conclusion Based on limited data, skin-related complications were not statistically different between Velcro and twill ties. Accidental decannulation is rare with Velcro and standard twill ties, and both are viable options following pediatric tracheostomy.

Sign in / Sign up

Export Citation Format

Share Document