Multimedia design for learning: An overview of reviews with meta-meta-analysis

2021 ◽  
Author(s):  
Michael Noetel ◽  
Shantell Griffith ◽  
Oscar Delaney ◽  
Nicole Rose Harris ◽  
Taren Sanders ◽  
...  
Keyword(s):  
Cognitive Load ◽  
Cognitive Theory ◽  
Meta Analysis ◽  
Learning Theories ◽  
Pedagogical Agents ◽  
Seductive Details ◽  
Multimedia Design ◽  
Design For Learning ◽  
Overview Of Systematic Reviews ◽  
Meta Analyses

Multimedia is ubiquitous in 21st-century education. Cognitive Load Theory and the Cognitive Theory of Multimedia Learning both postulate that the quality of multimedia design heavily influences learning. We sought to identify how to best design multimedia, and review how well those learning theories held up to meta-analyses. We conducted an overview of systematic reviews that tested the effects of multimedia design on learning or cognitive load. We found 29 reviews including 1,189 studies and 78,177 participants. We found 11 design principles that demonstrated significant, positive, meta-analytic effects on learning, and five that significantly improved management of cognitive load. The largest benefits were for captioning second-language videos, temporal/spatial contiguity, and signaling. We also found robust evidence for modality, animation, coherence/removing seductive details, anthropomorphics, segmentation, personalisation, pedagogical agents, and verbal redundancy effects. Good design was more important for more complex materials, and in system-paced environments (e.g., lectures) than self-paced ones (e.g., websites). Results supported many tenets of both theories. We highlight a range of evidence-based strategies that could be implemented by educators.

scholarly journals Overview of systematic reviews - a new type of study. Part II

2014 ◽  
Vol 133 (3) ◽  
pp. 206-217 ◽  
Author(s):  
Valter Silva ◽  
Antonio Jose Grande ◽  
Alan Pedrosa Viegas de Carvalho ◽  
Ana Luiza Cabrera Martimbianco ◽  
Rachel Riera
Keyword(s):  
Systematic Reviews ◽  
Methodological Quality ◽  
Meta Analysis ◽  
Quality Of Evidence ◽  
Overview Of Systematic Reviews ◽  
New Type ◽  
The Mean ◽  
Meta Analyses ◽  
General Profile

CONTEXT AND OBJECTIVE: Overviews of Systematic Reviews (OoRs) are a new type of study in which multiple evidence from systematic reviews (SRs) is compiled into an accessible and useful document. The aim here was to describe the state of the art and critically assess Cochrane OoRs that have been published.DESIGN AND SETTING: Descriptive study conducted at a research center.METHODS: The OoRs identified through the filter developed in Part I of this study were evaluated in five domains: methodological quality; quality of evidence; implications for practice; general profile of OoRs; and length of work.RESULTS: All 13 OoRs included had high methodological quality. Some OoRs did not present sufficient data to judge the quality of evidence; using sensitivity analysis, the quality of evidence of the OoRs increased. Regarding implications for practice, 64% of the interventions were judged as beneficial or harmful, while 36% of them showed insufficient evidence for judgment. It is expected (with 95% confidence interval) that one OoR will include 9,462 to 64,469 patients, 9 to 29 systematic reviews and 80 to 344 primary studies, and assess 6 to 21 interventions; and that 50 to 92% of OoRs will produce meta-analysis. The OoRs generated 2 to 26 meta-analyses over a period of 18 to 31 months.CONCLUSION: The OoRs presented high methodological quality; the quality of evidence tended to be moderate/high; most interventions were judged to be beneficial/harmful; the mean length of work was 24 months. The OoR profile adds power to decision-making.

scholarly journals Intake of Unprocessed and Processed Meat and the Association with Cardiovascular Disease: An Overview of Systematic Reviews

Nutrients ◽  
2021 ◽  
Vol 13 (10) ◽  
pp. 3303
Author(s):  
Marianne Uhre Jakobsen ◽  
Anette Bysted ◽  
Heddie Mejborn ◽  
Anders Stockmarr ◽  
Ellen Trolle
Keyword(s):  
Cardiovascular Disease ◽  
Cohort Studies ◽  
Systematic Reviews ◽  
Meta Analysis ◽  
Positive Association ◽  
Red Meat ◽  
Processed Meat ◽  
Overview Of Systematic Reviews ◽  
Meta Analyses

We conducted an overview of systematic reviews to summarize reviews of cohort studies on intake of unprocessed and processed meat and the risk of cardiovascular disease (CVD), coronary heart disease (CHD), and stroke. Systematic reviews of cohort studies published between January 2010 and August 2020 were identified through a systematic literature search in PubMed, Embase, and Web of Science. The quality of how each review was conducted was assessed and the overall confidence in the results of each review was rated using AMSTAR 2. The quality of evidence of each meta-analysis was graded using NutriGrade. Three reviews were included, with meta-analyses of unprocessed red meat and CVD (n = 1) and stroke (n = 2); unprocessed poultry and stroke (n = 1); and processed meat and CVD (n = 1), CHD (n = 1), and stroke (n = 3). The overall confidence in the results of each review was rated as critically low. The meta-evidence was graded moderate for a positive association between unprocessed red meat and stroke and moderate for a positive association between processed meat and CHD and stroke. For other associations the meta-evidence was graded as low or very low. In conclusion, the associations between unprocessed and processed meat with CVD and major subtypes of CVD have not been extensively investigated.

scholarly journals Ironic Effects of Thought Suppression: A Meta-Analysis

2019 ◽  
Author(s):  
Deming Wang ◽  
Martin S Hagger ◽  
Nikos Chatzisarantis
Keyword(s):  
Cognitive Load ◽  
Thought Suppression ◽  
Meta Analysis ◽  
Cognitive Resources ◽  
Rebound Effects ◽  
Meta Analyses ◽  
Ironic Process Theory ◽  
Ironic Process ◽  
Ironic Effects ◽  
Future Thought

The ironic effect of thought suppression refers to the phenomenon in which individuals trying to rid their mind of a target thought ironically experience greater levels of occurrence and accessibility of the thought compared to individuals that deliberately concentrate on the thought (Wegner, 1994). Ironic effects occurring after thought suppression, also known as rebound effects, have been consistently detected by previous meta-analyses. However, ironic effects that occur during thought suppression, also known as immediate enhancement effects, have been found to be largely absent. In the current meta-analysis, we test Wegner’s original proposition that detection of immediate enhancement effects is dependent on the cognitive load experienced by individuals when enacting thought suppression. Given that thought suppression is an effortful cognitive process, it is proposed that the introduction of additional cognitive load would compete for the allocation of existing cognitive resources and impair capacity for thought suppression. Studies (k = 31) consistent with Wegner’s original thought suppression paradigm were analysed. Consistent with our predictions, rebound effects were observed regardless of cognitive load while immediate enhancement effects were only observed in the presence of cognitive load. Implications are discussed in light of ironic process theory and suggestions for future thought suppression research provided.

scholarly journals An Overview of Systematic Reviews and Meta-Analyses on Acupuncture for Post-Acute Stroke Dysphagia

Geriatrics ◽  
2019 ◽  
Vol 4 (4) ◽  
pp. 68 ◽  
Author(s):  
Zi-Yu Tian ◽  
Xing Liao ◽  
Ying Gao ◽  
Shi-Bing Liang ◽  
Chong-Yang Zhang ◽  
...  
Keyword(s):  
Acute Stroke ◽  
Systematic Reviews ◽  
Primary Outcome ◽  
Acupuncture Treatment ◽  
Meta Analysis ◽  
Future Research ◽  
Randomized Controlled ◽  
Overview Of Systematic Reviews ◽  
Meta Analyses

Background: Many randomized controlled trials (RCTs) and systematic reviews (SRs) on acupuncture treatment for post-acute stroke dysphagia have been published. Conflicting results from different SRs necessitated an overview to summarize and assess the quality of this evidence to determine whether acupuncture is effective for this condition. The aim was to evaluate methodological quality and summarizing the evidence for important outcomes. Methods: Seven databases were searched for SRs and/or meta-analysis of RCTs and quasi-RCTs on acupuncture for post-acute stroke dysphagia. Two authors independently identified SRs and meta-analyses, collected data to assess the quality of included SRs and meta analyses according to the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) and the revised Assessment of Multiple Systematic Reviews (AMSTAR 2). Results: Searches yielded 382 SRs, 31 were included. The quality of 22 SRs was critically low, five SRs were low, and four Cochrane SRs were moderate when evaluated by AMSTAR2. A total of 17 SRs reported 85.2–96.3% of PRISMA items. Five SRs included explanatory RCTs, 16 SRs included pragmatic RCTs, and 10 SRs included both. Conclusion: Currently, evidence on the effectiveness of acupuncture on post-acute stroke dysphagia is of a low quality. The type of study appeared to have no direct influence on the result, but the primary outcome measures showed a relationship with the quality of SRs. High quality trials with large sample sizes should be the focus of future research.

scholarly journals Ironic Effects of Thought Suppression: A Meta-Analysis

2020 ◽  
Vol 15 (3) ◽  
pp. 778-793 ◽  
Author(s):  
Deming (Adam) Wang ◽  
Martin S. Hagger ◽  
Nikos L. D. Chatzisarantis
Keyword(s):  
Cognitive Load ◽  
Thought Suppression ◽  
Meta Analysis ◽  
Cognitive Resources ◽  
Rebound Effects ◽  
Meta Analyses ◽  
Ironic Process Theory ◽  
Ironic Process ◽  
Ironic Effects ◽  
Future Thought

The ironic effect of thought suppression refers to the phenomenon in which individuals trying to rid their mind of a target thought ironically experience greater levels of occurrence and accessibility of the thought compared with individuals who deliberately concentrate on the thought (Wegner, 1994, doi:10.1037/0033-295X.101.1.34). Ironic effects occurring after thought suppression, also known as rebound effects, were consistently detected by previous meta-analyses. However, ironic effects that occur during thought suppression, also known as immediate enhancement effects, were found to be largely absent. In this meta-analysis, we test Wegner’s original proposition that detection of immediate enhancement effects depends on the cognitive load experienced by individuals when enacting thought suppression. Given that thought suppression is an effortful cognitive process, we propose that the introduction of additional cognitive load would compete for the allocation of existing cognitive resources and impair capacity for thought suppression. Studies ( k = 31) consistent with Wegner’s original thought-suppression paradigm were analyzed. Consistent with our predictions, rebound effects were observed regardless of cognitive load, whereas immediate enhancement effects were observed only in the presence of cognitive load. We discuss implications in light of ironic-process theory and suggest future thought-suppression research.

scholarly journals An Overview of Systematic Reviews and Meta Analyses on Acupuncture for Post-Acute Stroke Dysphagia

2019 ◽  
Author(s):  
Zi-Yu Tian ◽  
Xing Liao ◽  
Ying Gao ◽  
Shi-Bing Liang ◽  
Chong-Yang Zhang ◽  
...  
Keyword(s):  
Acute Stroke ◽  
Systematic Reviews ◽  
Primary Outcome ◽  
Meta Analysis ◽  
Future Research ◽  
Overview Of Systematic Reviews ◽  
Registration Number ◽  
Meta Analyses ◽  
Quality Type

Background: Many randomized controlled trials (RCTs) and systematic reviews (SRs) on acupuncture treatment for post-acute stroke dysphagia have been published. Due to conflicting results an overview of SRs to summarize and assess the quality of this evidence to determine whether acupuncture is effective for this disease was conducted. Methods: Seven databases were searched for SRs and/or Meta-analysis of RCTs and quasi-RCTs on acupuncture for post-acute stroke dysphagia. Two authors independently identified SRs and meta-analyses, collected data to assess the quality of included SRs and meta analyses according to the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) and the revised Assessment of Multiple Systematic Reviews (AMSTAR 2). Results: 31 SRs were identified. Quality of 22 SRs was critically low, 5 SRs were low, and 4 Cochrane SRs were moderate when evaluated by AMSTAR2. 17 SRs reported 85.2-96.3% items of PRISMA. Five SRs included explanatory RCTs, 16 SRs included pragmatic RCTs, and 10 SRs included both. Conclusion: Currently evidence on the effectiveness of acupuncture on post-acute stroke dysphagia is low quality. Type of study appeared to have no direct influence on the result, but the primary outcome measures showed a relationship with the quality of SRs. High quality trials with large sample sizes should be the focus of future research. PROSPERO REGISTRATION NUMBER: CRD42019134163

scholarly journals Acupuncture for Primary Dysmenorrhea: An Overview of Systematic Reviews

2018 ◽  
Vol 2018 ◽  
pp. 1-11 ◽  
Author(s):  
Furong Zhang ◽  
Mingsheng Sun ◽  
Shanshan Han ◽  
Xiaoyu Shen ◽  
Yanan Luo ◽  
...  
Keyword(s):  
Systematic Reviews ◽  
Methodological Quality ◽  
Meta Analysis ◽  
Current Evidence ◽  
Primary Dysmenorrhea ◽  
Overview Of Systematic Reviews ◽  
Meta Analyses ◽  
Positive Results ◽  
Total Average

Objectives. As current evidence of the effectiveness on acupuncture for primary dysmenorrhea (PD) is inconsistent, we aimed to critically appraise the evidence from relevant systematic reviews (SRs). Methods. SRs of randomized controlled trials (RCTs) concerning acupuncture and PD were searched in four databases. The Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) and latest Assessment of Multiple Systematic Reviews 2 (AMSTAR2) checklists were used to assess reporting characteristics and methodological quality, respectively. Results. The literature search yielded 38 potential records, of which five met the inclusion criteria. The total average (SD) for PRISMA was 20.60 (1.14) out of 27. All five SRs have more than one critical weakness in AMSTAR2, so their methodological qualities were considered as critically low. The most frequent problems included nonregistration of study protocol, absence of a list of excluded studies, and unclear acknowledgment of conflicts of interests. The three studies of higher methodological quality reported positive results in pain relief. Conclusion. The reporting and methodological quality of systematic reviews and meta-analysis studies were suboptimal, which demands further improvement. More efforts are needed to improve validity of systematic reviews and RCTs in this area.

A Meta-Analysis of Interviews and Cognitive Ability

2013 ◽  
Vol 12 (4) ◽  
pp. 157-169 ◽  
Author(s):  
Philip L. Roth ◽  
Allen I. Huffcutt
Keyword(s):  
Cognitive Ability ◽  
Meta Analysis ◽  
Incremental Validity ◽  
Employment Interviews ◽  
Moderator Analysis ◽  
The Future ◽  
Research Questions ◽  
Meta Analyses ◽  
The Relationship

The topic of what interviews measure has received a great deal of attention over the years. One line of research has investigated the relationship between interviews and the construct of cognitive ability. A previous meta-analysis reported an overall corrected correlation of .40 ( Huffcutt, Roth, & McDaniel, 1996 ). A more recent meta-analysis reported a noticeably lower corrected correlation of .27 ( Berry, Sackett, & Landers, 2007 ). After reviewing both meta-analyses, it appears that the two studies posed different research questions. Further, there were a number of coding judgments in Berry et al. that merit review, and there was no moderator analysis for educational versus employment interviews. As a result, we reanalyzed the work by Berry et al. and found a corrected correlation of .42 for employment interviews (.15 higher than Berry et al., a 56% increase). Further, educational interviews were associated with a corrected correlation of .21, supporting their influence as a moderator. We suggest a better estimate of the correlation between employment interviews and cognitive ability is .42, and this takes us “back to the future” in that the better overall estimate of the employment interviews – cognitive ability relationship is roughly .40. This difference has implications for what is being measured by interviews and their incremental validity.

Power-Enhanced Funnel Plots for Meta-Analysis

2020 ◽  
Vol 228 (1) ◽  
pp. 43-49 ◽  
Author(s):  
Michael Kossmeier ◽  
Ulrich S. Tran ◽  
Martin Voracek
Keyword(s):  
Statistical Power ◽  
Meta Analysis ◽  
Relevant Information ◽  
Selective Reporting ◽  
Graphical Display ◽  
Funnel Plot ◽  
Evidential Value ◽  
Graphical Displays ◽  
Funnel Plots ◽  
Meta Analyses

Abstract. Currently, dedicated graphical displays to depict study-level statistical power in the context of meta-analysis are unavailable. Here, we introduce the sunset (power-enhanced) funnel plot to visualize this relevant information for assessing the credibility, or evidential value, of a set of studies. The sunset funnel plot highlights the statistical power of primary studies to detect an underlying true effect of interest in the well-known funnel display with color-coded power regions and a second power axis. This graphical display allows meta-analysts to incorporate power considerations into classic funnel plot assessments of small-study effects. Nominally significant, but low-powered, studies might be seen as less credible and as more likely being affected by selective reporting. We exemplify the application of the sunset funnel plot with two published meta-analyses from medicine and psychology. Software to create this variation of the funnel plot is provided via a tailored R function. In conclusion, the sunset (power-enhanced) funnel plot is a novel and useful graphical display to critically examine and to present study-level power in the context of meta-analysis.

Which Data to Meta-Analyze, and How?

2019 ◽  
Vol 227 (1) ◽  
pp. 64-82 ◽  
Author(s):  
Martin Voracek ◽  
Michael Kossmeier ◽  
Ulrich S. Tran
Keyword(s):  
Empirical Research ◽  
Meta Analysis ◽  
Curve Analysis ◽  
Research Progress ◽  
Primary Data ◽  
Statistical Procedures ◽  
Graphical Displays ◽  
Primary Data Analysis ◽  
Meta Analyses ◽  
Data Analytic

Abstract. Which data to analyze, and how, are fundamental questions of all empirical research. As there are always numerous flexibilities in data-analytic decisions (a “garden of forking paths”), this poses perennial problems to all empirical research. Specification-curve analysis and multiverse analysis have recently been proposed as solutions to these issues. Building on the structural analogies between primary data analysis and meta-analysis, we transform and adapt these approaches to the meta-analytic level, in tandem with combinatorial meta-analysis. We explain the rationale of this idea, suggest descriptive and inferential statistical procedures, as well as graphical displays, provide code for meta-analytic practitioners to generate and use these, and present a fully worked real example from digit ratio (2D:4D) research, totaling 1,592 meta-analytic specifications. Specification-curve and multiverse meta-analysis holds promise to resolve conflicting meta-analyses, contested evidence, controversial empirical literatures, and polarized research, and to mitigate the associated detrimental effects of these phenomena on research progress.

Sign in / Sign up

Export Citation Format

Share Document