Meta-Analysis

1992 ◽  
Vol 17 (4) ◽  
pp. 279-296 ◽  
Author(s):  
Larry V. Hedges

The use of statistical methods to combine the results of independent empirical research studies (meta-analysis) has a long history. Meta-analytic work can be divided into two traditions: tests of the statistical significance of combined results and methods for combining estimates across studies. The principal classes of combined significance tests are reviewed, and the limitations of these tests are discussed. Fixed effects approaches treat the effect magnitude parameters to be estimated as a consequence of a model involving fixed but unknown constants. Random effects approaches treat effect magnitude parameters as if they were sampled from a universe of effects and attempt to estimate the mean and variance of the hyperpopulation of effects. Mixed models incorporate both fixed and random effects. Finally, areas of current research are summarized, including methods for handling missing data, models for publication selection, models to handle studies that are not independent, and distribution-free models for random effects.

2021 ◽  
pp. 002221942110103
Author(s):  
Florina Erbeli ◽  
Peng Peng ◽  
Marianne Rice

Research on the question of creative benefit accompanying dyslexia has produced conflicting findings. In this meta-analysis, we determined summary effects of mean and variance differences in creativity between groups with and without dyslexia. Twenty studies were included ( n = 770 individuals with dyslexia, n = 1,671 controls). A random-effects robust variance estimation (RVE) analysis indicated no mean ( g = −0.02, p = .84) or variance differences ( g = −0.0004, p = .99) in creativity between groups. The mean summary effect was moderated by age, gender, and creativity domain. Compared with adolescents, adults with dyslexia showed an advantage over nondyslexic adults in creativity. In addition, a higher proportion of males in the dyslexia group was associated with poorer performance compared with the controls. Finally, the dyslexia group showed a significant performance disadvantage in verbal versus figural creativity. Regarding variance differences, they varied across age and creativity domains. Compared with adults, adolescents showed smaller variability in the dyslexia group. If the creativity task measured verbal versus figural or combined creativity, then the dyslexia group exhibited smaller variability. Altogether, our results suggest that individuals with dyslexia as a group are no more creative or show greater variability in creativity than peers without dyslexia.


Author(s):  
Laura Ruiz-Azcona ◽  
Ignacio Fernández-Olmo ◽  
Andrea Expósito ◽  
Bohdana Markiv ◽  
María Paz-Zulueta ◽  
...  

Background/Objective: Whether environmental exposure to Manganese (Mn) in adults is associated with poorer results in cognitive and motor function is unclear. We aimed to determine these associations through a meta-analysis of published studies. Methods: A systematic review was conducted to identify epidemiological studies on a population ≥18 years old exposed to environmental airborne Mn, and in which results on specific tests to evaluate cognitive or motor functions were reported. We consulted Medline through PubMed, Web of Science and SCOPUS databases. We also performed a manual search within the list of bibliographic references of the retrieved studies and systematic reviews. To weight Mn effects, a random effects versus fixed effect model was chosen after studying the heterogeneity of each outcome. Results. Eighteen studies met the inclusion criteria. Among them, eleven studies reported data susceptible for meta-analysis through a pooled correlation or a standardized means difference (SMD) approach between exposed and non-exposed groups. Regarding cognitive function, the results of the studies showed heterogeneity among them (I2 = 76.49%, p < 0.001). The overall effect was a statistically significant negative correlation in the random effects model (pooled r = −0.165; 95%CI: −0.214 to −0.116; p < 0.001). For SMD, the results showed a lower heterogeneity with a negative SMD that did not reach statistical significance under the fixed effects model (SMD = −0.052; 95%CI −0.108 to 0.004; p = 0.068). Regarding motor function, heterogeneity (I2 = 75%) was also observed in the correlation approach with a pooled r (random effect model) = −0.150; 95%CI: −0.219 to −0.079; p < 0.001. Moderate heterogeneity was observed according to the SMD approach (I2 = 52.28%), with a pooled SMD = −0.136; 95%CI: −0.188 to−0.084; p < 0.001, indicating worse motor function in those exposed. Conclusions: Correlation approach results support a negative effect on cognitive and motor functions (the higher the Mn levels, the poorer the scores). Regarding the SMD approach, results also support a worse cognitive and motor functions in those exposed, although only for motor function statistical significance was obtained.


Author(s):  
Janet L. Peacock ◽  
Philip J. Peacock

Meta-analysis: introduction 448 Searching for studies 450 Combining estimates in meta-analyses 452 Heterogeneity 454 Overcoming heterogeneity 456 Fixed effects estimates 458 Random effects estimates 460 Presenting meta-analyses 462 Publication bias 464 Detecting publication bias 466 Adjusting for publication bias 468 Independent patient data meta-analysis 472...


2020 ◽  
Vol 11 (4) ◽  
pp. 7266-7270
Author(s):  
Gyeong-Eun Min ◽  
Haesoo Kim ◽  
Da Eun Lee ◽  
Kisok Kim

5-Alpha-reductase inhibitors (5-ARIs) are used in the treatment of benign prostate hypertrophy (BPH). 5-ARIs, such as finasteride and dutasteride, suppress the biosynthesis of dihydrotestosterone (DHT), a precursor of androgen, which is closely related to the incidence of prostate cancer (PCa). A previous meta-analysis demonstrated a relationship between finasteride use and the incidence of PCA. However, there have been no meta-analyses on the relationship between PCa and dutasteride alone. This meta-analysis was performed to examine the prevalence of PCa in adult males taking dutasteride. We searched PubMed for reports regarding PCa risk and dutasteride use. The study was conducted according to the PRISMA guidelines for systematic reviews and meta-analyses. The analytic hierarchy process (AHP) method was used to weight the studies. Odds ratios (ORs), 95% confidence intervals (CIs), and P-values were calculated using fixed- and random-effects models. A total of eight articles were included in the meta-analysis. The overall OR for both the fixed- and random-effects models was 0.669 and the 95% CI for the random-effects model (0.526–0.851; P = 0.006) was wider than that for the fixed effects model (0.548–0.817; P < 0.001). This study confirmed that the incidence of PCa was significantly reduced by taking dutasteride.


Author(s):  
Andrew Heathcote ◽  
Dora Matzke

AbstractThe “marginality principle” for linear regression models states that when a higher order term is included, its constituent terms must also be included. The target article relies on this principle for the fixed-effects part of linear mixed models of ANOVA designs and considers the implication that if extended to combined fixed-and-random-effects models, model selection tests specific to some fixed-effects ANOVA terms are not possible. We review the basis for this principle for fixed-effects models and delineate its limits. We then consider its extension to combined fixed-and-random-effects models. We conclude that we have been unable to find in the literature, including the target article, and have ourselves been unable to construct any satisfactory argument against the use of incomplete ANOVA models. The only basis we could find requires one to assume that it is not possible to test point-null hypotheses, something we disagree with, and which we believe is incompatible with the Bayesian model-selection methods that are the basis of the target article.


2020 ◽  
Vol 0 (0) ◽  
Author(s):  
Hui Meng ◽  
Yunping Zhou ◽  
Yunxia Jiang

AbstractObjectivesThe results of existing studies on bisphenol A (BPA) and puberty timing did not reach a consensus. Thereby we performed this meta-analytic study to explore the association between BPA exposure in urine and puberty timing.MethodsMeta-analysis of the pooled odds ratios (OR), prevalence ratios (PR) or hazards ratios (HR) with 95% confidence intervals (CI) were calculated and estimated using fixed-effects or random-effects models based on between-study heterogeneity.ResultsA total of 10 studies involving 5621 subjects were finally included. The meta-analysis showed that BPA exposure was weakly associated with thelarche (PR: 0.96, 95% CI: 0.93–0.99), while no association was found between BPA exposure and menarche (HR: 0.99, 95% CI: 0.89–1.12; OR: 1.02, 95% CI: 0.73–1.43), and pubarche (OR: 1.00, 95% CI: 0.79–1.26; PR: 1.00, 95% CI: 0.95–1.05).ConclusionsThere was no strong correlation between BPA exposure and puberty timing. Further studies with large sample sizes are needed to verify the relationship between BPA and puberty timing.


2012 ◽  
Vol 9 (5) ◽  
pp. 610-620 ◽  
Author(s):  
Thomas A Trikalinos ◽  
Ingram Olkin

Background Many comparative studies report results at multiple time points. Such data are correlated because they pertain to the same patients, but are typically meta-analyzed as separate quantitative syntheses at each time point, ignoring the correlations between time points. Purpose To develop a meta-analytic approach that estimates treatment effects at successive time points and takes account of the stochastic dependencies of those effects. Methods We present both fixed and random effects methods for multivariate meta-analysis of effect sizes reported at multiple time points. We provide formulas for calculating the covariance (and correlations) of the effect sizes at successive time points for four common metrics (log odds ratio, log risk ratio, risk difference, and arcsine difference) based on data reported in the primary studies. We work through an example of a meta-analysis of 17 randomized trials of radiotherapy and chemotherapy versus radiotherapy alone for the postoperative treatment of patients with malignant gliomas, where in each trial survival is assessed at 6, 12, 18, and 24 months post randomization. We also provide software code for the main analyses described in the article. Results We discuss the estimation of fixed and random effects models and explore five options for the structure of the covariance matrix of the random effects. In the example, we compare separate (univariate) meta-analyses at each of the four time points with joint analyses across all four time points using the proposed methods. Although results of univariate and multivariate analyses are generally similar in the example, there are small differences in the magnitude of the effect sizes and the corresponding standard errors. We also discuss conditional multivariate analyses where one compares treatment effects at later time points given observed data at earlier time points. Limitations Simulation and empirical studies are needed to clarify the gains of multivariate analyses compared with separate meta-analyses under a variety of conditions. Conclusions Data reported at multiple time points are multivariate in nature and are efficiently analyzed using multivariate methods. The latter are an attractive alternative or complement to performing separate meta-analyses.


Cephalalgia ◽  
2014 ◽  
Vol 35 (1) ◽  
pp. 63-72 ◽  
Author(s):  
Amy A Gelfand ◽  
Peter J Goadsby ◽  
I Elaine Allen

Context Infant colic is a common and distressing disorder of early infancy. Its etiology is unknown, making treatment challenging. Several articles have suggested a link to migraine. Objective The objective of this article was to perform a systematic review and, if appropriate, a meta-analysis of the studies on the relationship between infant colic and migraine. Data sources Studies were identified by searching PubMed and ScienceDirect and by hand-searching references and conference proceedings. Study selection For the primary analysis, studies specifically designed to measure the association between colic and migraine were included. For the secondary analysis, studies that collected data on colic and migraine but were designed for another primary research question were also included. Data extraction Data were abstracted from the original studies, through communication with study authors, or both. Two authors independently abstracted data. Main outcomes and measures The main outcome measure was the association between infant colic and migraine using both a fixed-effects model and a more conservative random-effects model. Results Three studies were included in the primary analysis; the odds ratio for the association between migraine and infant colic was 6.5 (4.6–8.9, p < 0.001) for the fixed-effects model and 5.6 (3.3–9.5, p = 0.004) for the random-effects model. In a sensitivity analysis wherein the study with the largest effect size was removed, the odds ratio was 3.6 (95% CI 1.7–7.6, p = 0.001) for both the fixed-effects model and random-effects model. Conclusions In this meta-analysis, infant colic was associated with increased odds of migraine. If infant colic is a migrainous disorder, this would have important implications for treatment. The main limitation of this meta-analysis was the relatively small number of studies included.


Nematology ◽  
2014 ◽  
Vol 16 (2) ◽  
pp. 229-243 ◽  
Author(s):  
Wim Van Den Berg ◽  
Olaf Hartsema ◽  
Loes J.M.F. Den Nijs

A series of proficiency tests on potato cyst nematode (PCN; ) and free-living stages of Meloidogyne and Pratylenchus () were investigated to determine the accuracy and precision of the nematode counts and to gain insights into possible trends and potential improvements. In each test, each participating laboratory received ten samples of soil collected from naturally infested fields and well mixed before distribution. The variance between the counts from the ten samples, estimated per test and laboratory, was constant for PCN cysts and free-living stages of Meloidogyne spp. and Pratylenchus spp. during the period monitored. However, during the initial years, the variance between the samples showed a downward trend for PCN living juveniles. The variance between the laboratories, estimated per test, was constant for PCN cysts over the period 1994-2010. For PCN living juveniles the variance between laboratory means declined from 1994-2000 and from 2000 it was more or less constant, which coincided with the introduction of a well-described new methodology. For Meloidogyne spp. and Pratylenchus spp., from 1998-2005 the variance between laboratory means was more or less constant or increased. From 2006, all participating laboratories incubated the organic matter and the variance between the laboratories was stable and below the levels observed during 2003-2005. After discarding data from initial years with unstable variances of the nematode counts, a meta-analysis was carried out on the remaining data using HGLMs to model the mean and variance of the counts simultaneously. The within-laboratory variance for the ten samples and the interaction variance of test and laboratory were estimated and combined to percentage coefficient of variation (%CV) per laboratory. For PCN cysts, %CV per laboratory ranged from 12.6 to 41.6 and for PCN juveniles in sandy soil from 24.4 to 67.4 and in loamy soil from 37.9 to 102.0. For Meloidogyne spp., %CV ranged from 53.2 to 84.4 and for Pratylenchus spp. from 24.3 to 90.6. The quality of a proficiency test is largely defined by random distribution of the nematodes over the samples allocated, statistical analysis of the data and communication of the results to participating laboratories. This study provides insights into the accuracy and precision at laboratories in recent years and the effect of concerted actions during the period in which the proficiency tests were conducted.


2021 ◽  
Vol 2 (Supplement_1) ◽  
pp. A45-A45
Author(s):  
J Leota ◽  
D Hoffman ◽  
L Mascaro ◽  
M Czeisler ◽  
K Nash ◽  
...  

Abstract Introduction Home court advantage (HCA) in the National Basketball Association (NBA) is well-documented, yet the co-occurring drivers responsible for this advantage have proven difficult to examine in isolation. The Coronavirus disease (COVID-19) pandemic resulted in the elimination of crowds in ~50% of games during the 2020/2021 NBA season, whereas travel remained unchanged. Using this ‘natural experiment’, we investigated the impact of crowds and travel-related sleep and circadian disruption on NBA HCA. Methods 1080 games from the 2020/2021 NBA regular season were analyzed using mixed models (fixed effects: crowds, travel; random effects: team, opponent). Results In games with crowds, home teams won 58.65% of the time and outrebounded (M=2.28) and outscored (M=2.18) their opponents. In games without crowds, home teams won significantly less (50.60%, p = .01) and were outrebounded (M=-0.41, p &lt; .001) and outscored (M=-0.13, p &lt; .05) by their opponents. Further, the increase in home rebound margin fully mediated the relationship between crowds and home points margin (p &lt; .001). No significant sleep or circadian effects were observed. Discussion Taken together, these results suggest that HCA in the 2020/2021 NBA season was predominately driven by the presence of crowds and their influence on the effort exerted by the home team to rebound the ball. Moreover, we speculate that the strict NBA COVID-19 policies may have mitigated the travel-related sleep and circadian effects on the road team. These findings are of considerable significance to a domain wherein marginal gains can have immense competitive, financial, and even historical consequences.


Sign in / Sign up

Export Citation Format

Share Document