Practical application of meta-analysis results: avoiding the double use of data

2005 ◽  
Vol 62 (4) ◽  
pp. 925-929 ◽  
Author(s):  
C V Minte-Vera ◽  
T A Branch ◽  
I J Stewart ◽  
M W Dorn

Meta-analysis is an important new tool for synthesizing scientific knowledge from many previous studies. In fisheries, meta-analyses can be used to obtain prior distributions or penalty functions for parameters used in stock assessment models. Two types of results are generally published in a meta-analysis: Type A, the updated results for each stock used in the meta-analysis, and Type B, the results that would best describe a new stock. Including these results in assessments for the individual stocks would result in double use of the data if the assessments include the input data used in the meta-analyses, which they typically would. To solve this problem, we recommend that an additional form of results should be reported in meta-analyses: Type C, the results for a new stock obtained by sequentially excluding each stock's data set and repeating the meta-analysis. Type C results should be used whenever the assessment input data overlap with the meta-analysis input data, avoiding the double use of data. We illustrate the impact of this reporting change on the results of a recent meta-analysis.

2022 ◽  
Author(s):  
Elisabeth Bigsby ◽  
Dolores Albarracín

Abstract Fear appeals are designed to inspire intended and actual actions to avert a danger. Although prior meta-analyses report that the average effect of fear appeals is moderately positive, the role of efficacy information is not completely understood. Prior work and fear appeal theories have argued that the presence of both response and self-efficacy information improves fear appeal success but the individual impacts of each have not been properly estimated. A meta-analysis (k = 158, N = 19,736) was conducted to examine the individual and combined effects of response and self-efficacy information contained in fear appeals on behavioral intentions and behaviors. Estimating the impact of fear appeals relative to low and no fear controls, the meta-analysis showed that fear appeals had a stronger influence on behavioral outcomes when they included positive response efficacy information but did not vary as a function of including self-efficacy information or negative response efficacy information.


2019 ◽  
Author(s):  
Shinichi Nakagawa ◽  
Malgorzata Lagisz ◽  
Rose E O'Dea ◽  
Joanna Rutkowska ◽  
Yefeng Yang ◽  
...  

‘Classic’ forest plots show the effect sizes from individual studies and the aggregate effect from a meta-analysis. However, in ecology and evolution meta-analyses routinely contain over 100 effect sizes, making the classic forest plot of limited use. We surveyed 102 meta-analyses in ecology and evolution, finding that only 11% use the classic forest plot. Instead, most used a ‘forest-like plot’, showing point estimates (with 95% confidence intervals; CIs) from a series of subgroups or categories in a meta-regression. We propose a modification of the forest-like plot, which we name the ‘orchard plot’. Orchard plots, in addition to showing overall mean effects and CIs from meta-analyses/regressions, also includes 95% prediction intervals (PIs), and the individual effect sizes scaled by their precision. The PI allows the user and reader to see the range in which an effect size from a future study may be expected to fall. The PI, therefore, provides an intuitive interpretation of any heterogeneity in the data. Supplementing the PI, the inclusion of underlying effect sizes also allows the user to see any influential or outlying effect sizes. We showcase the orchard plot with example datasets from ecology and evolution, using the R package, orchard, including several functions for visualizing meta-analytic data using forest-plot derivatives. We consider the orchard plot as a variant on the classic forest plot, cultivated to the needs of meta-analysts in ecology and evolution. Hopefully, the orchard plot will prove fruitful for visualizing large collections of heterogeneous effect sizes regardless of the field of study.


2021 ◽  
Vol 11 (6) ◽  
pp. 755
Author(s):  
Falonn Contreras-Osorio ◽  
Christian Campos-Jara ◽  
Cristian Martínez-Salazar ◽  
Luis Chirosa-Ríos ◽  
Darío Martínez-García

One of the most studied aspects of children’s cognitive development is that of the development of the executive function, and research has shown that physical activity has been demonstrated as a key factor in its enhancement. This meta-analysis aims to assess the impact of specific sports interventions on the executive function of children and teenagers. A systematic review was carried out on 1 November 2020 to search for published scientific evidence that analysed different sports programs that possibly affected executive function in students. Longitudinal studies, which assessed the effects of sports interventions on subjects between 6 and 18 years old, were identified through a systematic search of the four principal electronic databases: Web of Science, PubMed, Scopus, and EBSCO. A total of eight studies, with 424 subjects overall, met the inclusion criteria and were classified based on one or more of the following categories: working memory, inhibitory control, and cognitive flexibility. The random-effects model for meta-analyses was performed with RevMan version 5.3 to facilitate the analysis of the studies. Large effect sizes were found in all categories: working memory (ES −1.25; 95% CI −1.70; −0.79; p < 0.0001); inhibitory control (ES −1.30; 95% CI −1.98; −0.63; p < 0.00001); and cognitive flexibility (ES −1.52; 95% CI −2.20; −0.83; p < 0.00001). Our analysis concluded that healthy children and teenagers should be encouraged to practice sports in order to improve their executive function at every stage of their development.


2021 ◽  
Vol 5 (1) ◽  
pp. e100135
Author(s):  
Xue Ying Zhang ◽  
Jan Vollert ◽  
Emily S Sena ◽  
Andrew SC Rice ◽  
Nadia Soliman

ObjectiveThigmotaxis is an innate predator avoidance behaviour of rodents and is enhanced when animals are under stress. It is characterised by the preference of a rodent to seek shelter, rather than expose itself to the aversive open area. The behaviour has been proposed to be a measurable construct that can address the impact of pain on rodent behaviour. This systematic review will assess whether thigmotaxis can be influenced by experimental persistent pain and attenuated by pharmacological interventions in rodents.Search strategyWe will conduct search on three electronic databases to identify studies in which thigmotaxis was used as an outcome measure contextualised to a rodent model associated with persistent pain. All studies published until the date of the search will be considered.Screening and annotationTwo independent reviewers will screen studies based on the order of (1) titles and abstracts, and (2) full texts.Data management and reportingFor meta-analysis, we will extract thigmotactic behavioural data and calculate effect sizes. Effect sizes will be combined using a random-effects model. We will assess heterogeneity and identify sources of heterogeneity. A risk-of-bias assessment will be conducted to evaluate study quality. Publication bias will be assessed using funnel plots, Egger’s regression and trim-and-fill analysis. We will also extract stimulus-evoked limb withdrawal data to assess its correlation with thigmotaxis in the same animals. The evidence obtained will provide a comprehensive understanding of the strengths and limitations of using thigmotactic outcome measure in animal pain research so that future experimental designs can be optimised. We will follow the Preferred Reporting Items for Systematic Reviews and Meta-Analyses reporting guidelines and disseminate the review findings through publication and conference presentation.


2014 ◽  
Vol 72 (1) ◽  
pp. 111-116 ◽  
Author(s):  
M. Dickey-Collas ◽  
N. T. Hintzen ◽  
R. D. M. Nash ◽  
P-J. Schön ◽  
M. R. Payne

Abstract The accessibility of databases of global or regional stock assessment outputs is leading to an increase in meta-analysis of the dynamics of fish stocks. In most of these analyses, each of the time-series is generally assumed to be directly comparable. However, the approach to stock assessment employed, and the associated modelling assumptions, can have an important influence on the characteristics of each time-series. We explore this idea by investigating recruitment time-series with three different recruitment parameterizations: a stock–recruitment model, a random-walk time-series model, and non-parametric “free” estimation of recruitment. We show that the recruitment time-series is sensitive to model assumptions and this can impact reference points in management, the perception of variability in recruitment and thus undermine meta-analyses. The assumption of the direct comparability of recruitment time-series in databases is therefore not consistent across or within species and stocks. Caution is therefore required as perhaps the characteristics of the time-series of stock dynamics may be determined by the model used to generate them, rather than underlying ecological phenomena. This is especially true when information about cohort abundance is noisy or lacking.


2018 ◽  
Vol 10 (4) ◽  
pp. 387-405 ◽  
Author(s):  
C. J. Bennett ◽  
R. E. Walker ◽  
M. L. Blumfield ◽  
J. Ma ◽  
F. Wang ◽  
...  

AbstractDespite many interventions aiming to reduce excessive gestational weight gain (GWG), it is currently unclear the impact on infant anthropometric outcomes. The aim of this review was to evaluate offspring anthropometric outcomes in studies designed to reduce GWG. A systematic search of seven international databases, one clinical trial registry and three Chinese databases was conducted without date limits. Studies were categorised by intervention type: diet, physical activity (PA), lifestyle (diet + PA), other, gestational diabetes mellitus (GDM) (diet, PA, lifestyle, metformin and other). Meta-analyses were reported as weighted mean difference (WMD) for birthweight and birth length, and risk ratio (RR) for small for gestational age (SGA), large for gestational age (LGA), macrosomia and low birth weight (LBW). Collectively, interventions reduced birthweight, risk of macrosomia and LGA by 71 g (WMD: −70.67, 95% CI −101.90 to −39.43,P<0.001), 16% (RR: 0.84, 95% CI 0.73–0.98,P=0.026) and 19% (RR: 0.81, 95% CI 0.69–0.96,P=0.015), respectively. Diet interventions decreased birthweight and LGA by 99 g (WMD −98.80, 95% CI −178.85 to −18.76,P=0.016) and 65% (RR: 0.35, 95% CI 0.17–0.72,P=0.004). PA interventions reduced the risk of macrosomia by 51% (RR: 0.49, 95% CI 0.26–0.92,P=0.036). In women with GDM, diet and lifestyle interventions reduced birthweight by 211 and 296 g, respectively (WMD: −210.93, 95% CI −374.77 to −46.71,P=0.012 and WMD:−295.93, 95% CI −501.76 to −90.10,P=0.005, respectively). Interventions designed to reduce excessive GWG lead to a small reduction in infant birthweight and risk of macrosomia and LGA, without influencing the risk of adverse outcomes including LBW and SGA.


2021 ◽  
Author(s):  
Xu Tian ◽  
Yan-Fei Jin ◽  
Zhao-Li Zhang ◽  
Hui Chen ◽  
Wei-Qing Chen ◽  
...  

Abstract Background: Enteral immunonutrition (EIN) has been extensively applied in cancer patients, however its role in esophageal cancer (EC) patients receiving esophagectomy remains unclear. We performed this network meta-analysis to investigate the impact of EIN on patients undergoing surgery for EC and further determine the optimal time of applying EIN.Methods: We searched PubMed, EMBASE, Cochrane library, and China National Knowledgement Infrastructure (CNKI) to identify eligible studies. Categorical data was expressed as the odds ratio with 95% confidence interval (CI), and continuous data was expressed as mean difference (MD) with 95% CI. Pair-wise and network meta-analysis was performed to evaluate the impact of EIN on clinical outcomes using RevMan 5.3 and ADDIS V.1.16.8 softwares. The surface under the cumulative ranking curve (SUCRA) was calculated to rank all nutritional regimes.Results: Total 14 studies involving 1071 patients were included. Pair-wise meta-analysis indicated no difference between EIN regardless of the application time and standard EN (SEN), however subgroup analyses found that postoperative EIN was associated with decreased incidence of total infectious complications (OR=0.47; 95%CI=0.26 to 0.84; p=0.01) and pneumonia (OR=0.47; 95%CI=0.25 to 0.90; p=0.02) and shortened LOH (MD=-1.01; 95%CI=-1.44 to -0.57; p<0.001) compared to SEN, which were all supported by network meta-analyses. Ranking probability analysis further indicated that postoperative EIN has the highest probability of being the optimal option in terms of these three outcomes.Conclusions: Postoperative EIN should be preferentially utilized in EC patients undergoing esophagectomy because it has optimal potential of decreasing the risk of total infectious complications and pneumonia and shortening LOH.OSF registration number: 10.17605/OSF.IO/KJ9UY.


2018 ◽  
Vol 44 (5) ◽  
pp. 915-952
Author(s):  
Petra Kipfelsberger ◽  
Heike Bruch ◽  
Dennis Herhausen

This article investigates how and when a firm’s level of customer contact influences the collective organizational energy. For this purpose, we bridge the literature on collective human energy at work with the job impact framework and organizational sensemaking processes and argue that a firm’s level of customer contact is positively linked to the collective organizational energy because a high level of customer contact might make the experience of prosocial impact across the firm more likely. However, as prior research at the individual level has indicated that customers could also deplete employees’ energy, we introduce transformational leadership climate as a novel contingency factor for this linkage at the organizational level. We propose that a medium to high transformational leadership climate is necessary to derive positive meaning from customer contact, whereas firms with a low transformational leadership climate do not get energized by customer contact. We tested the proposed moderated mediation model with multilevel modeling and a multisource data set comprising 9,094 employees and 75 key informants in 75 firms. The results support our hypotheses and offer important theoretical contributions for research on collective human energy in organizations and its interplay with customers.


2020 ◽  
Vol 14 (Supplement_1) ◽  
pp. S280-S281
Author(s):  
M Attauabi ◽  
M Zhao ◽  
F Bendtsen ◽  
J Burisch

Abstract Background Several studies have shown an association between inflammatory bowel diseases [IBD] and immune-mediated diseases [IMIDs], but data on the impact of co-occurring IMIDs on IBD course are inconsistent. The aim of this study was to investigate the impact of co-occurring IMIDs on IBD phenotype and disease course. Methods PubMed and EMBASE were searched from database inception through December 2018 and updated in October 2019 for studies reporting prevalences or odds, risks or hazard ratios of IBD-related disease outcomes in patients with and without co-existing IMIDs. Meta-analyses were performed to estimate summary prevalences and risks of the outcomes which included disease extension, IBD-related surgery and hospitalisation, malignancy, mortality and need of medication (biologic therapy, steroids and immunomodulators). IMIDs were stratified into primary sclerosing cholangitis [PSC] and ‘IMIDs other than PSC’. Results A total of 93 studies comprising 14,307 IBD patients with IMIDs and 3,409,914 IBD patients without IMIDs were included in the study. Summary risks and prevalences with 95% confidence intervals for each outcome are presented in figures 1 and 2, respectively. The following results are all significant (p &lt; 0.05). Compared with patients without co-occurring IMIDs, patients with ulcerative colitis [UC] and co-occurring IMIDs other than PSC more frequently received immunomodulators and steroids, and patients with Crohn’s disease [CD] and concomitant IMIDs other than PSC more often received biologic therapy. UC patients with co-existing IMIDs other than PSC more often underwent IBD-related surgery, while patients with CD and PSC received fewer surgeries. In addition, UC patients with co-occurring PSC were at increased risk for having extensive colitis, pancolitis, and malignancies. Patients with UC and PSC had a higher mortality rate, but no difference was found among patients with IMIDs other than PSC. PSC did not influence hospitalisation rates among IBD patients. Conclusion This meta-analysis found that IBD patients with co-existing IMIDs have a different disease course than patients without concomitant IMIDs. This study emphasises the importance of multidisciplinary care of IBD and that physicians caring for IBD patients need to be aware of IMIDs as a prognostic factor.


Rheumatology ◽  
2020 ◽  
Vol 59 (9) ◽  
pp. 2199-2206 ◽  
Author(s):  
Bradley Pittam ◽  
Sonal Gupta ◽  
Nicholas L Harrison ◽  
Selina Robertson ◽  
David M Hughes ◽  
...  

Abstract Objective To describe the prevalence of extra-articular manifestations—enthesitis, dactylitis, nail disease, uveitis and IBD—in PsA, and their impact on longitudinal disease outcomes. Methods We searched Medline, PubMed, Scopus and Web of Science using a predefined protocol in accordance with Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines. Studies using imaging to define extra-articular manifestations (EAMs) were excluded. Where possible, we performed meta-analyses of prevalence estimates, reported as percentages (95% CI). Heterogeneity (I2 statistic) was examined according to study characteristics. Results We identified 65 studies amounting to a total of 163 299 PsA patients. Enthesitis was assessed in 29 studies with an average prevalence of 30% (95% CI: 24%, 38%). Dactylitis was reported in 35 studies with an average prevalence of 25% (95% CI: 20%, 31%). Nail disease was present in 60% (95% CI: 52%, 68%) across 26 studies, but definitions were often unclear. Uveitis (3.2%; 95% CI: 1.9%, 5.3%) and IBD (3.3%; 95% CI: 1.5%, 7.1%) were less common. Heterogeneity was high (&gt;95%) in all meta-analyses, but could not be explained by study characteristics. No studies examined the impact of EAMs on longitudinal disease outcomes, except that dactylitis increases radiographic progression. Conclusion Enthesitis, dactylitis and nail disease are highly prevalent in PsA, but not uveitis and IBD. EAM patterns differ from axial SpA despite their shared disease mechanisms, which may help further understand differences between spondyloarthritides. More studies are needed on the impact of EAMs on disease outcomes such as response to treatment.


Sign in / Sign up

Export Citation Format

Share Document