Which Data to Meta-Analyze, and How?

2019 ◽  
Vol 227 (1) ◽  
pp. 64-82 ◽  
Author(s):  
Martin Voracek ◽  
Michael Kossmeier ◽  
Ulrich S. Tran
Keyword(s):  
Empirical Research ◽  
Meta Analysis ◽  
Curve Analysis ◽  
Research Progress ◽  
Primary Data ◽  
Statistical Procedures ◽  
Graphical Displays ◽  
Primary Data Analysis ◽  
Meta Analyses ◽  
Data Analytic

Abstract. Which data to analyze, and how, are fundamental questions of all empirical research. As there are always numerous flexibilities in data-analytic decisions (a “garden of forking paths”), this poses perennial problems to all empirical research. Specification-curve analysis and multiverse analysis have recently been proposed as solutions to these issues. Building on the structural analogies between primary data analysis and meta-analysis, we transform and adapt these approaches to the meta-analytic level, in tandem with combinatorial meta-analysis. We explain the rationale of this idea, suggest descriptive and inferential statistical procedures, as well as graphical displays, provide code for meta-analytic practitioners to generate and use these, and present a fully worked real example from digit ratio (2D:4D) research, totaling 1,592 meta-analytic specifications. Specification-curve and multiverse meta-analysis holds promise to resolve conflicting meta-analyses, contested evidence, controversial empirical literatures, and polarized research, and to mitigate the associated detrimental effects of these phenomena on research progress.

Power-Enhanced Funnel Plots for Meta-Analysis

2020 ◽  
Vol 228 (1) ◽  
pp. 43-49 ◽  
Author(s):  
Michael Kossmeier ◽  
Ulrich S. Tran ◽  
Martin Voracek
Keyword(s):  
Statistical Power ◽  
Meta Analysis ◽  
Relevant Information ◽  
Selective Reporting ◽  
Graphical Display ◽  
Funnel Plot ◽  
Evidential Value ◽  
Graphical Displays ◽  
Funnel Plots ◽  
Meta Analyses

Abstract. Currently, dedicated graphical displays to depict study-level statistical power in the context of meta-analysis are unavailable. Here, we introduce the sunset (power-enhanced) funnel plot to visualize this relevant information for assessing the credibility, or evidential value, of a set of studies. The sunset funnel plot highlights the statistical power of primary studies to detect an underlying true effect of interest in the well-known funnel display with color-coded power regions and a second power axis. This graphical display allows meta-analysts to incorporate power considerations into classic funnel plot assessments of small-study effects. Nominally significant, but low-powered, studies might be seen as less credible and as more likely being affected by selective reporting. We exemplify the application of the sunset funnel plot with two published meta-analyses from medicine and psychology. Software to create this variation of the funnel plot is provided via a tailored R function. In conclusion, the sunset (power-enhanced) funnel plot is a novel and useful graphical display to critically examine and to present study-level power in the context of meta-analysis.

Weight- and meta-analysis of empirical literature on entrepreneurship

2017 ◽  
Vol 18 (3) ◽  
pp. 195-209 ◽  
Author(s):  
Adel Alferaih
Keyword(s):  
Empirical Research ◽  
Meta Analysis ◽  
Empirical Studies ◽  
Entrepreneurial Intentions ◽  
Empirical Literature ◽  
Research Model ◽  
Entrepreneurship Research ◽  
Meta Analyses

While a number of studies have reviewed empirical research on individuals’ entrepreneurial intentions (EIs), very little is known about the cumulative performance of frequently used constructs and their direct and indirect relationships with EI. This research has exposed 123 usable empirical studies of EI to weight- and meta-analyses to determine the cumulative performance of various frequently explored relationships. A generic research model of the antecedents of EI is proposed on that basis. The outcomes of this research and its limitations have practical and theoretical implications for future entrepreneurship research.

scholarly journals Food insecurity and hypertension: A systematic review and meta-analysis

PLoS ONE ◽  
2020 ◽  
Vol 15 (11) ◽  
pp. e0241628
Author(s):  
Sourik Beltrán ◽  
Marissa Pharel ◽  
Canada T. Montgomery ◽  
Itzel J. López-Hinojosa ◽  
Daniel J. Arenas ◽  
...  
Keyword(s):  
Systematic Review ◽  
Food Insecurity ◽  
Patient Population ◽  
Meta Analysis ◽  
Population Characteristics ◽  
Primary Data ◽  
Significant Difference ◽  
Blood Pressures ◽  
Meta Analyses ◽  
The Relationship

Background Food insecurity (FIS) is an important public health issue associated with cardiovascular risk. Given the association of FIS with diets of poorer nutritional quality and higher salt intake as well as chronic stress, numerous studies have explored the link between FIS and hypertension. However, no systematic review or meta-analysis has yet to integrate or analyze the existing literature. Methods We performed a wide and inclusive search of peer-reviewed quantitative data exploring FIS and hypertension. A broad-terms, systematic search of the literature was conducted in PubMed, Embase, Scopus, and Web of Science for all English-language, human studies containing primary data on the relationship between FIS and hypertension. Patient population characteristics, study size, and method to explore hypertension were extracted from each study. Effect sizes including odds ratios and standardized mean differences were extracted or calculated based on studies’ primary data. Comparable studies were combined by the random effects model for meta-analyses along with assessment of heterogeneity and publication bias. Results A total of 36 studies were included in the final analyses. The studies were combined into different subgroups for meta-analyses as there were important differences in patient population characteristics, methodology to assess hypertension, and choice of effect size reporting (or calculability from primary data). For adults, there were no significantly increased odds of elevated blood pressures for food insecure individuals in studies where researchers measured the blood pressures: OR = 0.91 [95%CI: 0.79, 1.04; n = 29,781; Q(df = 6) = 7.6; I2 = 21%]. This remained true upon analysis of studies which adjusted for subject BMI. Similarly, in studies for which the standardized mean difference was calculable, there was no significant difference in measured blood pressures between food secure and FIS individuals: g = 0.00 [95%CI: -0.04, 0.05; n = 12,122; Q(df = 4) = 3.6; I2 = 0%]. As for retrospective studies that inspected medical records for diagnosis of hypertension, there were no significantly increased odds of hypertension in food insecure adults: OR = 1.11 [95%CI: 0.86, 1.42; n = 2,887; Q(df = 2) = 0.7; I2 = 0%]. In contrast, there was a significant association between food insecurity and self-reports of previous diagnoses of hypertension: 1.46 [95%CI: 1.13, 1.88; n = 127,467; Q(df = 7) = 235; I2 = 97%]. Only five pediatric studies were identified which together showed a significant association between FIS and hypertension: OR = 1.44 [95%CI: 1.16, 1.79; n = 19,038; Q(df = 4) = 5.7; I2 = 30%]. However, the small number of pediatric studies were not sufficient for subgroup meta-analyses based on individual study methodologies. Discussion In this systematic review and meta-analysis, an association was found between adult FIS and self-reported hypertension, but not with hypertension determined by blood pressure measurement or chart review. Further, while there is evidence of an association between FIS and hypertension among pediatric subjects, the limited number of studies precluded a deeper analysis of this association. These data highlight the need for more rigorous and longitudinal investigations of the relationship between FIS and hypertension in adult and pediatric populations.

Managing Countertransference

2019 ◽  
pp. 522-548
Author(s):  
Jeffrey A. Hayes ◽  
Charles J. Gelso ◽  
D. Martin Kivlighan ◽  
Simon B. Goldberg
Keyword(s):  
Empirical Research ◽  
Meta Analysis ◽  
Psychotherapy Outcome ◽  
Psychotherapy Outcomes ◽  
Therapy Outcomes ◽  
Management Factors ◽  
Definition Of ◽  
Meta Analyses

This chapter reviews the history and definition of countertransference, as well as empirical research on countertransference, its management, and the relation of both to psychotherapy outcome. Three meta-analyses are presented, as well as studies that illustrate findings from the meta-analyses. The first meta-analysis indicated that countertransference reactions are related inversely and modestly to psychotherapy outcomes (r = –.16, d = –.33, k = 14 studies, N = 973). A second meta-analysis supported the notion that countertransference management factors attenuate countertransference reactions (r = –.27, d = –.55, k = 13 studies, N = 1,065). The final meta-analysis revealed that successful countertransference management is related to better therapy outcomes (r = .39, d = .84, k = 9 studies, N = 392 participants). The authors conclude by summarizing the limitations of the research base, noting diversity considerations, and highlighting the therapeutic practices predicated on research.

scholarly journals Global epidemiology of Neisseria gonorrhoeae in infertile populations: systematic review, meta-analysis and metaregression

2020 ◽  
pp. sextrans-2020-054515
Author(s):  
Hiam Chemaitelly ◽  
Alzahraa Majed ◽  
Farah Abu-Hijleh ◽  
Karel Blondeel ◽  
Thabo Christopher Matsaseng ◽  
...  
Keyword(s):  
Meta Analysis ◽  
Primary Data ◽  
Tubal Infertility ◽  
Prevalence Studies ◽  
Systematic Assessment ◽  
Tubal Factor Infertility ◽  
Global Epidemiology ◽  
Registration Number ◽  
Tubal Factor ◽  
Meta Analyses

ObjectiveTo provide an in-depth systematic assessment of the global epidemiology of gonorrhoea infection in infertile populations.MethodsA systematic literature review was conducted up to 29 April 2019 on international databases and WHO regional databases, and reported following Preferred Reporting Items for Systematic Reviews and Meta-Analyses guidelines. All prevalence measures of gonorrhoea infection among infertile populations, based on primary data, qualified for inclusion. Infertile populations were broadly defined to encompass women/men undergoing infertility evaluation or treatment (infertility clinic attendees and partners). Pooled mean prevalence by relevant strata was estimated using random-effects meta-analysis. Associations with prevalence and sources of heterogeneity were explored using metaregression. Risk of bias was assessed using four quality domains.FindingsA total of 147 gonorrhoea prevalence studies were identified from 56 countries. The pooled mean prevalence of current gonorrhoea infection was estimated globally at 2.2% (95% CI 1.3% to 3.2%), with the highest prevalence in Africa at 5.0% (95% CI 1.9% to 9.3%). The mean prevalence was higher for populations with tubal factor infertility (3.6%, 95% CI 0.9%–7.7%) and mixed cause and unexplained infertility (3.6%, 95% CI 0.0% to 11.6%) compared with other diagnoses, such as ovarian and non-tubal infertility (0.1%, 95% CI 0.0% to 0.8%), and for secondary (2.5%, 95% CI 0.2% to 6.5%) compared with primary (0.5%, 95% CI 0.0% to 1.7%) infertility. Metaregression identified evidence of variations in prevalence by region and by infertility diagnosis, higher prevalence in women than men and a small-study effect. There was a trend of declining prevalence by about 3% per year over the last four decades (OR=0.97, 95% CI 0.95 to 0.99).ConclusionsGonorrhoea prevalence in infertile populations is several folds higher than that in the general population, with even higher prevalence in women with tubal factor infertility and in individuals with secondary infertility. These findings support the potential role of gonorrhoea in infertility and suggest that some infertility is possibly preventable by controlling gonorrhoea transmission.PROSPERO registration numberCRD42018102934.

scholarly journals The Contribution of “Individual Participant Data” Meta-Analyses of Psychotherapies for Depression to the Development of Personalized Treatments: A Systematic Review

2022 ◽  
Vol 12 (1) ◽  
pp. 93
Author(s):  
Pim Cuijpers ◽  
Marketa Ciharova ◽  
Soledad Quero ◽  
Clara Miguel ◽  
Ellen Driessen ◽  
...  
Keyword(s):  
Systematic Review ◽  
Statistical Power ◽  
Randomized Trials ◽  
Meta Analysis ◽  
Primary Data ◽  
Individual Participant Data ◽  
Psychological Treatments ◽  
Gender Education ◽  
Individual Participant ◽  
Meta Analyses

While randomized trials typically lack sufficient statistical power to identify predictors and moderators of outcome, “individual participant data” (IPD) meta-analyses, which combine primary data of multiple randomized trials, can increase the statistical power to identify predictors and moderators of outcome. We conducted a systematic review of IPD meta-analyses on psychological treatments of depression to provide an overview of predictors and moderators identified. We included 10 (eight pairwise and two network) IPD meta-analyses. Six meta-analyses showed that higher baseline depression severity was associated with better outcomes, and two found that older age was associated with better outcomes. Because power was high in most IPD meta-analyses, non-significant findings are also of interest because they indicate that these variables are probably not relevant as predictors and moderators. We did not find in any IPD meta-analysis that gender, education level, or relationship status were significant predictors or moderators. This review shows that IPD meta-analyses on psychological treatments can identify predictors and moderators of treatment effects and thereby contribute considerably to the development of personalized treatments of depression.

A meta-analysis of empirical e-government research and its future research implications

2016 ◽  
Vol 84 (1) ◽  
pp. 144-163 ◽  
Author(s):  
Bernd W. Wirtz ◽  
Peter Daiser
Keyword(s):  
Empirical Research ◽  
Meta Analysis ◽  
Empirical Studies ◽  
Theory Development ◽  
Future Research ◽  
Special Importance ◽  
Comprehensive Overview ◽  
Solid Foundation ◽  
Government Research ◽  
Meta Analyses

The desired e-government potentials and its shortcomings in reality are key reasons why e-government has become a major topic of interest to academics and practitioners, leading to an extensive body of knowledge. However, the literature still demands further quantitative empirical research to substantiate theory development. This situation calls for a specific review of the literature that arranges relevant knowledge and provides a solid foundation for future research. However, available meta-analyses do not deliver the particular insights to appropriately address the shortage of quantitative empirical e-government research. Therefore, this study explicitly focuses on this specific field to systematically uncover areas requiring further exploration, and defines promising research directions for a solid foundation for future investigations. Key findings of the meta-analysis are: the existence of a systematic divide of existing quantitative empirical e-government studies into 12 research subtopics, which are assessed according to different classification criteria for scientific research gap-spotting; the identification of emerging subtopics that carry innovative research potential; and that e-government is expected to be an ongoing, open-ended research environment that still provides manifold investigative opportunities. Based on these findings, straightforward suggestions for future research are provided. Points for practitioners Beyond providing insights into the current state of quantitative empirical research for scientific researchers, this article also delivers value for professionals working in public management and administration. First, the study provides a comprehensive overview of e-government-related meta-analyses, which allows us to quickly identify the literature in order to tackle particular e-government management issues. Second, the article classifies existing quantitative empirical studies, defines specific subject areas and arranges relevant knowledge, which eases the processes of confining and labelling e-government activities. Last, since these deliverables are based on empirical studies that draw their conclusions from perceptions of reality, the summaries and classifications are thus regarded to be of special importance for public managers.

scholarly journals Gender-specific design and effectiveness of non-pharmacological interventions against cognitive decline and dementia–protocol for a systematic review and meta-analysis

PLoS ONE ◽  
2021 ◽  
Vol 16 (8) ◽  
pp. e0256826
Author(s):  
Andrea E. Zuelke ◽  
Steffi G. Riedel-Heller ◽  
Felix Wittmann ◽  
Alexander Pabst ◽  
Susanne Roehr ◽  
...  
Keyword(s):  
Systematic Review ◽  
Cognitive Decline ◽  
Meta Analysis ◽  
Grey Literature ◽  
Primary Data ◽  
Subjective Cognitive Decline ◽  
Cochrane Central Register ◽  
Specific Design ◽  
Meta Analyses ◽  
Gender Specific

Introduction Dementia is a public health priority with projected increases in the number of people living with dementia worldwide. Prevention constitutes a promising strategy to counter the dementia epidemic, and an increasing number of lifestyle interventions has been launched aiming at reducing risk of cognitive decline and dementia. Gender differences regarding various modifiable risk factors for dementia have been reported, however, evidence on gender-specific design and effectiveness of lifestyle trials is lacking. Therefore, we aim to systematically review evidence on gender-specific design and effectiveness of trials targeting cognitive decline and dementia. Methods and analysis We will conduct a systematic review in accordance with the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines. Databases MEDLINE (PubMed interface), PsycINFO, Web of Science Core Collection, Cochrane Central Register of Controlled Trials (CENTRAL) and ALOIS will be searched for eligible studies using a predefined strategy, complemented by searches in clinical trials registers and Google for grey literature. Studies assessing cognitive function (overall measure or specific subdomains) as outcome in dementia-free adults will be included, with analyses stratified by level of cognitive functioning at baseline: a) cognitively healthy b) subjective cognitive decline 3) mild cognitive impairment. Two reviewers will independently evaluate eligible studies, extract data and determine methodological quality using the Scottish Intercollegiate Guidelines Network (SIGN)-criteria. If sufficient data with regards to quality and quantity are available, a meta-analysis will be conducted. Ethics and dissemination No ethical approval will be required as no primary data will be collected. PROSPERO registration number CRD42021235281.

Unresolved Heterogeneity in Meta-Analysis: Combined Construct Invalidity, Confounding, and Other Challenges to Understanding Mean Effect Sizes

2020 ◽  
Vol 46 (2-3) ◽  
pp. 343-354 ◽  
Author(s):  
Timothy R Levine ◽  
René Weber
Keyword(s):  
Content Analysis ◽  
Publication Bias ◽  
Effect Size ◽  
Meta Analysis ◽  
Effect Sizes ◽  
Size Distributions ◽  
Questionable Research Practices ◽  
Graphical Displays ◽  
Meta Analyses ◽  
Effect Heterogeneity

Abstract We examined the interplay between how communication researchers use meta-analyses to make claims and the prevalence, causes, and implications of unresolved heterogeneous findings. Heterogeneous findings can result from substantive moderators, methodological artifacts, and combined construct invalidity. An informal content analysis of meta-analyses published in four elite communication journals revealed that unresolved between-study effect heterogeneity was ubiquitous. Communication researchers mainly focus on computing mean effect sizes, to the exclusion of how effect sizes in primary studies are distributed and of what might be driving effect size distributions. We offer four recommendations for future meta-analyses. Researchers are advised to be more diligent and sophisticated in testing for heterogeneity. We encourage greater description of how effects are distributed, coupled with greater reliance on graphical displays. We council greater recognition of combined construct invalidity and advocate for content expertise. Finally, we endorse greater awareness and improved tests for publication bias and questionable research practices.

Sign in / Sign up

Export Citation Format

Share Document