An Empirical Review of Research and Reporting Practices in Psychological Meta-Analyses

2020 ◽  
Vol 24 (3) ◽  
pp. 195-209
Author(s):  
Richard E. Hohn ◽  
Kathleen L. Slaney ◽  
Donna Tafreshi
Keyword(s):  
Meta Analysis ◽  
Reporting Standards ◽  
Exclusion Criteria ◽  
Research Practices ◽  
Reporting Practices ◽  
Reporting Decisions ◽  
Research Findings ◽  
State Of Research ◽  
Meta Analyses ◽  
Made In

As meta-analytic studies have come to occupy a sizable contingent of published work in the psychological sciences, clarity in the research and reporting practices of such work is crucial to the interpretability and reproducibility of research findings. The present study examines the state of research and reporting practices within a random sample of 384 published psychological meta-analyses across several important dimensions (e.g., search methods, exclusion criteria, statistical techniques). In addition, we surveyed the first authors of the meta-analyses in our sample to ask them directly about the research practices employed and reporting decisions made in their studies, including the assessments and procedures they conducted and the guidelines or materials they relied on. Upon cross-validating the first author responses with what was reported in their published meta-analyses, we identified numerous potential gaps in reporting and research practices. In addition to providing a survey of recent reporting practices, our findings suggest that (a) there are several research practices conducted by meta-analysts that are ultimately not reported; (b) some aspects of meta-analysis research appear to be conducted at disappointingly low rates; and (c) the adoption of the reporting standards, including the Meta-Analytic Reporting Standards (MARS), has been slow to nonexistent within psychological meta-analytic research.

A Review and Evaluation of Meta-Analysis Practices in Management Research

2008 ◽  
Vol 35 (2) ◽  
pp. 393-419 ◽  
Author(s):  
Inge Geyskens ◽  
Rekha Krishnan ◽  
Jan-Benedict E. M. Steenkamp ◽  
Paulo V. Cunha
Keyword(s):  
Empirical Evidence ◽  
Meta Analysis ◽  
Management Research ◽  
Research Findings ◽  
Meta Analyses ◽  
Integrate Research ◽  
Made In

Meta-analysis has become increasingly popular in management research to quantitatively integrate research findings across a large number of studies. In an effort to help shape future applications of meta-analysis in management, this study chronicles and evaluates the decisions that management researchers made in 69 meta-analytic studies published between 1980 and 2007 in 14 management journals. It performs four meta-analyses of relationships that have been studied with varying frequency in management research, to provide empirical evidence that meta-analytical decisions influence results. The implications of the findings are discussed with a focus on the changes that seem appropriate.

scholarly journals Work Engagement – A Systematic Review of Polish Research

2017 ◽  
Vol 48 (2) ◽  
pp. 175-187
Author(s):  
Anita Pollak ◽  
Małgorzata Chrupała-Pniak ◽  
Patrycja Rudnicka ◽  
Mateusz Paliga
Keyword(s):  
Systematic Review ◽  
Work Engagement ◽  
Meta Analysis ◽  
Organizational Psychology ◽  
Measurement Methods ◽  
The Past ◽  
Current State ◽  
State Of Research ◽  
Meta Analyses ◽  
Positive Work

Abstract Over the past decade work engagement has gained both business and academia attention. With growing number of studies and meta-analyses the concept of work engagement is one of the pillars of positive work and organizational psychology. This systematic review presents the current state of research on work engagement in Poland. Results confirmed that work-engagement studies have not yet reached the threshold to conduct meta-analysis. The review of measurement methods and synthesis of findings allows to identify strengths and gaps in Polish studies. Discussion of limitations and biases in current research is accompanied with urge to overcome them and develop thriving stream of research on work engagement.

scholarly journals Reporting standards for literature searches and report inclusion criteria: Making research syntheses more transparent and easy to replicate

2016 ◽  
Author(s):  
Hannah Moshontz
Keyword(s):  
Literature Search ◽  
Meta Analysis ◽  
Research Synthesis ◽  
Search Strategies ◽  
Reference Database ◽  
Synthesis Methods ◽  
Reporting Standards ◽  
Inclusion Criteria ◽  
Literature Searches ◽  
Made In

A complete description of the literature search, including the criteria used for the inclusion of reports after they have been located, used in a research synthesis or meta-analysis is critical if subsequent researchers are to accurately evaluate and reproduce a synthesis' methods and results. Based on previous guidelines and new suggestions, we present a set of focused and detailed standards for reporting the methods used in a literature search. The guidelines cover five search strategies: reference database searches, journal and bibliography searches, searches of the reference lists of reports, citation searches, and direct contact searches. First, we bring together all the unique recommendations made in existing guidelines for research synthesis. Second, we identify gaps in reporting standards for search strategies. Third, we address these gaps by providing new reporting recommendations. Our hope is to facilitate successful evaluation and replication of research synthesis results.

118 The Use of Meta-analysis in Companion Animal Research

2021 ◽  
Vol 99 (Supplement_3) ◽  
pp. 62-62
Author(s):  
Emma N Bermingham
Keyword(s):  
Body Size ◽  
Statistical Analysis ◽  
Meta Analysis ◽  
Energy Requirements ◽  
Specific Question ◽  
Research Findings ◽  
Adult Cat ◽  
Number Of Publications ◽  
Meta Analyses ◽  
The Three Rs

Abstract In a world of the “Three Rs” (replace, reduce and refine), combined with more research published via open access research journals, there is increasing interest in the statistical analysis of existing literature. Meta-analysis – the combination of multiple studies, can be used to get better oversight into a specific question of interest. Additionally, it can be used to identify gaps in knowledge. For example, while there are a number of publications investigating energy requirements in adult cat and dog, few studies assess older animals. Similarly, in the dog, there is a lack of literature around dogs at the extremes of body size (i.e. giant and toy breeds). Herein, we describe several published examples that have been used to determine energy requirements of cats and dogs, and more recently, the impacts of diet on the microbiome of the cat and dog. This includes the use of Preferred Reporting Items for Systematic reviews and Meta-Analyses (PRISMA) guidelines, research findings and general findings related to research design and quality.

scholarly journals What components of smoking cessation care during pregnancy are implemented by health providers? A systematic review and meta-analysis

BMJ Open ◽  
2019 ◽  
Vol 9 (8) ◽  
pp. e026037 ◽  
Author(s):  
Gillian Sandra Gould ◽  
Laura Twyman ◽  
Leah Stevenson ◽  
Gabrielle R Gribbin ◽  
Billie Bonevski ◽  
...  
Keyword(s):  
Systematic Review ◽  
Smoking Cessation ◽  
Data Extraction ◽  
Meta Analysis ◽  
Self Report ◽  
Health Providers ◽  
Eligibility Criteria ◽  
Reporting Practices ◽  
Registration Number ◽  
Meta Analyses

BackgroundPregnancy is an opportunity for health providers to support women to stop smoking.ObjectivesIdentify the pooled prevalence for health providers in providing components of smoking cessation care to women who smoke during pregnancy.DesignA systematic review synthesising original articles that reported on (1) prevalence of health providers’ performing the 5As (‘Ask’, ‘Advise’, ‘Assess’, ‘Assist’, ‘Arrange’), prescribing nicotine replacement therapy (NRT) and (2) factors associated with smoking cessation care.Data sourcesMEDLINE, EMBASE, CINAHL and PsycINFO databases searched using ‘smoking’, ‘pregnancy’ and ‘health provider practices’.Eligibility criteria for selecting studiesStudies included any design except interventions (self-report, audit, observed consultations and women’s reports), in English, with no date restriction, up to June 2017.ParticipantsHealth providers of any profession.Data extraction, appraisal and analysisData were extracted, then appraised with the Hawker tool. Meta-analyses pooled percentages for performing each of the 5As and prescribing NRT, using, for example, ‘often/always’ and ‘always/all’. Meta-regressions were performed of 5As for ‘often/always’.ResultsOf 3933 papers, 54 were included (n=29 225 participants): 33 for meta-analysis. Health providers included general practitioners, obstetricians, midwives and others from 10 countries. Pooled percentages of studies reporting practices ‘often/always’ were: ‘Ask’ (n=9) 91.6% (95% CI 88.2% to 95%); ‘Advise’ (n=7) 90% (95% CI 72.5% to 99.3%), ‘Assess’ (n=3) 79.2% (95% CI 76.5% to 81.8%), ‘Assist (cessation support)’ (n=5) 59.1% (95% CI 56% to 62.2%), ‘Arrange (referral)’ (n=6) 33.3% (95% CI 20.4% to 46.2%) and ‘prescribing NRT’ (n=6) 25.4% (95% CI 12.8% to 38%). Heterogeneity (I2) was 95.9%–99.1%. Meta-regressions for ‘Arrange’ were significant for year (p=0.013) and country (p=0.037).ConclusionsHealth providers ‘Ask’, ‘Advise’ and ‘Assess’ most pregnant women about smoking. ‘Assist’, ‘Arrange’ and ‘prescribing NRT’ are reported at lower rates: strategies to improve these should be considered.PROSPERO registration numberCRD42015029989.

Het kwantitatief integreren van empirische studies: de methode van meta-analyse

2006 ◽  
Vol 19 (3) ◽  
Author(s):  
Marise Ph. Born ◽  
Stefan T. Mol
Keyword(s):  
Meta Analysis ◽  
Research Question ◽  
Empirical Studies ◽  
Dominant Position ◽  
The Social ◽  
Research Findings ◽  
The Many ◽  
Quantitative Integration ◽  
Meta Analyses ◽  
Research Domain

Quantitatively integrating empirical studies: The method of meta-analysis Quantitatively integrating empirical studies: The method of meta-analysis Marise Ph. Born & Stefan T. Mol, Gedrag & Organisatie, Volume 19, September 2006, nr. 3, pp. 251-271 Meta-analysis is a quantitative integration of results of a series of empirical studies into a specific research question. The method of meta-analysis has obtained a dominant position in the social sciences and beyond, as it may help in obtaining an overview of the explosively increased number of research publications. This contribution discusses the basics and consecutive steps in performing a meta-analysis. A meta-analysis that we conducted on expatriates serves as an illustration. Next to the many points in favor of meta-analyses, such as having a better overview of a research domain and shifting the traditional focus on significances of effects to sizes of effects, several important controversies remain. One of these is the issue of waving away a specific cause of variance in research findings as a methodological artifact, or interpreting it as a meaningful case of variance. We maintain that every social or industrial- and organizational psychologist who wants to stay up-to-date scientifically should be able to interpret meta-analyses.

Meta-Analyses of Built Environment Effects on Travel: No New Platinum Standard

2019 ◽  
pp. 0739456X1985642 ◽  
Author(s):  
Petter Næss
Keyword(s):  
Land Use ◽  
Meta Analysis ◽  
Model Specification ◽  
Specification Error ◽  
Environment Effects ◽  
Alternative Approach ◽  
Poor Understanding ◽  
Research Findings ◽  
Meta Analyses ◽  
Transportation Studies

This commentary presents a critique of a particular, strictly quantitative way of reviewing research findings within the field of land use and transportation studies, so-called meta-analyses. Beyond criticism raised earlier, the article draws attention to serious bias resulting when meta-analysis include studies encumbered with model specification error due to poor understanding of causal mechanisms. The article also discusses underestimated limitations due to neglect of differences between geographical contexts and inconsistent measurement of variables across studies. An example of an alternative approach is offered at the end of the article.

scholarly journals An Updated Systematic Review and Meta-Analysis of the Obstetric Consequences of Female Genital Mutilation/Cutting

2014 ◽  
Vol 2014 ◽  
pp. 1-8 ◽  
Author(s):  
R. C. Berg ◽  
J. Odgaard-Jensen ◽  
A. Fretheim ◽  
V. Underland ◽  
G. Vist
Keyword(s):  
Systematic Review ◽  
Prospective Studies ◽  
Retrospective Studies ◽  
Meta Analysis ◽  
Statistical Significance ◽  
Previous Systematic Review ◽  
Genital Mutilation ◽  
Meta Analyses ◽  
Female Genital ◽  
Made In

In our recent systematic review inObstetrics and Gynecology Internationalof the association between FGM/C and obstetric harm we concluded that FGM/C significantly increases the risk of delivery complications. The findings were based on unadjusted effect estimates from both prospective and retrospective studies. To accommodate requests by critics, we aimed to validate these results through additional analyses based on adjusted estimates from prospective studies. We judged that 7 of the 28 studies included in our original systematic review were prospective. Statistical adjustments for measured confounding factors were made in eight studies, including three prospective studies. The adjusted confounders differed across studies in number and type. Results from meta-analyses based on adjusted estimates, with or without data from retrospective studies, consistently pointed in the same direction as our earlier findings. There were only small differences in the sizes or the level of statistical significance. Using GRADE, we assessed that our confidence in the effect estimates was very low or low for all outcomes. The adjusted estimates generally show similar obstetric harms from FGM/C as unadjusted estimates do. Thus, the current analyses confirm the findings from our previous systematic review. There are sufficient grounds to conclude that FGM/C, with respect to obstetric circumstances, involves harm.

scholarly journals Interventions to Deliver Vaccination to, and Improve Vaccination Rates in, People who are Homeless

2020 ◽  
Vol 3 ◽  
pp. 1-15
Author(s):  
Laura McCosker ◽  
Robert Ware ◽  
Martin J. Downes
Keyword(s):  
Systematic Review ◽  
Meta Analysis ◽  
Cost Effective ◽  
Exclusion Criteria ◽  
Vaccine Preventable Diseases ◽  
Vaccination Rates ◽  
Search Terms ◽  
Health Related ◽  
Index Terms ◽  
Meta Analyses

Background: In comparison to the general population, people who are homeless have poorer health and health-related outcomes, including for vaccine-preventable diseases. Vaccination is safe, effective and cost-effective, and many vaccination guidelines specifically recommend vaccination in people who are homeless. This systematic review will identify interventions which are effective in delivering vaccination to, and/or at improving vaccination rates in, people who are homeless. Methods/Design: This systematic review is presented according to the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines. Searches will be undertaken on eight electronic databases, using combinations of search terms and subject headings or index terms. Citation chaining will also be undertaken. Literature will be screened for relevance against inclusion/exclusion criteria firstly by title/abstract and secondly by full text. The selected studies will be assessed for quality using an evidence-based tool appropriate to their methods. Data relevant to the topic will be extracted and examined using meta-analysis and narrative synthesis. Discussion: This systematic review will address an important gap in the literature about vaccination in people who are homeless. The review’s findings are particularly relevant considering the current coronavirus disease (COVID-19) pandemic, which is likely to be managed through vaccination.

A Primer on Systematic Reviews and Meta-Analyses

2018 ◽  
Vol 38 (02) ◽  
pp. 103-111 ◽  
Author(s):  
Nghia Nguyen ◽  
Siddharth Singh
Keyword(s):  
Systematic Reviews ◽  
Meta Analysis ◽  
Biomedical Literature ◽  
Data Abstraction ◽  
Exclusion Criteria ◽  
Medical Librarian ◽  
Quantitative Synthesis ◽  
Review Protocol ◽  
Meta Analyses

AbstractWith the rapid growth of biomedical literature, there is increasing need to make meaningful inferences from a comprehensive and complex body of evidence. Systematic reviews with or without meta-analyses offer an objective and summative approach to synthesize knowledge and critically appraise evidence to inform clinical practice. Systematic reviews also help identify key knowledge gaps for future investigation. In this review, the authors provide a step-by-step approach to conducting a systematic review. These include: (1) formulating a focused and clinically-relevant question; (2) designing a detailed review protocol with explicit inclusion and exclusion criteria; (3) performing a systematic literature search of multiple databases and unpublished data, in consultation with a medical librarian, to identify relevant studies; (4) meticulous data abstraction by at least two sets of investigators independently; (5) assessing risk of bias in individual studies; (6) quantitative synthesis with meta-analysis; and (7) critically and transparently ascertaining quality of evidence.

Sign in / Sign up

Export Citation Format

Share Document