Model-based sensitivity analysis for outcome reporting bias in the meta analysis of benefit and harm outcomes

2017 ◽  
Vol 28 (3) ◽  
pp. 889-903 ◽  
Author(s):  
John Copas ◽  
Anthony Marson ◽  
Paula Williamson ◽  
Jamie Kirkham

Outcome reporting bias occurs when outcomes in research studies are selectively reported, the selection being influenced by the study results. For benefit outcomes, we have shown how risk assessments using the Outcome Reporting Bias in Trials risk classification scale can be used to calculate bias-adjusted treatment effect estimates. This paper presents a new and simpler version of the benefits method, and shows how it can be extended to cover the partial reporting and non-reporting of harm outcomes. Our motivating example is a Cochrane systematic review of 12 studies of Topiramate add-on therapy for drug-resistant partial epilepsy. Bias adjustments for partially reported or unreported outcomes suggest that the review has overestimated the benefits and underestimated the harms of the test treatment.

Biostatistics ◽  
2013 ◽  
Vol 15 (2) ◽  
pp. 370-383 ◽  
Author(s):  
J. Copas ◽  
K. Dwan ◽  
J. Kirkham ◽  
P. Williamson

2021 ◽  
Author(s):  
Robbie Cornelis Maria van Aert ◽  
Jelte M. Wicherts

Outcome reporting bias (ORB) refers to the biasing effect caused by researchers selectively reporting outcomes based on their statistical significance. ORB leads to inflated average effect size estimates in a meta-analysis if only the outcome with the largest effect size is reported due to ORB. We propose a new method (CORB) to correct for ORB that includes an estimate of the variability of the outcomes' effect size as a moderator in a meta-regression model. An estimate of the variability of the outcomes' effect size can be computed by assuming a correlation among the outcomes. Results of a Monte-Carlo simulation study showed that effect size in meta-analyses may be severely overestimated without any correction for ORB. The CORB method accurately estimates effect size when overestimation caused by ORB is the largest. Applying the new method to a meta-analysis on the effect of playing violent video games on aggressive cognition showed that the average effect size estimate decreased when correcting for ORB. We recommend to routinely apply methods to correct for ORB in any meta-analysis. We provide annotated R code and functions to facilitate researchers to apply the CORB method.


Sign in / Sign up

Export Citation Format

Share Document