Missing Data Techniques and the Statistical Conclusion Validity of Survey-Based Alcohol and Drug Use Research Studies: A Review and Comment on Reproducibility

The goal of the present review was to examine whether or not the use of modern missing data techniques impacts the statistical conclusion validity of research on alcohol and drug use outcomes in survey-based research studies. We identified 28 papers and received complete case data from the authors of 12 studies. Seven studies (25%) reported the missing data pattern (missing not at random [MNAR], missing at random [MAR], missing completely at random [MCAR]), 15 studies (53.6%) indicated the amount of missing observations in the data set, and a significant proportion of studies ( n = 13, 46.4%) did not report any of the conditions or assumptions under which the missing data analysis was performed or implemented. Six of the 12 (50%) studies analyzed reported a different number of statistically significant associations between the complete case and full sample analyses. Efforts should be made to make missing data analysis more accessible, easy to implement and report to improve transparency and reproducibility of findings.