Estimating the reproducibility & transparency of smoking cessation behaviour change interventions
Introduction: Activities promoting research reproducibility and transparency are crucial for generating trustworthy evidence. Evaluation of smoking interventions is one area where vested interests may motivate reduced reproducibility and transparency. Aims: Assess markers of transparency and reproducibility in smoking behaviour change intervention evaluation reports.Methods: One hundred evaluation reports of smoking behaviour change intervention randomised controlled trials published in 2018-2019 were identified. Reproducibility markers of pre-registration, protocol sharing, data-, materials- and analysis script-sharing, replication of a previous study and open access publication were coded in identified reports. Transparency markers of funding and conflict of interest declarations were also coded. Coding was performed by two researchers, with inter-rater reliability calculated using Krippendorff’s alpha.Results: Seventy-one percent of reports were open access and 73% pre-registered. However, only 13% provided accessible materials, 7% accessible data and 1% accessible analysis scripts. No reports were replication studies. Ninety-four percent of reports provided a funding source statement and eighty-eight percent of reports provided a conflict of interest statement.Conclusions: Open data, materials, analysis and replications are rare in smoking behaviour change interventions, whereas funding source and conflict of interest declarations are common. Future smoking research should be more reproducible to enable knowledge accumulation.