Reducing the spread of fake news by shifting attention to accuracy: Meta-analytic evidence of replicability and generalizability
Simply failing to consider accuracy when deciding what to share on social media has been shown to play an important role in the spread of online misinformation. Interventions that shift users’ attention towards the concept of accuracy – accuracy prompts or nudges – are therefore a promising approach to improve the quality of news content that users share and therefore reduce misinformation online. Here we test the replicability and generalizability of this effect by conducting a personal meta-analysis of 20 accuracy prompt survey experiments (total N=26,245) that our group ran using American participants between 2017 and 2020. These experiments used a wide range of different accuracy prompts tested using a large variety of headline sets and with participants recruited from qualitatively different subject pools. We find that overall, accuracy prompts increased sharing discernment (difference in sharing intentions for true relative to false headlines) by 72% relative to the control, and that this effect was primarily driven by reducing sharing intentions for false headlines (10% reduction relative to the control). The magnitude of the accuracy prompt effect on sharing discernment did not significantly differ for headlines about politics versus COVID-19, and was larger for headline sets where users were less likely to distinguish between true and false headlines at baseline. With respect to individual-level variables, the treatment effect on sharing discernment was not significantly moderated by gender, race, or political ideology, and was significantly larger for older participants, participants who were higher on cognitive reflection, and participants who passed more attention check questions. These results suggest that accuracy prompt effects are replicable and generalize across prompts and headlines, and thus offer a promising approach for fighting against misinformation.