Response to Flournoy (2021): Reflections on the benefits and challenges of communicating the results of a pre-registered study
In 2020, we posted a preprint online presenting the results of two pre-registered studies, now published in revised form (Ellwood-Lowe et al., 2021; original preprint archived at https://osf.io/ktsdp/). While undergoing the journal review process, circulation of this preprint encouraged open feedback from peers, including a thoughtful comment on our studies and pre-registration best practices by Dr. John Flournoy (Flournoy, 2021). Here we respond to the points raised in Flournoy’s comments, and discuss the benefits and challenges of pre-registering “high-risk” studies, particularly as early career researchers. We begin by reflecting on our scientific process between the first pre-registration and the ultimate dissemination of results—pulling back a curtain to reveal a piece of the research process that is often occluded. Next, we address Flournoy’s comments directly and explain how they were helpful in shaping the final version of our paper. Finally, we make suggestions for pre-registered studies in the future.