Preregistration: Comparing Dream to Reality

2019 ◽  
Author(s):  
Aline Claesen ◽  
Sara Lucia Brazuna Tavares Gomes ◽  
francis tuerlinckx ◽  
wolf vanpaemel
Keyword(s):  
Research Finding ◽  
Third Party ◽  
Good Practices ◽  
Psychological Science ◽  
Research Outcomes

Doing research inevitably involves making numerous decisions that can influence research outcomes in such a way that it leads to overconfidence in statistical conclusions. One proposed method to increase the interpretability of a research finding is preregistration, which involves documenting analytic choices on a public, third-party repository prior to any influence by data. To investigate whether, in psychology, preregistration lives up to that potential, we focused on all articles published in Psychological Science with a preregistered badge between February 2015 and November 2017, and assessed the adherence to their corresponding preregistration plans. We observed deviations from the plan in all studies, and, more importantly, in all but one study, at least one of these deviations was not fully disclosed. We discuss examples and possible explanations, and highlight good practices for preregistering research.

scholarly journals Comparing dream to reality: an assessment of adherence of the first generation of preregistered studies

2021 ◽  
Vol 8 (10) ◽  
Author(s):  
Aline Claesen ◽  
Sara Gomes ◽  
Francis Tuerlinckx ◽  
Wolf Vanpaemel
Keyword(s):  
Statistical Analysis ◽  
Sample Size ◽  
First Generation ◽  
Reporting Guidelines ◽  
Third Party ◽  
Size Exclusion ◽  
Exclusion Criteria ◽  
Psychological Science ◽  
Research Transparency

Preregistration is a method to increase research transparency by documenting research decisions on a public, third-party repository prior to any influence by data. It is becoming increasingly popular in all subfields of psychology and beyond. Adherence to the preregistration plan may not always be feasible and even is not necessarily desirable, but without disclosure of deviations, readers who do not carefully consult the preregistration plan might get the incorrect impression that the study was exactly conducted and reported as planned. In this paper, we have investigated adherence and disclosure of deviations for all articles published with the Preregistered badge in Psychological Science between February 2015 and November 2017 and shared our findings with the corresponding authors for feedback. Two out of 27 preregistered studies contained no deviations from the preregistration plan. In one study, all deviations were disclosed. Nine studies disclosed none of the deviations. We mainly observed (un)disclosed deviations from the plan regarding the reported sample size, exclusion criteria and statistical analysis. This closer look at preregistrations of the first generation reveals possible hurdles for reporting preregistered studies and provides input for future reporting guidelines. We discuss the results and possible explanations, and provide recommendations for preregistered research.

From Outcome to Process Focus: Fostering a More Robust Psychological Science Through Registered Reports and Results-Blind Reviewing

2018 ◽  
Vol 13 (4) ◽  
pp. 448-456 ◽  
Author(s):  
James A. Grand ◽  
Steven G. Rogelberg ◽  
George C. Banks ◽  
Ronald S. Landis ◽  
Scott Tonidandel
Keyword(s):  
Research Process ◽  
Psychological Research ◽  
Scientific Practices ◽  
Psychological Science ◽  
Research Outcomes ◽  
Published Research ◽  
Distinguishing Features

A variety of alternative mechanisms, strategies, and “ways of doing” have been proposed for improving the rigor and robustness of published research in the psychological sciences in recent years. In this article, we describe two existing but underused publication models—registered reporting (RR) and results-blind reviewing (RBR)—that we believe would contribute in important ways to improving both the conduct and evaluation of psychological research. We first outline the procedures and distinguishing features of both publication pathways and note their value for promoting positive changes to current scientific practices. We posit that a significant value of RR and RBR is their potential to promote a greater focus on the research process (i.e., how and why research is conducted) relative to research outcomes (i.e., what was observed or concluded from research). We conclude by discussing what we perceive to be five common beliefs about RR and RBR practices and attempt to provide a balanced perspective of the realities likely to be experienced with these systems.

A pragmatist philosophy of psychological science and its implications for replication

2018 ◽  
Vol 41 ◽  
Author(s):  
Ana Gantman ◽  
Robin Gomila ◽  
Joel E. Martinez ◽  
J. Nathan Matias ◽  
Elizabeth Levy Paluck ◽  
...  
Keyword(s):  
William James ◽  
Mental Processes ◽  
Psychological Science ◽  
Behavioral Measurement ◽  
The World ◽  
Pragmatist Philosophy

AbstractA pragmatist philosophy of psychological science offers to the direct replication debate concrete recommendations and novel benefits that are not discussed in Zwaan et al. This philosophy guides our work as field experimentalists interested in behavioral measurement. Furthermore, all psychologists can relate to its ultimate aim set out by William James: to study mental processes that provide explanations for why people behave as they do in the world.

Replications can cause distorted belief in scientific progress

2018 ◽  
Vol 41 ◽  
Author(s):  
Michał Białek
Keyword(s):  
Real World ◽  
Scientific Progress ◽  
The Public ◽  
Psychological Science

AbstractIf we want psychological science to have a meaningful real-world impact, it has to be trusted by the public. Scientific progress is noisy; accordingly, replications sometimes fail even for true findings. We need to communicate the acceptability of uncertainty to the public and our peers, to prevent psychology from being perceived as having nothing to say about reality.

The many faces of obligation

2020 ◽  
Vol 43 ◽  
Author(s):  
Michael Tomasello
Keyword(s):  
Third Party ◽  
The Many ◽  
Sense Of Obligation

Abstract My response to the commentaries focuses on four issues: (1) the diversity both within and between cultures of the many different faces of obligation; (2) the possible evolutionary roots of the sense of obligation, including possible sources that I did not consider; (3) the possible ontogenetic roots of the sense of obligation, including especially children's understanding of groups from a third-party perspective (rather than through participation, as in my account); and (4) the relation between philosophical accounts of normative phenomena in general – which are pitched as not totally empirical – and empirical accounts such as my own. I have tried to distinguish comments that argue for extensions of the theory from those that represent genuine disagreement.

A Macintosh Interface for the Cameca Camebax-Micro Electron Microprobe

1990 ◽  
Vol 48 (1) ◽  
pp. 438-439
Author(s):  
Carl E. Henderson
Keyword(s):  
Electron Microprobe ◽  
Processing Speed ◽  
Word Processing ◽  
State Of The Art ◽  
Computer Control ◽  
Third Party ◽  
Disk Storage ◽  
The Past ◽  
User Facility ◽  
Instrument Control

Over the past few years it has become apparent in our multi-user facility that the computer system and software supplied in 1985 with our CAMECA CAMEBAX-MICRO electron microprobe analyzer has the greatest potential for improvement and updating of any component of the instrument. While the standard CAMECA software running on a DEC PDP-11/23+ computer under the RSX-11M operating system can perform almost any task required of the instrument, the commands are not always intuitive and can be difficult to remember for the casual user (of which our laboratory has many). Given the widespread and growing use of other microcomputers (such as PC’s and Macintoshes) by users of the microprobe, the PDP has become the “oddball” and has also fallen behind the state-of-the-art in terms of processing speed and disk storage capabilities. Upgrade paths within products available from DEC are considered to be too expensive for the benefits received. After using a Macintosh for other tasks in the laboratory, such as instrument use and billing records, word processing, and graphics display, its unique and “friendly” user interface suggested an easier-to-use system for computer control of the electron microprobe automation. Specifically a Macintosh IIx was chosen for its capacity for third-party add-on cards used in instrument control.

Coding for Evaluation and Treatment

2008 ◽  
Vol 18 (1) ◽  
pp. 9-20 ◽  
Author(s):  
Mark Kander ◽  
Steve White
Keyword(s):  
Medical Record ◽  
Treatment Session ◽  
Accurate Diagnosis ◽  
Third Party ◽  
Speech Language Pathologists ◽  
Adequate Information ◽  
Diagnosis Codes ◽  
Coding Rules ◽  
Procedure Codes ◽  
The Web

Abstract This article explains the development and use of ICD-9-CM diagnosis codes, CPT procedure codes, and HCPCS supply/device codes. Examples of appropriate coding combinations, and Coding rules adopted by most third party payers are given. Additionally, references for complete code lists on the Web and a list of voice-related CPT code edits are included. The reader is given adequate information to report an evaluation or treatment session with accurate diagnosis, procedure, and supply/device codes. Speech-language pathologists can accurately code services when given adequate resources and rules and are encouraged to insert relevant codes in the medical record rather than depend on billing personnel to accurately provide this information. Consultation is available from the Division 3 Reimbursement Committee members and from [email protected] .

Sign in / Sign up

Export Citation Format

Share Document