“The replication crisis in psychology: An overview for theoretical and philosophical psychology”: Correction to Wiggins and Christopherson (2019).

2021 ◽  
Vol 41 (2) ◽  
pp. 153-153
2021 ◽  
Author(s):  
Bradford Jay Wiggins ◽  
Cody D Christopherson

Psychology is in a replication crisis that has brought about a period of self-reflection and reform. Yet this reform appears in many ways to focus primarily on methodological and statistical practices, with little consideration for the foundational issues that concern many theoretical and philosophical psychologists and that may provide a richer account of the crisis. In this paper we offer an overview of the history of the replication crisis, the critiques and reforms at the heart of the crisis, and several points of intersection between the reform movement and broader theoretical and philosophical issues. We argue that the problems of the replication crisis and the concerns of the reform movement in fact provide various points of entry for theoretical and philosophical psychologists to collaborate with reformers in providing a more deeply philosophical critique and reform.


2021 ◽  
pp. 108926802110465
Author(s):  
Nicole C. Nelson ◽  
Julie Chung ◽  
Kelsey Ichikawa ◽  
Momin M. Malik

This article outlines what we call the “narrative of psychology exceptionalism” in commentaries on the replication crisis: many thoughtful commentaries link the current crisis to the specificity of psychology’s history, methods, and subject matter, but explorations of the similarities between psychology and other fields are comparatively thin. Historical analyses of the replication crisis in psychology further contribute to this exceptionalism by creating a genealogy of events and personalities that shares little in common with other fields. We aim to rebalance this narrative by examining the emergence and evolution of replication discussions in psychology alongside their emergence and evolution in biomedicine. Through a mixed-methods analysis of commentaries on replication in psychology and the biomedical sciences, we find that these conversations have, from the early years of the crisis, shared a common core that centers on concerns about the effectiveness of traditional peer review, the need for greater transparency in methods and data, and the perverse incentive structure of academia. Drawing on Robert Merton’s framework for analyzing multiple discovery in science, we argue that the nearly simultaneous emergence of this narrative across fields suggests that there are shared historical, cultural, or institutional factors driving disillusionment with established scientific practices.


PeerJ ◽  
2019 ◽  
Vol 7 ◽  
pp. e6232 ◽  
Author(s):  
Richard Wiseman ◽  
Caroline Watt ◽  
Diana Kornbrot

The recent ‘replication crisis’ in psychology has focused attention on ways of increasing methodological rigor within the behavioral sciences. Part of this work has involved promoting ‘Registered Reports’, wherein journals peer review papers prior to data collection and publication. Although this approach is usually seen as a relatively recent development, we note that a prototype of this publishing model was initiated in the mid-1970s by parapsychologist Martin Johnson in the European Journal of Parapsychology (EJP). A retrospective and observational comparison of Registered and non-Registered Reports published in the EJP during a seventeen-year period provides circumstantial evidence to suggest that the approach helped to reduce questionable research practices. This paper aims both to bring Johnson’s pioneering work to a wider audience, and to investigate the positive role that Registered Reports may play in helping to promote higher methodological and statistical standards.


2019 ◽  
Author(s):  
Giulia Bertoldo

The present work aims to analyze the replicability crisis in psychology with a focus on statistical inference. The main objective is to highlight the risks to beware when performing hypotheses tests in a Frequentist framework. In addition to the classic Type I and Type II errors, two other errors that are not commonly considered are Type M error (magnitude) and Type S error (sign), concerning the size and direction of the effects. The first chapter introduces Null Hypothesis Significance Testing (NHST), the prevalent approach to statistical inference in the social sciences, following a historical perspective and presenting also the approaches of the statisticians Ronald Fisher, Jerzy Neyman and Egon Pearson. The second chapter discusses the replicability crisis in psychology with an analysis of the origins, the factors that contributed to the crisis and solutions proposed for a change of direction. The third chapter analyzes the role of Type M and Type S errors in the replicability crisis. Studies with a high probability of committing these two types of errors could provide estimates of effects that are exaggerated and/or in the wrong direction. Two types of analysis are presented to examine these errors before conducting a study (prospective design analysis) or once the study has already been conducted (retrospective design analysis). The fourth chapter aims to link Type M and Type S errors with the decline effect, which is the observation that the magnitude of effects decreases with repeated replications. Although there may be multiple reasons behind the decline effect, a possible explanation is that the original study overestimated the effect. A case study illustrates how a retrospective design analysis of the original study can provide information on the probability of Type M and Type S errors and give support to the hypothesis of overestimation. The final chapter summarizes the contributions of Type M and Type S errors to the replication crisis and the role of a design analysis in planning studies and analyzing results.


2018 ◽  
Author(s):  
Bence Palfi ◽  
Peter Lush ◽  
Ryan Bradley Scott ◽  
Zoltan Dienes

Hypnosis and hypnotic suggestions are gradually gaining popularity within the consciousness community as established tools for the experimental manipulation of illusions of involuntariness, hallucinations and delusions. However, hypnosis is still far from being a widespread instrument; a crucial hindrance to taking it up is the amount of time needed to invest in identifying people high and low in responsiveness to suggestion. In this study, we introduced an online assessment of hypnotic response and estimated the extent to which the scores and psychometric properties of an online screening differ from an offline one. We propose that the online screening of hypnotic response is viable as it reduces the level of responsiveness only by a slight extent. The application of online screening may prompt researchers to run large-scale studies with more heterogeneous samples, which would help researchers to overcome some of the issues underlying the current replication crisis in psychology.


2017 ◽  
Vol 36 (3) ◽  
pp. 359-396
Author(s):  
Bin-Na Kim ◽  
Joonwon Choi ◽  
Hyunseok Ko

2018 ◽  
Vol 9 (1) ◽  
pp. 11-19
Author(s):  
Lexi Brunner

Reexamining William Rozeboom’s recommendations for the future direction of disciplines such as psychology and philosophy is imminent due to the pressing issues in null hypothesis significance testing (NHST). An overreliance on NHST forms the basis of the replication crisis in psychology. Likewise, the discipline’s stringent guidelines on significance levels convey a pressure to publish, which is also significantly contributing to the replication crisis. As researchers’ careers are staked on the extent to which they publish, reassessing the fundamental issues with NHST within the context of Rozeboom’s ideas is paramount. In this brief review, I focus specifically on Rozeboom’s critiques of NHST and on a proposed alternative for evaluating the depth of findings within the framework of theoretical psychology. Thereafter, I compare his foreboding concerns with modern issues facing the validity of psychology and posit Rozeboom prophesized the failings of the discipline years ahead of his time. Keywords: Theoretical Psychology; NHST; William Rozeboom; P-Hacking; Explanatory Induction


Sign in / Sign up

Export Citation Format

Share Document