Psychology Exceptionalism and the Multiple Discovery of the Replication Crisis

2021 ◽  
pp. 108926802110465
Author(s):  
Nicole C. Nelson ◽  
Julie Chung ◽  
Kelsey Ichikawa ◽  
Momin M. Malik

This article outlines what we call the “narrative of psychology exceptionalism” in commentaries on the replication crisis: many thoughtful commentaries link the current crisis to the specificity of psychology’s history, methods, and subject matter, but explorations of the similarities between psychology and other fields are comparatively thin. Historical analyses of the replication crisis in psychology further contribute to this exceptionalism by creating a genealogy of events and personalities that shares little in common with other fields. We aim to rebalance this narrative by examining the emergence and evolution of replication discussions in psychology alongside their emergence and evolution in biomedicine. Through a mixed-methods analysis of commentaries on replication in psychology and the biomedical sciences, we find that these conversations have, from the early years of the crisis, shared a common core that centers on concerns about the effectiveness of traditional peer review, the need for greater transparency in methods and data, and the perverse incentive structure of academia. Drawing on Robert Merton’s framework for analyzing multiple discovery in science, we argue that the nearly simultaneous emergence of this narrative across fields suggests that there are shared historical, cultural, or institutional factors driving disillusionment with established scientific practices.

2021 ◽  
pp. 108926802110339
Author(s):  
Wolfgang Maiers

The current dismay within the mainstream of nomological psychology may result from the fact that the anomaly of non-replicability has a direct bearing on its very own methodological requirements and quality criteria of empirical research. The call for more scientific rigour on the customary avenue in order to secure unambiguous empirical findings gives, however, rise to suspect that the deeper reason for this anomaly is not yet recognised: namely, the misguided regulation of a strictly objective inquiry, distorting what is present and relevant in everyday life and treating the ‘subjective’ of the subject matter as the central root of interfering factors which have to be eliminated or neutralised in the pursuit of experimental hypothesis testing. The problems of replicability would thus be a proof once again that the notorious inversion between matter and method does not really work, due to the uncircumventable characteristics of human inter-/subjectivity. In this sense, the replication crisis replicates the perennial topic of all historical discussions about a crisis in psychology – the failure of a ‘psychology without subject’.


PeerJ ◽  
2019 ◽  
Vol 7 ◽  
pp. e6232 ◽  
Author(s):  
Richard Wiseman ◽  
Caroline Watt ◽  
Diana Kornbrot

The recent ‘replication crisis’ in psychology has focused attention on ways of increasing methodological rigor within the behavioral sciences. Part of this work has involved promoting ‘Registered Reports’, wherein journals peer review papers prior to data collection and publication. Although this approach is usually seen as a relatively recent development, we note that a prototype of this publishing model was initiated in the mid-1970s by parapsychologist Martin Johnson in the European Journal of Parapsychology (EJP). A retrospective and observational comparison of Registered and non-Registered Reports published in the EJP during a seventeen-year period provides circumstantial evidence to suggest that the approach helped to reduce questionable research practices. This paper aims both to bring Johnson’s pioneering work to a wider audience, and to investigate the positive role that Registered Reports may play in helping to promote higher methodological and statistical standards.


Author(s):  
Jaap Bos

After Reading This Chapter, You Will: Understand how political factors impact modern science Appreciate in what ways the replication crisis endangers the values of science Know how publication pressure and perverse incentives challenge scientific practices See why teaching ethics requires reactive, proactive, and reflexive education


Housing Shock ◽  
2020 ◽  
pp. 107-130
Author(s):  
Rory Hearne

This chapter outlines how Ireland is an interesting case through which to understand housing, because of its particular history. It shows that housing crises are not new, nor are they universal, either within countries or across different countries. It explores different philosophies of housing, from Keynesianism to neoliberalism. It details Ireland’s housing history, from early state intervention in favour of tenant farmers, and responses to the housing crisis of the early years of the Irish free State through building public council housing. It details local authority housing expansion through the 20th Century, producing high-quality homes and neighbourhoods. It also details the neoliberal housing shift internationally, as a dramatic shift took place in the economic order in the late 1970s and the 1980s. It then introduces the concepts of financialisation and marketisation in housing, and explains ho w neoliberalism unfolded in the Irish housing system. It then details the Irish housing boom and bust of the 2000s. It ends with an overview of cost rental housing: unitary and dualist housing systems, to understand the Irish housing system.


2019 ◽  
Author(s):  
Giulia Bertoldo

The present work aims to analyze the replicability crisis in psychology with a focus on statistical inference. The main objective is to highlight the risks to beware when performing hypotheses tests in a Frequentist framework. In addition to the classic Type I and Type II errors, two other errors that are not commonly considered are Type M error (magnitude) and Type S error (sign), concerning the size and direction of the effects. The first chapter introduces Null Hypothesis Significance Testing (NHST), the prevalent approach to statistical inference in the social sciences, following a historical perspective and presenting also the approaches of the statisticians Ronald Fisher, Jerzy Neyman and Egon Pearson. The second chapter discusses the replicability crisis in psychology with an analysis of the origins, the factors that contributed to the crisis and solutions proposed for a change of direction. The third chapter analyzes the role of Type M and Type S errors in the replicability crisis. Studies with a high probability of committing these two types of errors could provide estimates of effects that are exaggerated and/or in the wrong direction. Two types of analysis are presented to examine these errors before conducting a study (prospective design analysis) or once the study has already been conducted (retrospective design analysis). The fourth chapter aims to link Type M and Type S errors with the decline effect, which is the observation that the magnitude of effects decreases with repeated replications. Although there may be multiple reasons behind the decline effect, a possible explanation is that the original study overestimated the effect. A case study illustrates how a retrospective design analysis of the original study can provide information on the probability of Type M and Type S errors and give support to the hypothesis of overestimation. The final chapter summarizes the contributions of Type M and Type S errors to the replication crisis and the role of a design analysis in planning studies and analyzing results.


2018 ◽  
Author(s):  
Bence Palfi ◽  
Peter Lush ◽  
Ryan Bradley Scott ◽  
Zoltan Dienes

Hypnosis and hypnotic suggestions are gradually gaining popularity within the consciousness community as established tools for the experimental manipulation of illusions of involuntariness, hallucinations and delusions. However, hypnosis is still far from being a widespread instrument; a crucial hindrance to taking it up is the amount of time needed to invest in identifying people high and low in responsiveness to suggestion. In this study, we introduced an online assessment of hypnotic response and estimated the extent to which the scores and psychometric properties of an online screening differ from an offline one. We propose that the online screening of hypnotic response is viable as it reduces the level of responsiveness only by a slight extent. The application of online screening may prompt researchers to run large-scale studies with more heterogeneous samples, which would help researchers to overcome some of the issues underlying the current replication crisis in psychology.


2017 ◽  
Author(s):  
Fernanda Ferreira

Fame is often deserved, emerging from a person’s significant and timely contributions to science. It is also true that fame and quality clearly sometimes diverge: many people who do excellent work are barely known, and some people are famous even though their work is mediocre. Reliance on fame and name recognition when identifying psychologists as candidates for honors and awards helps to perpetuate a range of stereotypes and prevents us from broadening participation in our field, particularly from women and underrepresented groups. The pursuit of fame may also be contributing to the current crisis in psychology concerning research integrity, because it incentivizes quantity and speed in publishing. The right attitude towards fame is to use it wisely if it happens to come, but to focus our efforts on conducting excellent research and nurturing talent in others.


Sign in / Sign up

Export Citation Format

Share Document