scholarly journals Replication and Reproducibility in Primate Cognition Research

2021 ◽  
Author(s):  
Benjamin George Farrar ◽  
Christopher Krupenye ◽  
Alba Motes Rodrigo ◽  
Claudio Tennie ◽  
Julia Fischer ◽  
...  

Replication is an important tool used to test and develop scientific theories. Areas of biomedical and psychological research have experienced a replication crisis, in which many published findings failed to replicate. Following this, many other scientific disciplines have been interested in the robustness of their own findings. This chapter examines replication in primate cognitive studies. First, it discusses the frequency and success of replication studies in primate cognition and explores the challenges researchers face when designing and interpreting replication studies across the wide range of research designs used across the field. Next, it discusses the type of research that can probe the robustness of published findings, especially when replication studies are difficult to perform. The chapter concludes with a discussion of different roles that replication can have in primate cognition research.

2021 ◽  
Author(s):  
Michele B. Nuijten

Increasing evidence indicates that many published findings in psychology may be overestimated or even false. An often-heard response to this “replication crisis” is to replicate more: replication studies should weed out false positives over time and increase robustness of psychological science. However, replications take time and money – resources that are often scarce. In this chapter, I propose an efficient alternative strategy: a four-step robustness check that first focuses on verifying reported numbers through reanalysis before replicating studies in a new sample.


2019 ◽  
Author(s):  
Farid Anvari ◽  
Daniel Lakens

Replication failures of past findings in several scientific disciplines, including psychology, medicine, and experimental economics, have created a ‘crisis of confidence’ among scientists. Psychological science has been at the forefront of tackling these issues, with discussions about replication failures and scientific self-criticisms of questionable research practices (QRPs) increasingly taking place in public forums. How this replicability crisis impacts the public’s trust is a question yet to be answered by research. Whereas some researchers believe that the public’s trust will be positively impacted or maintained, others believe trust will be diminished. Because it is our field of expertise, we focus on trust in psychological science. We performed a study testing how public trust in past and future psychological research would be impacted by being informed about i) replication failures, ii) replication failures and criticisms of QRPs, and iii) replication failures, criticisms of QRPs, and proposed reforms. Results from a mostly European sample (N = 1129) showed that, compared to a control group, whereas trust in past research was reduced when people were informed about the aspects of the replication crisis, trust in future research was maintained except when they were also informed about proposed reforms. Potential explanations are discussed.


2019 ◽  
Vol 54 (1) ◽  
pp. 29-39
Author(s):  
John L. Luckner ◽  
Rashida Banerjee ◽  
Sara Movahedazarhouligh ◽  
Kaitlyn Millen

Current federal legislation emphasizes the use of programs, interventions, strategies, and activities that have been demonstrated through research to be effective. One way to increase the quantity and quality of research that guides practice is to conduct replication research. The purpose of this study was to undertake a systematic review of the replication research focused on self-determination conducted between 2007 and 2017. Using methods used by Cook and colleagues, we identified 80 intervention studies on topics related to self-determination, of which 31 were coded as replications. Intervention study trends, rate of replication studies, percentage of agreements between findings of original and replication studies, amount of author overlap, and types of research designs used are reported along with recommendations for future research.


2017 ◽  
Vol 41 (4) ◽  
pp. 451-464 ◽  
Author(s):  
Sara I. McClelland

In research using self-report measures, there is little attention paid to how participants interpret concepts; instead, researchers often assume definitions are shared, universal, or easily understood. I discuss the self-anchored ladder, adapted from Cantril’s ladder, which is a procedure that simultaneously collects a participant’s self-reported rating and their interpretation of that rating. Drawing from a study about sexual satisfaction that included a self-anchored ladder, four analyses are presented and discussed in relation to one another: (1) comparisons of sexual satisfaction scores, (2) variations of structures participants applied to the ladder, (3) frequency of terms used to describe sexual satisfaction, and (4) thematic analysis of “best” and “worst” sexual satisfaction. These analytic strategies offer researchers a model for how to incorporate self-anchored ladder items into research designs as a means to draw out layers of meaning in quantitative, qualitative, and mixed methods data. I argue that the ladder invites the potential for conceptual disruption by prioritizing skepticism in survey research and bringing greater attention to how social locations, histories, economic structures, and other factors shape self-report data. I also address issues related to the multiple epistemological positions that the ladder demands. Finally, I argue for the centrality of epistemological self-reflexivity in critical feminist psychological research. Additional online materials for this article are available on PWQ’s website at http://journals.sagepub.com/doi/suppl/10.1177/0361684317725985


2020 ◽  
Author(s):  
Cooper Hodges ◽  
Hannah Michelle Lindsey ◽  
Paula Johnson ◽  
Bryant M Stone ◽  
James carter

The replication crisis within the social and behavioral sciences has called into question the consistency of research methodology. A lack of attention to minor details in replication studies may limit researchers’ abilities to reproduce the results. One such overlooked detail is the statistical programs used to analyze the data. In the current investigation, we compared the results of several nonparametric analyses and measures of normality conducted on a large sample of data in SPSS, SAS, Stata, and R with results obtained through hand-calculation using the raw computational formulas. Multiple inconsistencies were found in the results produced between statistical packages due to algorithmic variation, computational error, and lack of clarity and/or specificity in the statistical output generated. We also highlight similar inconsistencies in supplementary analyses conducted on subsets of the data, which reflect realistic sample sizes. These inconsistencies were largely due to algorithmic variations used within packages when the analyses are performed on data from small- or medium-sized samples. We discuss how such inconsistencies may influence the conclusions drawn from the results of statistical analyses depending on the statistical software used, and we urge researchers to analyze their data across multiple packages, report details regarding the statistical procedure used for data analysis and consider these details when conducting direct replications studies.


2016 ◽  
Author(s):  
Robert Z. Selden ◽  
Thomas J. Williams ◽  
Nancy Velchoff ◽  
Michael B. Collins

On August 19, 2016, selected Clovis artifacts from the Gault site (41BL323) were scanned in advance of a large collaborative research project. These data were collected using a NextEngineHD running ScanStudioHD Pro, and were post-processed in Geomagic Design X 2016.0.1. All data associated with this project have been made publicly available (open access) and are accessible in Zenodo under a Creative Commons Attribution license, where they can be downloaded for use in additional projects and learning activities. These data have the capacity to augment a variety of research designs spanning the digital humanities, applications of geometric morphometrics, and many others. Additionally, these scans will augment a wide range of comparative research topics throughout the Americas and beyond. Reuse potential for these data is significant.


2020 ◽  
Author(s):  
Cameron Brick ◽  
Bruce Hood ◽  
Vebjørn Ekroll ◽  
Lee de-Wit

The reliance in psychology on verbal definitions means that psychological research is unusually moored to how humans think and communicate about categories. Psychological concepts (e.g., intelligence; attention) are easily assumed to represent objective, definable categories with an underlying essence. Like the 'vital forces' previously thought to animate life, these assumed essences can create an illusion of understanding. We describe a pervasive tendency across psychological science to assume that essences explain phenomena by synthesizing a wide range of research lines from cognitive, clinical, and biological psychology and neuroscience. Labeling a complex phenomenon can appear as theoretical progress before sufficient evidence that the described category has a definable essence or known boundary conditions. Category labels can further undermine progress by masking contingent and contextual relationships and obscuring the need to specify mechanisms. Finally, we highlight examples of promising methods that circumvent the lure of essences and we suggest four concrete strategies to identify and avoid essentialist intuitions in theory development.


Psychology ◽  
2020 ◽  
Author(s):  
David C. Devonis

The Stanford Prison Experiment (SPE) took place at a time when the sources of authoritarianism and evil were a focal concern in psychology. It emerged from a tradition of activist social psychological research beginning with Solomon Asch in the 1940s and extending through Stanley Milgram’s obedience experiments in the early 1960s. The SPE was a product of the research program of social psychologist Philip Zimbardo, a member of the Stanford psychology faculty since 1968. Discussions among Zimbardo’s students in spring 1971 led to a plan to simulate a prison environment. They converted portions of the basement of a University building into a combination booking room and jail. Zimbardo and a number of his graduate and undergraduate students took on supervisory roles. Before the Experiment began, paid participants recruited through newspaper advertisements were screened to eliminate obvious psychopathology, then randomly assigned to either the role of ‘guard’ or ‘prisoner.’ On the first experimental morning August 14, 1971, actual local police simulated an arrest of each of the prisoner participants. After they arrived, blindfolded, a simulated booking took place. Guards escorted them to the prison hallway where prisoners were required to strip and exchange their clothing for simple shifts and slippers. After a simulated spray delousing, they entered makeshift cells. After this, the Experiment evolved as an extended improvisation, by both the guards and prisoners, on prison-related themes. Episodes of deprivation, bullying, and humiliation emerged unplanned. Originally planned to run for two weeks, the Experiment lasted only six days, prematurely terminated when its supervising personnel judged that the simulation had gotten out of their control. The coincidence of its termination with the Attica prison uprising in New York led to its immediate dissemination in the news. Since then the SPE has become one of the most iconic psychological studies of psychology’s modern era. Although intended to expose and ameliorate bad prison conditions, its effectiveness in this regard diminished during a rapid shift in US prison policy, in the mid-1970’s, from reform to repression. Over succeeding decades, the Experiment continued to stimulate the popular imagination, leading to an extensive replication on British television and its portrayal in two feature films. Soon after its original publication, the SPE attracted criticisms of its methodology. After 2010, critical scrutiny of the SPE as well as similar iconic studies from the 1960s and 1970s increased, fueled by the growing ‘replication crisis’ in psychology. This most recent phase of criticism reflects not just a turn toward reflexive disciplinary self-criticism but also the increased availability of archival sources for examination. The SPE continues to excite both passionate support and equally passionate obloquy, much as have other comparable simulations of human social behavior.


2018 ◽  
Vol 40 (1) ◽  
pp. 45-57 ◽  
Author(s):  
Michele Sinico

Summary This paper examines the experimentum crucis under the light of the Duhem’s holistic thesis. This methodological instrument is not usable in physics, because physical theories are always logically connected to many assumptions. On the contrary, it is usable in psychological research oriented to perceptual laws, when these laws are, without any hypothetical term, isolated systems. An application of experimentum crucis in Experimental Phenomenology of perception is presented. In conclusion, the role of perceptual knowledge as an essential assumption in other scientific disciplines that have a high degree of theoricity is also underlined.


2005 ◽  
Vol 69 (3) ◽  
pp. 373-392 ◽  
Author(s):  
Ling Yuan ◽  
Itzhak Kurek ◽  
James English ◽  
Robert Keenan

SUMMARY Systematic approaches to directed evolution of proteins have been documented since the 1970s. The ability to recruit new protein functions arises from the considerable substrate ambiguity of many proteins. The substrate ambiguity of a protein can be interpreted as the evolutionary potential that allows a protein to acquire new specificities through mutation or to regain function via mutations that differ from the original protein sequence. All organisms have evolutionarily exploited this substrate ambiguity. When exploited in a laboratory under controlled mutagenesis and selection, it enables a protein to “evolve” in desired directions. One of the most effective strategies in directed protein evolution is to gradually accumulate mutations, either sequentially or by recombination, while applying selective pressure. This is typically achieved by the generation of libraries of mutants followed by efficient screening of these libraries for targeted functions and subsequent repetition of the process using improved mutants from the previous screening. Here we review some of the successful strategies in creating protein diversity and the more recent progress in directed protein evolution in a wide range of scientific disciplines and its impacts in chemical, pharmaceutical, and agricultural sciences.


Sign in / Sign up

Export Citation Format

Share Document