scholarly journals General claims require generalized effects: A reply to Ruiz et al.’s (2020) ‘A systematic and critical response to Pendrous et al. (2020) replication study’

2020 ◽  
Author(s):  
Ian Hussey
Keyword(s):  
Scientific Community ◽  
Original Study ◽  
Replication Study ◽  
High Quality ◽  
Null Results ◽  
Critical Response ◽  
Replication Studies ◽  
Predictable Pattern ◽  
Made In

Recent evidence suggests the results of psychology studies replicate less than half the time. Replies are often then written by the authors of the original studies. This discourse often follows a predictable pattern: highly general claims are made in an original study, the replication produces null results, and the response by the original authors primarily focuses on reasons to disqualify the replication’s results from requiring consideration, rather than acknowledging that the original study’s finding may not in fact be replicable, or that the generality of the original claims may require revision or constraint. I illustrate these points using the example of a recently published trio of original study, failed replication, and response by original authors. I argue that our scientific goals would be better served by efforts to avoid falling into these writing tropes, and to instead move the discourse forward and reinforce the behaviours we want to see in our scientific community, such as the conduction of high-quality replication studies.

General claims require generalized effects: A reply to Ruiz et al.’s (2020) ‘A systematic and critical response to Pendrous et al. (2020) replication study’

2020 ◽  
Author(s):  
Ian Hussey
Keyword(s):  
Scientific Community ◽  
Original Study ◽  
Replication Study ◽  
High Quality ◽  
Null Results ◽  
Critical Response ◽  
Replication Studies ◽  
Predictable Pattern ◽  
Made In

Recent evidence suggests the results of psychology studies replicate less than half the time. Replies are often then written by the authors of the original studies. This discourse often follows a predictable pattern: highly general claims are made in an original study, the replication produces null results, and the response by the original authors primarily focuses on reasons to disqualify the replication’s results from requiring consideration, rather than acknowledging that the original study’s finding may not in fact be replicable, or that the generality of the original claims may require revision or constraint. I illustrate these points using the example of a recently published trio of original study, failed replication, and response by original authors. I argue that our scientific goals would be better served by efforts to avoid falling into these writing tropes, and to instead move the discourse forward and reinforce the behaviours we want to see in our scientific community, such as the conduction of high-quality replication studies.

scholarly journals A call for replications of addiction research: Which studies should we replicate & what constitutes a “successful” replication?

2020 ◽  
Author(s):  
Robert Heirene
Keyword(s):  
Problem Gambling ◽  
Experimental Research ◽  
Original Study ◽  
Replication Study ◽  
High Quality ◽  
Extant Literature ◽  
Entire Field ◽  
Replication Studies ◽  
Successful Replication

Several prominent researchers in the problem gambling field have recently called for high-quality replications of existing gambling studies. This call should be extended to the entire field of addiction research: there is a need to focus on ensuring that the understanding of addiction and related phenomena gained through the extant literature is robust and replicable. This article discusses two important questions addictions researchers should consider before proceeding with replication studies: [1] which studies should we attempt to replicate? And: [2] how should we interpret the findings of a replication study in relation to the original study? In answering these questions, a focus is placed on experimental research, though the discussion may still serve as a useful introduction to the topic of replications for addictions researchers using any methodology.

scholarly journals Bayesian evaluation of replication studies

2020 ◽  
Author(s):  
Hidde Jelmer Leplaa ◽  
Charlotte Rietbergen ◽  
Herbert Hoijtink
Keyword(s):  
Bayes Factor ◽  
Open Science ◽  
Original Study ◽  
Replication Study ◽  
Research Results ◽  
Replication Studies ◽  
Science Collaboration ◽  
Using Data

In this paper a method is proposed to determine whether the result from an original study is corroborated in a replication study. The paper is illustrated using data from the reproducibility project psychology by the Open Science Collaboration. This method emphasizes the need to determine what one wants to replicate: the hypotheses as formulated in the introduction of the original paper, or hypotheses derived from the research results presented in the original paper. The Bayes factor will be used to determine whether the hypotheses evaluated in/resulting from the original study are corroborated by the replication study. Our method to assess the successfulness of replication will better fit the needs and desires of researchers in fields that use replication studies.

Research Commentary: A Rejoinder: A Reflection on the Evolution of a Replication Study

2018 ◽  
Vol 49 (1) ◽  
pp. 111-115 ◽  
Author(s):  
Faiza M. Jamil
Keyword(s):  
Reward System ◽  
Past Research ◽  
Original Study ◽  
Replication Study ◽  
Expectancy Effects ◽  
Opportunity To Respond ◽  
Replication Studies ◽  
Teacher Expectancy ◽  
Do So

I appreciate the opportunity to respond to the thoughtful comments made by Alan Schoenfeld (2018) and Jon Star (2018) in their commentaries on replication studies in this issue of JRME, including their comments on our study of teacher expectancy effects (Jamil, Larsen, & Hamre, 2018). I have decided to write this rejoinder in the form of a personal reflection. As academics, we carry the tremendous burden of expertise, and perhaps that is partly why, as pointed out by Schoenfeld (2018), the academic reward system focuses so heavily on novelty and innovation. With our expertise, we are supposed to have all the answers, solve all the problems, and do so in brilliant, new ways. Replication studies are undervalued because they not only, by definition, recreate past research but, perhaps, also bring into question another scholar‧s expertise. Star (2018) even states that one of the three criteria of an outstanding replication study is that it “convincingly shows that there is reason to believe that the results of the original study may be flawed” (p. 99). Although this rigorous examination is precisely the way to build trust in the quality of our findings and move the field forward, it is also what makes it challenging to have candid conversations about what we do not know.

More Than One Replication Study Is Needed for Unambiguous Tests of Replication

2019 ◽  
Vol 44 (5) ◽  
pp. 543-570 ◽  
Author(s):  
Larry V. Hedges ◽  
Jacob M. Schauer
Keyword(s):  
High Power ◽  
Statistical Test ◽  
Original Study ◽  
Replication Study ◽  
Experimental Results ◽  
Replication Studies

The problem of assessing whether experimental results can be replicated is becoming increasingly important in many areas of science. It is often assumed that assessing replication is straightforward: All one needs to do is repeat the study and see whether the results of the original and replication studies agree. This article shows that the statistical test for whether two studies obtain the same effect is smaller than the power of either study to detect an effect in the first place. Thus, unless the original study and the replication study have unusually high power (e.g., power of 98%), a single replication study will not have adequate sensitivity to provide an unambiguous evaluation of replication.

scholarly journals Beïnvloedt een meer of minder sympathieke protagonist de transportatie van de lezer? : Twee nieuwe replicatiestudies

2019 ◽  
Vol 41 (3) ◽  
pp. 515-546
Author(s):  
Carel Jansen ◽  
Anneke de Graaf ◽  
Lettica Hustinx ◽  
Joëlle Ooms ◽  
Merel Schreinemakers ◽  
...  
Keyword(s):  
Statistical Tests ◽  
Meta Analysis ◽  
Original Study ◽  
Replication Study ◽  
Limited Extent ◽  
Replication Studies ◽  
Disposition Theory ◽  
Limited Power ◽  
Affective Disposition Theory ◽  
Positive Effect

Abstract Does a more or less sympathetic protagonist influence transportation of the reader? Two new replication studiesThree previous studies into presenting a protagonist in a story as more or less sympathetic have not provided a clear picture of the effects that the portrayal of the protagonist may have on transportation, and via transportation on story-consistent beliefs. Results from a first study (N = 83) by De Graaf and Hustinx (2015) suggest that the way the protagonist is portrayed ‐ as sympathetic, unsympathetic or neutral ‐ influences the extent to which readers are transported into a story. No significant effects on beliefs of the readers were found, however. In a direct replication study (N = 79) and in a conceptual replication study (N = 81), Jansen, Nederhoff, and Ooms (2017) found results that supported the hypotheses from the original study to a limited extent. In view of the relatively small numbers of participants in these three studies and the resulting limited power of the statistical tests two new, larger-scaled replication studies were conducted. A direct replication study was performed (N = 238) with the same versions of the story as used in the original study, and also a conceptual replication study (N = 248) with three versions of a new story. Again, the hypotheses from the original study were supported to a limited extent. A meta-analysis of all five studies revealed a large indirect positive effect of story version on transportation via empathy, when comparing the versions with a sympathetic protagonist with the versions with an unsympathetic protagonist. When comparing the neutral story versions with the versions with an unsympathetic protagonist, the meta-analytic indirect effect was medium sized. Other than what the Affective Disposition Theory (Raney, 2004; Zillmann, 1994; 2006) claims, the story versions with a neutral protagonist did not lead to an absence of emotional responses. Furthermore, the outcomes add to the Transportation-Imagery Model (Green & Brock, 2002; Van Laer, De Ruyter, Visconti, & Wetzels, 2014). While this model does not include concrete suggestions of story characteristics that lead to transportation, our studies show that a protagonist who is portrayed as sympathetic may contribute to the level of transportation that readers experience, be it indirectly through empathy.

A Comprehensive Review on C-3 Functionalization of β-Lactams

2019 ◽  
Vol 16 (1) ◽  
pp. 3-16 ◽  
Author(s):  
Reshma Nagpal ◽  
Jitender Bhalla ◽  
Shamsher S. Bari
Keyword(s):  
Scientific Community ◽  
Organometallic Reagent ◽  
Reaction Conditions ◽  
Biological Potential ◽  
Wide Range ◽  
Economic Strategies ◽  
Synthetic Utility ◽  
Recent Advancement ◽  
Equivalent Method ◽  
Made In

Background:A lot of advancement has been made in the area of β-lactams in recent times. Most of the research is targeted towards the synthesis of novel β-lactams, their functionalization and exploring their biological potential. The C-3 functionalization of β-lactams has continued to attract considerable interest of the scientific community due to their utility as versatile intermediates in organic synthesis and their therapeutic applications. This has led to the significant increase in efforts towards developing efficient and economic strategies for C-3 functionalized β-lactams.Objective:The present review aims to highlight recent advancement made in C-3 functionalization of β-lactams.Conclusion:To summarize, functionalization of β-lactams at C-3 is an essential aspect of β-lactam chemistry in order to improve/modify its synthetic utility as well as biological potential. The C-3 carbocation equivalent method has emerged as an important and convenient strategy for C-3 functionalization of β-lactam heterocycles which provides a wide range of β-lactams viz. 3-alkylated β-lactams, 3-aryl/heteroarylated β-lactams, 3- alkoxylated β-lactams. On the other hand, base mediated functionalization of β-lactams via carbanion intermediate is another useful approach but their scope is limited by the requirement of stringent reaction conditions. In addition to this, organometallic reagent mediated α-alkylation of 3-halo/3-keto-β-lactams also emerged as interesting methods for the synthesis of functionalized β-lactams having good yields and diastereoselectivities.

German labour market data – Data provision and access for the international scientific community

2020 ◽  
Vol 21 (3) ◽  
pp. 313-333
Author(s):  
Dana Müller ◽  
Stefanie Wolter
Keyword(s):  
Labour Market ◽  
Survey Data ◽  
Scientific Community ◽  
Market Research ◽  
Research Data ◽  
International Scientific Community ◽  
High Quality ◽  
Data Centre ◽  
Integrated Employment ◽  
Data Provision

AbstractThe Research Data Centre at the Institute for Employment Research (RDC-IAB) has been offering high-quality administrative and survey data on the German labour market for 15 years and has become one of the most important locations worldwide for researchers interested in data for labour market research. This article provides an overview of the RDC-IAB, including its data and access modes. The article presents two datasets in more detail: the Sample of Integrated Employment Biographies, a classic dataset, and the Linked Personnel Panel, a new dataset. Finally, this article provides insights into future infrastructure and data developments.

scholarly journals Informative value of referral letters from general practice for child and adolescent mental healthcare

2021 ◽  
Author(s):  
S. Aydin ◽  
M. R. Crone ◽  
B. M. Siebelink ◽  
M. E. Numans ◽  
R. R. J. M. Vermeiren ◽  
...  
Keyword(s):  
General Practice ◽  
Nodal Point ◽  
Mental Healthcare ◽  
Child And Adolescent ◽  
Child And Adolescent Psychiatry ◽  
Discriminative Ability ◽  
Replication Studies ◽  
Attention Deficit Hyperactivity Disorders ◽  
Referral Letters ◽  
Made In

AbstractAlthough referral letters (RLs) form a nodal point in a patient’s care journey, little is known about their informative value in child and adolescent mental healthcare. To determine the informative value of RLs to child and adolescent psychiatry, we conducted a chart review in medical records of minors registered at specialized mental healthcare between January 2015 and December 2017 (The Netherlands). Symptoms indicated in RLs originating from general practice (N = 723) were coded and cross-tabulated with the best estimate clinical classifications made in psychiatry. Results revealed that over half of the minors in the sample were classified in concordance with at least one reason for referral. We found fair to excellent discriminative ability for indications made in RLs concerning the most common psychiatric classifications (95% CI AUC: 60.9–70.6 for anxiety disorders to 90.5–100.0 for eating disorders). Logistic regression analyses suggested no statistically significant effects of gender, age, severity or mental healthcare history, with the exception of age and attention deficit hyperactivity disorders (ADHD), as RLs better predicted ADHD with increasing age (OR = 1.14, 95% CI 1.03–1.27). Contextual problems, such as difficulties studying, problems with parents or being bullied were indicated frequently and associated with classifications in various disorder groups. To conclude, general practitioners’ RLs showed informative value, contrary to common beliefs. Replication studies are needed to reliably incorporate RLs into the diagnostic work-up.

scholarly journals Non-destructive handheld XRF study of archaeological composite silver objects—the case study of the late Roman Seuso Treasure

2021 ◽  
Vol 13 (5) ◽  
Author(s):  
Viktória Mozgai ◽  
Bernadett Bajnóczi ◽  
Zoltán May ◽  
Zsolt Mráv
Keyword(s):  
Fluorescence Analysis ◽  
The Body ◽  
High Quality ◽  
X Ray ◽  
Composite Objects ◽  
Mechanical Attachment ◽  
Non Destructive ◽  
Made In ◽  
Late Roman

AbstractThis study details the non-destructive chemical analysis of composite silver objects (ewers, situlas, amphora and casket) from one of the most significant late Roman finds, the Seuso Treasure. The Seuso Treasure consists of fourteen large silver vessels that were made in the fourth–early fifth centuries AD and used for dining during festive banquets and for washing and beautification. The measurements were systematically performed along a pre-designed grid at several points using handheld X-ray fluorescence analysis. The results demonstrate that all the objects were made from high-quality silver (above 90 wt% Ag), with the exception of the base of the Geometric Ewer B. Copper was added intentionally to improve the mechanical properties of soft silver. The gold and lead content of the objects shows constant values (less than 1 wt% Au and Pb). The chemical composition as well as the Bi/Pb ratio suggests that the parts of the composite objects were manufactured from different silver ingots. The ewers were constructed in two ways: (i) the base and the body were made separately, or (ii) the ewer was raised from a single silver sheet. The composite objects were assembled using three methods: (i) mechanical attachment; (ii) low-temperature, lead-tin soft solders; or (iii) high-temperature, copper-silver hard solders. Additionally, two types of gilding were revealed by the XRF analysis, one with remnants of mercury, i.e. fire-gilding, and another type without remnants of mercury, presumably diffusion bonding.

Sign in / Sign up

Export Citation Format

Share Document