scholarly journals Replication and Open Science in Applied Linguistics Research

2021 ◽  
Author(s):  
Kevin McManus

This chapter addresses the role and place of replication research and open science practices in advancing theory building and new research directions in the field of applied linguistics. The chapter begins by describing what replication research is, what the most common types of replication study are, and why carrying out replication matters. Close attention is paid throughout to the ways in which replication benefits from and contributes to a variety of open science initiatives, including open materials, open access and preprints, and preregistration.

2021 ◽  
Author(s):  
Tamara Kalandadze ◽  
Sara Ann Hart

The increasing adoption of open science practices in the last decade has been changing the scientific landscape across fields. However, developmental science has been relatively slow in adopting open science practices. To address this issue, we followed the format of Crüwell et al., (2019) and created summaries and an annotated list of informative and actionable resources discussing ten topics in developmental science: Open science; Reproducibility and replication; Open data, materials and code; Open access; Preregistration; Registered reports; Replication; Incentives; Collaborative developmental science.This article offers researchers and students in developmental science a starting point for understanding how open science intersects with developmental science. After getting familiarized with this article, the developmental scientist should understand the core tenets of open and reproducible developmental science, and feel motivated to start applying open science practices in their workflow.


2020 ◽  
Author(s):  
Denis Cousineau

Born-Open Data experiments are encouraged for better open science practices. To be adopted, Born-Open data practices must be easy to implement. Herein, I introduce a package for E-Prime such that the data files are automatically saved on a GitHub repository. The BornOpenData package for E-Prime works seamlessly and performs the upload as soon as the experiment is finished so that there is no additional steps to perform beyond placing a package call within E-Prime. Because E-Prime files are not standard tab-separated files, I also provide an R function that retrieves the data directly from GitHub into a data frame ready to be analyzed. At this time, there are no standards as to what should constitute an adequate open-access data repository so I propose a few suggestions that any future Born-Open data system could follow for easier use by the research community.


2021 ◽  
Vol 13 (2) ◽  
pp. 184-205
Author(s):  
Rosanna De Rosa ◽  
Biagio Aragona

Open science is considered a new science paradigm to make research accessible, accountable, and effective. Open science is already changing the academic profession starting from micro-practices to professional relations with epistemic communities and stakeholders, with implications that we are not yet able to predict. The article delves first into literature and official documentation to unfold the discursive regimes which sustain the spread of open science. A specific focus is then devoted to the professional transition, highlighting the role of funding organizations in setting the new science environment and the subjective experience of academics. The article is completed by a case study in the field of Research Data Management where the misalignment among incumbent/changing processes can be more apparent. Finally, a research agenda that focuses on how academic micro-practices are affecting organizations and science structures is proposed. This article aims at beginning to plow the ground for new research directions to emerge.


2021 ◽  
Author(s):  
Hunter Gehlbach ◽  
Carly D Robinson

Recently, scholars have noted how several “old school” practices—a host of well-regarded, long-standing scientific norms—in combination, sometimes compromise the credibility of research. In response, other scholarly fields have developed several “open science” norms and practices to address these credibility issues. Against this backdrop, this special issue explores the extent to which and how these norms should be adopted and adapted for educational psychology and education more broadly. Our introductory article contextualizes the special issue’s goals by: overviewing the historical context that led to open science norms (particularly in medicine and psychology); providing a conceptual map to illustrate the interrelationships between various old school as well as open science practices; and then describing educational psychologists’ opportunity to benefit from and contribute to the translation of these norms to novel research contexts. We conclude by previewing the articles in the special issue.


2020 ◽  
Author(s):  
Emma Karoune

This is a dataset gathered to assess the state of open science practices in phytolith research. All articles presenting primary phytolith data were extracted from 16 prominent archaeological and palaeoecological journals between 2009 and 2018. In total, the dataset contains information on 341 articles. This included archaeological (n=214), palaeoenvironmental (n=53) and methodological (n=74) studies. Information was recorded regarding the data location and what type of data was included in the text and as supplementary files. There was also data recorded in relation to open access, picture inclusion, use of the International code for Phytolith Nomenclature (ICPN) and the inclusion of a full method.


2021 ◽  
Author(s):  
David Matthew Markowitz ◽  
Hyunjin Song ◽  
Samuel Hardman Taylor

A significant paradigm shift is underway in communication research as open science practices (e.g., preregistration, open materials) are becoming more prevalent. The current work identified how much the field has embraced such practices and evaluated their impact on authors (e.g., citation rates). We collected 10,517 papers across 26 journals from 2010-2020, observing that 5.1% of papers used or mentioned open science practices. Communication research has seen the rate of non-significant p-values (ps > .055) increasing with the adoption of open science over time, but p-values just below p < .05 have not reduced with open science adoption. Open science adoption was unrelated to citation rate at the article level; however, it was inversely related to the journals’ h-index. Our results suggest communication organizations and scholars have important work ahead to make open science more mainstream. We close with suggestions to increase open science adoption for the field at large.


2021 ◽  
Author(s):  
David M Markowitz ◽  
Hyunjin Song ◽  
Samuel Hardman Taylor

Abstract A significant paradigm shift is underway in communication research as open science practices (e.g., preregistration, open materials) are becoming more prevalent. The current work identified how much the field has embraced such practices and evaluated their impact on authors (e.g., citation rates). We collected 10,517 papers across 26 journals from 2010 to 2020, observing that 5.1% of papers used or mentioned open science practices. Communication research has seen the rate of nonsignificant p-values (p > .055) increasing with the adoption of open science over time, but p-values just below p < .05 have not reduced with open science adoption. Open science adoption was unrelated to citation rate at the article level; however, it was inversely related to the journals’ h-index. Our results suggest communication organizations and scholars have important work ahead to make open science more mainstream. We close with suggestions to increase open science adoption for the field at large.


2021 ◽  
Author(s):  
Suzanne Hoogeveen ◽  
Michiel van Elk

The Cognitive Science of Religion (CSR) is a relatively young but prolific field that has offered compelling insights into religious minds and practices. However, many empirical findings within this field are still preliminary and their reliability remains to be determined. In this paper, we first argue that it is crucial to critically evaluate the CSR literature and adopt open science practices and replication research in particular to move the field forward. Second, we highlight the outcomes of previous replications and make suggestions for future replication studies in the CSR, with a particular focus on neuroscience, developmental psychology, and qualitative research. Finally, we provide a ‘replication script’ with advice on how to select, conduct, and organize replication research. Our approach is illustrated with a ‘glimpse behind the scenes’ of the recently launched Cross-Cultural Religious Replication Project, in the hope of inspiring scholars of religion to embrace open science and replication in their own research.


PLoS ONE ◽  
2021 ◽  
Vol 16 (5) ◽  
pp. e0251268
Author(s):  
Russell T. Warne ◽  
Sam Golightly ◽  
Makai Black

Psychologists have investigated creativity for 70 years, and it is now seen as being an important construct, both scientifically and because of its practical value to society. However, several fundamental unresolved problems persist, including a suitable definition of creativity and the ability of psychometric tests to measure divergent thinking—an important component of creativity—in a way that aligns with theory. It is this latter point that this registered report is designed to address. We propose to administer two divergent thinking tests (the verbal and figural versions of the Torrance Tests of Creative Thinking; TTCT) with an intelligence test (the International Cognitive Ability Resource test; ICAR). We will then subject the subscores from these tests to confirmatory factor analysis to test which of nine theoretically plausible models best fits the data. When this study is completed, we hope to better understand whether the degree to which the TTCT and ICAR measure distinct constructs. This study will be conducted in accordance with all open science practices, including pre-registration, open data and syntax, and open materials (with the exception of copyrighted and confidential test stimuli).


2021 ◽  
Vol 5 (Supplement_1) ◽  
pp. 199-200
Author(s):  
Derek Isaacowitz

Abstract Some GSA journals are especially interested in promoting transparency and open science practices, reflecting how some subdisciplines in aging are moving toward open science practices faster than others. In this talk, I will consider the transparency and open science practices that seem most relevant to aging researchers, such as preregistration, open data, open materials and code, sample size justification and analytic tools for considering null effects. I will also discuss potential challenges to implementing these practices as well as reasons why it is important to do so despite these challenges. The focus will be on pragmatic suggestions for researchers planning and conducting studies now that they hope to publish later.


Sign in / Sign up

Export Citation Format

Share Document