scholarly journals Evidence on Research Transparency in Economics

2021 ◽  
Vol 35 (3) ◽  
pp. 193-214
Author(s):  
Edward Miguel
Keyword(s):  
Social Science ◽  
Open Data ◽  
Open Science ◽  
Science Practices ◽  
Radar Screen ◽  
Rapid Transition ◽  
Research Transparency ◽  
Journal Policies ◽  
Economics Research

A decade ago, the term “research transparency” was not on economists' radar screen, but in a few short years a scholarly movement has emerged to bring new open science practices, tools and norms into the mainstream of our discipline. The goal of this article is to lay out the evidence on the adoption of these approaches – in three specific areas: open data, pre-registration and pre-analysis plans, and journal policies – and, more tentatively, begin to assess their impacts on the quality and credibility of economics research. The evidence to date indicates that economics (and related quantitative social science fields) are in a period of rapid transition toward new transparency-enhancing norms. While solid data on the benefits of these practices in economics is still limited, in part due to their relatively recent adoption, there is growing reason to believe that critics' worst fears regarding onerous adoption costs have not been realized. Finally, the article presents a set of frontier questions and potential innovations.

scholarly journals Gambling Researchers’ Use and Views of Open Science Principles and Practices: A Brief Report

2021 ◽  
Author(s):  
Debi LaPlante ◽  
Eric R. Louderback ◽  
Brett Abarbanel
Keyword(s):  
Science Education ◽  
Social Science ◽  
Research Methodology ◽  
Open Data ◽  
Science Research ◽  
Open Science ◽  
Extensive Experience ◽  
Science Practices ◽  
Psychology And Economics ◽  
Open Materials

Scientists across disciplines have begun to implement “open science” principles and practices, which are designed to enhance the quality, transparency, and replicability of scientific research. Yet, studies examining the use of open science practices in social science fields such as psychology and economics show that awareness and use of such practices often is low. In gambling studies research, no studies to date have empirically investigated knowledge of and use of open science practices. In the present study, we collected survey data about awareness and use of open science practices from 86 gambling studies research stakeholders who had attended a major international gambling studies conference in May 2019. We found that—as hypothesized—a minority of gambling research stakeholders reported: 1) either some or extensive experience using open science research practices in general, and 2) either some or regular experience using specific open science practices, including study pre-registration, open materials/code, open data, and pre-print archiving. Most respondents indicated that replication was important for all studies in gambling research, and that genetic, neuroscience, and lab-based game characteristic studies were areas most in need of replication. Our results have important implications for open science education initiatives and for contemporary research methodology in gambling studies.

scholarly journals Learning Open Science by doing Open Science. A reflection of a qualitative research project-based seminar

2020 ◽  
Vol 36 (3) ◽  
pp. 263-279
Author(s):  
Isabel Steinhardt
Keyword(s):  
Qualitative Research ◽  
Open Source ◽  
Knowledge Society ◽  
Open Data ◽  
Open Science ◽  
Research Project ◽  
Science Practices ◽  
Bachelor's Degrees ◽  
Participatory Technologies ◽  
Digital Knowledge

Openness in science and education is increasing in importance within the digital knowledge society. So far, less attention has been paid to teaching Open Science in bachelor’s degrees or in qualitative methods. Therefore, the aim of this article is to use a seminar example to explore what Open Science practices can be taught in qualitative research and how digital tools can be involved. The seminar focused on the following practices: Open data practices, the practice of using the free and open source tool “Collaborative online Interpretation, the practice of participating, cooperating, collaborating and contributing through participatory technologies and in social (based) networks. To learn Open Science practices, the students were involved in a qualitative research project about “Use of digital technologies for the study and habitus of students”. The study shows the practices of Open Data are easy to teach, whereas the use of free and open source tools and participatory technologies for collaboration, participation, cooperation and contribution is more difficult. In addition, a cultural shift would have to take place within German universities to promote Open Science practices in general.

scholarly journals We need to change our attitude and journals can help

2019 ◽  
Author(s):  
Ineke Wessel ◽  
Helen Niemeyer
Keyword(s):  
Attitude Change ◽  
Open Science ◽  
Science Practices ◽  
Null Results ◽  
Journal Policies

Adopting Registered Reports is an important step for the European Journal of Psychotraumatology to promote open science practices in the field of psychotrauma research. However, adopting these practices requires us as individual researchers to change our perspective fundamentally. We need to put fears of being scooped aside, adopt a permissive stance towards making mistakes and accept that null-results should be part of the scientific record. Journal policies that reinforce openness and transparency can facilitate such an attitude change in individual researchers.

scholarly journals Open Developmental Science: An Overview and Annotated Reading List

2021 ◽  
Author(s):  
Tamara Kalandadze ◽  
Sara Ann Hart
Keyword(s):  
Open Access ◽  
Open Data ◽  
Open Science ◽  
Science Practices ◽  
The Core ◽  
Reading List ◽  
Annotated List ◽  
Developmental Science ◽  
Starting Point

The increasing adoption of open science practices in the last decade has been changing the scientific landscape across fields. However, developmental science has been relatively slow in adopting open science practices. To address this issue, we followed the format of Crüwell et al., (2019) and created summaries and an annotated list of informative and actionable resources discussing ten topics in developmental science: Open science; Reproducibility and replication; Open data, materials and code; Open access; Preregistration; Registered reports; Replication; Incentives; Collaborative developmental science.This article offers researchers and students in developmental science a starting point for understanding how open science intersects with developmental science. After getting familiarized with this article, the developmental scientist should understand the core tenets of open and reproducible developmental science, and feel motivated to start applying open science practices in their workflow.

scholarly journals Caracterización de las publicaciones de España y Portugal sobre Open Science y análisis de su presencia en las redes sociales

2019 ◽  
Vol 42 (2) ◽  
pp. 235 ◽  
Author(s):  
Daniela De Filippo ◽  
Paulo Silva ◽  
María Manuel Borges
Keyword(s):  
Social Science ◽  
Computer Science ◽  
Open Data ◽  
Open Science ◽  
Redes Sociales ◽  
Acceso Abierto

Se analizan las publicaciones sobre Ciencia Abierta de España y Portugal en la base de datos SCOPUS. A través de indicadores bibliométricos y altmétricos se estudia la repercusión de la producción en redes sociales. Entre 2000 y 2016 se detectaron 1273 documentos sobre el tema en ambos países, concentrados especialmente en el último quinquenio. Destacan las publicaciones sobre Open data y las temáticas de mayor producción han sido Computer Science y Social Science. Un tercio de las publicaciones con DOI ha tenido repercusión en las redes sociales siendo Twitter el medio que concentra mayor número de menciones. Si bien una tercera parte de los documentos se publicó en acceso abierto, no se detectó relación entre este indicador y la presencia en redes sociales.

scholarly journals Teaching Computational Social Science Skills to Psychology Students: An Undergraduate Research Lab Case Study

2020 ◽  
Vol 4 (1) ◽  
pp. 5-14
Author(s):  
Brian A. Eiler ◽  
◽  
Patrick C. Doyle ◽  
Rosemary L. Al-Kire ◽  
Heidi A. Wayment ◽  
...  
Keyword(s):  
Social Science ◽  
Data Science ◽  
Undergraduate Research ◽  
Psychology Students ◽  
Psychological Research ◽  
Open Science ◽  
Computational Social Science ◽  
Research Experience ◽  
Science Practices

This article provides a case study of a student-focused research experience that introduced basic data science skills and their utility for psychological research, providing practical learning experiences for students interested in learning computational social science skills. Skills included programming; acquiring, visualizing, and managing data; performing specialized analyses; and building knowledge about open-science practices.

scholarly journals Improving Social Science: Lessons from the Open Science Movement

2020 ◽  
Author(s):  
Per Engzell ◽  
Julia Marie Rohrer
Keyword(s):  
Social Sciences ◽  
Social Science ◽  
Open Science ◽  
Scientific Exchange ◽  
Research Transparency ◽  
Science Movement

The transdisciplinary movement towards greater research transparency opens the door for a meta-scientific exchange between different social sciences. In the spirit of such an exchange, we offer some lessons inspired by ongoing debates in psychology, highlighting the broad benefits of open science but also potential pitfalls, as well as practical challenges in the implementation that have not yet been fully resolved. Our discussion is aimed towards political scientists but relevant for population sciences more broadly.

Preregistration and Registered Reports

2021 ◽  
Author(s):  
Justin Reich
Keyword(s):  
Data Collection ◽  
Social Science ◽  
Educational Psychology ◽  
Data Analytics ◽  
Open Science ◽  
Science Methods ◽  
Special Issue ◽  
Scientific Process ◽  
Science Practices ◽  
Post Hoc

Preregistration and registered reports are two promising open science practices for increasing transparency in the scientific process. In particular, they create transparency around one of the most consequential distinctions in research design: the data analytics decisions made before data collection and post-hoc decisions made afterwards. Preregistration involves publishing a time-stamped record of a study design before data collection or analysis. Registered reports are a publishing approach that facilitates the evaluation of research without regard for the direction or magnitude of findings. In this paper, I evaluate opportunities and challenges for these open science methods, offer initial guidelines for their use, explore relevant tensions around new practices, and illustrate examples from educational psychology and social science. This paper was accepted for publication in Educational Psychologist volume 56, issue 2; scheduled for April 2021, as a part of a special issue titled, “Educational psychology in the open science era.”This preprint has been peer reviewed, but not copy edited by the journal and may differ from the final published version. The DOI of the final published version is: [insert preprint DOI number]. Once the article is published online, it will be available at the following permanent link: [insert doi link]

scholarly journals Born-Open Data for E-Prime

2020 ◽  
Author(s):  
Denis Cousineau
Keyword(s):  
Open Access ◽  
Open Data ◽  
Open Science ◽  
Research Community ◽  
Data Repository ◽  
Data Frame ◽  
Science Practices ◽  
Data Practices ◽  
Data Files ◽  
Access Data

Born-Open Data experiments are encouraged for better open science practices. To be adopted, Born-Open data practices must be easy to implement. Herein, I introduce a package for E-Prime such that the data files are automatically saved on a GitHub repository. The BornOpenData package for E-Prime works seamlessly and performs the upload as soon as the experiment is finished so that there is no additional steps to perform beyond placing a package call within E-Prime. Because E-Prime files are not standard tab-separated files, I also provide an R function that retrieves the data directly from GitHub into a data frame ready to be analyzed. At this time, there are no standards as to what should constitute an adequate open-access data repository so I propose a few suggestions that any future Born-Open data system could follow for easier use by the research community.

scholarly journals ‘Trust Us’: Open Data and Preregistration in Political Science and International Relations

2022 ◽  
Author(s):  
Bermond Scoggins ◽  
Matthew Peter Robertson
Keyword(s):  
International Relations ◽  
Political Science ◽  
Statistical Inference ◽  
Large Scale ◽  
Open Data ◽  
Population Level ◽  
Open Science ◽  
Science Practices ◽  
Level Data ◽  
Replication Crisis

The scientific method is predicated on transparency -- yet the pace at which transparent research practices are being adopted by the scientific community is slow. The replication crisis in psychology showed that published findings employing statistical inference are threatened by undetected errors, data manipulation, and data falsification. To mitigate these problems and bolster research credibility, open data and preregistration have increasingly been adopted in the natural and social sciences. While many political science and international relations journals have committed to implementing these reforms, the extent of open science practices is unknown. We bring large-scale text analysis and machine learning classifiers to bear on the question. Using population-level data -- 93,931 articles across the top 160 political science and IR journals between 2010 and 2021 -- we find that approximately 21% of all statistical inference papers have open data, and 5% of all experiments are preregistered. Despite this shortfall, the example of leading journals in the field shows that change is feasible and can be effected quickly.

Sign in / Sign up

Export Citation Format

Share Document