scholarly journals Code Sharing in Psychological Methods and Statistics: An Overview and Associations with Conventional and Alternative Research Metrics

2020 ◽  
Author(s):  
Šimon Kucharský ◽  
Bobby Lee Houtkoop ◽  
Ingmar Visser

Towards discovering more effective means to promote code sharing as an open science practice, this study explores the current state of code sharing within the field of psychological methods and statistics and examines the association between this practice and conventional and alternative research metrics. Towards this purpose, a total of 815 articles from three major journals within the field of psychological methods and statistics were manually screened and encoded based on code sharing practices and general article characteristics. In addition, data on conventional (citation counts) and alternative research metrics (Altmetric Attention Score) was retrieved through online scientific databases (Web of Science and Altmetric.com). This input was then analysed using descriptive statistics and regression models suitable for count data, and robustness of the findings were assessed using multiverse analysis. The findings of this study suggest that the sharing of scientific computer code is not (yet) extensively practiced within the field of psychological methods and statistics. In the majority of academic articles included in this study, scientific computer code was not shared (66 %). Moreover, if such code was shared, it was frequently found to be improperly annotated (70 %) and/or incomplete (52 %). Nevertheless, the findings of this study also suggest a hopeful prospect, as the sharing of scientific computer code has increased between 2010 and 2017. The study revealed a robust positive connection with alternative research metrics. This study did not find robust positive connection between code sharing and citation counts.

2019 ◽  
Author(s):  
Thomas R Etherington ◽  
Ben Jolly ◽  
Jan Zörner ◽  
Nick Spencer

Reproducible science is greatly aided by open publishing of scientific computer code. There are also many institutional benefits for encouraging the publication of scientific code, but there are also institutional considerations around intellectual property and risk. We discuss questions around scientific code publishing from the perspective of a research organisation asking: who will be involved, how should code be licensed, where should code be published, how to get credit, what standards, and what costs? In reviewing advice and evidence relevant to these questions we propose a research institution framework for publishing open scientific code to enable reproducible science.


Author(s):  
Alessandro Petruzzi ◽  
Francesco D’Auria ◽  
Tomislav Bajs ◽  
Francesc Reventos

Thermal-hydraulic system computer codes are extensively used worldwide for analysis of nuclear facilities by utilities, regulatory bodies, nuclear power plant designers and vendors, nuclear fuel companies, research organizations, consulting companies, and technical support organizations. The computer code user represents a source of uncertainty that can influence the results of system code calculations. This influence is commonly known as the ‘user effect’ and stems from the limitations embedded in the codes as well as from the limited capability of the analysts to use the codes. Code user training and qualification is an effective means for reducing the variation of results caused by the application of the codes by different users. This paper describes a systematic approach to training code users who, upon completion of the training, should be able to perform calculations making the best possible use of the capabilities of best estimate codes. In other words, the program aims at contributing towards solving the problem of user effect. The 3D S.UN.COP (Scaling, Uncertainty and 3D COuPled code calculations) seminars have been organized as follow-up of the proposal to IAEA for the Permanent Training Course for System Code Users [1]. Five seminars have been held at University of Pisa (2003, 2004), at The Pennsylvania State University (2004), at University of Zagreb (2005) and at the School of Industrial Engineering of Barcelona (2006). It was recognized that such courses represented both a source of continuing education for current code users and a mean for current code users to enter the formal training structure of a proposed ‘permanent’ stepwise approach to user training. The 3D S.UN.COP 2006 was successfully held with the attendance of 33 participants coming from 18 countries and 28 different institutions (universities, vendors, national laboratories and regulatory bodies). More than 30 scientists (coming from 13 countries and 23 different institutions) were involved in the organization of the seminar, presenting theoretical aspects of the proposed methodologies and holding the training and the final examination. A certificate (LA Code User grade) was released to participants that successfully solved the assigned problems. A sixth seminar will be organized in 2007 at the Texas A&M University involving more than 30 scientists between lecturers and code developers. (http://dimnp.ing.unipi.it/3dsuncop/2007)


Author(s):  
Alessandro Petruzzi ◽  
Francesco D’Auria ◽  
Tomislav Bajs ◽  
Francesc Reventos

Thermal-hydraulic system computer codes are extensively used worldwide for analysis of nuclear facilities by utilities, regulatory bodies, nuclear power plant designers and vendors, nuclear fuel companies, research organizations, consulting companies, and technical support organizations. The computer code user represents a source of uncertainty that can influence the results of system code calculations. This influence is commonly known as the ‘user effect’ and stems from the limitations embedded in the codes as well as from the limited capability of the analysts to use the codes. Code user training and qualification is an effective means for reducing the variation of results caused by the application of the codes by different users. This paper describes a systematic approach to training code users who, upon completion of the training, should be able to perform calculations making the best possible use of the capabilities of best estimate codes. In other words, the program aims at contributing towards solving the problem of user effect. The 3D S.UN.COP (Scaling, Uncertainty and 3D COuPled code calculations) seminars have been organized as follow-up of the proposal to IAEA for the Permanent Training Course for System Code Users. Nine seminars have been held at University of Pisa (two in 2004), at The Pennsylvania State University (2004), at the University of Zagreb (2005), at the School of Industrial Engineering of Barcelona (January-February 2006), in Buenos Aires, Argentina (October 2006), requested by Autoridad Regulatoria Nuclear (ARN), Nucleoelectrica Argentina S.A (NA-SA) and Comisio´n Nacional de Energi´a Ato´mica (CNEA), at the College Station, Texas A&M, (January-February 2007), in Hamilton and Niagara Falls, Ontario (October 2007) requested by Atomic Energy Canada Limited (AECL), Canadian Nuclear Society (CNS) and Canadian Nuclear Safety Commission (CNSC), in Petten, The Netherlands (October 2008) in cooperation with the Institute of Energy of the Joint Research Center of the European Commission (IE-JRC-EC). It was recognized that such courses represented both a source of continuing education for current code users and a mean for current code users to enter the formal training structure of a proposed ‘permanent’ stepwise approach to user training. The 3D S.UN.COP 2008 at IE-JRC was successfully held with the attendance of 35 participants coming from more than 10 countries and 20 different institutions (universities, vendors and national laboratories). More than 30 scientists (coming from more than 10 countries and 20 different institutions) were involved in the organization of the seminar, presenting theoretical aspects of the proposed methodologies and holding the training and the final examination. A certificate (LA Code User grade) was released to participants that successfully solved the assigned problems. A tenth seminar will be held (October 2009) at the Royal Institute of Technology (KTH) in Amsterdam (Sweden), involving more than 30 scientists between lectures and code developers (http://dimnp.ing.unipi.it/3dsuncop/2009/index.html).


Author(s):  
Rae-Joon Park ◽  
Kyoung-Ho Kang ◽  
Jong-Tae Kim ◽  
Kil-Mo Koo ◽  
Sang-Baik Kim ◽  
...  

Experimental and analytical studies on the penetration integrity of the reactor vessel in the APR (Advanced Power Reactor) 1400 have been performed under the condition of external vessel cooling in a severe accident. The objective of this study is to estimate failure or non-failure of the penetration including the ICI (In-Core Instrumentation) nozzle and the thimble tube. Five tests in conditions with and without external vessel cooling have been performed to estimate the effects of system, corium mass, and vessel geometry using alumina (Al2O3) melt as a simulant. The test results have been evaluated using the LILAC (Lower head IntegraL Analysis computer Code). The tests results have shown that penetration in the no external vessel cooling case is more damaged than that in the external vessel cooling case. An increase in system pressure from 0.9 MPa to 1.5 MPa was not effective on penetration damage, but an increase in corium mass from 40 kg to 60 kg and a vessel geometry change to flat plate with curvature were effective. The LILAC results are very similar to the test results on the ablation depth in the weld. It is concluded that external vessel cooling is a very effective means for maintaining penetration integrity.


Author(s):  
Pachisa Kulkanjanapiban ◽  
Tipawan Silwattananusarn

<p>This paper shows a significant comparison of two primary bibliographic data sources at the document level of Scopus and Dimensions. The emphasis is on the differences in their document coverage by institution level of aggregation. The main objective is to assess whether Dimensions offers at the institutional level good new possibilities for bibliometric analysis as at the global level. The results of a comparative study of the citation count profiles of articles published by faculty members of Prince of Songkla University (PSU) in Dimensions and Scopus from the year the databases first included PSU-authored papers (1970 and 1978, respectively) through the end of June 2020. Descriptive statistics and correlation analysis of 19,846 articles indexed in Dimensions and 13,577 indexed in Scopus. The main finding was that the number of citations received by Dimensions was highly correlated with citation counts in Scopus. Spearman’s correlation between citation counts in Dimensions and Scopus was a high and mighty relationship. The findings mainly affect Dimensions’ possibilities as instruments for carrying out bibliometric analysis of university members’ research productivity. University researchers can use Dimensions to retrieve information, and the design policies can be used to evaluate research using <br />scientific databases.</p>


2008 ◽  
Vol 2008 ◽  
pp. 1-16 ◽  
Author(s):  
Alessandro Petruzzi ◽  
Francesco D'Auria ◽  
Tomislav Bajs ◽  
Francesc Reventos ◽  
Yassin Hassan

Thermal-hydraulic system computer codes are extensively used worldwide for analysis of nuclear facilities by utilities, regulatory bodies, nuclear power plant designers, vendors, and research organizations. The computer code user represents a source of uncertainty that can influence the results of system code calculations. This influence is commonly known as the “user effect” and stems from the limitations embedded in the codes as well as from the limited capability of the analysts to use the codes. Code user training and qualification represent an effective means for reducing the variation of results caused by the application of the codes by different users. This paper describes a systematic approach to training code users who, upon completion of the training, should be able to perform calculations making the best possible use of the capabilities of best estimate codes. In other words, the program aims at contributing towards solving the problem of user effect. In addition, this paper presents the organization and the main features of the 3D S.UN.COP (scaling, uncertainty, and 3D coupled code calculations) seminars during which particular emphasis is given to the areas of the scaling, uncertainty, and 3D coupled code analysis.


2019 ◽  
Author(s):  
Thomas R Etherington ◽  
Ben Jolly ◽  
Jan Zörner ◽  
Nick Spencer

Reproducible science is greatly aided by open publishing of scientific computer code. There are also many institutional benefits for encouraging the publication of scientific code, but there are also institutional considerations around intellectual property and risk. We discuss questions around scientific code publishing from the perspective of a research organisation asking: who will be involved, how should code be licensed, where should code be published, how to get credit, what standards, and what costs? In reviewing advice and evidence relevant to these questions we propose a research institution framework for publishing open scientific code to enable reproducible science.


2020 ◽  
Author(s):  
Jürgen Schneider ◽  
Tom Rosman ◽  
Augustin Kelava ◽  
Samuel Merk

As a response to the replication crisis, reforms call for the implementation of open science standards. In this regard, open science badges are a promising method to signal a study’s adherence to open science practices (OSP). In an experimental study, we investigated whether badges on journal article title pages affect non-scientists’ trust in scientists. Furthermore, we analyzed the moderating role of epistemic beliefs in this regard. We randomly assigned 270 non-scientists to two of three conditions: Badges awarded (visible compliance to OSP), badges not awarded (visible non-compliance to OSP) and no badges (compliance not visible, control condition). Results indicate that badges influence trust in scientists as well as the epistemic beliefs of participants. However, epistemic beliefs did not moderate the effect of badges on trust. In sum, our paper provides support to the notion that badges are an effective means to promote epistemic beliefs and trust in scientists.


Author(s):  
Julian Cribb ◽  
Tjempaka Sari

Open Science is about how we address the profound challenges which now confront humanity: climate, the food crisis, environmental degradation, resource scarcity and disease; through science communication. These call for the sharing of scientific knowledge among billions of humans, on a scale never before attempted. Open Science offers practical ways to communicate science in a highly networked world where billions of people still have little or no access to advanced knowledge or technologies. The authors describe low-cost, effective means to transfer knowledge to target audiences in industry, government, the community and to the public at large. The book features sections on good science writing, practical advice on how to develop communication and media strategies, ways to measure communication performance, how to handle institutional 'crises', how to deal with politicians and much more.


Sign in / Sign up

Export Citation Format

Share Document