Evaluating quality of science in CGIAR research programs: Use of bibliometrics

2021 ◽  
pp. 003072702110242
Author(s):  
Max Rünzel ◽  
Paolo Sarfatti ◽  
Svetlana Negroustoueva

When evaluating Quality of Science (QoS) in the context of development initiatives, it is essential to define adequate criteria. The objective of this perspective paper is to show how altmetric and bibliometric indicators have been used to support the evaluation of QoS in the 2020 Review of the Phase 2-CGIAR Research Programs (CRPs, 2017–2022), where, for the first time, the Quality of Research for Development (QoR4D) frame of reference has been utilized across the entire CGIAR CRP portfolio. Overall, the CRP review showed a significant output of scientific publications during the period 2017–2020, with 4,872 articles, 220,101 references, and 7.1 citations per article. Additionally, wider interest in scientific publications is demonstrated by good to high altmetrics, with average attention scores ranging from 70.8 to 806.9 with an average of 425.1. The use of selected bibliometrics was shown to be an adequate tool, for use together with other qualitative indicators to evaluate the QoS in the 12 CRPs. The CRP review process clearly demonstrated that standardized, harmonized and consistent data on research output is paramount to provide high-quality quantitative instruments and should be a priority throughout the transition toward One CGIAR. Therefore, we conclude that the QoR4D framework should be augmented by standardized bibliometric indicators embedded in measurement frameworks within the new One CGIAR. Finally, its practical utilization in monitoring and evaluation should be supported with clear guidelines.

1970 ◽  
Vol 3 ◽  
pp. 175-184
Author(s):  
Julie Walker

Increasing the visibility of a journal is the key to increasing quality. The International Network for the Availability of Scientific Publications works with journal editors in the global South to publish their journals online and to increase the efficiency of the peer review process. Editors are trained in using the Open Journals System software and in online journal management and strategy so they have the tools and knowledge needed to initiate a ‘virtuous cycle' in which visibility leads to an increase in the number and quality of submissions and in turn, increased citations and impact. In order to maximise this increase in quality, it must be supported by strong editorial office processes and management. This article describes some of the issues and strategies faced by the editors INASP works with, placing a particular emphasis on Nepal Journals Online. Key words: INASP; Open Journals System; Journals Online Projects; Nepal Journals Online; journal visibility; peer review DOI: 10.3126/dsaj.v3i0.2786 Dhaulagiri Journal of Sociology and Anthropology Vol.3 2009 175-184


Social science research (SSR) has a vital role in enriching societies, by generating scientific knowledge that brings insights—even enlightenment—in understanding the dynamics of human behaviour and development. For social sciences to realize their potential in shaping public policy, it is imperative that the research ecosystem is dynamic and vibrant; the institutions governing it are robust and effective; and those producing quality research are strong and well governed. This volume elaborates on various dimensions of SSR in India, presenting a strong case for designing a comprehensive national social science policy which can meaningfully strengthen and promote a research ecosystem for improved public policymaking in the country. Addressing issues like lack of funding, availability of data, infrastructure, and quality of research output, it will serve as a national benchmark and reference database for social sciences in India.


2021 ◽  
Vol 98 ◽  
pp. 05037
Author(s):  
Olga Shakirova ◽  
Tatyana Stebliy ◽  
Nina Kozyavina ◽  
Olga Gorbunova ◽  
Olga Pavlovskaya

Modern society presents high requirements to the quality of humanitarian education, and one of the methods of optimization is the use of interactive education technologies. Formation of the system of teacher’s domination in implementation of active learning methods (ALM) is based on the development of meaningful components of own subject experience, representing continuous and purposeful process, the active use of which is an expression of independence and educational activity. In the metropolis environment, the degree of development of each component of the subject experience and their ratio between each other determine the teacher’s ability to construction and subsequent implementation of own educational route. The research objective was to develop a model of ALM selection for humanitarian education in metropolis and estimate it experimentally with consideration for existing level of development of subject experience of teachers of higher education. The research was based on theoretical (analysis of psychological and pedagogical scientific publications, regulatory documents, state educational standards, simulation, analysis and generalization of pedagogical experience) and practical (monitoring, expert appraisal, pedagogic experiment) methods. For the first time, the objective and subjective factors have been revealed and systemized, which can influence the development and subsequent implementation of subject experience of teachers in humanitarian education under conditions of metropolis. With consideration for highlighted scientifically substantiated meaningful components of subject experience, the model has been developed to support ALM by teachers depending on the level of formation of subject position of a teacher. During the performed pedagogical experiment the efficiency of different variants of the recommended model of pedagogical support during ALM selection has been determined.


2021 ◽  
Vol 10(1) (10(1)) ◽  
pp. 288-301
Author(s):  
Peter Onyonje Osiako ◽  
Viktória Szente

The quantity and quality of research output available on the subject of domestic tourism in Kenya is yet to be sufficiently documented. This review evaluates trends in the studies carried out on this subject and establishes perspectives revealed in these studies' findings. Methodologically, this is a conceptual review of integrative nature in which the reviewer summarized the findings of other studies conducted on domestic tourism in different parts of Kenya. Both published and unpublished works addressing domestic tourism in Kenya, and authored in the English language from January 1990 to August 2020 have been considered in the review. The reviewer used keywords to search relevant databases, arriving at thirty two pieces of work that were reviewed. The analysis focuses on themes covered by previous studies, methodologies used, and perspectives revealed in key findings. The review established a gap in existing literature in terms of quantity, quality, and scope, as discussed in the document. Recommendations are highlighted on ways to improve future research on domestic tourism in Kenya. This review will inform future approaches to research on domestic tourism in Kenya, for better policies and practice.


An unbiased and reasonable research evaluation should reflect the diversity and impact of research productivity. The evaluation of scientific research is essential to determine its achievement, reputation, growth, and progress of an individual or an institution. In this context, production and quality of scholarly content offer a strong foundation for its rational evaluation. The citations along with the number of scientific publications are predominantly used to evaluate research content. The use of scientometric indicators is of great use in the measurement and evaluation of the scientific research output, but at the same instant, it requires a great carefulness in use.


2021 ◽  
Vol 5 (2) ◽  
pp. 32-38
Author(s):  
Adaninggar Septi Subekti

The community service activity was conducted in the form of online training on Zoom and Youtube platforms. The participants were 80 lecturers, teachers, and university students from 28 different institutions. It aimed to facilitate the participants to be able to improve the quality of their scientific articles and to submit their articles to ‘carefully chosen’ journals. It lasted for 100 minutes. There were six important points regarding how the quality of research articles could be maintained and improved. Firstly, the participants should do a lot of reading before writing. Secondly, they should have strong rationales of conducting their studies. Thirdly, they needed to use combination of descriptive and analytical expressions. Fourth, they should write or review only relevant literature in meaty way. Next, they should ensure that all of the in-text citations correspond to the references. Last but not least, they should implement ethical principles in research. Furthermore, regarding how the participants could choose which journal was ‘best’ for their articles, four important points were discussed: choosing a journal which ‘matched’ the quality of the article, choosing a journal with regular publication, adhering to the chosen journal’s template, and asking the journal editors about the duration of the review process.  


2015 ◽  
Vol 98 (12) ◽  
pp. 1540-1549 ◽  
Author(s):  
Amy Waller ◽  
Kristy Forshaw ◽  
Jamie Bryant ◽  
Mariko Carey ◽  
Allison Boyes ◽  
...  

Author(s):  
Lonni Besançon ◽  
Nathan Peiffer-Smadja ◽  
Corentin Segalas ◽  
Haiting Jiang ◽  
Paola Masuzzo ◽  
...  

AbstractIn the last decade Open Science principles have been successfully advocated for and are being slowly adopted in different research communities. In response to the COVID-19 pandemic many publishers and researchers have sped up their adoption of Open Science practices, sometimes embracing them fully and sometimes partially or in a sub-optimal manner. In this article, we express concerns about the violation of some of the Open Science principles and its potential impact on the quality of research output. We provide evidence of the misuses of these principles at different stages of the scientific process. We call for a wider adoption of Open Science practices in the hope that this work will encourage a broader endorsement of Open Science principles and serve as a reminder that science should always be a rigorous process, reliable and transparent, especially in the context of a pandemic where research findings are being translated into practice even more rapidly. We provide all data and scripts at https://osf.io/renxy/.


2019 ◽  
Vol 4 ◽  
pp. 22-32 ◽  
Author(s):  
Burkan Isgor ◽  
Ueli Angst ◽  
Mette Geiker ◽  
Ceki Halmen ◽  
Carolyn Hansson ◽  
...  

Experience has shown that many aspects of experimental design for studying steel corrosion in cementitious systems may significantly influence the obtained results. In the absence of standardized methods to study steel corrosion in concrete, researchers usually define their own test setups, which partially explains the large scatter and uncertainty in the aggregated published data. When the details of these setups are not provided adequately, experimental results cannot be interpreted in a wider context. Unfortunately, many scientific publications lack important experimental details. Therefore, this paper aims at improving the quality of reported experimental details, observations, and data in scientific publications, and raising awareness for relevant issues to improve the quality of research in the field. To this end, this paper provides a list of experimental details that have been found important by many decades of research, and which are, thus, recommended to be considered in conducting and reporting laboratory studies involving corrosion of steel embedded in cementitious systems. Finally, we propose a checklist for reporting experimental data in scientific publications.


2019 ◽  
Vol 4 (2) ◽  
Author(s):  
Rizka Rahmaida ◽  
Asep Saefuddin ◽  
Bagus Sartono

<p>Research collaboration is one of the strength in research management due to its advantages in quantity and quality of the research. Co-authorship network is one of the proxies to evaluate the emerging research collaborations. Co-authorship that happens for the first time among a pair of author plays an important role as the key of success for their co-authorship in the future. Therefore, the research aims to build a model predicting new co-authorship as potential co-authorship. This research used scientific articles in Indonesian biodiversity research published in Scopus during 2006-2015. New co-authorship of between 4,628 pair of authors were analyzed in terms of their similarity in co-authorship network, research interest, and community to predict whether a pair of author will have a new co-authorship in future. Random forest classifier was used to build the model after applying 10-fold cross validation in various parameter and random undersampling technique as preprocessing procedures. The result shows that the similarity in network, community network, and research interest and becomes good features to predict the potential co-authorship among a pair of author. Furthermore, paired authors that predicted to be co-authored and involving authors from Indonesian Institute of Sciences are identified as the potential patners recommended for development of research teams.</p>


Sign in / Sign up

Export Citation Format

Share Document