scholarly journals Analyzing the Disciplinary Focus of Universities

2017 ◽  
pp. 161-185 ◽  
Author(s):  
Nicolas Robinson-Garcia ◽  
Evaristo Jiménez-Contreras
Keyword(s):  
Research Evaluation ◽  
Research Output ◽  
Judgment And Decision Making ◽  
Bibliometric Indicators ◽  
University Rankings ◽  
Key Factors ◽  
Research Activity ◽  
Disciplinary Differences ◽  
Higher Education System ◽  
League Tables

The phenomenon of rankings is intimately related with government interest in fiscalizing the research outputs of universities. New forms of managerialism have been introduced into the higher education system, leading to an increasing interest from funding bodies in developing external evaluation tools to allocate funds. Rankings rely heavily on bibliometric indicators. But, bibliometricians have been very critical with their use. Among other, they have pointed out the over-simplistic view rankings represent when analyzing the research output of universities, as they consider them as homogeneous ignoring disciplinary differences. Although many university rankings now include league tables by fields, reducing the complex framework of universities' research activity to a single dimension leads to poor judgment and decision making. This is partly because of the influence disciplinary specialization has on research evaluation. This chapter analyzes from a methodological perspective how rankings suppress disciplinary differences which are key factors to interpret correctly these rankings.

Evaluating quality of science in CGIAR research programs: Use of bibliometrics

2021 ◽  
pp. 003072702110242
Author(s):  
Max Rünzel ◽  
Paolo Sarfatti ◽  
Svetlana Negroustoueva
Keyword(s):  
Review Process ◽  
Research Output ◽  
Monitoring And Evaluation ◽  
Bibliometric Indicators ◽  
Scientific Publications ◽  
Practical Utilization ◽  
Research Programs ◽  
First Time ◽  
Quality Of Research

When evaluating Quality of Science (QoS) in the context of development initiatives, it is essential to define adequate criteria. The objective of this perspective paper is to show how altmetric and bibliometric indicators have been used to support the evaluation of QoS in the 2020 Review of the Phase 2-CGIAR Research Programs (CRPs, 2017–2022), where, for the first time, the Quality of Research for Development (QoR4D) frame of reference has been utilized across the entire CGIAR CRP portfolio. Overall, the CRP review showed a significant output of scientific publications during the period 2017–2020, with 4,872 articles, 220,101 references, and 7.1 citations per article. Additionally, wider interest in scientific publications is demonstrated by good to high altmetrics, with average attention scores ranging from 70.8 to 806.9 with an average of 425.1. The use of selected bibliometrics was shown to be an adequate tool, for use together with other qualitative indicators to evaluate the QoS in the 12 CRPs. The CRP review process clearly demonstrated that standardized, harmonized and consistent data on research output is paramount to provide high-quality quantitative instruments and should be a priority throughout the transition toward One CGIAR. Therefore, we conclude that the QoR4D framework should be augmented by standardized bibliometric indicators embedded in measurement frameworks within the new One CGIAR. Finally, its practical utilization in monitoring and evaluation should be supported with clear guidelines.

Towards complexity-sensitive book metrics for scholarly monographs in national databases for research output

2021 ◽  
Vol ahead-of-print (ahead-of-print) ◽  
Author(s):  
Linda Sīle ◽  
Raf Guns ◽  
Alesia A. Zuccala ◽  
Tim C.E. Engels
Keyword(s):  
Information Science ◽  
Research Evaluation ◽  
Research Output ◽  
Content Type ◽  
Social Sciences And Humanities ◽  
Work Related ◽  
Bibliographic Records ◽  
Bibliographic Data ◽  
The One ◽  
National Databases

PurposeThis study investigates an approach to book metrics for research evaluation that takes into account the complexity of scholarly monographs. This approach is based on work sets – unique scholarly works and their within-work related bibliographic entities – for scholarly monographs in national databases for research output.Design/methodology/approachThis study examines bibliographic records on scholarly monographs acquired from four European databases (VABB in Flanders, Belgium; CROSBI in Croatia; CRISTIN in Norway; COBISS in Slovenia). Following a data enrichment process using metadata from OCLC WorldCat and Amazon Goodreads, the authors identify work sets and the corresponding ISBNs. Next, on the basis of the number of ISBNs per work set and the presence in WorldCat, they design a typology of scholarly monographs: Globally visible single-expression works, Globally visible multi-expression works, Miscellaneous and Globally invisible works.FindingsThe findings show that the concept “work set” and the proposed typology can aid the identification of influential scholarly monographs in the social sciences and humanities (i.e. the Globally visible multi-expression works).Practical implicationsIn light of the findings, the authors outline requirements for the bibliographic control of scholarly monographs in national databases for research output that facilitate the use of the approach proposed here.Originality/valueThe authors use insights from library and information science (LIS) to construct complexity-sensitive book metrics. In doing so, the authors, on the one hand, propose a solution to a problem in research evaluation and, on the other hand, bring to attention the need for a dialogue between LIS and neighbouring communities that work with bibliographic data.

scholarly journals English Language University Teachers’ Difficulties in Research Engagement: A Case Study in Vietnam

2017 ◽  
Vol 2 (2) ◽  
pp. 91
Author(s):  
Huong Hoang Le
Keyword(s):  
English Language ◽  
Qualitative Case Study ◽  
Research Output ◽  
Structured Interview ◽  
Research Activity ◽  
University Teachers ◽  
Research Engagement ◽  
Cultural Framework ◽  
The One

The study uses a qualitative case study framed within a socio-cultural framework to investigate Vietnamese English language university teachers’ difficulties in their research engagement. The study was conducted among 21 English language university teachers in Hong Duc University in Vietnam. Skype semi-structured interview was employed to collect necessary data to explore teacher participants’ perceived obstacles to research. The findings of the study show that there was a gap between Vietnamese authorities’ expectations of research outputs and the realities of English language university teachers’ research capabilities. Such gap has caused serious challenges to those teachers and prevented them from effectively engaging in research. On the one hand, Vietnamese authorities hope to increase universities’ research output to keep up with the international academic ranking. On the other hand, the working realities of university teachers hinder their engagement in research. However, no official investigation has been done to reduce such gap and the enforcement of research activity in universities has been taken for granted. In this sense, the significance of this study is an opportunity for English language university teachers to voice their opinions about the enforced nature of research activity in universities in Vietnam.

scholarly journals Scientomentrics: a little bit of history and modern Russian realities

2019 ◽  
Vol 1 (1) ◽  
pp. 135-148
Author(s):  
Olga V. Moskaleva ◽  
Mark A. Akoev
Keyword(s):  
Russian Federation ◽  
Research Evaluation ◽  
International Experience ◽  
Bibliometric Indicators ◽  
Modern Russian

The article describes briefly the history od scientometrics and practical issues of research evaluation by bibliometric indicators in Russian Federation. The special attention is paid for main problems of of using specific bibliometric indicators and errors in their use. Possible options for the use of bibliometric indicators, taking into account international experience, are proposed.

scholarly journals The Thorny Excellence Initiative in India

2018 ◽  
pp. 24 ◽  
Author(s):  
Philip G. Altbach ◽  
Rahul Choudaha
Keyword(s):  
Higher Education ◽  
Education System ◽  
Research University ◽  
High Impact ◽  
University Rankings ◽  
Higher Education System ◽  
Excellence Initiative ◽  
Impact Research ◽  
World Class ◽  
The Government

India enrolls 35 million students in its large and complex higher education system. In its ambition to enter world-class university rankings, the government has identified six “Institutions of Eminence.” The case of the “greenfield” Jio Institute exemplifies the thorny policy landscape and expectations of building a high-impact research university.

scholarly journals How Efficiently Do Elite US Universities Produce Highly Cited Papers?

Publications ◽  
2019 ◽  
Vol 7 (1) ◽  
pp. 4 ◽  
Author(s):  
Klaus Wohlrabe ◽  
Félix de Moya Anegon ◽  
Lutz Bornmann
Keyword(s):  
Research Evaluation ◽  
Research Output ◽  
Harvard University ◽  
Institutional Research ◽  
Free Disposal Hull ◽  
Highly Cited Papers ◽  
Boston College ◽  
Free Disposal ◽  
Data Efficiency ◽  
Highly Cited

While output and impact assessments were initially at the forefront of institutional research evaluations, efficiency measurements have become popular in recent years. Research efficiency is measured by indicators that relate research output to input. The additional consideration of research input in research evaluation is obvious, since the output depends on the input. The present study is based on a comprehensive dataset with input and output data for 50 US universities. As input, we used research expenses, and as output the number of highly-cited papers. We employed Data Efficiency Analysis (DEA), Free Disposal Hull (FDH) and two more robust models: the order-m and order-α approaches. The results of the DEA and FDH analysis show that Harvard University and Boston College can be called especially efficient compared to the other universities. While the strength of Harvard University lies in its high output of highly-cited papers, the strength of Boston College is its small input. In the order-α and order-m frameworks, Harvard University remains efficient, but Boston College becomes super-efficient. We produced university rankings based on adjusted efficiency scores (subsequent to regression analyses), in which single covariates (e.g., the disciplinary profile) are held constant.

A study of Open Access research data repositories developed by BRICS countries

2020 ◽  
Vol ahead-of-print (ahead-of-print) ◽  
Author(s):  
Safat Mushtaq Misgar ◽  
Ajra Bhat ◽  
Zahid Ashraf Wani
Keyword(s):  
Open Access ◽  
Emerging Economies ◽  
Research Policy ◽  
Research Output ◽  
Research Data ◽  
Data Repository ◽  
Research Activity ◽  
Data Repositories ◽  
Content Type ◽  
Subject Coverage

Purpose In the present era, research data is a concern for researchers, as they are trying to find new ways to communicate their research findings and conclusions to other researchers in order to increase visibility and credibility. BRICS nations are fast emerging economies and contribute significantly in research output. This study makes an effort to analyze and explore the role of BRICS nations towards open access research data repository registered with Registry of Research Data Repositories. Design/methodology/approach The data were gathered from re3data repository, and the search was limited to BRICS nations. The data were further analyzed and tabulated as per set parameters, namely, country-wise distribution, types of contents, subject coverage and language diversity. Findings The findings depict that in terms of strength, India has the highest number of data repositories, thereby achieved the first rank among BRICS nations, and South Africa has the least number of data repositories, whereas in terms of content type and subject coverage, India again is leading among BRICS nations. The English language is used by repositories as the main language of the interface. Practical implications The study helps to understand the development of research data repositories by BRICS nations. The study is further beneficial to researchers, as Registry of Research Data Repository provides a single platform to access repositories from various disciplines. Readily available data saves time, money and efforts of researchers and helps the researcher in completing their research activity in a very short span of time. Originality/value The paper has investigated open access data repositories of BRICS nation that has not been attempted earlier. This gives readers comprehensive overview of research data repositories developed in fast emerging economies of the global. The paper can be very helpful for information managers, OA promoters and education and research policy makers to devise plans and policy bearing in mind the evolving research channels in emerging economies.

Co-authorship networks and institutional collaboration in works about Learning, Teaching and Education Leadership

2017 ◽  
Vol 6 (4) ◽  
pp. 175-188
Author(s):  
Julia Haba ◽  
Clara Haba ◽  
Julia Osca-Lluch
Keyword(s):  
Modern Science ◽  
Education Leadership ◽  
Bibliometric Indicators ◽  
Research Activity ◽  
International Context ◽  
Institutional Collaboration ◽  
Source Of Information ◽  
Research Situation ◽  
National Collaboration ◽  
Made In

Bibliometric indicators, based on the statistical analysis of quantitative data from scientific literature, constitute currently in an essential tool for the study of research activity. In the last years, the use of bibliometric indicators as a complement to other scientific indicators to analyse the research situation of a country, its evolution in its time and their position in the international context, has been extended. Collaboration is a characteristic feature of modern science and it is very difficult to measure this aspect. Nevertheless, it is widely accepted to count the combined signatures done by two or more authors, with the analysis of the institutional affiliation mentions and geographical provenance of these authors, constitute a very reasonable and coherent way to estimate this collaboration. To know roughly the peculiarities of patterns of institutional collaboration of researchers working on issues of Learning, Teaching and Education Leadership, we have analysed the institutions where these researchers have worked. Two types of collaboration have been distinguished: national collaboration (between institutions from the same country) and international (between institutions from different countries), using as source of information the communications submitted at the World Conference on Learning, Teaching and Education Leadership (WCLTA) included in the database Web of Science (WoS). The programs used to build collaborative networks were Pajek and Ucinet.A remarkable characteristic is that even if 73% of the works done by co-authorship (done by 2 or more authors), only in 6.19% there was an institutional collaboration. Works done by institutional collaboration move from a range of 52 papers done by institutions in two different countries up to 4 works done by institutions from four countries. The countries with a higher rate of national collaboration are Turkey, Spain, Romania, Czech Republic and People’s R. China. Only 0.80% of the works were made in international institutional collaboration by researchers working in 14 different countries. Of all these country, Turkey, Spain, Italy and Portugal standout being the countries that have participated in a larger number of works carried out with researchers and institutions from other countries. Key works: institutional collaboration, Learning, Teaching and Education Leadership, Collaboration networks, scientific production  

Sign in / Sign up

Export Citation Format

Share Document