Evaluating the effectiveness of research organizations: The CEMI RAS case study

2021 ◽  
Vol 20 (10) ◽  
pp. 1874-1896
Author(s):  
Ekaterina V. AKINFEEVA ◽  
Mariya A. NIKONOVA

Subject. The article investigates the effectiveness of scientific activities of the Central Economics and Mathematics Institute of the Russian Academy of Sciences (CEMI RAS). Objectives. Our aim is to evaluate the effectiveness of scientific activity of the CEMI RAS on the basis of publication activities for 2010–2019. Methods. We employ general scientific research methods. The data on the number of publications by the Institute's staff in journals included in Web of Science (WoS), Scopus, the Russian Science Citation Index (RSCI) databases, and the data of the CEMI RAS, serve as information base of the study. Results. The paper presents a brief overview of scientometric indicators used to assess the effectiveness of scientific organizations. We evaluated the effectiveness on the basis of statistical data of the CEMI RAS, considered various methods of evaluating the effectiveness of scientific activities of universities and research institutes. To improve the effectiveness of scientific activities of the CEMI RAS, we developed a methodology for calculating the standard of publications and scores by department. The offered methodology is designed to encourage staff to improve scientific activities, thereby increasing both their individual effectiveness and the effectiveness of the scientific organization as a whole. Conclusions. The analysis shows that during the period under review, the enhanced effectiveness of the CEMI RAS is confirmed by an increase in the number of articles, published by the Institute's staff in journals, included in the WoS, Scopus and RSCI databases, both overall and among individual researchers.

2021 ◽  
Vol 50 (2) ◽  
pp. 183-190
Author(s):  
P.A. Minakir ◽  

The legislative reforming of the Russian Academy of Sciences was activated in 2013. Not a consequence, but an important tool for the implementation of this reform and its deepening has become «digitalization» in the form of an exaggerated presentation of the results of scientific activity as bibliometric indicators, including the quality and number of publications. Based on the data of the Russian Science Citation Index the article examines the results of the policy of «increasing the visibility» of Russian economic science in the world publication space. It is shown that in a relatively short time, both extensive and intensive factors of increasing the publication mass are practically exhausted. At the same time, the qualitative parameters of publication activity turn out to be of low variability depending on the dynamics of the publications themselves. The issues of displaying the quality of scientific journals in bibliometric indicators are discussed. The conclusion is made that there is no antagonism between bibliometric and expert metrics when the latter prevail. A sequence of using these metrics is proposed for a comprehensive assessment of the results of scientific activities of organizations and scientists.


Acta Naturae ◽  
2012 ◽  
Vol 4 (2) ◽  
pp. 14-34 ◽  
Author(s):  
M. N. Kotsemir

The primary aim of this research report is to analyse the dynamics and structure of the publications of Russian authors, as well as to define the place of Russian science in the global scientific process. Bibliometric analysis methods are the main methods for quantitative analysis of scientific cooperation, efficiency, and other aspects of scientific activity. The information base for this research includes materials from science citation databases containing bibliographic descriptions of the articles published in scientific journals (mainly written in English) in a significant number of fields of science. Various parameters (e.g. dynamics of the number of publications, the number of citation, the level of co-authorship, the scientific specialization index, etc.) at various levels of aggregation (e.g. individual researchers, research organizations, countries and regions of the world) can be calculated based on these data. The results of bibliometric studies can be used in a number of ways: - analysis of latest trends in the development of various scientific fields; - evaluation of the effectiveness of research organizations; - overall assessment of the scientific potential of Russia (its strengths and weaknesses); - identification the most productive scientists in various fields of science; - drawing the international comparisons of publications; - analysis of collaboration networks of scientific teams. The paper analyses the basic indicators of the publication activity of scientists in Russia and the leading countries over the period between 2001 and 2011. Publication activity of Russian scientists is analysed in the context of specific areas of science. This allows the identification of areas of specialization of Russian publications. The paper also examines the dynamics of highly-cited publications and the indicators of the international scientific collaboration of Russian researchers. In this paper, materials of Web of Science database were used for analysis of publication activity.


Author(s):  
V. V. Arutyunov

The paper analyzes the importance of geological knowledge for solving a wide range of practical problems. The purpose of this study is to evaluate the results of the research of scientists and specialists in 2012–2018 in Geology, Geophysics, Geography, Mining, Geodesy and cartography on the basis of RSCI databases (Russian science citation index). The analysis was carried out taking into account a number of scientometric indicators: the publication activity of researchers – the annual number of their publications, as well as the citation of these publications and the demand for the results of their work. Features of publication activity are revealed: high values of its indicators for Geology and Geophysics and minimum values – for Geodesy and cartography; thus the number of publications on Geography and Mining approximately coincide. For Geology, there is stability in the number of publications since 2015, while in other analyzed industries there is a decline in the number of publications since 2017. Citation rates for all years under review are continuously decreasing. At the same time, in the field of Geophysics, citation rates are 3–4 times higher than similar indicators for Geography, and 7–9 times – indicators for Mining. The most popular are the results of research in Geophysics, the least – in the field of Geodesy and cartography. At the same time, if the annual demand for the results of studies in Geophysics exceeds similar indicators for Geography by 15–20%, for Geodesy and cartography – about 1.5 times. Low demand for all areas of research in 2018. The reason is obviously the same as for the small citation indicators this year: the delayed "response" of the scientific community to the publications of the current year.


Acta Naturae ◽  
2012 ◽  
Vol 4 (2) ◽  
pp. 14-34
Author(s):  
M. N. Kotsemir

The primary aim of this research report is to analyse the dynamics and structure of the publications of Russian authors, as well as to define the place of Russian science in the global scientific process. Bibliometric analysis methods are the main methods for quantitative analysis of scientific cooperation, efficiency, and other aspects of scientific activity. The information base for this research includes materials from science citation databases containing bibliographic descriptions of the articles published in scientific journals (mainly written in English) in a significant number of fields of science. Various parameters (e.g. dynamics of the number of publications, the number of citation, the level of co-authorship, the scientific specialization index, etc.) at various levels of aggregation (e.g. individual researchers, research organizations, countries and regions of the world) can be calculated based on these data. The results of bibliometric studies can be used in a number of ways: - analysis of latest trends in the development of various scientific fields; - evaluation of the effectiveness of research organizations; - overall assessment of the scientific potential of Russia (its strengths and weaknesses); - identification the most productive scientists in various fields of science; - drawing the international comparisons of publications; - analysis of collaboration networks of scientific teams. The paper analyses the basic indicators of the publication activity of scientists in Russia and the leading countries over the period between 2001 and 2011. Publication activity of Russian scientists is analysed in the context of specific areas of science. This allows the identification of areas of specialization of Russian publications. The paper also examines the dynamics of highly-cited publications and the indicators of the international scientific collaboration of Russian researchers. In this paper, materials of Web of Science database were used for analysis of publication activity.


2021 ◽  
Vol 18 (3) ◽  
pp. 402-409
Author(s):  
Petr V. GERASIMENKO ◽  

Objective: To suggest an algorithm for assessing the results of the scientific activity of a teacher drawing on published works and their quotes, which should make it possible to consider the total quoting of significant publications determined by the Hirsch algorithm. To create a more advanced approach to the effective assessment of scientists’ publication activities compared to the Hirsch number. Methods: A systematization approach is used to systematize the total citation array, by separating it into the following citation arrays: 1) the basic, defined Hirsch index; 2) significant publications; 3) intensity of work. The resulting arrays formed the basis of the creation of three indices: h – Hirsch’s index, g – an index of significant publications and p – intensive work index. These indexes allowed us to determine the Euclidean norms gh – the index of basic significant publications and hp – the intensive work index of a teacher. The above indices make it possible to differentiate the teachers’ publication activities and produce better ranking in the team. Results: The ratings of a team of authors formed by the sample from Russian Science Citation Index using the Hirsch index and the gh-index are built. It is shown that more efficient compared to the Hirsch index is the proposed approach. Practical importance: The described approach to the formation of the rating position of the authors of publications in the creative team is based on a simple calculation and comparison of the modified Hirsch indices


2021 ◽  
pp. 38-43
Author(s):  
A. S. Pavlova

Automation of library processes is an important topic in modern conditions of digitalization and transition of human activities to the latest computer technologies. Acquisition of literature to library collections forms the document base for the subsequent work of the library, so this process needs continuous improvement and optimization of its constituent operations. The article is devoted to the application of computer technologies in the preparation and use of the scientific library thematic-typological plan of acquisition as the scientific base of building collections. The object of the article is to present the experience of creating and using the electronic model of the Thematic and Typological Acquisition Plan in the scientific library, to define the perspectives of implementing the data base for information and library servicing UB RAS users.The article presents the results of content analysis of subject headings and indices of the State Rubricator of Scientific and Technical Information for bibliographic descriptions of Russian journals received in 2015–2017, in the Consolidated electronic catalog of periodicals of the Central Scientific Library of the Ural Branch of the Russian Academy of Sciences; of books, published by the institutes of the Ural Branch of the Russian Academy of Sciences in 2015–2017, according to the Electronic catalog of Russian books and continuing publications of the Central Scientific Library of the Ural Branch of the Russian Academy of Sciences; of publications (published in 2015–2019) of the institutes of the Ural Branch of the Russian Academy of Sciences, included in the database of the Russian Science Citation Index on the portal «eLIBRARY.ru» – are presented in the article. It also describes the stages of creation, analyzes the characteristics and capabilities of the database «Thematic-typological acquisition plan» of the Central Scientific Library of the Urals Branch of the Russian Academy of Sciences.


Author(s):  
V. V. Arutyunov

The paper analyzes the importance of power engineering for solving a wide range of practical problems. The purpose of this study is to evaluate the results of the research of scientists and specialists in 2013–2019 in power engineering, electrical engineering, electronics and radio engineering on the basis of RSCI databases (Russian Science Citation Index). The analysis was carried out taking into account a number of scientometric indicators: the publication activity of researchers – the annual number of their publications, as well as the citation of these publications and the demand for the results of their work. Features of dynamics of formation of indicators of publication activity are revealed: its high values are typical for electronics and radio engineering and minimum values (more than three times smaller) – for electrical engineering. For all three industries analyzed the number of publications increased in 2013–2018. It is noted that the citation indicators for the three industries have been continuously decreasing since 2014. At the same time, in the field of electronics and radio engineering in 2013–2017, citation rates are three or more times higher than similar indicators for energy and electrical engineering. The results of research in the field of electronics and radio engineering are the most popular, while the results of research in the energy sector are the least popular. At the same time, the annual demand for research results in electronics and radio engineering exceeds similar indicators for energy by about 1.4 times. The low demand indicators for all areas of research in 2019 are obviously due to the same reason as for small citation indicators this year: the slow “response” of the scientific community to this year's publications.


2021 ◽  
Vol 1 ◽  
pp. 41-59
Author(s):  
Dmitry Pletnev ◽  
◽  
Dina Basyrova ◽  

Introduction. One of the drivers of the Russian regions’ development is traditionally considered to be local universities and the scientific activity development, in particular. However, such a belief is usually based on speculative conclusions and is not subjected to detailed empirical testing. The purpose of the study is to assess the relationship between the development of science in universities in Russian regions and indicators of regional development according to 2017—18 data. Methods. The authors use methods of generalization, grouping, assessment of indicators of central tendency and variations, as well as methods of correlation analysis. The study is based on the data from regional statistics presented on the official website of Russian Statistics Agency, as well as data from monitoring the universities effectiveness, commissioned by the Ministry of Science and Higher Education of the Russian Federation. Scientific novelty of the research. For the first time, the authors present an empirical analysis of the relationship between indicators of socioeconomic development of Russian regions and indicators of scientific activity in universities in the region. The study is characterized by using a sample of homogeneous regions. The sample excluded regions that did not have significant scientific results, as well as regions that are leaders in economic development. As a result, a “core” of 57 Russian regions with similar characteristics of both economic development and the results of scientific activity was investigated. This increased the practical significance of the conclusions and their reliability. Results. As a result of the study, it was found out that there is a statistically significant relationship between all indicators of regional development and science in universities. However, a deeper analysis made it possible to establish that this relationship is indirect. In some cases, we can talk about the opposite influence - regional development on scientific results in universities. Conclusions. It was found that the indicators used in the public administration system for assessing the effectiveness and efficiency of scientific activity are not key in terms of their impact on regional development. It was revealed that publications in leading world databases and in the Russian Science Citation Index (RSCI) are equally related to regional development. It has been determined that in a number of cases, within the considered sample, it is possible to distinguish two groups of regions with a different nature of the relationship between regional development and science in universities.


2019 ◽  
pp. 29-31
Author(s):  
A. A. Stukalova

The results of examining sites of scientific organizations of the Siberian Branch of the Russian Academy of Sciences are given. Particular attention is paid at siting information about the library and its activities, providing search capabilities in electronic catalogs and databases of libraries, informing about remote resources.


Author(s):  
Tatiana Dergileva

The reform of the Russian Academy of Sciences (RAS), creation of the Federal Agency of Scientific Organizations (FANO), a change in legislation, the integration of three academies: Academy of Sciences, the Russian Academy of medical Sciences (RAMS), Russian Academy of agricultural Sciences (RAAS); restructuring of research institutions - served as prerequisites for changing RAS library system and called for the regulation of interaction and relationships between libraries within the system of scientific organizations. In these new conditions, a new concept of library and information support of scientific research is required to identify mechanisms for the uniform distribution and optimal development of libraries under FANO jurisdiction.


Sign in / Sign up

Export Citation Format

Share Document