scholarly journals Research evaluation of author’s citation-based performance through the relative author superiority index

2017 ◽  
Vol 29 (2) ◽  
pp. 191-201 ◽  
Author(s):  
Guillermo Armando RONDA-PUPO

Abstract The aim of this paper is to further explore the recent conversation about the indicators for research evaluation through citation-based indexes. It evaluates the Cuban Biotechnology; Applied Microbiology researchers’ citation-based performance, according to their scientific production in journals of the ISI Web of Science database through the Relative Author Superiority Index. The methodology comprises six steps: (1) preparation of the data; (2) calculation of the Percentile Rank Index for each of the papers; (3) calculation of the Author Superiority Index for each of the authors; (4) Calculation of the Relative Author Superiority Index; (5) Comparison of the Author Superiority Index of each author to their Hirsch (H) and G citation indexes and (6) individual or group evaluation of the citation-based performance. The findings suggest that the group of Cuban researchers in biotechnology achieved a high citation-based performance within the analyzed period. The results show the effectiveness of this index to assess the citation performance of individual or group researchers when the impact factor of the researcher or group under evaluation is not high. In addition, the Relative Author Superiority index could be complementary to other previous indicators such as H-index, G-index or citation counts as it overcomes the limitations of the age of publications, length of the author’s career, and the self-citation problem that are present in other indicators.

2021 ◽  
Author(s):  
Emanuel Kulczycki ◽  
Marek Hołowiecki ◽  
Zehra Taskin ◽  
Franciszek Krawczyk

One of the most fundamental issues in academia today is understanding the differences between legitimate and predatory publishing. While decision-makers and managers consider journals indexed in popular citation indexes such as Web of Science or Scopus as legitimate, they use two blacklists (Beall’s and Cabell’s), one of which has not been updated for a few years, to identify predatory journals. The main aim of our study is to reveal the contribution of the journals accepted as legitimate by the authorities to the visibility of blacklisted journals. For this purpose, 65 blacklisted journals in social sciences and 2,338 Web-of-Science-indexed journals that cited these blacklisted journals were examined in-depth in terms of index coverages, subject categories, impact factors and self-citation patterns. We have analysed 3,234 unique cited papers from blacklisted journals and 5,964 unique citing papers (6,750 citations of cited papers) from Web of Science journals. We found that 13% of the blacklisted papers were cited by WoS journals and 37% of the citations were from impact-factor journals. As a result, although the impact factor is used by decision-makers to determine the levels of the journals, it has been revealed that there is no significant relationship between the impact factor and the number of citations to blacklisted journals. On the other hand, country and author self-citation practices of the journals should be considered. All the findings of this study underline the importance of the second part of this study, which will examine the contents of citations to articles published in predatory journals because understanding the motivations of the authors who cited blacklisted journals is important to correctly understand the citation patterns between impact-factor and blacklisted journals.


2019 ◽  
Vol 17 (2) ◽  
pp. 93-99
Author(s):  
Fábio Hech Dominski

Introdução: É notável o crescimento na produção de conhecimento na área da psicologia do esporte (PE). O conhecimento produzido pelos pesquisadores ocorre através da publicação de seus trabalhos no formato de artigos em periódicos científicos. Não existe na literatura análises considerando os periódicos específicos da área e suas características. Objetivo: Discutir acerca do cenário atual de periódicos específicos relacionados à PE. Métodos: Trata-se de uma pesquisa documental a respeito dos periódicos de PE. Foram extraídos e analisados dados como país, instituição, editora, língua de publicação, as métricas (JCR - ISI Web of Science, SJR, Citescore e SNIP – Scopus, e índice h5 – Google Scholar), periodicidade, período de publicações e número de artigos publicados em 2018. Resultados: Foram observados 14 periódicos na literatura relacionados diretamente a temática da PE. A maioria dos periódicos (5) é dos Estados Unidos, três da Espanha e três do Reino Unido. Brasil, Itália e Holanda apresentaram um periódico cada. A maioria dos periódicos publica na língua inglesa (13 dos 14). O fator de impacto (JCR) dos periódicos variou de 0,64 a 6,90, cinco periódicos não apresentaram essa métrica em 2018. Neste ano, os periódicos publicaram de 11 até 144 artigos. Conclusão: A partir da análise dos periódicos científicos específicos da PE, verificou-se que os de maior qualidade considerando as métricas analisadas, são dos Estados Unidos e da Europa. No Brasil ressalta-se a necessidade de fortalecimento do periódico específico existente na área, que pode ser realizado a partir da unificação das organizações que atuam na prática profissional e na pesquisa científica em PE. ABSTRACT. Sport psychology research and the specific journals scenario. Background: There is a remarkable growth in the production of knowledge in the field of sports psychology (SP). The knowledge produced by researchers occurs through the publication of their work in the format of articles in scientific journals. There are no analyses in the literature considering the specific journals of the area and their characteristics. Objective: To discuss about the current scenario of specific journals related to SP. Methods: This is a documentary research about the SP journals. The following data were extracted and analyzed: country, institution, publisher, publication language, metrics (JCR - ISI Web of Science, SJR, Citescore and SNIP – Scopus, and index h5 – Google Scholar), periodicity, publication period, and number of articles published in 2018. Results: It was observed 14 journals related to SP. Most of them are from United States, three from Spain and three from United Kingdom. Brazil, Italy and Netherlands showed one journal each. Most of the journals publish in English language (13 of 14). The impact factor ranged from 0.64 to 6.90, and five journals do not show this metric in 2018. In this year, the journals published from 11 to 144 articles. Conclusion: From the analysis of the specific scientific journals of the SP, it was found that the journals with highest quality are from the United States and Europe. In Brazil, there is a need to strengthen the existing specific journal in the area, which can be done by unifying the organizations that work in professional practice and scientific research of SP.


2018 ◽  
Vol 18 (4) ◽  
pp. 629-637 ◽  
Author(s):  
Liliane Mendonça ◽  
José M. Castro-Lopes

Abstract Background and aims The recent economic crisis started in the USA in 2008 but quickly had worldwide impact. Ireland, Greece, and Portugal were in economic distress in 2009 and received rescue monetary packages from the European Union (EU) and the International Monetary Fund (IMF) in the following years. Meanwhile, the economic recovery has begun for those countries, but at different paces. The aim of the present study was to evaluate if the economic crisis influenced pain research outcomes, by performing a bibliometric analysis based on the ISI Web of Science to evaluate the evolution of the scientific production and performance in the field of pain research between 1997 and 2017. Methods Articles search was conducted using the ISI Web of Science, search keywords “pain or nocicep*”, between 1997 and 2017, and one author affiliated in an Irish, Greek or Portuguese institution. The total number of published articles per country, total citations, h-index, document types and authors’ institution were tabulated to determine the quantity and quality of the publications in this field. Results The search retrieved 2,368 publications over the 20 years’ period, increasing from 26 in 1997 to 230 in 2017. The number of Irish publications per year increased steadily along the studied period, while the number of Greek publications stabilized from 2008 onward and Portuguese publications started to increase only in 2007 but declined slightly after 2014. In total, Irish authors published 1,143 articles, Greek authors 624 and Portuguese authors 618. There were nine articles with more than 100 citations, and Irish publications had a higher h-index (52) than Greek’s (45) or Portuguese’s (36) publications. Ireland had the highest number of pain publications per capita, but in 2016 Portugal had the lowest cost per publication, as measured by the GDP per capita per publication (in 1997 Portugal had the highest cost). The three major research fields of the publications were neurosciences/neurology (19%), general internal medicine (16%) and anaesthesiology (13%), and the affiliation institutions were mostly universities or universities hospitals. Conclusions The number of Irish, Greek, and Portuguese pain publications increased between 1997 and 2017, but at different paces. It appears that the economic crisis had no impact on the rate of pain publications in Ireland, had a delayed impact in Portugal, and affected mostly Greek pain scientific research. This may be related to the fact that Greece was the country that received more rescue packages and where the economic crisis was deepest and lasted longer. Implications Economics and scientific production have a mutual influence: usually research investment decreases in recession times (reducing grants and scientific employment), but health scientific production can improve health and quality of life and also benefit the economy. So in crisis periods, governments should create means to protect and foster scientific work.


2008 ◽  
Vol 14 (4) ◽  
pp. 285 ◽  
Author(s):  
M. C. Calver ◽  
K. A. Bryant

We analysed Pacific Conservation Biology?s authorship and readership from 1993?2007 to quantify who publishes in the journal, who cites the journal, how the journal compares to other conservation journals and whether there are trends in authorship and useage over time. Authors came from Australia (73%, represented in 15 of 15 years), the Americas (Canada, USA and South American countries) (12%, represented in 13 of 15 years), New Zealand (8%, represented in 14 of 15 years), other Pacific and Asian countries (4%, represented in 11 of 15 years) and Europe (2%, represented in 11 of 15 years). Overall, 46% of authors were academics. Using the Scopus database in April 2008 and the cited reference feature in the ISI Web of Science in July 2008, =84% papers published each year between 1993 and 2001 were cited at least once in each database, declining to under 19% in 2007 because articles had far less time to accrue citations. Using the cited reference feature in the ISI Web of Science database in July 2008, authors citing Pacific Conservation Biology came from Australia and 82 other countries. Compared to 24 journals listed in Thomson Reuters? ?Biodiversity Conservation? category in 2008, Pacific Conservation Biology ranked between the 10th and 39th percentiles for a range of citation statistics derived from both Scopus and ISI Web of Science, including: Journal Impact Factor (JIF) for 2006, mean JIF for 2001?2006 and h-index, g-index, mean citations/paper and median citations/paper for 2000?2006. Overall, most authors are Australian, but with consistent international representation and academic and non-academic authors. With time, most papers are cited (including many international citations) and citation statistics are within the range of similar journals abstracted in ISI Web of Science. On the basis of the results, we offer suggestions for increasing Pacific Conservation Biology?s use and a critique of the growing tendency to accept citation-based bibliometric data as indicators of the quality or achievements of journals and individual scientists.


2021 ◽  
Vol 0 (0) ◽  
Author(s):  
Fangjie Xi ◽  
Ronald Rousseau ◽  
Xiaojun Hu

AbstractPurposeThis article aims to determine the percentage of “Sparking” articles among the work of this year’s Nobel Prize winners in medicine, physics, and chemistry.Design/methodology/approachWe focus on under-cited influential research among the key publications as mentioned by the Nobel Prize Committee for the 2020 Noble Prize laureates. Specifically, we extracted data from the Web of Science, and calculated the Sparking Indices using the formulas as proposed by Hu and Rousseau in 2016 and 2017. In addition, we identified another type of igniting articles based on the notion in 2017.FindingsIn the fields of medicine and physics, the proportions of articles with sparking characteristics share 78.571% and 68.75% respectively, yet, in chemistry 90% articles characterized by “igniting”. Moreover, the two types of articles share more than 93% in the work of the Nobel Prize included in this study.Research limitationsOur research did not cover the impact of topic, socio-political, and author’s reputation on the Sparking Indices.Practical implicationsOur study shows that the Sparking Indices truly reflect influence of the best research work, so it can be used to detect under-cited influential articles, as well as identifying fundamental work.Originality/valueOur findings suggest that the Sparking Indices have good applicability for research evaluation.


2012 ◽  
Vol 5 (2) ◽  
Author(s):  
Thiago Reis Xavier ◽  
Raoni De Oliveira Inácio ◽  
Milton Luiz Wittmann ◽  
Angela Cabral Flecha

O turismo constitui um setor fragmentado, multifacetado e sua composição é em quase todos os segmentos por pequenas e médias empresas (PME’s) prestadoras dos mais variados tipos de serviços. A falta de um planejamento compartilhado entre as empresas do setor turístico e a necessidade por dados que subsidiem as tomadas de decisão a empresários e aos governos locais têm levado ao enfraquecimento do poder competitivo de destinos. Os aglomerados (clusters) aparecem como uma alternativa de promoção do desenvolvimento regional. Este artigo tem como objetivo ressaltar, através da relação entre os conceitos de redes, redes de PME’s e o turismo, como o entendimento das relações entre os atores de um destino pode proporcionar sua qualificação da oferta turística. Ademais, procura-se verificar como está a produção acadêmica sobre o tema em epígrafe. Tal objetivo pôde ser alcançado por meio de uma revisão teórica e aplicação da bibliometria na ISI Web of Science do índice de citações ISI Citation Indexes.


2020 ◽  
Vol 3 (3) ◽  
pp. 562-569 ◽  
Author(s):  
Weishu Liu

Purpose: In relation to the boom in China’s SCI-indexed publications, this opinion piece examines this phenomenon and looks at future possible directions for the reform of China’s research evaluation processes. Design/Approach/Methods: This opinion piece uses bibliographic data for the past decade (2010–2019) from the Science Citation Index Expanded in the Web of Science Core Collection to examine the rise in China’s SCI-indexed publications. Findings: China has surpassed the U.S. and been the largest contributor of SCI publications since 2018. However, while the impact of China’s SCI publications is rising, the scale of this impact still lags behind that of other major contributing countries. China’s SCI publications are also overrepresented in some journals. Originality/Value: Reporting the latest facts about China’s SCI-indexed publications, this article will benefit the reform of China’s research evaluation system.


2017 ◽  
Vol 5 (3) ◽  
pp. 232596711769402 ◽  
Author(s):  
Jeffrey Kay ◽  
Muzammil Memon ◽  
Darren de SA ◽  
Nicole Simunovic ◽  
Andrew Duong ◽  
...  

Background: The h-index is a metric widely used to present both the productivity and impact of an author’s previous publications. Purpose: To evaluate and observe any correlations among the h-indices of 2015 editorial board members from 8 top sports medicine journals. Study Design: Systematic review. Methods: The sex, country of residence, degree, and faculty position of the editorial board members were identified using their respective scientific publication profiles. The h-index and other bibliometric indicators of these editorial board members were obtained using both the Web of Science (WoS) and Google Scholar (GS) databases. Nonparametric statistics were used to analyze differences in h-index values, and regression models were used to assess the ability of the editorial board member’s h-index to predict their journal’s impact factor (IF). Results: A total of 422 editorial board members were evaluated. The median h-index of all editors was 20 (interquartile range [IQR], 19) using GS and 15 (IQR, 15) using WoS. GS h-index values were 1.19 times higher than WoS, with significant correlation between these values ( r2 = 0.88, P = .0001). Editorial board members with a PhD had significantly higher h-indices than those without (GS, P = .0007; WoS, P = .0002), and full professors had higher h-indices than associate and assistant professors (GS, P = .0001; WoS, P = .0001). Overall, there were significant differences in the distribution of the GS ( P < .0001) and WoS ( P < .0001) h-indices of the editorial board members by 2014 IF of the journals. Both the GS h-index (β coefficient, 0.01228; 95% CI, 0.01035-0.01423; P < .0001) as well as the WoS h-index (β coefficient, 0.01507; 95% CI, 0.01265-0.01749; P < .0001) of editorial board members were significant predictors of the 2014 IF of their journal. Conclusion: The h-indices of editorial board members of top sports medicine journals are significant predictors of the IF of their respective journals.


2021 ◽  
Author(s):  
Emanuel Kulczycki ◽  
Marek Hołowiecki ◽  
Zehra Taşkın ◽  
Franciszek Krawczyk

AbstractOne of the most fundamental issues in academia today is understanding the differences between legitimate and questionable publishing. While decision-makers and managers consider journals indexed in popular citation indexes such as Web of Science or Scopus as legitimate, they use two lists of questionable journals (Beall’s and Cabell’s), one of which has not been updated for a few years, to identify the so-called predatory journals. The main aim of our study is to reveal the contribution of the journals accepted as legitimate by the authorities to the visibility of questionable journals. For this purpose, 65 questionable journals from social sciences and 2338 Web-of-Science-indexed journals that cited these questionable journals were examined in-depth in terms of index coverages, subject categories, impact factors and self-citation patterns. We have analysed 3234 unique cited papers from questionable journals and 5964 unique citing papers (6750 citations of cited papers) from Web of Science journals. We found that 13% of the questionable papers were cited by WoS journals and 37% of the citations were from impact-factor journals. The findings show that neither the impact factor of citing journals nor the size of cited journals is a good predictor of the number of citations to the questionable journals.


2017 ◽  
Vol 16 (4) ◽  
pp. 133-153
Author(s):  
Thiago de Luca Sant'ana Ribeiro ◽  
José Eduardo Valladares Teixeira

The book "The Red Queen among organizations: how competitiveness evolves" synthesizes and extends several works in which William P. Barnett studies competition among companies, based on the idea that organizations learn through the act of competing and, by doing so, they become stronger competitors over time. A review of this book is presented here, summarizing the theory developed by Barnett and the empirical tests that the author carried out for the validation of his main hypotheses in two industries, with partially confirmatory results. In addition to the exposition of theory and its tests, the results of a bibliometric research carried out at ISI Web of Science, which investigates the impact of Barnett's work and its influence on different lines of research aimed at competition amog companies are also presented.


Sign in / Sign up

Export Citation Format

Share Document