scholarly journals In praise of the impact factor

2020 ◽  
Author(s):  
John Antonakis ◽  
Nicolas Bastardoz ◽  
Philippe Jacquart
Keyword(s):  
Impact Factor ◽  
Journal Impact Factor ◽  
Journal Articles ◽  
Good Proxy ◽  
Number Of Citations ◽  
The Impact ◽  
Journal Impact ◽  
Article Quality

The impact factor has been criticized on several fronts, including that the distribution of citations to journal articles is heavily skewed. We nuance these critiques and show that the number of citations an article receives is significantly predicted by journal impact factor. Thus, impact factor can be used as a reasonably good proxy of article quality.

scholarly journals Use of the journal impact factor for assessing individual articles: Statistically flawed or not?

F1000Research ◽  
2021 ◽  
Vol 9 ◽  
pp. 366
Author(s):  
Ludo Waltman ◽  
Vincent A. Traag
Keyword(s):  
Impact Factor ◽  
San Francisco ◽  
Journal Impact Factor ◽  
Dominant Role ◽  
Research Assessment ◽  
Primary Focus ◽  
Number Of Citations ◽  
The Impact ◽  
Journal Impact ◽  
Accurate Indicator

Most scientometricians reject the use of the journal impact factor for assessing individual articles and their authors. The well-known San Francisco Declaration on Research Assessment also strongly objects against this way of using the impact factor. Arguments against the use of the impact factor at the level of individual articles are often based on statistical considerations. The skewness of journal citation distributions typically plays a central role in these arguments. We present a theoretical analysis of statistical arguments against the use of the impact factor at the level of individual articles. Our analysis shows that these arguments do not support the conclusion that the impact factor should not be used for assessing individual articles. Using computer simulations, we demonstrate that under certain conditions the number of citations an article has received is a more accurate indicator of the value of the article than the impact factor. However, under other conditions, the impact factor is a more accurate indicator. It is important to critically discuss the dominant role of the impact factor in research evaluations, but the discussion should not be based on misplaced statistical arguments. Instead, the primary focus should be on the socio-technical implications of the use of the impact factor.

What are the variables associated with Altmetric scores? – An overview of methodological reviews (Preprint)

2019 ◽  
Author(s):  
Amanda Costa Araujo Sr ◽  
Adriane Aver Vanin Sr ◽  
Dafne Port Nascimento Sr ◽  
Gabrielle Zoldan Gonzalez Sr ◽  
Leonardo Oliveira Pena Costa Sr
Keyword(s):  
Open Access ◽  
Impact Factor ◽  
Journal Impact Factor ◽  
Cochrane Library ◽  
Open Access Journals ◽  
Citation Counts ◽  
Number Of Citations ◽  
The Impact ◽  
Journal Impact ◽  
Publishing Journal

BACKGROUND The most common way to assess the impact of an article is based upon the number of citations. However, the number of citations do not precisely reflect if the message of the paper is reaching a wider audience. Currently, social media has been used to disseminate contents of scientific articles. In order to measure this type of impact a new tool named Altmetric was created. Altmetric aims to quantify the impact of each article through the media online. OBJECTIVE This overview of methodological reviews aims to describe the associations between the publishing journal and the publishing articles variables with Altmetric scores. METHODS Search strategies on MEDLINE, EMBASE, CINAHL, CENTRAL and Cochrane Library including publications since the inception until July 2018 were conducted. We extracted data related to the publishing trial and the publishing journal associated with Altmetric scores. RESULTS A total of 11 studies were considered eligible. These studies summarized a total of 565,352 articles. The variables citation counts, journal impact factor, access counts (i.e. considered as the sum of HTML views and PDF downloads), papers published as open access and press release generated by the publishing journal were associated with Altmetric scores. The magnitudes of these correlations ranged from weak to moderate. CONCLUSIONS Citation counts and journal impact factor are the most common associators of high Altmetric scores. Other variables such as access counts, papers published in open access journals and the use of press releases are also likely to influence online media attention. CLINICALTRIAL N/A

scholarly journals Use of the journal impact factor for assessing individual articles need not be statistically wrong

F1000Research ◽  
2020 ◽  
Vol 9 ◽  
pp. 366
Author(s):  
Ludo Waltman ◽  
Vincent A. Traag
Keyword(s):  
Impact Factor ◽  
San Francisco ◽  
Journal Impact Factor ◽  
Dominant Role ◽  
Research Assessment ◽  
Primary Focus ◽  
Number Of Citations ◽  
The Impact ◽  
Journal Impact

Most scientometricians reject the use of the journal impact factor for assessing individual articles and their authors. The well-known San Francisco Declaration on Research Assessment also strongly objects against this way of using the impact factor. Arguments against the use of the impact factor at the level of individual articles are often based on statistical considerations. The skewness of journal citation distributions typically plays a central role in these arguments. We present a theoretical analysis of statistical arguments against the use of the impact factor at the level of individual articles. Our analysis shows that these arguments do not support the conclusion that the impact factor should not be used for assessing individual articles. In fact, our computer simulations demonstrate the possibility that the impact factor is a more accurate indicator of the value of an article than the number of citations the article has received. It is important to critically discuss the dominant role of the impact factor in research evaluations, but the discussion should not be based on misplaced statistical arguments. Instead, the primary focus should be on the socio-technical implications of the use of the impact factor.

Analysis of the journal impact factor and related bibliometric indicators in education and educational research category

2021 ◽  
pp. 1-22
Author(s):  
Metin Orbay ◽  
Orhan Karamustafaoğlu ◽  
Ruben Miranda
Keyword(s):  
Impact Factor ◽  
Educational Research ◽  
Journal Impact Factor ◽  
Impact Factors ◽  
Bibliometric Indicators ◽  
Strongly Correlated ◽  
Starting Point ◽  
Consistent Assessment ◽  
The Impact ◽  
Journal Impact

This study analyzes the journal impact factor and related bibliometric indicators in Education and Educational Research (E&ER) category, highlighting the main differences among journal quartiles, using Web of Science (Social Sciences Citation Index, SSCI) as the data source. High impact journals (Q1) publish only slightly more papers than expected, which is different to other areas. The papers published in Q1 journal have greater average citations and lower uncitedness rates compared to other quartiles, although the differences among quartiles are lower than in other areas. The impact factor is only weakly negative correlated (r=-0.184) with the journal self-citation but strongly correlated with the citedness of the median journal paper (r= 0.864). Although this strong correlation exists, the impact factor is still far to be the perfect indicator for expected citations of a paper due to the high skewness of the citations distribution. This skewness was moderately correlated with the citations received by the most cited paper of the journal (r= 0.649) and the number of papers published by the journal (r= 0.484), but no important differences by journal quartiles were observed. In the period 2013–2018, the average journal impact factor in the E&ER has increased largely from 0.908 to 1.638, which is justified by the field growth but also by the increase in international collaboration and the share of papers published in open access. Despite their inherent limitations, the use of impact factors and related indicators is a starting point for introducing the use of bibliometric tools for objective and consistent assessment of researcher.

Citation Skew in Plastic Surgery Journals: Does the Journal Impact Factor Predict Individual Article Citation Rate?

2019 ◽  
Vol 40 (10) ◽  
pp. 1136-1142 ◽  
Author(s):  
Malke Asaad ◽  
Austin Paul Kallarackal ◽  
Jesse Meaike ◽  
Aashish Rajesh ◽  
Rafael U de Azevedo ◽  
...  
Keyword(s):  
Impact Factor ◽  
Plastic Surgery ◽  
Journal Impact Factor ◽  
Citation Rate ◽  
Scientific Work ◽  
Biomedical Science ◽  
Unequal Distribution ◽  
Number Of Citations ◽  
Journal Impact ◽  
Surgery Journals

Abstract Background Citation skew refers to the unequal distribution of citations to articles published in a particular journal. Objectives We aimed to assess whether citation skew exists within plastic surgery journals and to determine whether the journal impact factor (JIF) is an accurate indicator of the citation rates of individual articles. Methods We used Journal Citation Reports to identify all journals within the field of plastic and reconstructive surgery. The number of citations in 2018 for all individual articles published in 2016 and 2017 was abstracted. Results Thirty-three plastic surgery journals were identified, publishing 9823 articles. The citation distribution showed right skew, with the majority of articles having either 0 or 1 citation (40% and 25%, respectively). A total of 3374 (34%) articles achieved citation rates similar to or higher than their journal’s IF, whereas 66% of articles failed to achieve a citation rate equal to the JIF. Review articles achieved higher citation rates (median, 2) than original articles (median, 1) (P < 0.0001). Overall, 50% of articles contributed to 93.7% of citations and 12.6% of articles contributed to 50% of citations. A weak positive correlation was found between the number of citations and the JIF (r = 0.327, P < 0.0001). Conclusions Citation skew exists within plastic surgery journals as in other fields of biomedical science. Most articles did not achieve citation rates equal to the JIF with a small percentage of articles having a disproportionate influence on citations and the JIF. Therefore, the JIF should not be used to assess the quality and impact of individual scientific work.

scholarly journals Comparison of the Impact Factors of the Most-Cited Cardiovascular Journals

2019 ◽  
Vol 124 (12) ◽  
pp. 1718-1724 ◽  
Author(s):  
Tobias Opthof
Keyword(s):  
Impact Factor ◽  
Journal Impact Factor ◽  
European Heart Journal ◽  
The Other ◽  
Impact Factors ◽  
Additional Advantage ◽  
The Right ◽  
Number Of Classes ◽  
The Impact ◽  
Journal Impact

In this article, I show that the distribution of citations to papers published by the top 30 journals in the category Cardiac & Cardiovascular Systems of the Web of Science is extremely skewed. This skewness is to the right, which means that there is a long tail of papers that are cited much more frequently than the other papers of the same journal. The consequence is that there is a large difference between the mean and the median of the citation of the papers published by the journals. I further found that there are no differences between the citation distributions of the top 4 journals European Heart Journal , Circulation , Journal of the American College of Cardiology , and Circulation Research . Despite the fact that the journal impact factor (IF) varied between 23.425 for Eur Heart J and 15.211 for Circ Res with the other 2 journals in between, the median citation of their articles plus reviews (IF Median) was 10 for all 4 journals. Given the fact that their citation distributions were similar, it is obvious that an indicator (IF Median) that reflects this similarity must be superior to the classical journal impact factor, which may indicate a nonexisting difference. It is underscored that the IF Median is substantially lower than the journal impact factor for all 30 journals under consideration in this article. Finally, the IF Median has the additional advantage that there is no artificial ranking of 128 journals in the category but rather an attribution of journals to a limited number of classes with comparable impact.

scholarly journals Ckj consolidation among Q1 Urology and Nephrology journals

2020 ◽  
Vol 13 (5) ◽  
pp. 723-727
Author(s):  
Alberto Ortiz
Keyword(s):  
Chronic Kidney Disease ◽  
Kidney Disease ◽  
Impact Factor ◽  
Cost Efficiency ◽  
Journal Impact Factor ◽  
Outcome Prediction ◽  
Web Of Science ◽  
Sglt2 Inhibitors ◽  
The Impact ◽  
Journal Impact

Abstract The Clinical Kidney Journal (ckj) impact factor from Clarivate’s Web of Science for 2019 was 3.388. This consolidates ckj among journals in the top 25% (first quartile, Q1) in the Urology and Nephrology field according to the journal impact factor. The manuscripts contributing the most to the impact factor focused on chronic kidney disease (CKD) epidemiology and evaluation, CKD complications and their management, cost-efficiency of renal replacement therapy, pathogenesis of CKD, familial kidney disease and the environment–genetics interface, onconephrology, technology, SGLT2 inhibitors and outcome prediction. We provide here an overview of the hottest and most impactful topics for 2017–19.

Predicting Long-Term Citation Impact of Articles in Social and Personality Psychology

2010 ◽  
Vol 106 (3) ◽  
pp. 891-900 ◽  
Author(s):  
Nick Haslam ◽  
Peter Koval
Keyword(s):  
Impact Factor ◽  
Citation Impact ◽  
The United States ◽  
Personality Psychology ◽  
The United Kingdom ◽  
Number Of Citations ◽  
The Impact ◽  
Journal Impact ◽  
Citation Advantage

The citation impact of a comprehensive sample of articles published in social and personality psychology journals in 1998 was evaluated. Potential predictors of the 10-yr. citation impact of 1,580 articles from 37 journals were investigated, including number of authors, number of references, journal impact factor, author nationality, and article length, using linear regression. The impact factor of the journal in which articles appeared was the primary predictor of the citations that they accrued, accounting for 30% of the total variance. Articles with greater length, more references, and more authors were cited relatively often, although the citation advantage of longer articles was not proportionate to their length. A citation advantage was also enjoyed by authors from the United States of America, Canada, and the United Kingdom. 37% of the variance in the total number of citations was accounted for by the study variables.

scholarly journals Modeling and Simulation Analysis of Journal Impact Factor Dynamics Based on Submission and Citation Rules

Complexity ◽  
2020 ◽  
Vol 2020 ◽  
pp. 1-17
Author(s):  
Jian Zhou ◽  
Lin Feng ◽  
Ning Cai ◽  
Jie Yang
Keyword(s):  
Impact Factor ◽  
Journal Impact Factor ◽  
Simulation Analysis ◽  
Impact Factors ◽  
Model Parameters ◽  
Review Time ◽  
Citation Window ◽  
Sociological Factors ◽  
The Impact ◽  
Journal Impact

The variation of the journal impact factor is affected by many statistical and sociological factors such as the size of citation window and subject difference. In this work, we develop an impact factor dynamics model based on the parallel system, which can be used to analyze the correlation between the impact factor and certain elements. The parallel model aims to simulate the submission and citation behaviors of the papers in journals belonging to a similar subject, in a distributed manner. We perform Monte Carlo simulations to show how the model parameters influence the impact factor dynamics. Through extensive simulations, we reveal the important role that certain statistics elements and behaviors play to affect impact factors. The experimental results and analysis on actual data demonstrate that the value of the JIF is comprehensively influenced by the average review time, average number of references, and aging distribution of citation.

Sign in / Sign up

Export Citation Format

Share Document