Research evaluation of computer science publications using Altmetrics: a cohort study of Indian Central Universities

2021 ◽  
Vol ahead-of-print (ahead-of-print) ◽  
Author(s):  
Manika Lamba ◽  
Neha Kashyap ◽  
Margam Madhusudhan
Keyword(s):  
Computer Science ◽  
Research Evaluation ◽  
Strong Positive Correlation ◽  
Content Type ◽  
Indian Central ◽  
Scholarly Impact ◽  
Funding Agencies ◽  
Reference Tools ◽  
Jawaharlal Nehru ◽  
The Relationship

Purpose Social interaction applications and reference tools are actively used by researchers to share and manage their research publications. Thus, this paper aims to determine the scholarly impact of selected Indian central universities. Design/methodology/approach This study analyzed 669 articles having both Dimensions citations and Altmetric attention scores published by 35 Indian central universities for 4 subfields of Computer Science using Altmetric Explorer. This paper determined each university’s contribution in the studied subfields of Computer Science and the correlation among Altmetric attention score (aggregated and individual), Dimensions citation, and Mendeley readership counts for all 669 articles and stratified percentile sets of top 25%, and top 50% of the overall number of articles. Findings The findings showed that Jawaharlal Nehru University had the maximum Altmetric attention score, Banaras Hindu University received the maximum Dimensions citation, and University of Hyderabad (UoH) received the maximum number of Mendeley readers. Each central university was examined individually and then ranked based on their median values of Dimensions citations and Altmetric attention scores. Further, Twitter had the maximum Altmetric coverage, followed by Google+, Patent and Facebook for the retrieved articles. A significant strong positive correlation was observed between the Dimensions citation and Mendeley readership counts for all the three categories. Research limitations/implications Both Altmetric attention scores and Dimensions citations can help funding agencies to assess and evaluate the research productivity of these universities, thus, making important decisions such as increasing, decreasing, re-distributing their funds. Originality/value The current body of research is focused mostly on relationships between citations and individual Altmetric indicators predominantly. For most of the studies, the citations were retrieved from Scopus, Web of Science or Google Scholar database. It was observed that by far, no study had examined the relationship between citations retrieved from Dimensions database, Altmetrics scores (both aggregated and individual) and Mendeley readership counts.

Relationship amongst ResearchGate altmetric indicators and Scopus bibliometric indicators

2015 ◽  
Vol 116 (9/10) ◽  
pp. 564-577 ◽  
Author(s):  
RISHABH SHRIVASTAVA ◽  
Preeti Mahajan
Keyword(s):  
Sample Size ◽  
Correlation Coefficients ◽  
Strong Positive Correlation ◽  
Bibliometric Indicators ◽  
Pearson’S Correlation ◽  
Content Type ◽  
Positive Correlation ◽  
Pearson's Correlation ◽  
Different Characteristics ◽  
The Relationship

Purpose – The purpose of this paper is twofold. First, the study aims to investigate the relationship between the altmetric indicators from ResearchGate (RG) and the bibliometric indicators from the Scopus database. Second, the study seeks to examine the relationship amongst the RG altmetric indicators themselves. RG is a rich source of altmetric indicators such as Citations, RGScore, Impact Points, Profile Views, Publication Views, etc. Design/methodology/approach – For establishing whether RG metrics showed the same results as the established sources of metrics, Pearson’s correlation coefficients were calculated between the metrics provided by RG and the metrics obtained from Scopus. Pearson’s correlation coefficients were also calculated for the metrics provided by RG. The data were collected by visiting the profile pages of all the members who had an account in RG under the Department of Physics, Panjab University, Chandigarh (India). Findings – The study showed that most of the RG metrics showed strong positive correlation with the Scopus metrics, except for RGScore (RG) and Citations (Scopus), which showed moderate positive correlation. It was also found that the RG metrics showed moderate to strong positive correlation amongst each other. Research limitations/implications – The limitation of this study is that more and more scientists and researchers may join RG in the future, therefore the data may change. The study focuses on the members who had an account in RG under the Department of Physics, Panjab University, Chandigarh (India). Perhaps further studies can be conducted by increasing the sample size and by taking a different sample size having different characteristics. Originality/value – Being an emerging field, not much has been conducted in the area of altmetrics. Very few studies have been conducted on the reach of academic social networks like RG and their validity as sources of altmetric indicators like RGScore, Impact Points, etc. The findings offer insights to the question whether RG can be used as an alternative to traditional sources of bibliometric indicators, especially with reference to a rapidly developing country such as India.

Altmetrics and their relationship with citation counts: a case of journal articles in physics

2022 ◽  
Vol ahead-of-print (ahead-of-print) ◽  
Author(s):  
Rishabh Shrivastava ◽  
Preeti Mahajan
Keyword(s):  
Design Methodology ◽  
Large Scale ◽  
Research Evaluation ◽  
Rank Correlation ◽  
Journal Articles ◽  
Content Type ◽  
Spearman’S Rank Correlation ◽  
Spearman’S Rank Correlation Coefficient ◽  
Low Coverage ◽  
The Relationship

Purpose The first purpose of the present study is to investigate the coverage of journal articles in Physics in various sources of altmetrics. Secondly, the study investigates the relationship between altmetrics and citations. Finally, the study also investigates whether the relationship between citations and altmetrics was stronger or weaker for those articles that had been mentioned at least once in the sources of altmetrics. Design/methodology/approach The journal articles in Physics having at least one author from an Indian Institution and published during 2014–2018 in sources of altmetrics have been investigated. Altmetric.com was used for collecting altmetrics data. Spearman’s rank correlation coefficient (ρ) has been used as the data found to be skewed. Findings The highest coverage was found on Twitter (22.68%), followed by Facebook (3.62%) and blogs (2.18%). The coverage in the rest of the sources was less than 1%. The average Twitter mentions for journal articles tweeted at least once was found to be 4 (3.99) and for Facebook mentions, it was found to be 1.48. Correlations between Twitter mentions–citations and Facebook mentions–citation were found to be statistically significant but low to weak positive. Research limitations/implications The study concludes that due to the low coverage of journal articles, altmetrics should be used cautiously for research evaluation keeping in mind the disciplinary differences. The study also suggests that altmetrics can function as complementary to citation-based metrics. Originality/value The study is one of the first large scale altmetrics studies dealing with research in Physics. Also, Indian research has not been attended to in the altmetrics literature and the present study shall fill that void.

Relationship between citation counts and Mendeley readership metrics

2016 ◽  
Vol 117 (3/4) ◽  
pp. 229-238 ◽  
Author(s):  
Rishabh Shrivastava ◽  
Preeti Mahajan
Keyword(s):  
Strong Positive Correlation ◽  
Bibliometric Indicators ◽  
Content Type ◽  
Positive Correlation ◽  
Time Periods ◽  
Scopus Database ◽  
Citation Counts ◽  
The Difference ◽  
Number Of Citations ◽  
The Relationship

Purpose – Social media has given way for the development of various new altmetric indicators. Mendeley readership count is one such indicator. The purpose of this paper is twofold. First, the paper aims to investigate the relationship between citation counts and Mendeley readership counts. The paper also evaluates the relationship between Mendeley readership metrics for two different time periods, thereby investigating its nature as an altmetric indicator. Design/methodology/approach – Data were collected using the Scopus database. Top 100 papers in Physics published during 2005 as well as in 2010 that received the largest number of citations were selected. Mendeley readership data were collected using Mendeley readership statistics for documents indexed in Scopus. For establishing a relationship between citation counts and Mendeley readership, correlation was calculated between the citations in Scopus database and Mendeley readership. The difference in Mendeley readership for different time periods was also investigated. Findings – The paper showed that for both the years, Mendeley readership counts were in positive correlation with citation counts. For the year 2010, it was found that Mendeley readership counts were in strong positive correlation with citation counts, whereas for 2005, they were in moderate positive correlation. Research limitations/implications – One of the limitations of this paper is that with time more scientists and researchers may join Mendeley causing various changes in data and giving different results. Also, the paper has focused on the highly cited papers in Physics. Originality/value – Very few studies have been conducted in the area of altmetrics, as it is a comparatively new and emerging field of research. The findings of this paper offer insights to the question whether Mendeley readership counts can be used as an alternative to traditional sources of bibliometric indicators like citations, h-index, etc. The paper also evaluates the difference in the nature of traditional bibliometric indicators and Mendeley readership counts.

An altmetric analysis of ResearchGate profiles of physics researchers

2017 ◽  
Vol 18 (1) ◽  
pp. 52-66 ◽  
Author(s):  
Rishabh Shrivastava ◽  
Preeti Mahajan
Keyword(s):  
Design Methodology ◽  
Research Evaluation ◽  
Great Depth ◽  
Social Networking Site ◽  
Faculty Members ◽  
The Novel ◽  
Content Type ◽  
Average Citation ◽  
The Relationship ◽  
Single Publication

Purpose The purpose of this paper is to carry out an altmetric analysis of faculty members and research scholars of Department of Physics and Astrophysics, University of Delhi (India) (Univ.Delhi P&A) who are members of the academic social networking site ResearchGate. ReserachGate is a rich source of altmetric indictors such as publications, reads, profile views, citations, impact points, RGScore, followers and following, etc. The RGScore, unique to ResearchGate, was further explored in depth in the study. Design/methodology/approach The data were collected manually by visiting the profile pages of all the members who had an account in ResearchGate under Univ.Delhi P&A during the first week of July, 2016. The authors found a total of 173 members in ResearchGate from the department. Data were collected for publications, reads, profile views, citations, impact points, RGScore, followers and following from the profile pages of the members. Correlations were calculated amongst the metrics provided by ResearchGate to seek the nature of the relationship amongst the various ResearchGate metrics. Findings The analysis revealed that the publications added by researchers to their profiles were relatively low, as 28.32 per cent of the members had not added even a single publication to their profiles. Average reads acquired per person was found to be 909.49 and the median value of reads was found to be 95. Average citation per member in ResearchGate was found to be 414.60 and the median value was found to be 7. Majority of the researchers (45.09 per cent) had impact points in the range of 0.2-50. Most of the members (35.84 per cent) had followers in the range of 1-10. Majority of the members (52.02 per cent) had profile views in the range of 1-100. Most of the members (26.01 per cent) had RGScore equivalent to 0.01. The highest correlation of RGScore was found with publications added by researchers to their profiles, followed by correlation between RGScore and reads, correlation between RGscore and profile views, correlation between RGScore and number of Full Texts and correlation between RGScore and number of followers of a researcher. Originality/value Not much research has been conducted in the area of altmetrics, especially using ResearchGate as a source of altmetrics. The findings of the study help in understanding the validity of ResearchGate as a source of altmetrics for research evaluation in a developing country such as India. Also, the novel ResearchGate indicator RGScore has been evaluated in great depth and its relationship with other ResearchGate altmetric and bibliometric indicators has been established.

Exploring the relationship between web presence and web usability for universities

2016 ◽  
Vol 50 (2) ◽  
pp. 157-174 ◽  
Author(s):  
Serhat Peker ◽  
Seyma Kucukozer-Cavdar ◽  
Kursat Cagiltay
Keyword(s):  
Usability Evaluation ◽  
Strong Positive Correlation ◽  
Content Type ◽  
Web Usability ◽  
Web Presence ◽  
University Websites ◽  
Usability Problems ◽  
The University ◽  
The Relationship ◽  
Practical Implications

Purpose – The purpose of this paper is to statistically explore the relationship between web usability and web presence of the universities. As a case study, five Turkish universities in different rankings which were selected from Webometrics rankings were evaluated and compared. Design/methodology/approach – Two different methods were employed for performing usability evaluation of the selected universities: a user testing was used to measure the user performance on the selected tasks and a questionnaire to assess the user satisfaction on the website use. Both usability evaluation methods were applied on the pre-determined tasks for each university by participation of 20 subjects. After the usability evaluation, the universities were ranked in terms of usability results and finally, the relationship between web usability and web presence of universities was statistically investigated by using Kendall’s rank correlation. Findings – Several common usability problems which were asserted by related previous studies were identified at the end of usability evaluation of university websites. The usability results also revealed that selected Turkish university websites suffer from numerous usability problems. Further, a strong positive correlation (p < 0.05) between the usability of the university websites and their web presences were identified. Hence, the participants showed a higher success and satisfaction while performing the tasks on the university websites which have strong web presences. Practical implications – The findings from this study have practical implications for universities. Correlation results showed that universities can improve their web usability by giving importance to their web presence volumes. Universities can estimate their web usability levels by investigating their web presence rankings and they can also raise their rankings in Webometrics ranking system by improving the usability of their websites. Moreover, university web developers can design more usable and more user-friendly websites by avoiding usability and design problems identified through usability evaluation. Originality/value – Different from the prior research efforts focussing on usability of educational web pages, this study contributes to the growing literature by statistically exploring the relationship between web presence and web usability of universities. This study is also precious from the point of view that it is one of the first attempts to evaluate and compare usability levels of a set of universities’ websites from Turkey.

Investigating Diseases and Chemicals in COVID-19 Literature with Text Mining (Preprint)

2020 ◽  
Author(s):  
Amir Karami ◽  
Brandon Bookstaver ◽  
Melissa Nolan
Keyword(s):  
Text Mining ◽  
Literature Review ◽  
Topic Modeling ◽  
Large Scale ◽  
Clinical Manifestations ◽  
International Health ◽  
Research Papers ◽  
Strategic Plans ◽  
Funding Agencies ◽  
The Relationship

BACKGROUND The COVID-19 pandemic has impacted nearly all aspects of life and has posed significant threats to international health and the economy. Given the rapidly unfolding nature of the current pandemic, there is an urgent need to streamline literature synthesis of the growing scientific research to elucidate targeted solutions. While traditional systematic literature review studies provide valuable insights, these studies have restrictions, including analyzing a limited number of papers, having various biases, being time-consuming and labor-intensive, focusing on a few topics, incapable of trend analysis, and lack of data-driven tools. OBJECTIVE This study fills the mentioned restrictions in the literature and practice by analyzing two biomedical concepts, clinical manifestations of disease and therapeutic chemical compounds, with text mining methods in a corpus containing COVID-19 research papers and find associations between the two biomedical concepts. METHODS This research has collected papers representing COVID-19 pre-prints and peer-reviewed research published in 2020. We used frequency analysis to find highly frequent manifestations and therapeutic chemicals, representing the importance of the two biomedical concepts. This study also applied topic modeling to find the relationship between the two biomedical concepts. RESULTS We analyzed 9,298 research papers published through May 5, 2020 and found 3,645 disease-related and 2,434 chemical-related articles. The most frequent clinical manifestations of disease terminology included COVID-19, SARS, cancer, pneumonia, fever, and cough. The most frequent chemical-related terminology included Lopinavir, Ritonavir, Oxygen, Chloroquine, Remdesivir, and water. Topic modeling provided 25 categories showing relationships between our two overarching categories. These categories represent statistically significant associations between multiple aspects of each category, some connections of which were novel and not previously identified by the scientific community. CONCLUSIONS Appreciation of this context is vital due to the lack of a systematic large-scale literature review survey and the importance of fast literature review during the current COVID-19 pandemic for developing treatments. This study is beneficial to researchers for obtaining a macro-level picture of literature, to educators for knowing the scope of literature, to journals for exploring most discussed disease symptoms and pharmaceutical targets, and to policymakers and funding agencies for creating scientific strategic plans regarding COVID-19.

Role of burnout on job level, job satisfaction, and task performance

2017 ◽  
Vol 38 (5) ◽  
pp. 630-645 ◽  
Author(s):  
Won Ho Kim ◽  
Young-An Ra ◽  
Jong Gyu Park ◽  
Bora Kwon
Keyword(s):  
Job Satisfaction ◽  
Task Performance ◽  
Organizational Context ◽  
Content Type ◽  
Job Level ◽  
Mediating Role ◽  
Final Sample ◽  
The Relationship ◽  
And Task

Purpose The purpose of this paper is to examine the mediating role of burnout (i.e. exhaustion, cynicism, professional inefficacy) in the relationship between job level and job satisfaction as well as between job level and task performance. Design/methodology/approach The final sample included 342 Korean workers from selected companies. The authors employed the Hayes (2013) PROCESS tool for analyzing the data. Findings The results showed that all three subscales of burnout (i.e. exhaustion, cynicism, professional inefficacy) mediate the relationship between job level and job satisfaction. However, only two mediators (i.e. cynicism, professional inefficacy) indicated the mediating effects on the association between job level and task performance. Originality/value This research presented the role of burnout on the relationships between job level, job satisfaction, and task performance especially in South Korean organizational context. In addition to role of burnout, findings should prove helpful in improving job satisfaction and task performance. The authors provide implications and limitations of the findings.

Dave Snowden on KM and big data/analytics: interview with David J. Pauleen

2017 ◽  
Vol 21 (1) ◽  
pp. 12-17 ◽  
Author(s):  
David J. Pauleen
Keyword(s):  
Big Data ◽  
Data Analytics ◽  
Big Data Analytics ◽  
Theory And Practice ◽  
Content Type ◽  
Face To Face ◽  
The Relationship ◽  
A Company ◽  
Practical Implications ◽  
Scientific Officer

Purpose Dave Snowden has been an important voice in knowledge management over the years. As the founder and chief scientific officer of Cognitive Edge, a company focused on the development of the theory and practice of social complexity, he offers informative views on the relationship between big data/analytics and KM. Design/methodology/approach A face-to-face interview was held with Dave Snowden in May 2015 in Auckland, New Zealand. Findings According to Snowden, analytics in the form of algorithms are imperfect and can only to a small extent capture the reasoning and analytical capabilities of people. For this reason, while big data/analytics can be useful, they are limited and must be used in conjunction with human knowledge and reasoning. Practical implications Snowden offers his views on big data/analytics and how they can be used effectively in real world situations in combination with human reasoning and input, for example in fields from resource management to individual health care. Originality/value Snowden is an innovative thinker. He combines knowledge and experience from many fields and offers original views and understanding of big data/analytics, knowledge and management.

Heuristic biases in investment decision-making and perceived market efficiency

2018 ◽  
Vol 10 (1) ◽  
pp. 85-110 ◽  
Author(s):  
Syed Zulfiqar Ali Shah ◽  
Maqsood Ahmad ◽  
Faisal Mahmood
Keyword(s):  
Financial Markets ◽  
Market Efficiency ◽  
Negative Impact ◽  
Investment Decisions ◽  
Sampling Technique ◽  
Investment Strategy ◽  
Individual Investors ◽  
Content Type ◽  
Specific Investment ◽  
The Relationship

Purpose This paper aims to clarify the mechanism by which heuristics influences the investment decisions of individual investors, actively trading on the Pakistan Stock Exchange (PSX), and the perceived efficiency of the market. Most studies focus on well-developed financial markets and very little is known about investors’ behaviour in less developed financial markets or emerging markets. The present study contributes to filling this gap in the literature. Design/methodology/approach Investors’ heuristic biases have been measured using a questionnaire, containing numerous items, including indicators of speculators, investment decisions and perceived market efficiency variables. The sample consists of 143 investors trading on the PSX. A convenient, purposively sampling technique was used for data collection. To examine the relationship between heuristic biases, investment decisions and perceived market efficiency, hypotheses were tested by using correlation and regression analysis. Findings The paper provides empirical insights into the relationship of heuristic biases, investment decisions and perceived market efficiency. The results suggest that heuristic biases (overconfidence, representativeness, availability and anchoring) have a markedly negative impact on investment decisions made by individual investors actively trading on the PSX and on perceived market efficiency. Research limitations/implications The primary limitation of the empirical review is the tiny size of the sample. A larger sample would have given more trustworthy results and could have empowered a more extensive scope of investigation. Practical implications The paper encourages investors to avoid relying on heuristics or their feelings when making investments. It provides awareness and understanding of heuristic biases in investment management, which could be very useful for decision makers and professionals in financial institutions, such as portfolio managers and traders in commercial banks, investment banks and mutual funds. This paper helps investors to select better investment tools and avoid repeating expensive errors, which occur due to heuristic biases. They can improve their performance by recognizing their biases and errors of judgment, to which we are all prone, resulting in a more efficient market. So, it is necessary to focus on a specific investment strategy to control “mental mistakes” by investors, due to heuristic biases. Originality/value The current study is the first of its kind, focusing on the link between heuristics, individual investment decisions and perceived market efficiency within the specific context of Pakistan.

Sign in / Sign up

Export Citation Format

Share Document