A new index to evaluate the academic impact of journals: RAQ index

PurposeTo improve the deficiencies of the existing journal influencing evaluation indexes, which have single influencing factors and are greatly affected by the number of papers published, this paper proposes a new evaluation of the journal influence method based on the RA index.Design/methodology/approachIn the metrics create, the paper introduces the RA index for evaluating the impact of authors and analyzing its feasibility in journal evaluation. Then the RA index is divided by the number of journal's published papers to obtain the RAQ index to evaluate journal impact. In the metrics analysis, the authors analyze the statistical characteristics of the RAQ index using statistical analysis, and t-test, Roc curve and PLS were used to analyze the relationship between the RAQ index and other indicators.FindingsEmpirical results show that the RAQ index can effectively identify high-quality journals and reduce the number of published papers on journal evaluation. The empirical results show that the RAQ index has higher stability and discrimination than the h-index and g-index. Compared with other indexes, the RAQ index has better evaluation effects and statistical characteristics.Originality/valueThe current study proposes journals' RAQ index, which integrates the influence of high-, low- and zero-cited papers. It solves the problem of the virtual high of the h-type index. The findings will contribute to the evaluation of journal influence by offering a new research idea that facilitates the fairness and rationality of journal evaluation.

Impact assessment indicators for the UK Web Archive

PurposeThe purpose of this paper is to present the results of a study to examine, determine and propose the optimal approach to develop impact assessment indicators for the UK Web Archive.Design/methodology/approachThe paper analyses the existing literature on impact assessment frameworks for digital resources and the types of impact in related fields to set an approach to develop an impact assessment plan. Primarily drawing from the Balanced Value Impact Model, the approach consists of three stages: context setting, indicator development and indicator evaluation.FindingsThe development of a set of potential impact assessment indicators for the UK Web Archive shows not only an optimal approach for the development but also recommendations for web archiving organisations.Research limitations/implicationsThe research did not carry out follow-up interviews regarding the feedback from UK Web Archive's staff. Adoption of the new set of indicators will further this development.Practical implicationsThe staff's duties influence their prioritisation of the indicators, so discussions among partners will be helpful in recognising different perceptions, unnoticed strengths and potential values. A progressive accumulation of assessment and improvements from the current state and small regular evaluations will be also helpful to demonstrate the impact and value to the stakeholders in the future.Originality/valueThis paper proposes a set of 13 potential indicators for the UK Web Archive of which functionality was checked against set quality criteria and tested through semi-structured interviews and survey submissions with the UK Web Archive staff members.

Assessing an academic library performance before and during the COVID-19 pandemic: a case study in UAE

PurposeThe purpose of this case study is to assess and compare the performance of an academic library, in the United Arab Emirates (UAE), before and during the coronavirus disease 2019 (COVID-19) pandemic.Design/methodology/approachThe study is based on data collected from the library management system, usage reports of online databases, and monthly reports and archives to evaluate and assess library performance in managerial activities, collection development, collection treatment, collection circulation, usage of digital resources, quality control, reference services and information literacy activities. Frequency distributions and non-parametric tests were used in identifying differences and testing hypotheses.FindingsThe study found that library performance before the COVID-19 pandemic outperformed library performance during the pandemic in collection development, collection treatment, collection circulation, access and use of digital resources, quality control and information literacy. On the other hand, the library demonstrated higher performance in managerial activities and reference services during the COVID-19 pandemic than that of before the pandemic period. Interestingly, the analysis of the Wilcoxon signed-ranks test revealed statistically no significant difference in the library performance before and during the COVID-19 pandemic. The results supported all the eight hypotheses stated in this study.Research limitations/implicationsThis is a case study based on data collected from an academic library in the UAE before and during the COVID-19 pandemic. The findings may not be generalized and may differ if more data are analyzed from many academic libraries.Practical implicationsCOVID-19 pandemic is a turning point for library managers to increase the number of digital resources and services, to ensure that library staff are equipped with essential and up-to-date information and communication technology (ICT) skills and knowledge, to ensure that library users are equipped with essential and up-to-date information literacy skills and knowledge. These will enable them to satisfy users' information needs and ensure library operation in disasters and crisis periods.Originality/valueThis is one of the few studies conducted in the Gulf Cooperation Council (GCC) countries to evaluate library performance before and during COVID-19 pandemic. The findings of the study could be an important reference in understanding how libraries responded to COVID-19 pandemic in the Middle East. The results of the study may contribute to the provision of digital resources and services during the pandemic and disasters in the UAE and the Arab world.

A review of cluster analysis techniques and their uses in library and information science research: k-means and k-medoids clustering

PurposeThis literature review explores the definitions and characteristics of cluster analysis, a machine-learning technique that is frequently implemented to identify groupings in big datasets and its applicability to library and information science (LIS) research. This overview is intended for researchers who are interested in expanding their data analysis repertory to include cluster analysis, rather than for existing experts in this area.Design/methodology/approachA review of LIS articles included in the Library and Information Source (EBSCO) database that employ cluster analysis is performed. An overview of cluster analysis in general (how it works from a statistical standpoint, and how it can be performed by researchers), the most popular cluster analysis techniques and the uses of cluster analysis in LIS is presented.FindingsThe number of LIS studies that employ a cluster analytic approach has grown from about 5 per year in the early 2000s to an average of 35 studies per year in the mid- and late-2010s. The journal Scientometrics has the most articles published within LIS that use cluster analysis (102 studies). Scientometrics is the most common subject area to employ a cluster analytic approach (152 studies). The findings of this review indicate that cluster analysis could make LIS research more accessible by providing an innovative and insightful process of knowledge discovery.Originality/valueThis review is the first to present cluster analysis as an accessible data analysis approach, specifically from an LIS perspective.

Comparison of library website function access tools 2014–2018

PurposeFour years after the release of a responsive design website that provides a dynamic screen layout across three access devices (computer, tablet and smartphone), a repeat study was conducted to determine changes in the way that library website functions are and are not accessed.Design/methodology/approachA survey, similar to the original study, was used to determine the rate of access of 20 website functions by three access devices (computer, tablet and smartphone) and a “did not use” (DNU) category. A two-proportion Z-test was used to determine significant differences in the rate of access for each website function and the “did not use” (DNU) category by each access device from 2014 to 2018.FindingsThe computer is still the primary tool used to access website functions, but its rate of use is declining, while access via the smartphone is increasing, including research and for learning functions traditionally accessed only by computer. Access by tablet, with poor website function access rates in 2014, declined in use, with some rates approaching zero. Increases in the DNU category for website functions occurred, but reasons why were not determined. The increases raised questions about the relevance of some of the website functions and if other actions are needed to increase use.Originality/valueRepeating the 2014 study provided insights into the changing landscape of device preferences for accessing library website functions. The number of significant changes identified demonstrates the importance of recurring studies to determine how online access to library website functions evolves over time.

STEM undergraduate students: library use, perceptions and GPA

PurposeThis study aims to examine if differences exist in undergraduate students' library use, perceptions and grade point average (GPA) among science, technology, engineering and mathematics (STEM) and non-STEM disciplines.Design/methodology/approachThe current study used data from the 2018 student survey. Among 2,277 students who completed the survey (response rate = 8%), only undergraduate students (n = 1,265) were selected for this study because the current study aims to examine the differences between STEM and non-STEM undergraduate students.FindingsThe findings from a Mann–Whitney U test revealed that STEM respondents perceived specific library resources (subject and course guide, library instructions and library workshops) as slightly less than non-STEM respondents. The results from ANOVA demonstrated that the mean scores in GPA for STEM respondents who never used online library, journals and databases were lower than respondents who used those library resources, regardless of STEM and non-STEM disciplines.Originality/valueRevisiting the data collected and analyzing specific user groups will be valuable to academic libraries because this study will provide academic librarians with a deeper understanding of specific user needs and perceptions of library resources and services.

Employee performance appraisal system development in the National Library and Archives of Iran (NLAI): soft operational research approach

PurposeThe performance evaluation process is a key step in any management system and constitutes the basis for continuous improvement. Resistance to change is considered as a critical factor in any change management project; so, development of employee performance appraisal systems like all of the change management projects has always faced many challenges. This study seeks to illustrate the two-year experience (2018–2020) and lessons learned by developing an employee performance appraisal system in the National Library and Archives of Iran (NLAI) as a cultural public sector organization.Design/methodology/approachThis study was carried out by using soft operational research (OR) approaches, using a novel combination of two methods, soft system methodology (SSM) and importance performance analysis (IPA). For this purpose, at the beginning, with the help of the SSM approach, the challenges of implementation was identified, then, using the opinions and experiences of the system's stakeholders, improvement actions were defined and prioritized using the IPA method.FindingsThe research findings showed that “coaching development,” “optimizing the forced distribution rating system (FDRS)” and “customizing the system” are the most important improvement actions.Originality/valueThe research has bridged the gap between research and practice in the field of employee performance appraisal system in national libraries.

Quality outcomes in NHS library and knowledge services

PurposeThis paper aims to demonstrate the approach taken in delivering the quality and impact elements of Knowledge for Healthcare, the strategic development framework for National Health Service (NHS) library and knowledge services in England. It examines the work undertaken to enhance quality and demonstrate the value and impact of health library and knowledge services. It describes the interventions developed and implemented over a five-year period 2015–2020 and the move towards an outcome rather than process approach to impact and quality.Design/methodology/approachThe case study illustrates a range of interventions that have been developed, including the outcomes of implementation to date. The methodology behind each intervention is informed by the evidence base and includes professional engagement.FindingsThe outcomes approach to the development and implementation of quality and impact interventions and assets provides evidence to demonstrate the value of library and knowledge staff to the NHS in England to both high-level decision-makers and service users.Originality/valueThe interventions are original concepts developed within the NHS to demonstrate system-wide impacts and change. The Evaluation Framework has been developed based on the impact planning and assessment (IPA) methodology. The interventions can be applied to other healthcare systems, and the generic learning is transferable to other library and knowledge sectors, such as higher education.

Gap assessment and comparison of the quality of services between central libraries of the University of Tehran and Allameh Tabataba'i University

PurposeThe purpose of this study is to measure the gap and compare the quality of services provided by the Central Library of the University of Tehran and Allameh Tabataba'i University and identify the components of service that need improvement in these libraries.Design/methodology/approachIn this study, a descriptive survey method is used for data collection. The study sample contains 205 people selected out of 31,000 members of Tehran University and 100 people out of 15,000 members at Allameh Tabataba'i University. The LibQual tool is used to measure different levels of users' perceptions of library service quality.FindingsBased on the findings of the study, the level of service received at the University of Tehran was higher than the minimum expected level, and at Allameh Tabataba'i University, the level of service received was lower than the minimum level of expected, which indicates users' satisfaction at this index at the University of Tehran and users' dissatisfaction at Allameh Tabataba'i University. In the index of information control and library as a place in Tehran University, the level of service received was higher than the minimum level and in Allameh Tabataba'i University, the level of service received was lower than the minimum level, which indicates the satisfaction of users in this index at the University of Tehran and users' dissatisfaction at Allameh Tabataba'i University.Practical implicationsService quality, or quality of service, is the measurement and comparison of the size of service provided with users' expectations. The following principles illustrate the dimensions of service quality: Quality of service is much more difficult to measure than the quality of goods. The quality of service is based on users' expectations. Quality of service varies in status, meaning that the quality of a service is measured against the customer's initial expectations of that service (Parasuraman et al., 1985).Originality/valueBeing the first performance evaluation, community synchronization, economic justification, user satisfaction and customer orientation are the values of the present study.

Bibliometric analysis of a controversial paper on predatory publishing

PurposeIn 2017, one study (Derek Pyne; Journal of Scholarly Publishing; DOI: 10.3138/jsp.48.3.137; University of Toronto Press) in the “predatory” publishing literature attracted global media attention. Now, over three years, according to adjusted Google Scholar data, with 53 citations (34 in Clarivate Analytics' Web of Science), that paper became that author's most cited paper, accounting for one-third of his Google Scholar citations.Design/methodology/approachIn this paper, the authors conducted a bibliometric analysis of the authors who cited that paper.FindingsWe found that out of the 39 English peer-reviewed journal papers, 11 papers (28%) critically assessed Pyne's findings, some of which even refuted those findings. The 2019 citations of the Pyne (2017) paper caused a 43% increase in the Journal of Scholarly Publishing 2019 Journal Impact Factor, which was 0.956, and a 7.7% increase in the 2019 CiteScore.Originality/valueThe authors are of the opinion that scholars and numerous media that cited the Pyne (2017) paper were unaware of its flawed findings.