Information science’s contributions towards emerging open evaluation practices

2019 ◽  
Vol 20 (1) ◽  
pp. 2-16
Author(s):  
Leonor Gaspar Pinto ◽  
Paula Ochôa

Purpose The purpose of this paper is to discuss emerging practices in open evaluation, namely, the concept of co-evaluation and how research on evaluation developed within information science can contribute to enhance stakeholders and citizens’ involvement in open science. Design/methodology/approach A meta-evaluative and transdisciplinary approach – directed toward the intersection between information science, evaluation, competences management, sustainability transitions management and participatory methodologies – provided the basis for the identification and subsequent reflection on the levels of stakeholder participation embedded into ISO 16439’s (2014) methods for assessing the impact of libraries and on the domains and competences to be mobilized for (co)evaluation. The contributions of Engaged 2020 Action Catalogue, as well as several taxonomies of evaluator competences and the Council of Europe’s (2016) conceptual model of competences for a democratic culture were particularly relevant for this (re)construction process. Findings Two results of the line of research carried out since 2012 at the Faculty of Social Sciences and Humanities of the Universidade NOVA de Lisboa (Portugal) can significantly contribute to improve stakeholders’ participation in Open Science: ISO 16439’s systematization of methods and procedures for assessing the impact of libraries and the (co-)evaluation competency framework. Originality/value This paper presents the transdisciplinary concept of co-evaluation and examines the current epistemological challenges to science by analyzing the general tendency to openness through the lens of research on evaluation and participatory methods developed within information science.

2021 ◽  
Vol ahead-of-print (ahead-of-print) ◽  
Author(s):  
Linda Sīle ◽  
Raf Guns ◽  
Alesia A. Zuccala ◽  
Tim C.E. Engels

PurposeThis study investigates an approach to book metrics for research evaluation that takes into account the complexity of scholarly monographs. This approach is based on work sets – unique scholarly works and their within-work related bibliographic entities – for scholarly monographs in national databases for research output.Design/methodology/approachThis study examines bibliographic records on scholarly monographs acquired from four European databases (VABB in Flanders, Belgium; CROSBI in Croatia; CRISTIN in Norway; COBISS in Slovenia). Following a data enrichment process using metadata from OCLC WorldCat and Amazon Goodreads, the authors identify work sets and the corresponding ISBNs. Next, on the basis of the number of ISBNs per work set and the presence in WorldCat, they design a typology of scholarly monographs: Globally visible single-expression works, Globally visible multi-expression works, Miscellaneous and Globally invisible works.FindingsThe findings show that the concept “work set” and the proposed typology can aid the identification of influential scholarly monographs in the social sciences and humanities (i.e. the Globally visible multi-expression works).Practical implicationsIn light of the findings, the authors outline requirements for the bibliographic control of scholarly monographs in national databases for research output that facilitate the use of the approach proposed here.Originality/valueThe authors use insights from library and information science (LIS) to construct complexity-sensitive book metrics. In doing so, the authors, on the one hand, propose a solution to a problem in research evaluation and, on the other hand, bring to attention the need for a dialogue between LIS and neighbouring communities that work with bibliographic data.


2020 ◽  
Vol ahead-of-print (ahead-of-print) ◽  
Author(s):  
Magdalena Wójcik

PurposeThe subject of the article is the concept of augmented intelligence, which constitutes a further stage in the development of research on artificial intelligence. This is a new phenomenon that has rarely been considered in the subject literature so far, which may be interesting for the fields of social sciences and humanities. The aim is to describe the features of this technology and determine the practical and ethical problems associated with its implementation in libraries.Design/methodology/approachThe method of literature review was used. Systematic searches according to specific questions were carried out using the Scopus and Web of Science scientific databases, as well as Google Scholar and the LISTA abstract database.FindingsThe results established that the issue of augmented intelligence has barely been discussed in the field of librarianship. Although this technology may be interesting as a new area of librarian research and as a new framework for designing innovative services, deep ethical consideration is necessary before this technology is introduced in libraries.Research limitations/implicationsThe article deals with some of the newest technologies available, and this topic is generally very rarely discussed in scientific publications in either the social sciences or humanities. Therefore, due to the limited availability of materials, the findings presented in the article are primarily of a conceptual nature. The aim is to present this topic from the perspective of librarianship and to create a starting point for further discussion on the ethical aspects of introducing new technologies in libraries.Practical implicationsThe results can be widely used in practice as a framework for the implementation of augmented intelligence in libraries.Social implicationsThe article can help to facilitate the debate on the role of implementing new technologies in libraries.Originality/valueThe problem of augmented intelligence is very rarely addressed in the subject literature in the field of library and information science.


2020 ◽  
Vol ahead-of-print (ahead-of-print) ◽  
Author(s):  
Md Anwarul Islam ◽  
Naresh Kumar Agarwal

Purpose The purpose of this study is to determine the place of library and information Science (LIS) research within leading knowledge management (KM) journals and conferences. Design/methodology/approach Authors examined articles published from 2000-2018 in top-20 KM publications identified by Google Scholar to look for relationship with LIS. Authors analyzed the identified LIS-related articles to determine the publication trends based on LIS terms used, populations, authorship pattern, country, information setting type and top-cited articles. Findings Authors found that the coverage of LIS-related articles within leading KM publications was very low. From the more than 10,000 KM research articles, less than 1 per cent were LIS-related. Research limitations/implications This study would help LIS researchers measure the space they have created for their field within leading KM research. By showing the relatively low coverage of LIS within KM research, the study demonstrates that LIS researchers/practitioners need to do more for LIS to be recognized as an important area within KM. KM publications can also enable greater synergies with LIS for mutual benefit. Originality/value LIS researchers have increasingly called for KM implementation within libraries. The KM field has a long history in library practice in the context of managing and organizing codified knowledge. Both KM and LIS share the common goals of providing access to knowledge for sharing, transfer and use. However, hardly any studies have looked at the amount of synergy or overlap between these two different but related areas, and whether LIS matters to KM, even though LIS practitioners have been highlighting that KM matters to LIS.


2019 ◽  
Vol 33 (1) ◽  
pp. 56-82 ◽  
Author(s):  
Leida Chen ◽  
Xiaohan Zhang ◽  
Zhensheng Li

Purpose Drawing upon the theory of information culture from information science and prior research on Chinese information practices. The purpose of this paper is to posit that instead of over-relying on Hofstede’s national cultural values, the IS field should develop theories on national information culture to bridge the theoretical gaps found in explaining the differences in individuals’ IT perceptions and behaviors across cultures. Design/methodology/approach To achieve the objectives of this study, two quantitative studies were conducted. The first study is exploratory in nature and focuses on the development and calibration of an instrument to measure the Chinese information culture (CIC). The second study takes a confirmatory approach to investigate the impact of the CIC on IT perceptions of manager. Findings The study develops and validates an instrument for measuring the CIC that comprises information source and format preference, information ownership and analysis style, and centralized decision-making and information control. The CIC is found to influence IT perceptions of managers including perceived performance improvement resulted from IT use, attitude toward using work technologies and attitude on the value of IT in general. Originality/value This study is one of the first studies to theorize national information culture to understand IT perceptions at the individual level. The development of the CIC measure provides the much needed methodological support for contextualizing cross-cultural research.


2016 ◽  
Vol 44 (3) ◽  
pp. 292-308 ◽  
Author(s):  
Kasia Gonnerman ◽  
Ken Johnson

Purpose The purpose of this study is to demonstrate how to create and sustain a successful mentoring program for reference student assistants in the liberal arts environment. The study delineates student training, program assessment and the impact on reference practice in a way that can be used at other institutions considering implementing a similar initiative. Design/methodology/approach This case study is written by professionals who have been deeply engaged in initiating, running and assessing the program. It presents the value of the program in an unbiased and objective manner by including the voices of the student mentees themselves reflecting on the experience. Findings The mentorship program has proven to be worthwhile and rewarding in equal measures to both the mentees and reference librarians working with our future successors. It serves an important role in inspiring and encouraging library student workers to become interested in academic librarianship as a career choice and it prepares them to be successful students in library and information science graduate programs. Originality/value Although the discussion of training reference student assistants per se is not rare in the library literature, this particular program is unique in several ways: its main intent is to mentor students who are interested in pursuing librarianship as a career goal; it occurs in the context of a liberal arts college rather than in a larger university setting, especially those offering degrees in information and library science; and it empowers students to provide in-depth independent reference services for their peers and faculty.


2021 ◽  
Vol ahead-of-print (ahead-of-print) ◽  
Author(s):  
Arno van der Hoeven ◽  
Adam Behr ◽  
Craig Hamilton ◽  
Martijn Mulder ◽  
Patrycja Rozbicka

PurposeThis paper sets out to compare different methodologies for measuring the value(s) of live popular music and to explore the different motivations amongst a range of organisations engaged in that work.Design/methodology/approachThe authors analyse how the values of live music are measured, who does it and why. Based on this analysis the authors present a model that visualises the myriad of organisations, methods, aims and objectives involved.FindingsThe authors identify three approaches to measuring the impact of live music (economic impact studies, mapping and censuses and social sciences and humanities) and three types of actors (industry, policy and academia). The analysis of these demonstrates that measuring live music is not a neutral activity, but itself constructs a vision on how live music ecologies functionPractical implicationsFor cultural organisations, demonstrating the outcomes of their work is important in acquiring various forms of support. The model presented in this paper helps them to select adequate methodologies and to reflect on the consequences of particular approaches to measuring live music activities.Originality/valueWhile the number of studies measuring live music's impact is growing, theoretical and methodological reflection on these activities is missing. The authors compare the different methodologies by discussing strengths and weaknesses. This results in a model that identifies gaps in existing studies and explores new directions for future live music research. It enhances understanding of how different ways of measuring live music affect policymaking and conceptions of what live music is and should be.


2016 ◽  
Vol 44 (4) ◽  
pp. 182-185
Author(s):  
Mike McGrath

Purpose This paper aims to review the current library and information science (LIS) literature for document supply, resource sharing and other issues such as open access (OA) that have an impact on the service. Design/methodology/approach The approach is based on the scanning of about 150 journals, reports, websites and blogs. Findings OA continues to grow and, hence, the impact of document supply. Improvements in the Interlending and Document Supply service are satisfying. Originality/value This paper is the only regular review of LIS literature in this subject area.


2019 ◽  
Vol 37 (1) ◽  
pp. 67-80 ◽  
Author(s):  
Muhammad Farooq ◽  
Hikmat Ullah Khan ◽  
Tassawar Iqbal ◽  
Saqib Iqbal

Purpose Bibliometrics is one of the research fields in library and information science that deals with the analysis of academic entities. In this regard, to gauge the productivity and popularity of authors, publication counts and citation counts are common bibliometric measures. Similarly, the significance of a journal is measured using another bibliometric measure, impact factor. However, scarce attention has been paid to find the impact and productivity of conferences using these bibliometric measures. Moreover, the application of the existing techniques rarely finds the impact of conferences in a distinctive manner. The purpose of this paper is to propose and compare the DS-index with existing bibliometric indices, such as h-index, g-index and R-index, to study and rank conferences distinctively based on their significance. Design/methodology/approach The DS-index is applied to the self-developed large DBLP data set having publication data over 50 years covering more than 10,000 conferences. Findings The empirical results of the proposed index are compared with the existing indices using the standard performance evaluation measures. The results confirm that the DS-index performs better than other indices in ranking the conferences in a distinctive manner. Originality/value Scarce attention is paid to rank conferences in distinctive manner using bibliometric measures. In addition, exploiting the DS-index to assign unique ranks to the different conferences makes this research work novel.


2018 ◽  
Vol 8 (1) ◽  
pp. 30-46 ◽  
Author(s):  
Russell Thomas Warne

PurposeThe purpose of this paper is to ascertain the relative impact of different Tony Award nominations and wins on the financial success of a Broadway theater production, as defined by the length of the production’s run.Design/methodology/approachCox hazard regression was used to identify the impact of Tony Award nominations and wins (time-varying covariates), while controlling for several time-invariant covariates: type of production (play or musical, revival or original Broadway production), production costs (operationalized via the cast size), the month and year of opening, and initial marketing success (defined as the percentage of first full week’s tickets sold).FindingsThe award with the strongest relationship with production longevity was the Tony Award for Best Musical (nomination OR=0.566,p=0.110; win OR=0.323,p=0.020). Several other awards had a relationship with production longevity, but most were not statistically significant.Research limitations/implicationsThe limitations include the low statistical power for many time-varying covariates and the cumulative impact of multiple awards was not investigated. Future researchers interested in the Broadway industry should not combine Tony Awards because of the varying impact on economic outcomes for a production.Originality/valueThis study is the first to investigate all 22 Tony Award nominations and wins and their individual impact on an economic outcome. This paper includes the study’s raw data and SPSS syntax to comply with open science practices. The author encourages readers to replicate the analysis.


2016 ◽  
Vol 44 (2) ◽  
pp. 88-91
Author(s):  
Mike McGrath

Purpose This paper aims to review the current Library and Information Science (LIS) literature for document supply, resource sharing and other issues such as open access that have an impact on the service. Design/methodology/approach The approach is based on the scanning of about 150 journals, reports, websites and blogs. Findings Open access continues to grow and, hence, the impact of document supply. There is a particularly useful progress report on open access in the UK which is widely relevant. Originality/value This paper is the only regular review of LIS literature in this subject area.


Sign in / Sign up

Export Citation Format

Share Document