The NICE OECD countries’ geographic search filters: Part 2—validation of the MEDLINE and Embase (Ovid) filters

Objective: We previously developed draft MEDLINE and Embase (Ovid) geographic search filters for Organisation for Economic Co-operation and Development (OECD) countries to assess their feasibility for finding evidence about the countries. Here, we describe the validation of these search filters.Methods: We identified OECD country references from thirty National Institute for Health and Care Excellence (NICE) guidelines to generate gold standard sets for MEDLINE (n=2,065) and Embase (n=2,023). We validated the filters by calculating their recall against these sets. We then applied the filters to existing search strategies for three OECD-focused NICE guideline reviews (NG103 on flu vaccination, NG140 on abortion care, and NG146 on workplace health) to calculate the filters’ impact on the number needed to read (NNR) of the searches.Results: The filters both achieved 99.95% recall against the gold standard sets. Both filters achieved 100% recall for the three NICE guideline reviews. The MEDLINE filter reduced NNR from 256 to 232 for the NG103 review, from 38 to 27 for the NG140 review, and from 631 to 591 for the NG146 review. The Embase filter reduced NNR from 373 to 341 for the NG103 review, from 101 to 76 for the NG140 review, and from 989 to 925 for the NG146 review.Conclusion: The NICE OECD countries’ search filters are the first validated filters for the countries. They can save time for research topics about OECD countries by finding the majority of evidence about OECD countries while reducing search result volumes in comparison to no filter use.

Addressing challenges with systematic review teams through effective communication: a case report

Background: Every step in the systematic review process has challenges, ranging from resistance by review teams to adherence to standard methodology to low-energy commitment to full participation. These challenges can derail the project and result in significant delays, duplication of work, and failure to complete the review. Communication during the systematic review process is key to ensuring it runs smoothly and is identified as a core competency for librarians involved in systematic reviews.Case Presentation: This case report presents effective communication approaches that our librarians employ to address challenges encountered while working with systematic review teams. The communication strategies we describe engage teams through information, questions, and action items and lead to productive collaborations with publishable systematic reviews.Conclusions: Effective communication with review teams keeps systematic review projects moving forward. The techniques covered in this case study strive to minimize misunderstandings, educate collaborators, and, in our experience, have led to multiple successful collaborations and publications. Librarians working in the systematic review space will recognize these challenges and can adapt these techniques to their own environments.

Gloria Werner, 1940–2021

Gloria Werner, successor to Louise M. Darling at the UCLA Louise M. Darling Biomedical Library, university librarian emerita, and eighteenth editor of the Bulletin of the Medical Library Association, died on March 5, 2021, in Los Angeles. Before assuming responsibility in 1990 for one of the largest academic research libraries in the US, she began her library career as a health sciences librarian and spent twenty years at the UCLA Biomedical Library, first as an intern in the NIH/NLM-funded Graduate Training Program in Medical Librarianship in 1962–1963, followed by successive posts in public services and administration, eventually succeeding Darling as biomedical librarian and associate university librarian from 1979 to 1983. Werner’s forty-year career at UCLA, honored with the UCLA University Service Award in 2013, also included appointments as associate university librarian for Technical Services. She was president of the Association of Research Libraries in 1997, served on the boards of many organizations including the Association of Academic Health Sciences Library Directors, and consulted extensively. She retired as university librarian in 2002.

Translation and validation of PubMed and Embase search filters for identification of systematic reviews, intervention studies, and observational studies in the field of first aid

Objective: The aim of this project was to validate search filters for systematic reviews, intervention studies, and observational studies translated from Ovid MEDLINE and Embase syntax and used for searches in PubMed and Embase.com during the development of evidence summaries supporting first aid guidelines. We aimed to achieve a balance among recall, specificity, precision, and number needed to read (NNR).Methods: Reference gold standards were constructed per study type derived from existing evidence summaries. Search filter performance was assessed through retrospective searches and measurement of relative recall, specificity, precision, and NNR when using the translated search filters. Where necessary, search filters were optimized. Adapted filters were validated in separate validation gold standards.Results: Search filters for systematic reviews and observational studies reached recall of ≥85% in both PubMed and Embase. Corresponding specificities for systematic review filters were ≥96% in both databases, with a precision of 9.7% (NNR 10) in PubMed and 5.4% (NNR 19) in Embase. For observational study filters, specificity, precision, and NNR were 68%, 2%, and 51 in PubMed and 47%, 0.8%, and 123 in Embase, respectively. These filters were considered sufficiently effective. Search filters for intervention studies reached a recall of 85% and 83% in PubMed and Embase, respectively. Optimization led to recall of ≥95% with specificity, precision, and NNR of 49%, 1.3%, and 79 in PubMed and 56%, 0.74%, and 136 in Embase, respectively.Conclusions: We report validated filters to search for systematic reviews, observational studies, and intervention studies in guideline projects in PubMed and Embase.com.

OpenAthens odyssey: challenges of implementing federated authentication for a multi-institutional user population

Background: The Texas Medical Center (TMC) is home to one of the world’s largest cohorts of faculty, students, researchers, and clinicians who rely on seamless and immediate access to digital biomedical and health resources. This group is served by the TMC Library, with a collection that includes over 380,000 ebooks and 59,000 ejournals. In 2018, the TMC Library implemented OpenAthens, a federated authentication system to replace a locally hosted instance of EZproxy.Case Presentation: The TMC Library is unique in its multi-institutional user population, which presents distinct challenges in adopting a single sign-on authentication system. Our project involved OpenAthens technical support, information technology teams from six academic institutions, and over thirty publishers. Implementation included the creation of an OpenAthens parent account, an active user directory, a resource catalog, and installation of our OpenAthens credentials at each publisher site. Because the TMC Library serves multiple institutions, OpenAthens built a custom login page and a portal to support both single sign-on and a generic username and password option. This case report discusses the reasons why OpenAthens was chosen, the preparation methods for implementation, the various challenges encountered and resolved, and recommendations for other health sciences libraries considering this system.Conclusions: The OpenAthens system provides important benefits: granular usage reports, single sign-on access, and data to negotiate reduced pricing for online resources. With prior knowledge and preparation, health sciences libraries can successfully implement OpenAthens with customizations tailored to their specific resources and user population.

Analyzing University of Virginia Health publications using open data, Python, and Streamlit

As part of a larger project to understand the publishing choices of UVA Health authors and support open access publishing, a team from the Claude Moore Health Sciences Library analyzed an open data set from Europe PMC, which includes metadata from PubMed records. We used the Europe PMC REST API to search for articles published in 2017–2020 with “University of Virginia” in the author affiliation field. Subsequently, we parsed the JSON metadata in Python and used Streamlit to create a data visualization from our public GitHub repository. At present, this shows the relative proportions of open access versus subscription-only articles published by UVA Health authors. Although subscription services like Web of Science, Scopus, and Dimensions allow users to do similar analyses, we believe this is a novel approach to doing this type of bibliometric research with open data and open source tools.

Development of an efficient search filter to retrieve systematic reviews from PubMed

Objective: Locating systematic reviews is essential for clinicians and researchers when creating or updating reviews and for decision-making in health care. This study aimed to develop a search filter for retrieving systematic reviews that improves upon the performance of the PubMed systematic review search filter.Methods: Search terms were identified from abstracts of reviews published in Cochrane Database of Systematic Reviews and the titles of articles indexed as systematic reviews in PubMed. Both the precision of the candidate terms and the number of systematic reviews retrieved from PubMed were evaluated after excluding the subset of articles retrieved by the PubMed systematic review filter. Terms that achieved a precision greater than 70% and relevant publication types indexed with MeSH terms were included in the filter search strategy.Results: The search strategy used in our filter added specific terms not included in PubMed’s systematic review filter and achieved a 61.3% increase in the number of retrieved articles that are potential systematic reviews. Moreover, it achieved an average precision that is likely greater than 80%.Conclusions: The developed search filter will enable users to identify more systematic reviews from PubMed than the PubMed systematic review filter with high precision.

Adopting a toolkit to manage time, resources, and expectations in the systematic review process: a case report

Background: The proliferation of systematic reviews has impacted library operations and activities as librarians support, collaborate, and perform more tasks in the systematic review process. This case report describes a toolkit that librarians with extensive experience in supporting multiple review teams use to manage time, resources, and expectations in the systematic review process.Case Presentation: The toolkit is a compilation of documents that we use to effectively communicate with and help review teams understand and navigate each stage of the systematic review process. Elements included in the toolkit and discussed in this case report are intake forms, communication templates and memoranda, a process flow diagram, library guides on tools for retrieval and data appraisal, and established standards for guidance during the write-up stage. We describe the use of the toolkit for both education and project management, with a focus on its use in helping manage team time, resources, and expectations.Discussion: The systematic review toolkit helps librarians connect systematic review steps and tasks to actionable items. The content facilitates and supports discussion and learning by both librarians and team members. This toolkit helps librarians share important information and resources for each stage of the process.

LYRASIS Learning

-

Providing real-time resources in support of LGBTQ+ and HIV+ populations as information experts on the ECHO hub team: a case report

Background: Project ECHO (Extension for Community Healthcare Outcomes) is a telehealth initiative that aims to reduce disparities in delivery of health care by leveraging technology and local expertise to provide guidance on specialized subjects to health care providers across the world. In 2018, a new ECHO hub convened in Indianapolis with a focus on health care for individuals in the lesbian, gay, bisexual, trans, and queer (LGBTQ+) populations. This ECHO iteration was one of the first of its kind and would soon be followed by a new human immunodeficiency virus (HIV) ECHO as well.Case Presentation: In a novel approach, information professionals participated in the early planning stages of the formation of these ECHO teams, which enabled the provision of real-time medical evidence and resources at the point-of-need once the teams were launched. This case study demonstrates proof of concept for including health sciences librarians and/or information professionals in the ECHO as hub team members. In this case study, the authors describe and quantify the value added to the HIV and LGBTQ+ ECHO sessions by the medical librarians, as well as provide a template for how other telehealth initiatives can collaborate with their local health information professionals.Conclusions: Librarian involvement in Project ECHO over the past three years has been enthusiastically received. The librarians have contributed hundreds of resources to ECHO participants, helped build and curate resource repositories, and expanded the embedded librarian program to an additional two ECHO iterations. ECHO hub team members report high rates of satisfaction with the performance of embedded librarians and appreciate the provision of point-of-need evidence to ECHO participants.