PNS46 Application of Text Mining to the Development of a Geographic Search Filter to Facilitate Evidence Retrieval in Ovid Medline

Objective: The aim of this project was to validate search filters for systematic reviews, intervention studies, and observational studies translated from Ovid MEDLINE and Embase syntax and used for searches in PubMed and Embase.com during the development of evidence summaries supporting first aid guidelines. We aimed to achieve a balance among recall, specificity, precision, and number needed to read (NNR).Methods: Reference gold standards were constructed per study type derived from existing evidence summaries. Search filter performance was assessed through retrospective searches and measurement of relative recall, specificity, precision, and NNR when using the translated search filters. Where necessary, search filters were optimized. Adapted filters were validated in separate validation gold standards.Results: Search filters for systematic reviews and observational studies reached recall of ≥85% in both PubMed and Embase. Corresponding specificities for systematic review filters were ≥96% in both databases, with a precision of 9.7% (NNR 10) in PubMed and 5.4% (NNR 19) in Embase. For observational study filters, specificity, precision, and NNR were 68%, 2%, and 51 in PubMed and 47%, 0.8%, and 123 in Embase, respectively. These filters were considered sufficiently effective. Search filters for intervention studies reached a recall of 85% and 83% in PubMed and Embase, respectively. Optimization led to recall of ≥95% with specificity, precision, and NNR of 49%, 1.3%, and 79 in PubMed and 56%, 0.74%, and 136 in Embase, respectively.Conclusions: We report validated filters to search for systematic reviews, observational studies, and intervention studies in guideline projects in PubMed and Embase.com.

Download Full-text

Development and validation of search filters to find articles on palliative care in bibliographic databases

Palliative Medicine ◽

10.1177/0269216318824275 ◽

2019 ◽

Vol 33 (4) ◽

pp. 470-474 ◽

Cited By ~ 8

Author(s):

Judith AC Rietjens ◽

Wichor M Bramer ◽

Eric CT Geijteman ◽

Agnes van der Heide ◽

Wendy H Oldenmenger

Keyword(s):

Palliative Care ◽

Cochrane Library ◽

Bibliographic Databases ◽

Search Filter ◽

Ovid Medline ◽

Online Databases ◽

Literature Searches ◽

Search Filters ◽

Validation Set ◽

Development And Validation

Background: Healthcare professionals and researchers in the field of palliative care often have difficulties finding relevant articles in online databases. Standardized search filters may help improve the efficiency and quality of such searches, but prior developed filters showed only moderate performance. Aim: To develop and validate a specific search filter and a sensitive search filter for the field of palliative care. Design: We used a novel, objective method for search filter development. First, we created a gold standard set. This set was split into three groups: term identification, filter development, and filter validation set. After creating the filters in PubMed, we translated the filters into search filters for Ovid MEDLINE, Embase, CINAHL, PsychINFO, and Cochrane Library. We calculated specificity, sensitivity and precision of both filters. Results: The specific filter had a specificity of 97.4%, a sensitivity of 93.7%, and a precision of 45%. The sensitive filter had a sensitivity of 99.6%, a specificity of 92.5%, and a precision of 5%. Conclusion: Our search filters can support literature searches in the field of palliative care. Our specific filter retrieves 93.7% of relevant articles, while 45% of the retrieved articles are relevant. This filter can be used to find answers to questions when time is limited. Our sensitive filter finds 99.6% of all relevant articles and may, for instance, help conducting systematic reviews. Both filters perform better than prior developed search filters in the field of palliative care.

Download Full-text

PERFORMANCE OF OVID MEDLINE SEARCH FILTERS TO IDENTIFY HEALTH STATE UTILITY STUDIES

International Journal of Technology Assessment in Health Care ◽

10.1017/s0266462317000897 ◽

2017 ◽

Vol 33 (4) ◽

pp. 472-480 ◽

Cited By ~ 9

Author(s):

Mick Arber ◽

Sonia Garcia ◽

Thomas Veale ◽

Mary Edwards ◽

Alison Shaw ◽

...

Keyword(s):

High Sensitivity ◽

Health State Utility ◽

Health State ◽

Search Filter ◽

Medline Search ◽

Ovid Medline ◽

Search Filters ◽

Validation Set ◽

Health State Utility Values ◽

Standard Sets

Objectives: This study was designed to assess the sensitivity of three Ovid MEDLINE search filters developed to identify studies reporting health state utility values (HSUVs), to improve the performance of the best performing filter, and to validate resulting search filters.Methods: Three quasi-gold standard sets (QGS1, QGS2, QGS3) of relevant studies were harvested from reviews of studies reporting HSUVs. The performance of three initial filters was assessed by measuring their relative recall of studies in QGS1. The best performing filter was then developed further using QGS2. This resulted in three final search filters (FSF1, FSF2, and FSF3), which were validated using QGS3.Results: FSF1 (sensitivity maximizing) retrieved 132/139 records (sensitivity: 95 percent) in the QGS3 validation set. FSF1 had a number needed to read (NNR) of 842. FSF2 (balancing sensitivity and precision) retrieved 128/139 records (sensitivity: 92 percent) with a NNR of 502. FSF3 (precision maximizing) retrieved 123/139 records (sensitivity: 88 percent) with a NNR of 383.Conclusions: We have developed and validated a search filter (FSF1) to identify studies reporting HSUVs with high sensitivity (95 percent) and two other search filters (FSF2 and FSF3) with reasonably high sensitivity (92 percent and 88 percent) but greater precision, resulting in a lower NNR. These seem to be the first validated filters available for HSUVs. The availability of filters with a range of sensitivity and precision options enables researchers to choose the filter which is most appropriate to the resources available for their specific research.

Download Full-text

The medline UK filter: development and validation of a geographic search filter to retrieve research about the UK from OVID medline

Health Information & Libraries Journal ◽

10.1111/hir.12187 ◽

2017 ◽

Vol 34 (3) ◽

pp. 200-216 ◽

Cited By ~ 14

Author(s):

Lynda Ayiku ◽

Paul Levay ◽

Tom Hudson ◽

Jenny Craven ◽

Elizabeth Barrett ◽

...

Keyword(s):

Search Filter ◽

Ovid Medline ◽

The Uk ◽

Development And Validation

Download Full-text

Characteristics of the Frequency-Following Response to Speech in Neonates and Potential Applicability in Clinical Practice: A Systematic Review

Journal of Speech Language and Hearing Research ◽

10.1044/2020_jslhr-19-00322 ◽

2020 ◽

Vol 63 (5) ◽

pp. 1618-1635

Author(s):

Céline Richard ◽

Mary Lauren Neel ◽

Arnaud Jeanvoine ◽

Sharon Mc Connell ◽

Alison Gehred ◽

...

Keyword(s):

Systematic Review ◽

Cochrane Library ◽

Neurodevelopmental Outcomes ◽

Frequency Following Response ◽

Ovid Medline ◽

Published Evidence ◽

Mesh Terms ◽

Potential Applicability ◽

Clinical Potential

Purpose We sought to critically analyze and evaluate published evidence regarding feasibility and clinical potential for predicting neurodevelopmental outcomes of the frequency-following responses (FFRs) to speech recordings in neonates (birth to 28 days). Method A systematic search of MeSH terms in the Cumulative Index to Nursing and Allied HealthLiterature, Embase, Google Scholar, Ovid Medline (R) and E-Pub Ahead of Print, In-Process & Other Non-Indexed Citations and Daily, Web of Science, SCOPUS, COCHRANE Library, and ClinicalTrials.gov was performed. Manual review of all items identified in the search was performed by two independent reviewers. Articles were evaluated based on the level of methodological quality and evidence according to the RTI item bank. Results Seven articles met inclusion criteria. None of the included studies reported neurodevelopmental outcomes past 3 months of age. Quality of the evidence ranged from moderate to high. Protocol variations were frequent. Conclusions Based on this systematic review, the FFR to speech can capture both temporal and spectral acoustic features in neonates. It can accurately be recorded in a fast and easy manner at the infant's bedside. However, at this time, further studies are needed to identify and validate which FFR features could be incorporated as an addition to standard evaluation of infant sound processing evaluation in subcortico-cortical networks. This review identifies the need for further research focused on identifying specific features of the neonatal FFRs, those with predictive value for early childhood outcomes to help guide targeted early speech and hearing interventions.

Download Full-text