scholarly journals The NICE OECD countries’ geographic search filters: Part 2—validation of the MEDLINE and Embase (Ovid) filters

2021 ◽  
Vol 109 (4) ◽  
Author(s):  
Lynda Ayiku ◽  
Thomas Hudson ◽  
Ceri Williams ◽  
Paul Levay ◽  
Catherine Jacob
Keyword(s):  
Gold Standard ◽  
Oecd Country ◽  
Oecd Countries ◽  
Workplace Health ◽  
Nice Guidelines ◽  
Nice Guideline ◽  
Abortion Care ◽  
Flu Vaccination ◽  
Search Filters ◽  
Standard Sets

Objective: We previously developed draft MEDLINE and Embase (Ovid) geographic search filters for Organisation for Economic Co-operation and Development (OECD) countries to assess their feasibility for finding evidence about the countries. Here, we describe the validation of these search filters.Methods: We identified OECD country references from thirty National Institute for Health and Care Excellence (NICE) guidelines to generate gold standard sets for MEDLINE (n=2,065) and Embase (n=2,023). We validated the filters by calculating their recall against these sets. We then applied the filters to existing search strategies for three OECD-focused NICE guideline reviews (NG103 on flu vaccination, NG140 on abortion care, and NG146 on workplace health) to calculate the filters’ impact on the number needed to read (NNR) of the searches.Results: The filters both achieved 99.95% recall against the gold standard sets. Both filters achieved 100% recall for the three NICE guideline reviews. The MEDLINE filter reduced NNR from 256 to 232 for the NG103 review, from 38 to 27 for the NG140 review, and from 631 to 591 for the NG146 review. The Embase filter reduced NNR from 373 to 341 for the NG103 review, from 101 to 76 for the NG140 review, and from 989 to 925 for the NG146 review.Conclusion: The NICE OECD countries’ search filters are the first validated filters for the countries. They can save time for research topics about OECD countries by finding the majority of evidence about OECD countries while reducing search result volumes in comparison to no filter use.

scholarly journals Integrated Care Search: Development and validation of a PubMed search filter for retrieving the integrated care research evidence

2020 ◽  
Author(s):  
Raechel A. Damarell ◽  
Suzanne Lewis ◽  
Camilla Trenerry ◽  
Jennifer J. Tieman
Keyword(s):  
Integrated Care ◽  
Gold Standard ◽  
Research Evidence ◽  
Evidence Base ◽  
Standard Test ◽  
Advisory Group ◽  
Search Filter ◽  
Filter Performance ◽  
Search Filters ◽  
Development And Validation

Abstract Background Integrated care is an increasingly important principle for organising healthcare. Integrated care models show promise in reducing resource wastage and service fragmentation whilst improving the accessibility, patient-centredness and quality of care for patients. Those needing reliable access to the growing research evidence base for integrated care can be frustrated by search challenges reflective of the topic's complexity. The aim of this study is to report the empirical development and validation of two search filters for rapid and effective retrieval of integrated care evidence in PubMed. One filter is optimised for recall and the other for precision.Methods An Expert Advisory Group comprising international integrated care experts guided the study. A gold standard test set of citations was formed from screening Handbook Integrated Care chapter references for relevance. This set was divided into a Term Identification Set (20%) for determining candidate terms using frequency analysis; a Filter Development Set (40%) for testing performance of term combinations; and a Filter Validation Set (40%) reserved for confirming final filter performance. In developing the high recall filter, recall was steadily increased while maintaining precision at ≥ 50%. Similarly, the high precision filter sought to maximise precision while keeping recall ≥ 50%. For each term combination tested, an approximation of precision was obtained by reviewing the first 100 citations retrieved in Medline for relevance.Results The gold standard set comprised 534 citations. The search filter optimised for recall ('Broad Integrated Care Search') achieved 86.0%-88.3% recall with corresponding low precision (47%-53%). The search filter optimised for precise searching ('Narrow Integrated Care Search') demonstrated precision of 73%-95% with recall reduced to between 55.9% and 59.8%. These filters are now available as one-click URL hyperlinks in the website of International Foundation for Integrated Care.Conclusions The Broad and Narrow Integrated Care Search filters provide potential users, such as policy makers and researchers, seamless, reliable and ongoing access to integrated care evidence for decision making. These filters were developed according to a rigorous and transparent methodology designed to circumvent the challenges of information retrieval posed by this complex, multifaceted topic.

scholarly journals Research on New and Traditional Energy Sources in OECD Countries

2019 ◽  
Vol 16 (7) ◽  
pp. 1122 ◽  
Author(s):  
Ying Li ◽  
Yung-ho Chiu ◽  
Tai-Yu Lin
Keyword(s):  
Renewable Energy ◽  
Clean Energy ◽  
Past Research ◽  
Oecd Country ◽  
Oecd Countries ◽  
Pollutant Emissions ◽  
Energy Sources ◽  
Low Carbon ◽  
Low Carbon Economy ◽  
New Energy

To mitigate the problems associated with climate change, the low-carbon economy concept is now being championed around the world in an effort to reduce greenhouse gas emissions and ensure sustainable economic growth. Therefore, to reduce the dependence on traditional energy sources, the Organization for Economic Co-operation and Development (OECD) has been actively promoting the use of renewable energy. Past research has tended to neglect the influence of other pollutants such as fine particulate matter (PM2.5) and sulfur dioxide (SO2) and have mainly been based on static analyses. To make up for these research gaps, this study examined OECD country data from 2010–2014, with labor, fixed assets, new energy, and traditional energy as the inputs, and Gross Domestic Product (GDP), carbon dioxide (CO2), and PM2.5 as the outputs, from which it was found: (1) the overall efficiency of the individual countries varied significantly, with nine countries being found to have efficiencies of 1 for all five years, but many others having efficiencies below 0.2; (2) in countries where there was a need for improvements in traditional energy (which here refers to coal, petroleum and other fossil energy sources), there was also a significant need for improvement in new energy sources (which here refers to clean energy which will produce pollutant emissions and can be directly used for production and life, including resources like nuclear energy and “renewable energy”); (3) countries with poor traditional energy and new energy efficiencies also had poor CO2 and PM2.5 efficiencies; (4) many OECD countries have made progress towards sustainable new energy developments

scholarly journals P.1.28 Air pollution and diseases: a practical tool for effective pubmed search

2019 ◽  
Vol 76 (Suppl 1) ◽  
pp. A84.3-A84
Author(s):  
Stefania Curti ◽  
Stefano Mattioli
Keyword(s):  
Air Pollution ◽  
Gold Standard ◽  
Outdoor Air ◽  
Medical Subject Headings ◽  
Outdoor Air Pollution ◽  
Search Terms ◽  
Mesh Terms ◽  
Search Filters ◽  
Pubmed Search ◽  
Practical Tool

ObjectivesTo identify efficient PubMed search filters for the study of outdoor air pollution determinants of diseases.MethodsWe listed Medical Subject Headings (MeSH) and non-MeSH terms that seemed pertinent to outdoor air pollutants exposure as determinants of diseases. Proportions of potentially pertinent articles retrieved by each term were estimated. We then formulated two filters: one ‘more specific’, one ‘more sensitive’. Their performances were compared with a gold standard of systematic reviews on associations between diseases and outdoor air pollution. We calculated, for both the filters, the number (of abstract) needed to read (NNR) to identify one potentially pertinent article, exploring three diseases potentially associated with outdoor air pollution.ResultsThe combination of terms that yielded a threshold of potentially pertinent articles≥40% permitted to formulate the ‘more specific’ filter. On the basis of the combination of all search terms under study we formulated the ‘more sensitive’ filter. In comparison with the gold standard, the ‘more specific’ filter had the highest specificity (67.4%; with a sensitivity of 82.5%) and the ‘more sensitive’ filter had the highest sensitivity (98.5%; with a specificity of 47.9%). For the ‘more specific’ filter and the ‘more sensitive’ one the NNR to find one potentially pertinent article was 1.9 and 3.3, respectively.ConclusionsThe proposed search filters help investigating environmental determinants of medical conditions. We published them on: Curti S et al. PubMed search filters for the study of putative outdoor air pollution determinants of disease. BMJ Open. 2016;6 (12):e013092.

Barriers to consent taking in ECT

2011 ◽  
Vol 26 (S2) ◽  
pp. 1152-1152
Author(s):  
S.R. Pereira ◽  
A. Slattery ◽  
J. Beezhold
Keyword(s):  
Patient Participation ◽  
Consent Form ◽  
Convulsive Therapy ◽  
Nice Guidelines ◽  
Nice Guideline ◽  
Full Compliance ◽  
Study Case ◽  
The One ◽  
Electro Convulsive Therapy ◽  
Improve Patient

IntroductionThere were 16,482 administrations of Electro-convulsive Therapy (ECT) to 2835 individuals in England between January-March 1999. Controversy still surrounds the safety, ethics and necessity of ECT with some patients reporting severe adverse effects and feeling particularly strongly about it being administered without their consent. NICE guidelines along with the ECT accreditation service (ECTAS) sought to address these concerns and raise standards for ECT in UK.Aims and ObjectiveTo identify any barriers to compliance with NICE guidelines regarding consent for ECT.MethodsAll patients newly started on ECT during a 3 month period at Hellesdon Hospital were enrolled into this study. Case notes were analysed for 16 patients against the 21 standard ECTAS consent criteria.ResultsThe hospital rated good (70–89%) or excellent (90–100%) for all guidance except the one which requires patients to complete some sections of the consent form. Only 63% of the patients had completed these, however 100% went on to sign the consent form before every session. Guidance compliance was excellent for 15 (72%) of items examined.ConclusionsThere is good compliance with NICE guideline relating to consent for ECT. The only barrier to full compliance was inadequate documentation by patients in some sections. Steps to improve patient participation can now be implemented. This will provide assurance that ECT is used appropriately and that the process fully enables informed consent. Further research is required to discover the reasons for unsatisfactory patient participation in the consent process.

scholarly journals You have to acknowledge the problem before you can address the problem: Audit looking at identification of co-existing substance misuse in a Liaison Psychiatry patient population

BJPsych Open ◽  
2021 ◽  
Vol 7 (S1) ◽  
pp. S91-S91
Author(s):  
Emma McLean ◽  
Akash Kadiwar ◽  
Mariam Alexander
Keyword(s):  
Substance Use ◽  
Substance Misuse ◽  
Training Session ◽  
Care Pathways ◽  
Liaison Psychiatry ◽  
Nice Guidelines ◽  
Nice Guideline ◽  
Retrospective Audit ◽  
Objective Evidence ◽  
Drug And Alcohol

AimsTo evaluate if patients referred to Ealing Liaison Psychiatry Service (ELPS) with co-existing substance use are being appropriately identified as per NICE guidelines.Patients with co-existing substance misuse have greater morbidity and mortality and it is therefore important to identify these patients to optimise their management. NICE recommends that all patients are asked about their substance use.Anecdotally, our team felt we were doing a good job of identifying and managing such patients but we had no objective evidence of this.MethodCompleted a retrospective audit looking at a sample of patients referred to ELPS over two weeks in December 2019.A training session for ELPS was then held to highlight the initial audit results and NICE guideline recommendations.We then repeated the audit over two weeks in March 2020.ResultInitial audit (100 patients):Only 69% of patients asked about substance use. From those asked, 50-65.2% were using a substance, most commonly alcohol.None of the patients over the age of 80 were asked about substance use vs 79.5% of patients aged 20–40 years.55% of females vs 81% of males were asked about illicit substances.33.3% of ward referrals vs 74.2% of Emergency Department referrals asked about substance useRe-audit (53 patients):Significant improvement across all areas93% now asked about substance use60% of over 80s, 96% of females and 85% of ward referrals were now being correctly asked about substance useConclusionWe were surprised to find that we were initially not meeting NICE standards regarding asking patients about their substance use.Acknowledging this problem during our training session proved to be effective.This knowledge will help us develop our care pathways with our Acute colleagues and the Drug and Alcohol Liaison Service.

scholarly journals Which are the most sensitive search filters to identify randomized controlled trials in MEDLINE?

2020 ◽  
Vol 108 (4) ◽  
Author(s):  
Julie Glanville ◽  
Eleanor Kotas ◽  
Robin Featherstone ◽  
Gordon Dooley
Keyword(s):  
Randomized Controlled Trials ◽  
Gold Standard ◽  
High Sensitivity ◽  
Controlled Trials ◽  
Relative Precision ◽  
Randomized Controlled ◽  
Ovid Medline ◽  
Search Filters ◽  
Standard Set ◽  
Central Database

Objective: The Cochrane Handbook of Systematic Reviews contains search filters to find randomized controlled trials (RCTs) in Ovid MEDLINE: one maximizing sensitivity and another balancing sensitivity and precision. These filters were originally published in 1994 and were adapted and updated in 2008. To determine the performance of these filters, the authors tested them and thirty-six other MEDLINE filters against a large new gold standard set of relevant records.Methods: We identified a gold standard set of RCT reports published in 2016 from the Cochrane CENTRAL database of controlled clinical trials. We retrieved the records in Ovid MEDLINE and combined these with each RCT filter. We calculated their sensitivity, relative precision, and f-scores.Results: The gold standard comprised 27,617 records. MEDLINE searches were run on July 16, 2019. The most sensitive RCT filter was Duggan et al. (sensitivity=0.99). The Cochrane sensitivity-maximizing RCT filter had a sensitivity of 0.96 but was more precise than Duggan et al. (0.14 compared to 0.04 for Duggan). The most precise RCT filters had 0.97 relative precision and 0.83 sensitivity.Conclusions: The Cochrane Ovid MEDLINE sensitivity-maximizing RCT filter can continue to be used by Cochrane reviewers and to populate CENTRAL, as it has very high sensitivity and a slightly better precision relative to more sensitive filters. The results of this study, which used a very large gold standard to compare the performance of all known RCT filters, allows searchers to make better informed decisions about which filters to use for their work.

scholarly journals Integrated Care Search: Development and validation of a PubMed search filter for retrieving the integrated care research evidence

2019 ◽  
Author(s):  
Raechel A. Damarell ◽  
Suzanne Lewis ◽  
Camilla Trenerry ◽  
Jennifer J. Tieman
Keyword(s):  
Integrated Care ◽  
Gold Standard ◽  
Research Evidence ◽  
Evidence Base ◽  
Standard Test ◽  
Advisory Group ◽  
Search Filter ◽  
Filter Performance ◽  
Search Filters ◽  
Development And Validation

Abstract Background Integrated care is an increasingly important principle for organising healthcare. Integrated care models show promise in reducing resource wastage and service fragmentation whilst improving the accessibility, patient-centredness and quality of care for patients. Those needing reliable access to the growing research evidence base for integrated care can be frustrated by search challenges reflective of the topic's complexity. The aim of this study is to report the empirical development and validation of two search filters for rapid and effective retrieval of integrated care evidence in PubMed. One filter is optimised for recall and the other for precision.Methods An Expert Advisory Group comprising international integrated care experts guided the study. A gold standard test set of citations was formed from screening Handbook Integrated Care chapter references for relevance. This set was divided into a Term Identification Set (20%) for determining candidate terms using frequency analysis; a Filter Development Set (40%) for testing performance of term combinations; and a Filter Validation Set (40%) reserved for confirming final filter performance. In developing the high recall filter, recall was steadily increased while maintaining precision at ≥ 50%. Similarly, the high precision filter sought to maximise precision while keeping recall ≥ 50%. For each term combination tested, an approximation of precision was obtained by reviewing the first 100 citations retrieved in Medline for relevance.Results The gold standard set comprised 534 citations. The search filter optimised for recall ('Broad Integrated Care Search') achieved 86.0%-88.3% recall with corresponding low precision (47%-53%). The search filter optimised for precise searching ('Narrow Integrated Care Search') demonstrated precision of 73%-95% with recall reduced to between 55.9% and 59.8%. These filters are now available as one-click URL hyperlinks in the website of International Foundation for Integrated Care.Conclusions The Broad and Narrow Integrated Care Search filters provide potential users, such as policy makers and researchers, seamless, reliable and ongoing access to integrated care evidence for decision making. These filters were developed according to a rigorous and transparent methodology designed to circumvent the challenges of information retrieval posed by this complex, multifaceted topic.

scholarly journals Diagnosing Autism Spectrum Disorders in Deaf Children Using Two Standardised Assessment Instruments: The ADIR-Deaf Adaptation and the ADOS-2 Deaf Adaptation

2021 ◽  
Vol 10 (19) ◽  
pp. 4374
Author(s):  
Victoria Allgar ◽  
Barry Wright ◽  
Amelia Taylor ◽  
Ann Le Couter ◽  
Helen Phillips
Keyword(s):  
Gold Standard ◽  
Assessment Tool ◽  
Autism Spectrum ◽  
Diagnostic Assessment ◽  
Deaf Children ◽  
Assessment Instruments ◽  
False Negatives ◽  
Nice Guideline ◽  
Combined Use ◽  
Spectrum Disorders

The aim was to investigate the agreement between the ADI-R Deaf adaptation and ADOS-2 Deaf adaptation overall diagnostic categorisation for autism (AUT) and a wider threshold to include autism spectrum (ASD) in a cohort of deaf children with and without ASD. We compared results of the instruments used on their own and when combined and propose standard criteria for the combined use of the ADI-R Deaf adaptation and ADOS-2 Deaf adaptation for use with deaf children. In total, 116 deaf children had a Gold standard NICE guideline assessment; 58 diagnosed with ASD and 58 without ASD, and for both groups a blinded informant based ADI-R Deaf adaptation and direct assessment using the ADOS-2 Deaf adaptation were separately completed. There was moderate agreement between the ADI-R Deaf adaptation and ADOS-2 Deaf adaptation for the wider threshold of ASD (Kappa, 0.433). To achieve the lowest number of false negatives, the most successful assessment tool approach is using the wider threshold of ASD with either ADI-R Deaf adaptation or ADOS-2-Deaf adaptation (95% sensitivity). This compares with 88% for the ADI-R Deaf adaptation alone and 74% for the ADOS-2-Deaf adaptation alone (wider threshold of ASD). To achieve a low number of false positives, the most successful assessment tool approach is a combination of ADI-R Deaf adaptation and ADOS-2- Deaf adaptation (using the narrow threshold of autism for both) (95% specificity). This compares with 83% for the ADI-R Deaf adaptation alone and 81% for the ADOS-2-Deaf adaptation (narrow threshold) alone. This combination is therefore recommended in specialist clinics for diagnostic assessment in deaf children.

OP128 Improving Literature Searching For Evidence On Health Apps: The National Institute For Health And Care Excellence (NICE) MEDLINE And Embase (Ovid) Health Apps Search Filters

2021 ◽  
Vol 37 (S1) ◽  
pp. 2-2
Author(s):  
Lynda Ayiku ◽  
Sarah Glover
Keyword(s):  
Gold Standard ◽  
Search Strategies ◽  
Bibliographic Databases ◽  
Literature Searching ◽  
Health Apps ◽  
Search Terms ◽  
Search Filters ◽  
Standard Set ◽  
Validation Set

IntroductionLiterature searching for evidence on apps in bibliographic databases is challenging because they are often described with inconsistent terminology. Information Specialists from the United Kingdom's National Institute for Health and Care Excellence (NICE) have developed validated search filters for retrieving evidence about apps from MEDLINE and Embase (Ovid) reliably.MethodsMedical informatics journals were hand-searched to create a ‘gold standard’ set of app references. The gold standard set was divided into two sets. The development set provided the search terms for the filters. The filters were validated by calculating their recall against the validation set. Target recall was >90%.A case study was then conducted to compare the number-needed-to-read (NNR) of the filters with previous non-validated MEDLINE and Embase app search strategies used for the ‘MIB214 myCOPD app’ NICE topic. NNR is the number of references screened to find each relevant reference.ResultsThe MEDLINE and Embase filters achieved 98.6 percent and 98.5 percent recall against the validation set, respectively. In the case study they achieved 100 percent recall, reducing NNR from 348 to 147 in MEDLINE and from 456 to 271 in Embase.ConclusionsThe novel NICE health apps search filters retrieve evidence on apps from MEDLINE and Embase effectively and more efficiently than previous non-validated search strategies used at NICE.

Sign in / Sign up

Export Citation Format

Share Document