Using grey literature when evaluating effectiveness in digital health and health and welfare technology: a source worth considering (Preprint)

2021 ◽  
Author(s):  
Sara Landerdahl Stridsberg ◽  
Matt X Richardson ◽  
Ken Redekop ◽  
Maria Ehn ◽  
Sarah Wamala Andersson

UNSTRUCTURED The need for assessing the effectiveness and value of interventions involving digital health and/or health and welfare technology is becoming more important, due to the rapidly growing development of these technologies and their areas of application. Systematic reviews gather the available evidence based on published articles and make it accessible to researchers, practitioners, decision makers and policy makers. A thorough and systematic search in several bibliographic databases is essential when reviewing literature. But should publications outside the realm of traditional publication databases - known as grey literature – also be included? Can grey literature contribute to broaden the results of the review and how systematic can you be when searching for it INTERNATIONAL REGISTERED REPORT RR2-27267

2015 ◽  
Vol 10 (1) ◽  
pp. 50 ◽  
Author(s):  
Paul Levay ◽  
Michael Raynor ◽  
Daniel Tuvey

Abstract Objective – To make recommendations for the National Institute for Health and Care Excellence (NICE) on the factors to consider when choosing databases and search techniques when producing systematic reviews to support public health guidance development. Methods – Retrospective analysis of how the publications included in systematic reviews commissioned by NICE on obesity, spatial planning, and tuberculosis were retrieved. The included publications were checked to see if they were found from searching MEDLINE, another database or through other search techniques. Results – MEDLINE contributed 24.2% of the publications included in the obesity review, none of the publications in the spatial planning review and 72% of those in the tuberculosis review. Other databases accounted for 9.1% of included publications in obesity, 20% in spatial planning and 4% in tuberculosis. Non-database methods provided 42.4% of the included publications in the obesity review, compared to 5% in the spatial planning review and 24% in the tuberculosis review. It was not possible to establish retrospectively how 24.2% of the publications in the obesity review and 75% in the spatial planning review were found. Conclusions – Topic-specific databases and non-database search techniques were useful for tailoring the resources to the review questions. The value of MEDLINE in these reviews was affected by the degree of overlap with clinical topics, the domain of public health, and the need to find grey literature. The factors that NICE considers when planning a systematic search are the multidisciplinary nature of public health and the different types of evidence required.


2020 ◽  
Author(s):  
Neal Robert Haddaway ◽  
Eliza Grames ◽  
Douglas H. Boyes ◽  
Manu E. Saunders ◽  
Nigel G Taylor

BackgroundInsects play a central role in the functioning of terrestrial and freshwater ecosystems and contribute to a multitude of ecosystem services in managed and unmanaged systems Even local declines of insect abundance and richness can have enormous ecological and economic consequences. Evidence-informed conservation actions are essential to prevent potential cascading consequences of insect declines, and to help declining populations recover. Policy-makers rely on syntheses of primary research, such as reviews and meta-analyses, when making decisions about which conservation actions to implement. These evidence reviews vary in their quality, and do not necessarily synthesise the full range of scientific evidence found in the primary literature, which hampers decision-making.. This evidence review map will identify, catalogue, and describe evidence reviews that investigate actions and policies to conserve insect biodiversity. This will help policy makers identify relevant reviews and researchers to identify synthesis gaps. It will also generate a list of conservation actions which can feed into future synthesis projects. We will produce an interactive database of evidence reviews, acting as a bibliography for policy-makers, curate a list of insect conservation actions that have been reviewed, and identify synthesis gaps for conservation actions that have not been reviewed.MethodsWe will search for evidence reviews across seven large, generic bibliographic databases, a database of environmental reviews, and five grey literature resources using a search string consisting of an insect substring, a biodiversity or population response substring, an evidence synthesis substring, and a conservation substring. The results will be deduplicated and then screened at title and abstract (concurrently) and full text levels against predefined inclusion criteria. We will initially perform consistency checking on a subset of records at each level to ensure the inclusion criteria are sufficiently clear and understood by multiple reviewers. We will extract a suite of descriptive meta-data from relevant reviews, including a description of the action and information on each review’s focal taxa, biomes, and locations. If resources allow, we will apply the CEESAT critical appraisal tool for evidence reviews to assess validity of individual records and the evidence base as a whole. We will summarise our findings in an interactive database of reviews and other visualisations, including evidence atlases and heat maps (cross tabulations of the volume of evidence across two categorical variables). The findings of the evidence review map will support the identification of synthesis gaps and clusters that may warrant further attention through secondary research.


2021 ◽  
Author(s):  
Maria Ehn ◽  
Matt X Richardson ◽  
Sara Landerdahl Stridsberg ◽  
W. Ken Redekop ◽  
Sarah Wamala-Andersson

BACKGROUND Global Positioning System (GPS) alarms aim at supporting users in independent daily indoor and outdoor activities. GPS alarms are implemented in social care, particularly in Nordic countries. Previous systematic reviews report lack of clear evidence of the effectiveness of GPS alarms on the health and welfare of users and their families, as well as social care provision. Evidence on effectiveness can support informed decision on implementation of health and welfare technologies. Standardized evidence frameworks have been developed to ensure that new technologies are clinically effective and offer economic value. However, systematic reviews seldom assess identified evidence using the frameworks. OBJECTIVE This study provides an up-to-date systematic review on evidence from existing studies of GPS-based alarms’ effects on health, welfare and social provision in elderly care, compared to non-GPS standard care. Moreover, the study findings are assessed against the evidence standard framework for digital health technologies (DHTs) established by the National Institute for Health and Care Excellence (NICE) in UK. METHODS The review was conducted according to recommended guidelines. Primary studies published in peer-reviewed and grey literature between January 2005 and August 2020 were identified through searches in 13 databases and several sources of grey literature. Articles were included if the studied population was persons 50 years and older, who either received social care for elderly or social care for persons with dementia; employed GPS devices that enabled the users to initiate alarms and/or localization of user position and/or geofencing functions as an intervention; were performed in Canada, US, EU, Singapore, Australia, New Zealand, Hong Kong, South Korea, or Japan; and addressed outcomes related to health, welfare and social care outcomes by use of quantitative methods. Study findings were categorized and summarized according to the requirements for “active monitoring” DHTs (i.e. tier 3b) of the NICE evidence standard framework. RESULTS 16 of the 986 screened records met the eligibility criteria. 7 peer-reviewed publications and 9 grey literature studies contributed with information. Best practice evidence was identified according to standards for tier 1 category “Relevance to current pathways in health/social care system” and minimum standard evidence was identified according to standards for tier 1 category “Credibility with health, social care professionals” of the NICE framework. However, several evidence categories in tiers 1 and 2 could not be assessed and no clear evidence demonstrating effectiveness in outcomes or improvements in outcomes could be identified. The evidence required for DHTs tracking patient location (tier 3b) in the NICE framework was therefore insufficient. CONCLUSIONS The evidence in current grey and peer-reviewed literature for GPS-based mobile alarms’ beneficial effects on health and welfare of older adults and social care provision is insufficient. Future research should utilize knowledge produced in previous studies and systematic reviews. CLINICALTRIAL Not required, no primary study.


Author(s):  
Wright ◽  
Colley ◽  
Knudsen ◽  
Kendall

This research aimed to synthesize housing supports funded by 20 major insurance-based schemes for Australians with an acquired brain injury (ABI) or spinal cord injury (SCI). Publicly available grey literature (i.e., primary information from respective scheme websites) was systematically reviewed and compared. There were notable differences between the different scheme types (disability vs. workers compensation schemes) and across different States. Collectively, scheme funding was more likely to be focused on housing infrastructure and service delivery, than on tenancy support. Australians who are least likely to benefit from the current funding context are those whose home cannot be reasonably modified, are wanting to build or purchase a new home, do not have suitable, alternative short- or long-term housing options if their current home is not feasible, require support to maintain occupancy of their home or financial assistance to move into a new home, may benefit from case management services, family supports, and assistance animals, and/or cannot afford their rent or home loan repayments. Several interactions, inconsistencies, contradictions, and gaps that warrant further attention were also revealed. This review has highlighted the need for policy makers to provide transparent information about housing entitlements for individuals with ABI or SCI, and their families. A unified, evidence-based framework to guide the funding of housing and housing support services may increase the consistency of interventions available to people with ABI or SCI and, therefore, improve outcomes.


2014 ◽  
Vol 23 (2) ◽  
pp. 479-483
Author(s):  
Fabiana Villela Mamede

This study is a reflection on conducting a systematic review in public health. Systematic reviews of public health are fraught with challenges. Complexity is inherent and this may be due to multi-component interventions, diverse study populations, multiple outcomes measured, mixed study designs, or implementation and effectiveness of the review. For policy makers and practitioners to use systematic reviews to implement effective systematic reviews of public health program, the reviews must include this information, which seeks to answer the questions posed by decision-makers, including recipients of the program. We discuss methodological and practice issues that need to be considered when undertaking systematic reviews in this field, including recommendations to reviewers on the issues to address within a systematic public health review and, indirectly, provides advice to researchers on the reporting requirements of primary studies for the production of high quality systematic reviews.


2018 ◽  
Vol 7 (8) ◽  
pp. 137 ◽  
Author(s):  
Victoria A. Goodyear ◽  
Kathleen M. Armour

: It has been reported from numerous international and socio-economic contexts that young people are becoming increasingly interested in and/or using social media, apps, and wearable devices for their health. Yet, there are few robust empirical accounts on the types of health-related information young people find, select, and use, the reasons for their choices, and how young people use these technologies in a way that influences their health-related knowledge and behaviors. This paper synthesizes findings from three separate projects that investigated over 1600 young people’s (age 13–19) perspectives on and experiences of health-related social media, apps, and wearable health devices. The findings show that young people are both critical and vulnerable users and generators of digital health technologies. Many young people experience a range of positive benefits for their physical activity, diet/nutritional, and body image related behaviors. Yet there are a number of risks, and young people report on the power of digital health technologies to shape, influence, and change their health-related behaviors. The paper concludes by providing new and evidence-based direction and guidance on how relevant adults (including teachers, parents/guardians, health professionals/practitioners, policy-makers, and researchers) can better understand and support young people’s engagement with digital health technologies.


2020 ◽  
Vol 4 (Supplement_2) ◽  
pp. 1366-1366
Author(s):  
Solomon Eshetu Hailu ◽  
Tesfaye Bekele ◽  
Namukolo Covic ◽  
Desalegn Kuche ◽  
Beza Teshome ◽  
...  

Abstract Objectives Despite much nutrition research conducted in Ethiopia, none has described existing opportunities for synergy or possible missed opportunities to use research to inform policy and program decisions to foster accelerated progress. The study aimed to describe prevailing processes on evidence use in formulating nutrition policy and program decisions and identify potential barriers and opportunities for evidence-based decision-making for nutrition for Ethiopia's context. Methods In 2017, 29 purposively selected key informants (KIs) were interviewed. They were identified using a consultative stakeholder mapping workshop and represented National Nutrition Program coordinators, key actors in government sectors, program coordinators from selected local and international NGOs, local and international universities and research institutes involved in nutrition research and key actors in policy decision-making. A framework analysis including identifying themes, coding, indexing, charting, mapping and interpretation was used. A validation workshop discussed findings and added perspectives to interpretation. Results The KIs perceived that demand for evidence from the Ethiopian government had been increasing over time. Majority referred to poor research quality as a barrier for using research in decision-making processes. Other challenges identified included limited cross-linkage, coordination gaps between researchers and decision makers, and inadequate translation of research evidence into meaningful information for policy makers. Availability of different forums, research dissemination conferences and suitable institutional structures that enable research and evidence dissemination were considered to be opportunities that should be leveraged to inform policy making. Conclusions The quality of research, and of collaborative engagement between those who produce evidence and decision makers who formulate policies need to be strengthened. Regular evidence dissemination events and publication of action oriented easy to read briefs could increase use of evidence among nutrition policy makers. Funding Sources Ethiopian Public Health Institute and Evidence-informed Decision-making in Health and Nutrition Network.


2008 ◽  
Vol 24 (04) ◽  
pp. 403-411 ◽  
Author(s):  
Sue E. Bayliss ◽  
Clare Davenport

Objectives:The aim of this study was to examine location of systematic reviews of test accuracy in five specialist review databases: York CRD's DARE and HTA databases, Medion (University of Maastricht), C-EBLM (International Federation of Clinical Chemistry), and the ARIF in-house database (University of Birmingham).Methods:Searches were limited to the period 1996–2006. Test accuracy reviews were located using in-house diagnostic search filters and with help from database producers where databases were not confined to test accuracy reviews. References were coded according to disease area, review purpose, and test application. Ease of use, volume, overlap, and content of databases was noted.Results:A large degree of overlap existed between databases. Medion contained the largest number (n= 672) and the largest number of unique (n= 328) test accuracy references. A combination of three databases identified only 76% of test reviews. All databases were rated as easy to search but varied with respect to timeliness and compatibility with reference management software. Most reviews evaluated test accuracy (85%) but the HTA database had a larger proportion of cost-effectiveness and screening reviews and C-EBLM more reviews addressing early test development. Most reviews were conducted in secondary care settings.Conclusions:Specialist review databases offer an essential addition to general bibliographic databases where application of diagnostic method filters can compromise search sensitivity. Important differences exist between databases in terms of ease of use and content. Our findings raise the question whether the current balance of research setting, in particular the predominance of research on tests used in secondary care, matches the needs of decision makers.


2020 ◽  
Vol 9 (1) ◽  
Author(s):  
Neal R. Haddaway ◽  
Eliza M. Grames ◽  
Douglas H. Boyes ◽  
Manu E. Saunders ◽  
Nigel G. Taylor

Abstract Background Insects play a central role in the functioning of terrestrial and freshwater ecosystems and contribute to a multitude of ecosystem services in managed and unmanaged systems Even local declines of insect abundance and richness can have enormous ecological and economic consequences. Evidence-informed conservation actions are essential to prevent potential cascading consequences of insect declines, and to help declining populations recover. Policy-makers rely on syntheses of primary research, such as reviews and meta-analyses, when making decisions about which conservation actions to implement. These evidence reviews vary in their quality, and do not necessarily synthesise the full range of scientific evidence found in the primary literature, which hampers decision-making. This evidence review map will identify, catalogue, and describe evidence reviews that investigate actions and policies to conserve insect biodiversity. This will help policy makers identify relevant reviews and researchers to identify synthesis gaps. It will also generate a list of conservation actions which can feed into future synthesis projects. We will produce an interactive database of evidence reviews, acting as a bibliography for policy-makers, curate a list of insect conservation actions that have been reviewed, and identify synthesis gaps for conservation actions that have not been reviewed. Methods We will search for evidence reviews across seven large, generic bibliographic databases, a database of environmental reviews, and five grey literature resources using a search string consisting of an insect substring, a biodiversity or population response substring, an evidence synthesis substring, and a conservation substring. The results will be deduplicated and then screened at title and abstract (concurrently) and full text levels against predefined inclusion criteria. We will initially perform consistency checking on a subset of records at each level to ensure the inclusion criteria are sufficiently clear and understood by multiple reviewers. We will extract a suite of descriptive meta-data from relevant reviews, including a description of the action and information on each review’s focal taxa, biomes, and locations. If resources allow, we will apply the CEESAT critical appraisal tool for evidence reviews to assess validity of individual records and the evidence base as a whole. We will summarise our findings in an interactive database of reviews and other visualisations, including evidence atlases and heat maps (cross tabulations of the volume of evidence across two categorical variables). The findings of the evidence review map will support the identification of synthesis gaps and clusters that may warrant further attention through secondary research.


Author(s):  
Sara Landerdahl Stridsberg ◽  
Matt X Richardson ◽  
Ken Redekop ◽  
Maria Ehn ◽  
Sarah Wamala Andersson

Sign in / Sign up

Export Citation Format

Share Document