scholarly journals Measures of Facilitator Competent Adherence Used in Parenting Programs and Their Psychometric Properties: A Systematic Review

2021 ◽  
Author(s):  
Mackenzie Martin ◽  
Bridget Steele ◽  
Jamie M. Lachman ◽  
Frances Gardner
Keyword(s):  
Systematic Review ◽  
Psychometric Properties ◽  
Scale Up ◽  
Implementation Fidelity ◽  
Parenting Programs ◽  
High Quality ◽  
Observational Measures ◽  
Intervention Science ◽  
Cosmin Checklist ◽  
Registration Number

AbstractImplementation fidelity is a critical component of intervention science, which aims to understand how interventions unfold in practice to improve outcomes. A key element of fidelity is facilitator competent adherence—the extent to which a program is delivered as prescribed with the specified level of quality. We conducted a two-part systematic review examining these aspects in parenting programs aiming to reduce child behavior problems and maltreatment. Part One reviews measures of facilitator competent adherence and Part Two examines the psychometric properties of the observational measures found. Searches identified 9153 articles from electronic databases, citation tracking, and expert input. After screening using pre-specified criteria, 156 (Part One) and 41 (Part Two) articles remained. In Part One, measure, facilitator, and intervention characteristics were extracted and synthesized from 65 measures. Most measures were observational, used by facilitators and researchers, and employed Likert-scale ratings. In Part Two, evidence on the reliability (internal consistency, inter-rater, intra-rater, test–retest) and validity (content, construct, convergent/divergent, criterion) of 30 observational measures identified from Part One was synthesized and evaluated. An adapted COSMIN checklist was used to assess study and measure quality. We found most studies to be of reasonably high quality. This is the first review to summarize and critically appraise measures of facilitator competent adherence used in the parenting program literature and establish their psychometric properties. The findings underscore the need to advance research on measures of facilitator competent adherence; reliable, valid, and high-quality implementation measures allow for evidence-based decisions regarding the delivery and scale-up of parenting programs. PROSPERO Registration Number: CRD42020167872.

scholarly journals Determining the influence of intervention characteristics on implementation success requires reliable and valid measures: Results from a systematic review

2021 ◽  
Vol 2 ◽  
pp. 263348952199419
Author(s):  
Cara C Lewis ◽  
Kayne Mettert ◽  
Aaron R Lyon
Keyword(s):  
Systematic Review ◽  
Psychometric Properties ◽  
Systematic Reviews ◽  
Quality Measures ◽  
Measure Development ◽  
Relative Advantage ◽  
Design Quality ◽  
High Quality ◽  
Evidence Strength

Background: Despite their inclusion in Rogers’ seminal diffusion of innovations theory, few implementation studies empirically evaluate the role of intervention characteristics. Now, with growing evidence on the role of adaptation in implementation, high-quality measures of characteristics such as adaptability, trialability, and complexity are needed. Only two systematic reviews of implementation measures captured those related to the intervention or innovation and their assessment of psychometric properties was limited. This manuscript reports on the results of eight systematic reviews of measures of intervention characteristics with nuanced data regarding a broad range of psychometric properties. Methods: The systematic review proceeded in three phases. Phase I, data collection, involved search string generation, title and abstract screening, full text review, construct assignment, and citation searches. Phase II, data extraction, involved coding psychometric information. Phase III, data analysis, involved two trained specialists independently rating each measure using PAPERS (Psychometric And Pragmatic Evidence Rating Scales). Results: Searches identified 16 measures or scales: zero for intervention source, one for evidence strength and quality, nine for relative advantage, five for adaptability, six for trialability, nine for complexity, and two for design quality and packaging. Information about internal consistency and norms was available for most measures, whereas information about other psychometric properties was most often not available. Ratings for psychometric properties fell in the range of “poor” to “good.” Conclusion: The results of this review confirm that few implementation scholars are examining the role of intervention characteristics in behavioral health studies. Significant work is needed to both develop new measures (e.g., for intervention source) and build psychometric evidence for existing measures in this forgotten domain. Plain Language Summary Intervention characteristics have long been perceived as critical factors that directly influence the rate of adopting an innovation. It remains unclear the extent to which intervention characteristics including relative advantage, complexity, trialability, intervention source, design quality and packaging, evidence strength and quality, adaptability, and cost impact implementation of evidence-based practices in behavioral health settings. To unpack the differential influence of these factors, high quality measures are needed. Systematic reviews can identify measures and synthesize the data regarding their quality to identify gaps in the field and inform measure development and testing efforts. Two previous reviews identified measures of intervention characteristics, but they did not provide information about the extent of the existing evidence nor did they evaluate the host of evidence available for identified measures. This manuscript summarizes the results of nine systematic reviews (i.e., one for each of the factors listed above) for which 16 unique measures or scales were identified. The nuanced findings will help direct measure development work in this forgotten domain.

scholarly journals 459 - Psychometric properties of the Geriatric Anxiety Inventory : A systematic review

2020 ◽  
Vol 32 (S1) ◽  
pp. 180-180
Author(s):  
Philippe Landreville ◽  
Alexandra Champagne ◽  
Patrick Gosselin
Keyword(s):  
Systematic Review ◽  
Psychometric Properties ◽  
Internal Consistency ◽  
Methodological Quality ◽  
The Body ◽  
Self Report ◽  
Test Reliability ◽  
Cosmin Checklist ◽  
Validity Indices

Background.The Geriatric Anxiety Inventory (GAI) is a widely used self-report measure of anxiety symptoms in older adults. Much research has been conducted on the psychometric properties of the GAI in various populations and using different language versions. Previous reviews of this literature have examined only a small proportion of studies in light of the body of research currently available and have not evaluated the methodological quality of this research. We conducted a systematic review of the psychometric properties of the GAI.Method.Relevant studies (N = 30) were retrieved through a search of electronic databases (Pubmed, PsycINFO, CINAHL, EMBASE and Google Scholar) and a hand search. The methodological quality of the included studies was assessed by two independent reviewers using the ‘‘COnsensusbased Standards for the selection of health status Measurement INstruments’’ (COSMIN) checklist.Results.Based on the COSMIN checklist, internal consistency and test reliability were mostly rated as poorly assessed (62.1% and 70% of studies, respectively) and quality of studies examining structural validity was mostly fair (60% of studies). The GAI showed adequate internal consistency and test-retest reliability. Convergent validity indices were highest with measures of generalized anxiety and lowest with instruments that include somatic symptoms. A substantial overlap with measures of depression was reported. While there was no consensus on the factorial structure of the GAI, several studies found it to be unidimensional.Conclusions.The GAI presents satisfactory psychometric properties. However, future efforts should aim to achieve a higher degree of methodological quality.

scholarly journals Psychometric properties and feasibility of use of dementia specific quality of life instruments for use in care settings: a systematic review

2019 ◽  
pp. 1-15 ◽  
Author(s):  
Laura J. Hughes ◽  
Nicolas Farina ◽  
Thomas E. Page ◽  
Naji Tabet ◽  
Sube Banerjee
Keyword(s):  
Quality Of Life ◽  
Systematic Review ◽  
Psychometric Properties ◽  
Care Home ◽  
Care Homes ◽  
Cosmin Checklist ◽  
Many Instruments ◽  
The Uk ◽  
Quality Instruments

ABSTRACTBackground:Over 400,000 people live in care home settings in the UK. One way of understanding and improving the quality of care provided is by measuring and understanding the quality of life (QoL) of those living in care homes. This review aimed to identify and examine the psychometric properties including feasibility of use of dementia-specific QoL measures developed or validated for use in care settings.Design:Systematic review.Methods:Instruments were identified using four electronic databases (PubMed, PsycINFO, Web of Science, and CINAHL) and lateral search techniques. Searches were conducted in January 2017. Studies which reported on the development and/or validation of dementia specific QoL instruments for use in care settings written in English were eligible for inclusion. The methodological quality of the studies was assessed using the COSMIN checklist. Feasibility was assessed using a checklist developed specifically for the review.Results:Six hundred and sixteen articles were identified in the initial search. After de-duplication, screening and further lateral searches were performed, 25 studies reporting on 9 dementia-specific QoL instruments for use in care home settings were included in the review. Limited evidence was available on the psychometric properties of many instruments identified. Higher-quality instruments were not easily accessible or had low feasibility of use.Conclusions:Few high-quality instruments of QoL validated for use in care home settings are readily or freely available. This review highlights the need to develop a well-validated measure of QoL for use within care homes that is also feasible and accessible.

scholarly journals Resource Use, Availability and Cost in the Provision of Critical Care in Tanzania: A Systematic Review

2021 ◽  
Author(s):  
Joseph Kazibwe ◽  
Hiral A. Shah ◽  
August Kuwawenaruwa ◽  
Carl Otto Schell ◽  
Karima Khalid ◽  
...  
Keyword(s):  
Systematic Review ◽  
Critical Care ◽  
Resource Use ◽  
Unit Cost ◽  
Scale Up ◽  
Urban Settings ◽  
Care Services ◽  
Rural And Urban ◽  
Registration Number ◽  
Meta Analyses

Abstract IntroductionCritical care is essential in saving lives of critically ill patients, however, provision of critical care across lower resource settings can be costly, fragmented and heterogenous. Despite the urgent need to scale-up the provision of critical care, little is known about its availability and cost. Here, we aim to systematically review and identify reported resource use, availability and costs for the provision of critical care and the nature of critical care provision in Tanzania. Methods The systematic review followed the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines; PROSPERO registration number: CRD42020221923. We searched Medline, Embase and global health databases. We included studies that reported on provision of critical care, cost and availability of resources used in the provision of critical care published after 2010. Costs were adjusted and reported in 2019 USD and TZS using the world bank GDP deflators. ResultsA total 31 studies were found to fulfil the inclusion and exclusion criteria. Critical care identified in Tanzania was categorised into: ICU delivered critical care and non-ICU critical care. The availability of ICU delivered critical care was limited to urban settings whereas non-ICU critical care was found in rural and urban settings. 15 studies reported on the costs of services related to critical care yet no study reported an average or unit cost of critical care. Costs of medication, equipment (e.g. oxygen, PPE), services, and human resources were identified as inputs to specific critical care services in Tanzania. ConclusionThere is limited evidence on the resource use, availability and costs of critical care in Tanzania. There is a strong need for further empirical research on critical care resources availability, utilization and costs across specialties and hospitals of different level in LMICs like Tanzania to inform planning, priority setting and budgeting for critical care services.

scholarly journals Assessing food and nutrition literacy in children and adolescents: a systematic review of existing tools

2021 ◽  
pp. 1-16
Author(s):  
Nicholas Carroll ◽  
Maude Perreault ◽  
David WL Ma ◽  
Jess Haines
Keyword(s):  
Systematic Review ◽  
Psychometric Properties ◽  
Children And Adolescents ◽  
Eating Habits ◽  
Life Stage ◽  
Assessment Tools ◽  
Food Label ◽  
Specific Criterion ◽  
Food Literacy ◽  
Cosmin Checklist

Abstract Objective: Food literacy (FL) and nutrition literacy (NL) are concepts that can help individuals to navigate the current food environment. Building these skills and knowledge at a young age is important for skill retention, confidence in food practices and supporting lifelong healthy eating habits. The objectives of this systematic review were to: (i) identify existing tools that measure FL and NL among children and/or adolescents and (ii) describe the psychometric properties. Design: A 4-phase protocol was used to systematically retrieve articles. The search was performed in May 2021. Study characteristics and psychometric properties were extracted, and a narrative synthesis was used to summarise findings. Risk of bias was assessed using the COSMIN checklist. Setting: Six databases were searched to identify current tools. Participants: Children (2–12 years) and adolescents (13–18 years) participated in this study. Results: Twelve tools were identified. Three tools measured FL, 1 tool measured NL, 4 tools measured both FL and NL, and 4 tools measured subareas of NL—more specifically, critical NL, food label and menu board literacy. Most tools were self-reported, developed based on a theoretical framework and assessed some components of validity and/or reliability for a specific age and ethnic group. The majority of tools targeted older children and adolescents (9–18 years of age), and one tool targeted preschoolers (3–6 years of age). Conclusions: Most widely used definitions of FL and NL do not acknowledge life-stage specific criterion. Continued efforts are needed to develop a comprehensive definition and framework of FL and NL appropriate for children, which will help inform future assessment tools.

scholarly journals Systematic review of the tools of oral and dental health literacy: Assessment of conceptual dimensions and psychometric properties

2020 ◽  
Author(s):  
Mohtasham Ghaffari ◽  
Sakineh Rakhshanderou ◽  
Ali Ramezankhani ◽  
Yadollah Mehrabi ◽  
Ali Safari-Moradabadi
Keyword(s):  
Systematic Review ◽  
Health Literacy ◽  
Psychometric Properties ◽  
Dental Health ◽  
Qualitative Assessment ◽  
One Dimension ◽  
Literacy Assessment ◽  
General Evaluation ◽  
Cosmin Checklist ◽  
Literacy Methods

Abstract Background This article aims to provide a description of conceptual dimensions and psychometric properties of the tools of oral and dental health literacy. Methods Two authors in this study conducted electronic searches in the Medline (via PubMed), and Embase databases to find relevant articles from 1990 to present day. Evaluation of the tools was carried out in two parts; general evaluation of the tools using skills introduced by Sørensen et al., and qualitative assessment of psychometric properties using COSMIN checklist. Results After reviewing 1839 articles on oral and dental health literacy and evaluating 33 full text articles for eligibility, 21 articles entered the study. The sample size varied from 20 to 1405 subjects and the items of each tool ranged from 11 to 99 items. Of the 21 tools examined, 16 tools were evaluated for word recognition. For the studies examined, the evaluation of COSMIN scores was often fair or good. Of the 21 tools examined, 9 tools at least in one dimension were in the category of "poor", 19 tools were in the category of "fair", 20 tools were in the category of "good", and 4 tools were in the category of "excellent" in at least one dimension. Conclusion The findings of this study showed that some aspects of oral and dental health literacy are being ignored in the existing tools. Therefore, the authors of present study emphasize on the necessity to design and develop a comprehensive tool and take into account two characteristics of simplicity and briefness for international use.

scholarly journals A Systematic Review of the Psychometric Properties of the Geriatric Anxiety Inventory

2020 ◽  
Vol 4 (Supplement_1) ◽  
pp. 368-368
Author(s):  
Philippe Landreville ◽  
Alexandra Champagne ◽  
Patrick Gosselin
Keyword(s):  
Systematic Review ◽  
Psychometric Properties ◽  
Internal Consistency ◽  
Methodological Quality ◽  
Short Form ◽  
Self Report ◽  
Test Reliability ◽  
Cosmin Checklist ◽  
Validity Indices

Abstract The Geriatric Anxiety Inventory (GAI) is a widely used self-report measure of anxiety symptoms in older adults. Although much research has been conducted on the psychometric properties of the GAI, previous reviews have examined only a small proportion of studies and have not evaluated the methodological quality of this work. In view of this, we conducted a systematic review of the psychometric properties of the GAI and it’s short form (GAI-SF). Relevant studies (N = 31) were retrieved through a search of electronic databases (Pubmed, PsycINFO, CINAHL, EMBASE and Google Scholar) and a hand search. The methodological quality of the included studies was assessed by two independent reviewers using the ‘‘COnsensus-based Standards for the selection of health status Measurement INstruments’’ (COSMIN) checklist. Based on the COSMIN checklist, internal consistency and test reliability were mostly rated as poorly assessed (63% and 72.7% of studies, respectively) and quality of studies examining structural validity was mostly fair (60% of studies). Both the GAI and GAI-SF showed adequate internal consistency and test-retest reliability. Convergent validity indices were highest with measures of generalized anxiety and lowest with instruments that include somatic symptoms. Substantial overlap with measures of depression was reported. While there is no consensus on the factorial structure of the GAI, the short version was found to be unidimensional. Our review therefore suggests that the GAI and GAI-SF have satisfactory psychometric properties while indicating that future efforts should aim to achieve a higher degree of methodological quality.

scholarly journals Systematic review of the tools of oral and dental health literacy: Assessment of conceptual dimensions and psychometric properties

2020 ◽  
Author(s):  
Mohtasham Ghaffari ◽  
Sakineh Rakhshanderou ◽  
Ali Ramezankhani ◽  
Yadollah Mehrabi ◽  
Ali Safari-Moradabadi
Keyword(s):  
Systematic Review ◽  
Health Literacy ◽  
Psychometric Properties ◽  
Dental Health ◽  
Qualitative Assessment ◽  
One Dimension ◽  
Literacy Assessment ◽  
General Evaluation ◽  
Cosmin Checklist ◽  
Literacy Methods

Abstract Background This article aims to provide a description of conceptual dimensions and psychometric properties of the tools of oral and dental health literacy. Methods Two authors in this study conducted electronic searches in the Medline (via PubMed), and Embase databases to find relevant articles from 1990 to present day. Evaluation of the tools was carried out in two parts; general evaluation of the tools using skills introduced by Sørensen et al., and qualitative assessment of psychometric properties using COSMIN checklist. Results After reviewing 1839 articles on oral and dental health literacy and evaluating 33 full text articles for eligibility, 21 articles entered the study. The sample size varied from 20 to 1405 subjects and the items of each tool ranged from 11 to 99 items. Of the 21 tools examined, 16 tools were evaluated for word recognition. For the studies examined, the evaluation of COSMIN scores was often fair or good. Of the 21 tools examined, 9 tools at least in one dimension were in the category of "poor", 19 tools were in the category of "fair", 20 tools were in the category of "good", and 4 tools were in the category of "excellent" in at least one dimension. Conclusion The findings of this study showed that some aspects of oral and dental health literacy are being ignored in the existing tools. Therefore, the authors of present study emphasize on the necessity to design and develop a comprehensive tool and take into account two characteristics of simplicity and briefness for international use.

Evidence of scalable psychological interventions for forcibly displaced persons: A systematic review

2018 ◽  
Author(s):  
Camila Perera ◽  
Tiziano Scott ◽  
Rikke Holm Bramsen ◽  
Hansen ◽  
Cecilie Dinesen ◽  
...  
Keyword(s):  
Systematic Review ◽  
Psychological Distress ◽  
Scale Up ◽  
Barriers And Facilitators ◽  
Depression Symptoms ◽  
Psychological Interventions ◽  
Displaced Persons ◽  
High Quality ◽  
High Quality Evidence ◽  
Quality Evidence

There is evidence to suggest that simplified and lay facilitated psychological interventions could contribute to reducing human resource for mental health shortages and disparities among forcibly displaced migrants. The review aimed to identify the evidence for the effectiveness of scalable psychological interventions for this sub-populations and the barriers and facilitators to their implementation. A systematic review was conducted, using peer-reviewed evidence published up until September 2017. Quantitative and mixed methods intervention studies were screened from Medline, Embase, Scopus, PsychINFO and CINAHL. Only English-language studies in which non-specialists administered the intervention were included. Narrative synthesis was used to analyse the study findings on effectiveness and the barriers and facilitators to implementation were identified through thematic analysis. Out of 2,766 relevant citations and abstracts screened, 13 met the inclusion criteria. We found high quality evidence with mixed results on the effectiveness of Narrative Exposure Therapy in reducing PTSD symptoms in children and adults. Medium-high quality evidence was found for the effectiveness of parenting skills interventions in reducing children’s behavioural problems and for interventions with components of Cognitive Behavioural Therapy in reducing psychological distress. High-quality evidence was also found for a simplified version of IPT-G administered by lay facilitators indicating significant reductions in depression symptoms among adolescent among girls, but not boys, aged 14-17 years. We also found medium-high quality evidence showing no effect of psycho-education in reducing psychological distress. Cultural adaptation was identified as a facilitator to implementation and the training of non-specialists was described as both a barrier and facilitator. There is scarce but good quality evidence for the effectiveness of scalable psychological interventions for forcibly displaced persons. Further research on the effectiveness of these interventions on adults is urgently needed. Future studies should detail the process of adapting the training material, the supervision, and training received by non-specialists to assess fidelity, allow future replications, and facilitate scale-up.

Sign in / Sign up

Export Citation Format

Share Document