A systematic review of the psychometric properties of observational measures of mother-infant interaction

2012 ◽  
Author(s):  
A. Lotzin ◽  
J. Schiborr ◽  
G. Romer ◽  
B. Ramsauer
Author(s):  
Mackenzie Martin ◽  
Bridget Steele ◽  
Jamie M. Lachman ◽  
Frances Gardner

AbstractImplementation fidelity is a critical component of intervention science, which aims to understand how interventions unfold in practice to improve outcomes. A key element of fidelity is facilitator competent adherence—the extent to which a program is delivered as prescribed with the specified level of quality. We conducted a two-part systematic review examining these aspects in parenting programs aiming to reduce child behavior problems and maltreatment. Part One reviews measures of facilitator competent adherence and Part Two examines the psychometric properties of the observational measures found. Searches identified 9153 articles from electronic databases, citation tracking, and expert input. After screening using pre-specified criteria, 156 (Part One) and 41 (Part Two) articles remained. In Part One, measure, facilitator, and intervention characteristics were extracted and synthesized from 65 measures. Most measures were observational, used by facilitators and researchers, and employed Likert-scale ratings. In Part Two, evidence on the reliability (internal consistency, inter-rater, intra-rater, test–retest) and validity (content, construct, convergent/divergent, criterion) of 30 observational measures identified from Part One was synthesized and evaluated. An adapted COSMIN checklist was used to assess study and measure quality. We found most studies to be of reasonably high quality. This is the first review to summarize and critically appraise measures of facilitator competent adherence used in the parenting program literature and establish their psychometric properties. The findings underscore the need to advance research on measures of facilitator competent adherence; reliable, valid, and high-quality implementation measures allow for evidence-based decisions regarding the delivery and scale-up of parenting programs. PROSPERO Registration Number: CRD42020167872.


2021 ◽  
Vol 2 ◽  
pp. 263348952199419
Author(s):  
Cara C Lewis ◽  
Kayne Mettert ◽  
Aaron R Lyon

Background: Despite their inclusion in Rogers’ seminal diffusion of innovations theory, few implementation studies empirically evaluate the role of intervention characteristics. Now, with growing evidence on the role of adaptation in implementation, high-quality measures of characteristics such as adaptability, trialability, and complexity are needed. Only two systematic reviews of implementation measures captured those related to the intervention or innovation and their assessment of psychometric properties was limited. This manuscript reports on the results of eight systematic reviews of measures of intervention characteristics with nuanced data regarding a broad range of psychometric properties. Methods: The systematic review proceeded in three phases. Phase I, data collection, involved search string generation, title and abstract screening, full text review, construct assignment, and citation searches. Phase II, data extraction, involved coding psychometric information. Phase III, data analysis, involved two trained specialists independently rating each measure using PAPERS (Psychometric And Pragmatic Evidence Rating Scales). Results: Searches identified 16 measures or scales: zero for intervention source, one for evidence strength and quality, nine for relative advantage, five for adaptability, six for trialability, nine for complexity, and two for design quality and packaging. Information about internal consistency and norms was available for most measures, whereas information about other psychometric properties was most often not available. Ratings for psychometric properties fell in the range of “poor” to “good.” Conclusion: The results of this review confirm that few implementation scholars are examining the role of intervention characteristics in behavioral health studies. Significant work is needed to both develop new measures (e.g., for intervention source) and build psychometric evidence for existing measures in this forgotten domain. Plain Language Summary Intervention characteristics have long been perceived as critical factors that directly influence the rate of adopting an innovation. It remains unclear the extent to which intervention characteristics including relative advantage, complexity, trialability, intervention source, design quality and packaging, evidence strength and quality, adaptability, and cost impact implementation of evidence-based practices in behavioral health settings. To unpack the differential influence of these factors, high quality measures are needed. Systematic reviews can identify measures and synthesize the data regarding their quality to identify gaps in the field and inform measure development and testing efforts. Two previous reviews identified measures of intervention characteristics, but they did not provide information about the extent of the existing evidence nor did they evaluate the host of evidence available for identified measures. This manuscript summarizes the results of nine systematic reviews (i.e., one for each of the factors listed above) for which 16 unique measures or scales were identified. The nuanced findings will help direct measure development work in this forgotten domain.


2020 ◽  
Vol 32 (S1) ◽  
pp. 180-180
Author(s):  
Philippe Landreville ◽  
Alexandra Champagne ◽  
Patrick Gosselin

Background.The Geriatric Anxiety Inventory (GAI) is a widely used self-report measure of anxiety symptoms in older adults. Much research has been conducted on the psychometric properties of the GAI in various populations and using different language versions. Previous reviews of this literature have examined only a small proportion of studies in light of the body of research currently available and have not evaluated the methodological quality of this research. We conducted a systematic review of the psychometric properties of the GAI.Method.Relevant studies (N = 30) were retrieved through a search of electronic databases (Pubmed, PsycINFO, CINAHL, EMBASE and Google Scholar) and a hand search. The methodological quality of the included studies was assessed by two independent reviewers using the ‘‘COnsensusbased Standards for the selection of health status Measurement INstruments’’ (COSMIN) checklist.Results.Based on the COSMIN checklist, internal consistency and test reliability were mostly rated as poorly assessed (62.1% and 70% of studies, respectively) and quality of studies examining structural validity was mostly fair (60% of studies). The GAI showed adequate internal consistency and test-retest reliability. Convergent validity indices were highest with measures of generalized anxiety and lowest with instruments that include somatic symptoms. A substantial overlap with measures of depression was reported. While there was no consensus on the factorial structure of the GAI, several studies found it to be unidimensional.Conclusions.The GAI presents satisfactory psychometric properties. However, future efforts should aim to achieve a higher degree of methodological quality.


2014 ◽  
Vol 23 (7) ◽  
pp. 610-618 ◽  
Author(s):  
Carolina A. Chavez ◽  
Chantal F. Ski ◽  
David R. Thompson

2017 ◽  
Vol 9 (4) ◽  
pp. 233-246 ◽  
Author(s):  
Sara Gómez-Valero ◽  
Fernando García-Pérez ◽  
Mariano Tomás Flórez-García ◽  
Juan Carlos Miangolarra-Page

Background The present study aimed to conduct a systematic review of self-administered shoulder-disability functional assessment questionnaires adapted to Spanish, analyzing the quality of the transcultural adaptation and the clinimetric properties of the new version. Methods A search of the main biomedical databases was conducted to locate Spanish shoulder function assessment scales. The authors reviewed the papers and considered whether the process of adaptation of the questionnaire had followed international recommendations, and whether its psychometric properties had been appropriately assessed. Results The search identified nine shoulder function assessment scales adapted to Spanish: Disabilities of the Arm, Shoulder and Hand Questionnaire (DASH), Upper Limb Functional Index (ULFI), Simple Shoulder Test (SST), Shoulder Pain and Disability Index (SPADI), Oxford Shoulder Score (OSS), Shoulder Disability Questionnaire (SDQ), Western Ontario Rotator Cuff index (WORC), Western Ontario Shoulder Instability index (WOSI) and Wheelchair Users Shoulder Pain Index (WUSPI). The DASH was adapted on three occasions and the SPADI on two. The transcultural adaptation procedure was generally satisfactory, albeit somewhat less rigorous for the SDQ and WUSPI. Reliability was analyzed in all cases. Validity was not measured for one of the adaptations of the DASH, nor was it measured for the SDQ. Conclusions The transcultural adaptation was satisfactory and the psychometric properties analyzed were similar to both the original version and other versions adapted to other languages.


Sign in / Sign up

Export Citation Format

Share Document