scholarly journals Psychometric Properties of a Fidelity Scale for Illness Management and Recovery

2019 ◽  
Vol 47 (6) ◽  
pp. 885-893 ◽  
Author(s):  
Karina Myhren Egeland ◽  
Kristin Sverdvik Heiervang ◽  
Matthew Landers ◽  
Torleif Ruud ◽  
Robert E. Drake ◽  
...  
Keyword(s):  
Psychometric Properties ◽  
Entire Range ◽  
Interrater Reliability ◽  
Limited Attention ◽  
Illness Management ◽  
Sensitivity To Change ◽  
Frequency Distributions ◽  
Illness Management And Recovery ◽  
Time Points ◽  
Fidelity Scale

Abstract This study examined the psychometric properties and feasibility of the Illness Management and Recovery (IMR) Fidelity scale. Despite widespread use of the scale, the psychometric properties have received limited attention. Trained fidelity assessors conducted assessments four times over 18 months at 11 sites implementing IMR. The IMR Fidelity scale showed excellent interrater reliability (.99), interrater item agreement (94%), internal consistency (.91–.95 at three time points), and sensitivity to change. Frequency distributions generally showed that item ratings included the entire range. The IMR Fidelity scale has excellent psychometric properties and should be used to evaluate and guide the implementation of IMR. Trial registration: ClinicalTrials.gov Identifier: NCT03271242.

scholarly journals The Family Psychoeducation Fidelity Scale: Psychometric Properties

2020 ◽  
Vol 47 (6) ◽  
pp. 894-900 ◽  
Author(s):  
I. Joa ◽  
J. O. Johannessen ◽  
K. S. Heiervang ◽  
A. A. Sviland ◽  
H. A. Nordin ◽  
...  
Keyword(s):  
Psychometric Properties ◽  
Internal Consistency ◽  
Interrater Reliability ◽  
Review Process ◽  
Trial Registration ◽  
Family Psychoeducation ◽  
Time Points ◽  
The Family ◽  
Fidelity Scale

Abstract This study examined psychometric properties and feasibility of the Family Psychoeducation (FPE) Fidelity Scale. Fidelity assessors conducted reviews using the FPE fidelity scale four times over 18 months at five sites in Norway. After completing fidelity reviews, assessors rated feasibility of the fidelity review process. The FPE fidelity scale showed excellent interrater reliability (.99), interrater item agreement (88%), and internal consistency (mean = .84 across four time points). By the 18-month follow-up, all five sites increased fidelity and three reached adequate fidelity. Fidelity assessors rated feasibility as excellent. The FPE fidelity scale has good psychometric properties and is feasible for evaluating the implementation of FPE programs. Trial registration ClinicalTrials.gov Identifier: NCT03271242.

scholarly journals The Antipsychotic Medication Management Fidelity Scale: Psychometric properties

2020 ◽  
Vol 47 (6) ◽  
pp. 911-919 ◽  
Author(s):  
Torleif Ruud ◽  
Karin Drivenes ◽  
Robert E. Drake ◽  
Vegard Øksendal Haaland ◽  
Matthew Landers ◽  
...  
Keyword(s):  
Psychometric Properties ◽  
Antipsychotic Medication ◽  
Interrater Reliability ◽  
Medication Management ◽  
Evidence Based ◽  
Sensitivity To Change ◽  
Implementation Support ◽  
Fidelity Scale ◽  
Distribution Sensitivity ◽  
Evidence Based Guidelines

Abstract The paper describes the Antipsychotic Medication Management Fidelity Scale and its psychometric properties, including interrater reliability, frequency distribution, sensitivity to change and feasibility. Fidelity assessors conducted fidelity reviews four times over 18 months at eight sites receiving implementation support for evidence-based antipsychotic medication management. Data analyses shows good to fair interrater reliability, adequate sensitivity to change over time and good feasibility. At 18 months, item ratings varied from poor to full fidelity on most items. Use of the scale can assess fidelity to evidence-based guidelines for antipsychotic medication management and guide efforts to improve practice. Further research should improve and better calibrate some items, and improve the procedures for access to information. Trial registration: ClinicalTrials.gov Identifier: NCT03271242.

THE MATERNAL BEHAVIOR INVENTORY: MEASURING THE BEHAVIORAL SIDE OF MOTHER-TO-INFANT ATTACHMENT

1994 ◽  
Vol 22 (2) ◽  
pp. 177-193 ◽  
Author(s):  
Gilbert Becker ◽  
Constance Becker
Keyword(s):  
Psychometric Properties ◽  
Maternal Behavior ◽  
Interrater Reliability ◽  
Maternity Ward ◽  
Infant Attachment ◽  
Frequency Distributions ◽  
Rating Format ◽  
Structural Differences ◽  
Scale Scores ◽  
The Mean

This study examined the psychometric properties of four indicators of mother-to-infant attachment. Observations were made on 200 maternity ward patients during an infant feeding period on the third day postpartum. The results suggested that a single dimension underlying all four indicators can account fairly well for the interindicator correlation matrix. The mean interindicator correlation was .43, implying a total scale interitem reliability of .75. The interrater reliability for a single rater was estimated to be .95. All four indicators, based on a five-point rating format, produced inverted J-shaped frequency distributions. Nontrivial structural differences, but only inconsequential elevational differences, were found in comparisons between primiparous and multiparous mothers, and between mothers with male infants and those with female infants. Of several background variables, working outside the home was the best predictor of optimal total scale scores. Given its favorable psychometric properties, and because it takes only up to five minutes to administer, the Maternal Behavior Inventory or MBI was recommended as a research tool in the study of mother-to-infant attachment, and as a possible predictor of children at risk.

scholarly journals Psychometric Properties of the General Organizational Index (GOI): A Measure of Individualization and Quality Improvement to Complement Program Fidelity

2020 ◽  
Vol 47 (6) ◽  
pp. 920-926 ◽  
Author(s):  
Kristin Sverdvik Heiervang ◽  
Karina Myhren Egeland ◽  
Matthew Landers ◽  
Torleif Ruud ◽  
Inge Joa ◽  
...  
Keyword(s):  
Mental Health ◽  
Psychometric Properties ◽  
Interrater Reliability ◽  
Health Programs ◽  
Evidence Based ◽  
Sensitivity To Change ◽  
Standardized Measures ◽  
Program Fidelity ◽  
Mental Health Practices ◽  
Mental Health Programs

Abstract To assess the implementation of effective practices, mental health programs need standardized measures. The General Organizational Index (GOI), although widely used for this purpose, has received minimal psychometric research. For this study, we assessed psychometric properties of the GOI scale administered four times over 18 months during the implementation of a new program in 11 sites. The GOI scale demonstrated high levels of interrater reliability (.97), agreement between assessors on item ratings (86% overall), internal consistency (.77–.80 at three time points), sensitivity to change, and feasibility. We conclude that the GOI scale has acceptable psychometric properties, and its use may enhance implementation and research on evidence-based mental health practices. Trial registration: REK2015/2169. ClinicalTrials.gov Identifier: NCT03271242

scholarly journals Psychometric Comparisons of 4 Measures for Assessing Upper-Extremity Function in People With Stroke

2009 ◽  
Vol 89 (8) ◽  
pp. 840-850 ◽  
Author(s):  
Jau-Hong Lin ◽  
Miao-Ju Hsu ◽  
Ching-Fan Sheu ◽  
Tzung-Shian Wu ◽  
Ruey-Tay Lin ◽  
...  
Keyword(s):  
Psychometric Properties ◽  
Upper Extremity ◽  
Motor Function ◽  
Predictive Validity ◽  
Concurrent Validity ◽  
Interrater Reliability ◽  
Time Points ◽  
Function Test ◽  
Wolf Motor Function Test ◽  
Test Retest Reliability

BackgroundFunctional limitation of the upper extremities is common in patients with stroke. An upper-extremity measure with sound psychometric properties is indispensable for clinical and research use.ObjectiveThe purpose of this study was to compare the psychometric properties of 4 clinical measures for assessing upper-extremity motor function in people with stroke: the upper-extremity subscale of the Fugl-Meyer Motor Test (UE-FM), the upper-extremity subscale of the Stroke Rehabilitation Assessment of Movement, the Action Research Arm Test (ARAT), and the Wolf Motor Function Test.DesignThis was a prospective, longitudinal study.MethodsFifty-three people with stroke were evaluated with the 4 measures at 4 time points (14, 30, 90, and 180 days after stroke). Thirty-five participants completed all of the assessments. The ceiling and floor effects, validity (concurrent validity and predictive validity), and responsiveness of each measure were examined. Interrater reliability and test-retest reliability also were examined.ResultsAll measures, except for the UE-FM, had significant floor effects or ceiling effects at one or more time points. The Spearman ρ correlation coefficient for each pair of the 4 measures was ≥.81, indicating high concurrent validity. The predictive validity of the 4 measures was satisfactory (Spearman ρ, ≥.51). The responsiveness of the 4 measures at 14 to 180 days after stroke was moderate (.52 ≤ effect size ≤ .79). The 4 measures had good interrater reliability (intraclass correlation coefficient [ICC], ≥.92) and test-retest reliability (ICC, ≥.97). Only the minimal detectable changes of the UE-FM (8% of the highest possible score) and the ARAT (6%) were satisfactory.LimitationsThe sample size was too small to conduct data analysis according to type or severity of stroke. In addition, the timed component of the Wolf Motor Function Test was not used in this study.ConclusionsAll 4 measures showed sufficient validity, responsiveness, and reliability in participants with stroke. The UE-FM for assessing impairment and the ARAT for assessing disability had satisfactory minimal detectable changes, supporting their utility in clinical settings.

scholarly journals Psychometric properties of a self-assessment questionnaire concerning symptoms and impairment in urinary tract infections: the UTI-SIQ-8

BMJ Open ◽  
2021 ◽  
Vol 11 (2) ◽  
pp. e043328
Author(s):  
Ildikó Gágyor ◽  
Katrin Rentzsch ◽  
Stephanie Strube-Plaschke ◽  
Wolfgang Himmel
Keyword(s):  
Primary Care ◽  
Urinary Tract ◽  
Psychometric Properties ◽  
Symptom Severity ◽  
Web Application ◽  
Sensitivity To Change ◽  
Observation Study ◽  
Tract Infections ◽  
Daily Changes ◽  
The Web

ObjectivesTo validate the urinary tract infection-Symptom and Impairment Questionnaire (UTI-SIQ-8), a questionnaire that consists of four items to assess the symptom severity for dysuria, urgency, frequenc, and low abdominal pain and four items to assess the resulting impairment of activity by UTIs.DesignProspective observation study.SettingGerman primary care practices.ParticipantsAn unselected population of women with UTI. Women could participate online via a web application for smartphones, smartwatches and tablets or use a paper-and-pencil version.Main outcomesPsychometric properties of the UTI-SIQ-8 regarding reliability, validity and sensitivity to change by using factor analysis and multilevel and network analysis.ResultsData from 120 women with a total of 769 symptom reports across 7 days of measurement were analysed. The majority of the participating patients (87/120) used the web application via smartphones or other devices. The reliability of the UTI-SIQ-8 was high, with Cronbach’s alpha of .86 at intake; convergent and discriminant validity was satisfactory. Intraclass correlation demonstrated high sensitivity to change, with 68% of the total variance being due to time differences. These daily changes in an individual’s symptoms moved parallel with daily changes in the EQ-5D-5L (b=1.68, SE=0.12, p<0.001) and the visual analogue scale (b=0.03, SE=0.003, p<0.001), also highlighting convergent validity with respect to daily changes in symptom severity.ConclusionsThe present findings support the UTI-SIQ-8 questionnaire as an economic, reliable and valid instrument for the assessment of symptom severity and symptom change in women with uncomplicated UTI. The web application helped patients to report symptoms on a daily basis. These findings may encourage primary care physicians to use the UTI-SIQ-8 in their daily practice and researchers to apply it to studies involving patients with uncomplicated UTI.

Sign in / Sign up

Export Citation Format

Share Document