The Family Psychoeducation Fidelity Scale: Psychometric Properties

Abstract This study examined psychometric properties and feasibility of the Family Psychoeducation (FPE) Fidelity Scale. Fidelity assessors conducted reviews using the FPE fidelity scale four times over 18 months at five sites in Norway. After completing fidelity reviews, assessors rated feasibility of the fidelity review process. The FPE fidelity scale showed excellent interrater reliability (.99), interrater item agreement (88%), and internal consistency (mean = .84 across four time points). By the 18-month follow-up, all five sites increased fidelity and three reached adequate fidelity. Fidelity assessors rated feasibility as excellent. The FPE fidelity scale has good psychometric properties and is feasible for evaluating the implementation of FPE programs. Trial registration ClinicalTrials.gov Identifier: NCT03271242.

Download Full-text

Psychometric Properties of a Fidelity Scale for Illness Management and Recovery

Administration and Policy in Mental Health and Mental Health Services Research ◽

10.1007/s10488-019-00992-5 ◽

2019 ◽

Vol 47 (6) ◽

pp. 885-893 ◽

Cited By ~ 3

Author(s):

Karina Myhren Egeland ◽

Kristin Sverdvik Heiervang ◽

Matthew Landers ◽

Torleif Ruud ◽

Robert E. Drake ◽

...

Keyword(s):

Psychometric Properties ◽

Entire Range ◽

Interrater Reliability ◽

Limited Attention ◽

Illness Management ◽

Sensitivity To Change ◽

Frequency Distributions ◽

Illness Management And Recovery ◽

Time Points ◽

Fidelity Scale

Abstract This study examined the psychometric properties and feasibility of the Illness Management and Recovery (IMR) Fidelity scale. Despite widespread use of the scale, the psychometric properties have received limited attention. Trained fidelity assessors conducted assessments four times over 18 months at 11 sites implementing IMR. The IMR Fidelity scale showed excellent interrater reliability (.99), interrater item agreement (94%), internal consistency (.91–.95 at three time points), and sensitivity to change. Frequency distributions generally showed that item ratings included the entire range. The IMR Fidelity scale has excellent psychometric properties and should be used to evaluate and guide the implementation of IMR. Trial registration: ClinicalTrials.gov Identifier: NCT03271242.

Download Full-text

Psychometric Evaluation of the TWente Engagement with Ehealth Technologies Scale (TWEETS): Evaluation Study (Preprint)

10.2196/preprints.17757 ◽

2020 ◽

Author(s):

Saskia Marion Kelders ◽

Hanneke Kip ◽

Japie Greeff

Keyword(s):

Behavior Change ◽

Psychometric Properties ◽

Predictive Validity ◽

Internal Consistency ◽

Convergent Validity ◽

Digital Health ◽

Internal Consistency Reliability ◽

Divergent Validity ◽

Time Points ◽

Perceived Behavior

BACKGROUND Engagement emerges as a predictor for the effectiveness of digital health interventions. However, a shared understanding of engagement is missing. Therefore, a new scale has been developed that proposes a clear definition and creates a tool to measure it. The TWente Engagement with Ehealth Technologies Scale (TWEETS) is based on a systematic review and interviews with engaged health app users. It defines engagement as a combination of behavior, cognition, and affect. OBJECTIVE This paper aims to evaluate the psychometric properties of the TWEETS. In addition, a comparison is made with the experiential part of the Digital Behavior Change Intervention Engagement Scale (DBCI-ES-Ex), a scale that showed some issues in previous psychometric analyses. METHODS In this study, 288 participants were asked to use any step counter app on their smartphones for 2 weeks. They completed online questionnaires at 4 time points: T0=baseline, T1=after 1 day, T2=1 week, and T3=2 weeks. At T0, demographics and personality (conscientiousness and intellect/imagination) were assessed; at T1-T3, engagement, involvement, enjoyment, subjective usage, and perceived behavior change were included as measures that are theoretically related to our definition of engagement. Analyses focused on internal consistency, reliability, and the convergent, divergent, and predictive validity of both engagement scales. Convergent validity was assessed by correlating the engagement scales with involvement, enjoyment, and subjective usage; divergent validity was assessed by correlating the engagement scales with personality; and predictive validity was assessed by regression analyses using engagement to predict perceived behavior change at later time points. RESULTS The Cronbach alpha values of the TWEETS were .86, .86, and .87 on T1, T2, and T3, respectively. Exploratory factor analyses indicated that a 1-factor structure best fits the data. The TWEETS is moderately to strongly correlated with involvement and enjoyment (theoretically related to cognitive and affective engagement, respectively; <i>P</i><.001). Correlations between the TWEETS and frequency of use were nonsignificant or small, and differences between adherers and nonadherers on the TWEETS were significant (<i>P</i><.001). Correlations between personality and the TWEETS were nonsignificant. The TWEETS at T1 was predictive of perceived behavior change at T3, with an explained variance of 16%. The psychometric properties of the TWEETS and the DBCI-ES-Ex seemed comparable in some aspects (eg, internal consistency), and in other aspects, the TWEETS seemed somewhat superior (divergent and predictive validity). CONCLUSIONS The TWEETS performs quite well as an engagement measure with high internal consistency, reasonable test-retest reliability and convergent validity, good divergent validity, and reasonable predictive validity. As the psychometric quality of a scale is a reflection of how closely a scale matches the conceptualization of a concept, this paper is also an attempt to conceptualize and define engagement as a unique concept, providing a first step toward an acceptable standard of defining and measuring engagement.

Download Full-text

Evaluation of a bifactor model and psychometric properties of FACES III in Peruvian students

Interacciones Revista de Avances en Psicología ◽

10.24016/2020.v6n2.160 ◽

2020 ◽

Author(s):

Aaron Caycho Caja ◽

César Abraham Castilla Arias

Keyword(s):

Psychometric Properties ◽

Internal Structure ◽

Structural Properties ◽

Internal Consistency ◽

Dimensional Model ◽

Probability Sampling ◽

One Dimensional ◽

Family Adaptability ◽

The Family ◽

The One

Background: To analyze the internal structure of the Family Adaptability and Cohesion Evaluation Scales-FACES III by evaluating three tentative models. Method: Non-probability sampling of 306 Peruvian students of both sexes between 15 and 26 years of age. The structural properties and internal consistency of the Original, Bifactorial and One-dimensional models were studied in detail. Results: The bifactorial model has a better fit than the remaining models, but was discarded as it does not satisfy the criteria of the suggested evaluation indices. Likewise, difficulties are observed in the internal consistency of the Flexibility subscale except for the One-Dimensional Model. Conclusion: FACES III is an instrument with consistency and internal structure problems directly associated with the presence of the Flexibility subscale as reported in previous studies.

Download Full-text

The Antipsychotic Medication Management Fidelity Scale: Psychometric properties

Administration and Policy in Mental Health and Mental Health Services Research ◽

10.1007/s10488-020-01018-1 ◽

2020 ◽

Vol 47 (6) ◽

pp. 911-919 ◽

Cited By ~ 4

Author(s):

Torleif Ruud ◽

Karin Drivenes ◽

Robert E. Drake ◽

Vegard Øksendal Haaland ◽

Matthew Landers ◽

...

Keyword(s):

Psychometric Properties ◽

Antipsychotic Medication ◽

Interrater Reliability ◽

Medication Management ◽

Evidence Based ◽

Sensitivity To Change ◽

Implementation Support ◽

Fidelity Scale ◽

Distribution Sensitivity ◽

Evidence Based Guidelines

Abstract The paper describes the Antipsychotic Medication Management Fidelity Scale and its psychometric properties, including interrater reliability, frequency distribution, sensitivity to change and feasibility. Fidelity assessors conducted fidelity reviews four times over 18 months at eight sites receiving implementation support for evidence-based antipsychotic medication management. Data analyses shows good to fair interrater reliability, adequate sensitivity to change over time and good feasibility. At 18 months, item ratings varied from poor to full fidelity on most items. Use of the scale can assess fidelity to evidence-based guidelines for antipsychotic medication management and guide efforts to improve practice. Further research should improve and better calibrate some items, and improve the procedures for access to information. Trial registration: ClinicalTrials.gov Identifier: NCT03271242.

Download Full-text

Psychometric Properties of the Family Inventory of Resources for Management in a Sample of Iranian Family Caregivers of Cancer Patients

Nursing Research and Practice ◽

10.1155/2016/1401645 ◽

2016 ◽

Vol 2016 ◽

pp. 1-5

Author(s):

Seyed Reza Mirsoleymani ◽

Camelia Rohani ◽

Mahsa Matbouei ◽

Malihe Nasiri ◽

Parvaneh Vasli

Keyword(s):

Psychometric Properties ◽

Cancer Patients ◽

Family Caregivers ◽

Caregiver Burden ◽

Internal Consistency ◽

Convergent Validity ◽

Convenience Sample ◽

Significant Difference ◽

The Family ◽

Good Internal Consistency

Objective. The aim of this study was to investigate the psychometric properties of the Family Inventory of Resources for Management (FIRM) in a sample of family caregivers of cancer patients. Methods. In this methodological study, construct validity of the FIRM was evaluated by known groups and convergent validity in a convenience sample of family caregivers of cancer patients (n=104) referred to the outpatient oncology wards of five educational hospitals in Tehran from January to April 2016. Reliability was determined by assessing the internal consistency and stability of the instrument. Results. The known-groups findings showed that there is a significant difference between the scores of the FIRM in family caregivers with different levels of caregiver burden (p<0.001). Also, the results of convergent validity showed that there is a moderate negative correlation (r=-0.50; p<0.001) between the total scores of the FIRM and the scores of the caregiver burden inventory (CBI). The FIRM showed a good internal consistency (α=0.85) and a good stability of the test-retest reliability result. Conclusions. There is a sound psychometric basis for the use of the Persian translation of the FIRM for family studies in the Iranian population.

Download Full-text

Psychometric Evaluation of the TWente Engagement with Ehealth Technologies Scale (TWEETS): Evaluation Study

Journal of Medical Internet Research ◽

10.2196/17757 ◽

2020 ◽

Vol 22 (10) ◽

pp. e17757

Author(s):

Saskia Marion Kelders ◽

Hanneke Kip ◽

Japie Greeff

Keyword(s):

Behavior Change ◽

Psychometric Properties ◽

Predictive Validity ◽

Internal Consistency ◽

Convergent Validity ◽

Digital Health ◽

Internal Consistency Reliability ◽

Divergent Validity ◽

Time Points ◽

Perceived Behavior

Background Engagement emerges as a predictor for the effectiveness of digital health interventions. However, a shared understanding of engagement is missing. Therefore, a new scale has been developed that proposes a clear definition and creates a tool to measure it. The TWente Engagement with Ehealth Technologies Scale (TWEETS) is based on a systematic review and interviews with engaged health app users. It defines engagement as a combination of behavior, cognition, and affect. Objective This paper aims to evaluate the psychometric properties of the TWEETS. In addition, a comparison is made with the experiential part of the Digital Behavior Change Intervention Engagement Scale (DBCI-ES-Ex), a scale that showed some issues in previous psychometric analyses. Methods In this study, 288 participants were asked to use any step counter app on their smartphones for 2 weeks. They completed online questionnaires at 4 time points: T0=baseline, T1=after 1 day, T2=1 week, and T3=2 weeks. At T0, demographics and personality (conscientiousness and intellect/imagination) were assessed; at T1-T3, engagement, involvement, enjoyment, subjective usage, and perceived behavior change were included as measures that are theoretically related to our definition of engagement. Analyses focused on internal consistency, reliability, and the convergent, divergent, and predictive validity of both engagement scales. Convergent validity was assessed by correlating the engagement scales with involvement, enjoyment, and subjective usage; divergent validity was assessed by correlating the engagement scales with personality; and predictive validity was assessed by regression analyses using engagement to predict perceived behavior change at later time points. Results The Cronbach alpha values of the TWEETS were .86, .86, and .87 on T1, T2, and T3, respectively. Exploratory factor analyses indicated that a 1-factor structure best fits the data. The TWEETS is moderately to strongly correlated with involvement and enjoyment (theoretically related to cognitive and affective engagement, respectively; P<.001). Correlations between the TWEETS and frequency of use were nonsignificant or small, and differences between adherers and nonadherers on the TWEETS were significant (P<.001). Correlations between personality and the TWEETS were nonsignificant. The TWEETS at T1 was predictive of perceived behavior change at T3, with an explained variance of 16%. The psychometric properties of the TWEETS and the DBCI-ES-Ex seemed comparable in some aspects (eg, internal consistency), and in other aspects, the TWEETS seemed somewhat superior (divergent and predictive validity). Conclusions The TWEETS performs quite well as an engagement measure with high internal consistency, reasonable test-retest reliability and convergent validity, good divergent validity, and reasonable predictive validity. As the psychometric quality of a scale is a reflection of how closely a scale matches the conceptualization of a concept, this paper is also an attempt to conceptualize and define engagement as a unique concept, providing a first step toward an acceptable standard of defining and measuring engagement.

Download Full-text

Factor structure of the SDQ and longitudinal associations from pre-school to pre-teen in New Zealand

PLoS ONE ◽

10.1371/journal.pone.0247932 ◽

2021 ◽

Vol 16 (3) ◽

pp. e0247932

Author(s):

John M. D. Thompson ◽

Rebecca F. Slykerman ◽

Clare R. Wall ◽

Rinki Murphy ◽

Edwin A. Mitchell ◽

...

Keyword(s):

Factor Analysis ◽

New Zealand ◽

Factor Structure ◽

Internal Consistency ◽

Strengths And Difficulties Questionnaire ◽

Self Report ◽

Time Points ◽

Strengths And Difficulties ◽

Over Time

Objective The objective of this study was to assess the validity of the Strengths and Difficulties Questionnaire in a cohort of New Zealand children followed from birth to the age of eleven. The study also aimed to assess the stability of the child data in relation to behavioural outcomes during this period. Methods Children in the Auckland Birthweight Collaborative Study were assessed at approximately 3½, 7 and 11 years of age. At all time-points parents completed the parent version of the Strengths and Difficulties Questionnaire, and the children themselves completed the self-report version at 11 years of age. The validity and internal consistency were assessed using exploratory factor analysis, Cronbach’s alpha, and McDonald’s Omega. Cross tabulations and Chi-square statistics were used to determine whether Total Difficulty scores, as per accepted cut-offs, remained stable over time (between normal and abnormal/borderline categories). Results The factor structure remained relatively consistent across all three time-points, though several questions did not load as per the originally published factor analysis at the earliest age. The internal consistency of the Strengths and Difficulties Questionnaire was good at all time-points and for parent- and child-completed versions. There was low agreement in the total scores between time points. Conclusions The factor analysis shows that the Strengths and Difficulties Questionnaire has a similar factor structure, particularly in older ages, to that previously published and shows good internal consistency. At the pre-school follow up, a larger than expected proportion of children were identified with high scores, particularly in the conduct sub-scale. Children’s behaviour changes over time, with only poor to moderate agreement between those identified as abnormal or borderline over the longitudinal follow up.

Download Full-text

Cross-cultural adaptation and validation of the Danish 10-item Connor-Davidson Resilience Scale among hospital staff

Scandinavian Journal of Public Health ◽

10.1177/1403494817721056 ◽

2017 ◽

Vol 45 (6) ◽

pp. 654-657 ◽

Cited By ~ 7

Author(s):

Line Skjødt Lauridsen ◽

Morten Vejs Willert ◽

Anita Eskildsen ◽

David Høyrup Christiansen

Keyword(s):

Construct Validity ◽

Psychometric Properties ◽

Internal Consistency ◽

Negative Correlation ◽

Change Scores ◽

Cronbach's Alpha ◽

Resilience Scale ◽

Danish Version ◽

Longitudinal Validity

Objectives: The 10-item Connor-Davidson Resilience Scale (CD-RISC 10) is a brief instrument measuring resilience in adults. The scale has shown sound psychometric properties in different populations and cultures. Our objectives were to cross-culturally adapt the CD-RISC 10 into Danish and to establish the psychometric properties of the Danish version in terms of internal consistency, construct validity and longitudinal validity. Methods: The CD-RISC 10 was translated using established guidelines. Employees ( N=272) at hospitals in the Central Denmark Region completed questionnaires at baseline and three months follow-up. Questionnaires included the translated Danish version of the CD-RISC 10 and the 10-item Perceived Stress Scale (PSS-10). Internal consistency was assessed by Cronbach’s alpha and construct and longitudinal validity by correlating CD-RISC 10 and PSS-10 baseline scores and change scores from baseline to follow-up. Results: The Danish CD-RISC 10 provides acceptable internal consistency (Cronbach’s alpha = 0.87). Analysis of construct validity revealed a negative correlation with the PSS-10 at baseline ( r=−.63 [95%CI: −.70; −.55], p<.0001). Analysis of longitudinal validity similarly demonstrated a negative correlation on change scores from baseline to follow-up ( r=−.51 [95%CI: −.62; −.39], p<.0001). Conclusions: The scale has acceptable psychometric properties as an instrument for measuring resilience in a Danish-speaking population.

Download Full-text

Cross-Cultural Adaptation and Psychometric Properties of an Arabic Version of the Western Ontario Shoulder Instability Index (WOSI)

International Journal of Innovative Research in Medical Science ◽

10.23958/ijirms/vol05-i12/1010 ◽

2020 ◽

Vol 5 (12) ◽

pp. 585-588

Author(s):

Dr Aliaa Khaja ◽

Dr Ahmed Bouhamra ◽

Dr Sager Hanna ◽

Dr Ali Maqdis

Keyword(s):

Psychometric Properties ◽

Internal Consistency ◽

Cultural Adaptation ◽

Shoulder Instability ◽

Cross Cultural ◽

Dash Score ◽

Arabic Version ◽

Instability Index ◽

Cross Cultural Adaptation

Background: The Western Ontario Shoulder Instability Index (WOSI) score is a tool that helps with self-assessment of the shoulder’s functional status in patients experiencing instability problems.The purpose of this study was the cross-cultural adaptation of WOSI into Arabic and assessment of its psychometric properties in comparison to a gold standard-questionnaire, namely the Arabic Disability of the Arm, Shoulder and Hand (DASH) score. Material & Methods: 100 patients participated in this survey, tested initially and retest after two months. The internal consistency tests were performed using Cronbach's alpha. Besides, Pearson's Correlation and Standard response mean (SRM) were calculated to estimate criterion validity and responsiveness of the Arabic WOSI in comparison to the Arabic DASH. Results: The Arabic WOSI had a Cronbach's alpha score of 0.85 at the baseline and 0.91 at the follow-up time period. All subscales had an internal consistency greater than 0.7, except Sport/Work (0.69 at follow-up). A strong correlation with Arabic DASH score was observed (r = 0.79 at baseline & 0.87 at Follow-up) which suggested good validity. Also, moderately correlated changes of baseline to follow-up in DASH and WOSI indicated moderate responsiveness. No ceiling and floor effects were observed among the responses. Conclusion: Overall, the Arabic version of WOSI proved to be a good and reliable diagnostic tool for patients with shoulder instability.

Download Full-text

Psychometric Properties and Factor Structure of the German Version of the Clinician-Administered PTSD Scale for DSM-5

Assessment ◽

10.1177/1073191118774840 ◽

2018 ◽

Vol 27 (6) ◽

pp. 1128-1138 ◽

Cited By ~ 8

Author(s):

Meike Müller-Engelmann ◽

Ulrich Schnyder ◽

Clara Dittmann ◽

Kathlen Priebe ◽

Martin Bohus ◽

...

Keyword(s):

Psychometric Properties ◽

Factor Structure ◽

Internal Consistency ◽

Interrater Reliability ◽

Discriminant Validity ◽

German Version ◽

Dsm 5 ◽

Convergent And Discriminant Validity ◽

Ptsd Scale ◽

Best Fit

The Clinician-Administered PTSD Scale (CAPS) is a widely used diagnostic interview for posttraumatic stress disorder (PTSD). Following fundamental modifications in the Diagnostic and Statistical Manual of Mental Disorders, Fifth Edition ( DSM-5), the CAPS had to be revised. This study examined the psychometric properties (internal consistency, interrater reliability, convergent and discriminant validity, and structural validity) of the German version of the CAPS-5 in a trauma-exposed sample ( n = 223 with PTSD; n =51 without PTSD). The results demonstrated high internal consistency (αs = .65-.93) and high interrater reliability (ICCs = .81-.89). With regard to convergent and discriminant validity, we found high correlations between the CAPS severity score and both the Posttraumatic Diagnostic Scale sum score ( r = .87) and the Beck Depression Inventory total score ( r = .72). Regarding the underlying factor structure, the hybrid model demonstrated the best fit, followed by the anhedonia model. However, we encountered some nonpositive estimates for the correlations of the latent variables (factors) for both models. The model with the best fit without methodological problems was the externalizing behaviors model, but the results also supported the DSM-5 model. Overall, the results demonstrate that the German version of the CAPS-5 is a psychometrically sound measure.

Download Full-text