Measurement invariance across educational levels and gender in 12-item Zarit Burden Interview (ZBI) on caregivers of people with dementia

2017 ◽  
Vol 29 (11) ◽  
pp. 1841-1848 ◽  
Author(s):  
Chung-Ying Lin ◽  
Li-Jung Elizabeth Ku ◽  
Amir H. Pakpour

ABSTRACTBackground:The Zarit Burden Interview (ZBI) is a commonly used self-report to assess caregiver burden. A 12-item short form of the ZBI has been developed; however, its measurement invariance has not been examined across some different demographics. It is unclear whether different genders and educational levels of a population interpret the ZBI items similarly. Therefore, this study aimed to examine the measurement invariance of the 12-item ZBI across gender and educational levels in a Taiwanese sample.Methods:Caregivers who had a family member with dementia (n= 270) completed the ZBI through telephone interviews. Three confirmatory factor analysis (CFA) models were conducted: Model 1 was the configural model, Model 2 constrained all factor loadings, Model 3 constrained all factor loadings and item intercepts. Multiple group CFAs and the differential item functioning (DIF) contrast under Rasch analyses were used to detect measurement invariance across males (n= 100) and females (n= 170) and across educational levels of junior high schools and below (n= 86) and senior high schools and above (n= 183).Results:The fit index differences between models supported the measurement invariance across gender and across educational levels (∆ comparative fit index (CFI) = −0.010 and 0.003; ∆ root mean square error of approximation (RMSEA) = −0.006 to 0.004). No substantial DIF contrast was found across gender and educational levels (value = −0.36 to 0.29).Conclusions:The ZBI is appropriate for combined use and for comparisons in caregivers across gender and different educational levels in Taiwan.

2020 ◽  
Vol 3 (2) ◽  
pp. 166-184 ◽  
Author(s):  
Ian Hussey ◽  
Sean Hughes

It has recently been demonstrated that metrics of structural validity are severely underreported in social and personality psychology. We comprehensively assessed structural validity in a uniquely large and varied data set ( N = 144,496 experimental sessions) to investigate the psychometric properties of some of the most widely used self-report measures ( k = 15 questionnaires, 26 scales) in social and personality psychology. When the scales were assessed using the modal practice of considering only internal consistency, 88% of them appeared to possess good validity. Yet when validity was assessed comprehensively (via internal consistency, immediate and delayed test-retest reliability, factor structure, and measurement invariance for age and gender groups), only 4% demonstrated good validity. Furthermore, the less commonly a test was reported in the literature, the more likely the scales were to fail that test (e.g., scales failed measurement invariance much more often than internal consistency). This suggests that the pattern of underreporting in the field may represent widespread hidden invalidity of the measures used and may therefore pose a threat to many research findings. We highlight the degrees of freedom afforded to researchers in the assessment and reporting of structural validity and introduce the concept of validity hacking ( v-hacking), similar to the better-known concept of p-hacking. We argue that the practice of v-hacking should be acknowledged and addressed.


2017 ◽  
Vol 41 (S1) ◽  
pp. S134-S134
Author(s):  
E. Dalbudak ◽  
C. Evren ◽  
B. Evren ◽  
S. Ozen

ObjectiveThe aim of the present study was to evaluate relationship of high PTSD risk with severity of ADHD symptoms while controlling the effect of impulsivity in a sample of university students.MethodParticipants included 271 volunteered university students. Participants were evaluated with the Short Form Barratt Impulsiveness Scale (BIS-11-SF), the Adult ADHD Self-Report Scale (ASRS) and PTSD Checklist Civilian version (PCL-C).ResultsAge and gender did not differed between those with the high PTSD risk (n = 224, 82.7%) and those without (n = 47, 17.3%). BIS-11-SF and subscale scores, other than non-planning impulsivity (which showed no difference), and ASRS scores were higher among those with the high PTSD risk than those without. Severity of ADHD symptoms, particularly inattentiveness (IN) score, predicted the high risk of PTSD, together with the severity of motor impulsivity in a logistic regression model.ConclusionThese findings suggest that the severity of ADHD symptoms is related with the high risk of PTSD, while severity of motor impulsivity may have an effect on this relationship among young adults.Disclosure of interestThe authors have not supplied their declaration of competing interest.


Author(s):  
Chee-Seng Tan ◽  
Siew-May Cheng ◽  
Chin Wen Cong ◽  
Afi Roshezry Bin Abu Bakar ◽  
Edwin Michael ◽  
...  

The 10-item Body Appreciation Scale-2 (BAS-2) is a measurement for individuals to self-report the extent to which they accept and respect their bodies. Although the BAS-2 has been translated into the Malay language and found to have promising qualities, the psychometric characteristics of the English version of BAS-2 remain unknown in the Malaysian context. The present study thus administered the English version BAS-2 and selfie-editing frequency scale to 797 individuals aged 18 to 56 years old in Malaysia. The dataset that was randomly divided into two halves were submitted to exploratory factor analysis and confirmatory factor analysis respectively. Both of the factor analyses consistently support a one-factor model. The Cronbach’s alpha and McDonald omega coefficients were greater than 0.90, indicating that the BAS-2 has good internal consistency. The incremental validity is also evident. A hierarchical multiple regression showed that the BAS-2 score had a positive relationship with selfie-editing frequency after controlling for age and gender. Moreover, the measurement invariance test supported scalar invariance between genders, and an analysis of covariance did not find significant gender differences. Overall, the findings replicate past findings and regularly support the usability of the BAS-2 in the Malaysian context. The implications of the BAS-2 and future directions are also discussed.


Author(s):  
Ian Hussey ◽  
Sean Hughes

Flake, Pek, and Hehman (2017) recently demonstrated that metrics of structural validity are severely underreported in social and personality psychology. We apply their recommendations for the comprehensive assessment of structural validity to a uniquely large and varied dataset (N = 144496 experimental sessions) to investigate the psychometric properties of some of the most widely used self-report measures (k = 15 questionnaires, 26 subscales) in social and personality psychology. When assessed using the modal practice of considering only their internal consistency, 89% of scales appeared to possess good validity. Yet, when validity was assessed comprehensively (via internal consistency, immediate and delayed test-retest reliability, factor structure, and measurement invariance for median age and gender) only 4% demonstrated good validity. Furthermore, the less commonly a test is reported in the literature, the more likely it was to be failed (e.g., measurement invariance). This suggests that the pattern of under- reporting in the field may represent widespread hidden invalidity of the measures we use, and therefore pose a threat to many research findings. We highlight the degrees of freedom afforded to researchers in the assessment and reporting of structural validity. Similar to the better-known concept of p-hacking, we introduce the concept of validity hacking (v-hacking) and argue that it should be acknowledged and addressed.


2021 ◽  
Author(s):  
Jose Antonio Piqueras ◽  
Veronica Vidal-Areanas ◽  
Raquel Falco ◽  
Beatriz Moreno-Amador ◽  
Juan Carlos Marzo ◽  
...  

BACKGROUND The Short Form of the Pediatric Symptom Checklist-Youth Self-Report (PSC-17-Y) is validate measure that assesses psychosocial problems overall and in three major psychopathological domains: internalizing, externalizing, and attention deficit hyperactivity, taking 5-10 minutes to complete. Prior research has established sound psychometric properties of the PSC-17-Y for English-speakers. OBJECTIVE To provide evidence of reliability and structure, convergent and discriminant validity, as well as longitudinal and gender invariance of the PSC-17-Y in a large sample of Spanish adolescents. METHODS Data were collected on 5430 pediatric community, ages 12 to 18 years, who filled out the PSC-17-Y twice during 2019 (7-months interval). We calculated Cronbach’s alpha and omega coefficients to test reliability, Pearson's correlations for convergent (distress) and criterion validity (well-being, quality of life and socioemotional skills), CFA analysis for structure validity, and a multigroup and longitudinal measurement invariance analysis for longitudinal and gender stability. RESULTS Within structural analysis for PSC-17-Y, the CFA analysis supported a correlated three-factor solution, which was also invariant longitudinally and across gender. All three sub-scales showed evidence of reliability with coefficients near or above .70. Moreover, scores of PSC-17-Y sub-scales were positively related with convergent measures and negatively with criterion measures. Normative data for PSC-17-Y are presented in the form of percentiles (75 and 90th). CONCLUSIONS The present work provides the first evidence of reliability and validity of the Spanish version of PSC-17-Y administered over the internet to assess mental health problems among adolescents, maintaining the same domains of the long version.


2021 ◽  
Vol 12 ◽  
Author(s):  
Daniel Hernández-Torrano ◽  
Laura Ibrayeva ◽  
Ainur Muratkyzy ◽  
Natalya Lim ◽  
Yerden Nurtayev ◽  
...  

Positive mental health and well-being are significant dimensions of health, employment, and educational outcomes. Research on positive mental health and well-being requires measurement instruments in native languages for use in local contexts and target populations. This study examines the psychometric properties of the Kazakhstani version of the Mental Health Continuum—Short Form (MHC-SF), a brief self-report instrument measuring emotional, social, and psychological well-being. The sample included 664 University students (425 females) purposefully selected in three higher education institutions in South, East, and Central Kazakhstan. Their average age was 20.25 and ranged from 18 to 43. Participants completed a Kazakhstani version of the MHC-SF online. Statistical analyses to evaluate the structural validity, reliability, and measurement invariance of the Kazakhstani version of the MHC-SF were performed. The results confirmed the superiority of the bifactor model (i.e., three separated factors of well-being plus a general factor of well-being) over the alternatives. However, most of the reliable variance was attributable to the general well-being factor. Subscale scores were unreliable, explaining very low variance beyond that explained by the general factor. The findings demonstrated the measurement invariance of the MHC-SF across gender and age. Overall, these findings support the use of the Kazakhstani version of the MHC-SF to examine a general factor of well-being and the measurement invariance of the instrument across gender and age groups. However, the results advise against the interpretation of the subscale scores as unequivocal indicators of emotional, social, and psychological well-being.


2018 ◽  
Vol 49 (15) ◽  
pp. 2600-2607 ◽  
Author(s):  
Baptiste Pignon ◽  
Hugo Peyre ◽  
Aziz Ferchiou ◽  
Jim van Os ◽  
Bart P. F. Rutten ◽  
...  

AbstractBackgroundThe Community Assessment of Psychic Experiences (CAPE) is a 42-item self-report questionnaire that has been developed and validated to measure the dimensions of psychosis in the general population. The CAPE has a three-factor structure with dimensions of positive, negative and depression. Assessing the cross-national equivalence of a questionnaire is an essential prerequisite before pooling data from different countries. In this study, our aim was to investigate the measurement invariance of the CAPE across different countries.MethodsData were drawn from the European Union Gene-Environment Interaction (EU-GEI) study. Participants (incident cases of psychotic disorder, controls and siblings of cases) were recruited in Brazil, France, Italy, the Netherlands, Spain and UK. To analyse the measurement invariance across these samples, we tested configural invariance (i.e. identical structures of the factors), metric invariance (i.e. equivalence of the factor loadings) and scalar invariance (i.e. equivalence of the thresholds) of the three CAPE dimensions using multigroup categorical confirmatory factor analysis methods.ResultsThe configural invariance model fits well, providing evidence for identical factorial structure across countries. In comparison with the configural model invariance, the fit indices were very similar in the metric and scalar invariance models, indicating that factor loadings and thresholds did not differ across the six countries.ConclusionWe found that, across six countries, the CAPE showed equivalent factorial structure, factor loadings and thresholds. Thus, differences observed in scores between individuals from different countries should be considered as reflecting different levels of psychosis.


Author(s):  
Daniel Brugman ◽  
Marinus G. C. J. Beerthuizen ◽  
Petra Helmond ◽  
Karen S. Basinger ◽  
John C. Gibbs

Abstract. The Sociomoral Reflection Measure – Short Form Objective (SRM-SFO) aims to assess the reasoning and valuing components of moral judgment. A new index for measuring moral reasoning is introduced. The first study assessed construct validity by examining the structure and invariance of moral reasoning and moral value evaluation in community adolescents and adults from The Netherlands ( N = 1,583). Factor analyses supported the unidimensionality of both components. Measurement invariance was found across age groups, gender, and educational levels. Convergent validity was supported by positive relationships between moral reasoning and age in males and between moral reasoning and higher educational levels. Divergent validity was supported by the weak relationship of both components with social desirability and their negative relationship with self-centered orientation and self-reported antisocial/delinquent behavior. The second study included incarcerated juvenile delinquents ( N = 246). Measurement invariance was found for both components across delinquency groups. Furthermore, community participants reporting no antisocial/delinquent behavior showed higher levels on both components than community participants reporting antisocial/delinquent behavior and juvenile delinquents. The SRM-SFO provides acceptable to good psychometric properties for assessing the reasoning and valuing components of moral judgment. Its practical benefits support its use in large-scale research from young adolescence onward.


Sign in / Sign up

Export Citation Format

Share Document