The Screen for Child Anxiety Related Emotional Disorders (SCARED): Informant Discrepancy, Measurement Invariance, and Test–Retest Reliability

The psychometric properties of the Revised Child Anxiety and Depression Scale (RCADS-47) are established cross-culturally but lacking for the Greek population. The present study examined RCADS internal consistency and validity (structural and concurrent) in Greek adolescents, and tested measurement invariance across sex and age groups. We recruited 619 secondary school students ( n = 321 females), aged 12–18 years ( n = 318, 12–14-year-olds). Besides RCADS, all students completed Strengths and Difficulties Questionnaire (SDQ), a subsample ( n = 300) completed Screen for Child Anxiety-Related Emotional Disorders (SCARED), whereas a non-overlapping subsample ( n = 219) completed Depression Self-Rating Scale (DSRS). Structural validity was examined with Confirmatory Factor Analysis and measurement invariance was assessed with Multiple Indicators Multiple Causes (MIMIC) modeling. Convergent and divergent validity were examined using Spearman correlations between RCADS subscales and DSRS, SCARED, and SDQ validators. The six-factor model fitted the data best, validating the originally proposed RCADS structure. Three items displayed differential item functioning for sex, another three for age group, and one item for both, albeit with trivial effect sizes ( d < 0.2). Cronbach’s alpha was .94. Convergent and divergent validity were also established. In conclusion, the RCADS is a valid and reliable instrument for assessing anxiety and depression symptoms in Greek adolescents.

Download Full-text

The My Children’s Future Scale: Construct validity, measurement invariance, and reliability in a Turkish sample

Australian Journal of Career Development ◽

10.1177/1038416220941853 ◽

2020 ◽

Vol 29 (3) ◽

pp. 185-195

Author(s):

Erol Esen

Keyword(s):

Data Collection ◽

Construct Validity ◽

Measurement Invariance ◽

Factor Structure ◽

Reliable Data ◽

Data Collection Tool ◽

Psychometric Characteristics ◽

Retest Reliability ◽

Parent Gender ◽

Test Retest Reliability

The My Children’s Future Scale (MCFS) measures the support provided by parents for their children’s careers. The aim of this study was to adapt the MCFS to Turkish and examine its psychometric characteristics in a study conducted in the Turkish context. Participants consisted of 280 parents (190 mothers and 90 fathers). The factor structure of the MCFS and measurement invariance across parent gender were examined. The unidimensional factor structure was confirmed and the scale was invariant across parent gender. In addition, the reliability of the MCFS was assessed for internal consistency and test-retest reliability. Cronbach’s alpha and McDonald’s omega coefficients were calculated as .87, and test-retest reliability coefficient as .83. Our findings suggested that the Turkish form of the MCFS can be considered a valid and reliable data collection tool for use in Turkey to measure the support provided by parents for their children’s careers.

Download Full-text

An Empirical Comparison of Four Generalized Trust Scales: Test–Retest Reliability, Measurement Invariance, Predictive Validity, and Replicability

Sociological Methods & Research ◽

10.1177/00491241211055765 ◽

2021 ◽

pp. 004912412110557

Author(s):

Blaine G. Robbins

Keyword(s):

Measurement Invariance ◽

Predictive Validity ◽

Social Trust ◽

Self Report ◽

Generalized Trust ◽

Retest Reliability ◽

Measurement Validation ◽

Test Retest Reliability ◽

Trust Scale ◽

Reliability Measurement

The Stranger Face Trust scale (SFT) and Imaginary Stranger Trust scale (IST) are two new self-report measures of generalized trust that assess trust in strangers—both real and imaginary—across four trust domains. Prior research has established the reliability and validity of SFT and IST, but a number of measurement validation tests remain. Across three separate studies, I assess the test–retest reliability, measurement invariance, predictive validity, and replicability of SFT and IST, with the misanthropy scale (MST) and generalized social trust scale (GST) serving as benchmarks. First, tests of internal consistency, test–retest reliability, and longitudinal measurement invariance established that all four generalized trust scales were acceptably reliable, with SFT and IST yielding greater overall reliability than MST and GST. Second, tests of multiple group measurement invariance revealed that SFT and IST were equivalent across gender, race, education, and age groups, while MST and GST were non-equivalent across the same sociodemographic groups. Third, an investment game established the predictive validity of SFT and MST, with IST and GST yielding poor predictive validity. Fourth, tests of factor structure and measurement invariance indicated that all four generalized trust scales replicated across samples. The present findings bolster the validity, reliability, and measurement equivalence of SFT and IST, while illustrating the compromised validity and measurement non-equivalence of MST and GST. Implications for the measurement of generalized trust are discussed.

Download Full-text

Evidence for the Brief Mysticism Scale: Psychometric Properties, and Moderation and Mediation Effects in Predicting Spiritual Self-identification

10.31234/osf.io/6bx2s ◽

2021 ◽

Author(s):

Heinz Streib ◽

Zhuo Job Chen

Keyword(s):

Psychometric Properties ◽

Measurement Invariance ◽

Psychometric Property ◽

Good Test ◽

Mediation Effects ◽

Retest Reliability ◽

Efficient Measurement ◽

Spiritual Self ◽

Test Retest Reliability ◽

Over Time

How are mystical experiences related to self-rated spirituality? Is the recently developed short 8-item version of Hood’s (1975) Mysticism Scale an efficient measurement? The current study expands evidence for both questions using N = 1,582 American and N = 1,492 German samples measured in three waves, average 4 to 5 years apart. Results show that the 8-item brief M-Scale has good psychometric property evidenced by 1) measurement invariance across time, and 2) good test-retest reliability. Results further demonstrate that the 8-item brief M-Scale 3) moderates the effect of self-rated religiosity on self-rated spirituality, and 4) mediates the prediction of self-rated religiosity on self-rated spirituality over time. We conclude that the M-Scale can be used as a measure for self-attributed spirituality and that the 8-item brief version of the M-Scale can be used, when questionnaire length is an issue.

Download Full-text

Measurement invariance of a household water insecurity metric in Greater Accra, Ghana: Implications for test-retest reliability

International Journal of Hygiene and Environmental Health ◽

10.1016/j.ijheh.2022.113922 ◽

2022 ◽

Vol 240 ◽

pp. 113922

Author(s):

Melissa N. Sidote ◽

Zachary T. Goodman ◽

Christina L. Paraggio ◽

Raymond A. Tutu ◽

Justin Stoler

Keyword(s):

Measurement Invariance ◽

Water Insecurity ◽

Retest Reliability ◽

Household Water ◽

Test Retest Reliability

Download Full-text

Psychometric properties of the perceived stress scale (PSS): measurement invariance between athletes and non-athletes and construct validity

10.7287/peerj.preprints.2268v2 ◽

2016 ◽

Author(s):

Yi-Hsiang Chiu ◽

Frank Jing-Horng Lu ◽

Ju-Han Lin ◽

Chiao-Lin Nien ◽

Ya-Wen Hsu ◽

...

Keyword(s):

Construct Validity ◽

Measurement Invariance ◽

Perceived Stress ◽

Convergent Validity ◽

Student Athletes ◽

Discriminant Validity ◽

Perceived Stress Scale ◽

Retest Reliability ◽

Stress Scale ◽

Test Retest Reliability

Background: Although Perceived Stress Scale (PSS, Cohen, Kamarack, Mermelstein, 1983) has been validated and widely used in many domains, there is still no validation in sports by comparing athletes and non-athletes and examining related psychometric indices. Purpose: The purpose of this study was to examine the measurement invariance of PSS between athletes and non-athletes, and examine construct validity and reliability in the sports contexts. Methods: Study 1 sampled 359 college student-athletes (males = 233; females = 126) and 242 non-athletes (males=124; females=118) and examined factorial structure, measurement invariance and internal consistency. Study 2 sampled 196 student-athletes (males = 139, females = 57, Mage =19.88 yrs, SD = 1.35) and examined discriminant validity and convergent validity of PSS. Study 3 sampled 37 student-athletes to assess test-retest reliability of PSS. Results: Results found that 2-factor PSS-10 fitted the model the best and had appropriate reliability. Also, there was a measurement invariance between athletes and non-athletes; and PSS positively correlated with athletic burnout and life stress but negatively correlated with coping efficacy provided evidence of discriminant validity and convergent validity. Further, the test-retest reliability for PSS subscales was significant (r=.66 and r=.50). Discussion: It is suggested that 2-factor PSS-10 can be a useful tool in assessing perceived stress either in sports or non-sports settings. We suggest future study may use 2-factor PSS-10 in examining the effects of stress on the athletic injury, burnout, and psychiatry disorders.

Download Full-text

Psychometric Properties of the Screen for Child Anxiety Related Emotional Disorders (SCARED) in Cypriot Children and Adolescents

European Journal of Psychological Assessment ◽

10.1027/1015-5759/a000116 ◽

2013 ◽

Vol 29 (1) ◽

pp. 19-28 ◽

Cited By ~ 12

Author(s):

Cecilia A. Essau ◽

Xenia Anastassiou-Hadjicharalambous ◽

Luna C. Muñoz

Keyword(s):

Psychometric Properties ◽

Children And Adolescents ◽

Emotional Disorders ◽

Separation Anxiety ◽

Community Sample ◽

Child Anxiety ◽

Self Report ◽

Initial Assessment ◽

Confirmatory Factor Analyses ◽

Test Retest Reliability

The Screen for Child Anxiety Related Emotional Disorders (SCARED) is a 41-item self-report questionnaire that measures symptoms of DSM-IV anxiety disorders (panic/somatic, generalized anxiety, separation anxiety, social phobia) and school phobia in children and adolescents. This study examined the psychometric properties of the Greek translation of SCARED in a large community sample of children and adolescents (N = 1,072), aged 12 to 17 years, in the nonoccupied territory of Cyprus. A subsample of these participants (N = 108) was retested an average of 8 weeks after the initial assessment. The SCARED demonstrated high internal consistency (α = .92) and test-retest reliability (r = .84, over 8 weeks). The SCARED total scores correlated significantly with the internalizing factor of the Youth Self-Report, the Columbia Impairment Scale, and with the emotional subscale of the Strength and Difficulty Questionnaire. Confirmatory factor analyses revealed the same five-factor structure as the original SCARED. The SCARED proved to be a reliable and valid measure of anxiety symptoms in the Cypriot context.

Download Full-text

Psychometric properties of the Perceived Stress Scale (PSS): measurement invariance between athletes and non-athletes and construct validity

PeerJ ◽

10.7717/peerj.2790 ◽

2016 ◽

Vol 4 ◽

pp. e2790 ◽

Cited By ~ 9

Author(s):

Yi-Hsiang Chiu ◽

Frank Jing-Horng Lu ◽

Ju-Han Lin ◽

Chiao-Lin Nien ◽

Ya-Wen Hsu ◽

...

Keyword(s):

Construct Validity ◽

Measurement Invariance ◽

Perceived Stress ◽

Convergent Validity ◽

Student Athletes ◽

Discriminant Validity ◽

Perceived Stress Scale ◽

Retest Reliability ◽

Stress Scale ◽

Test Retest Reliability

BackgroundAlthough Perceived Stress Scale (PSS, Cohen, Kamarack & Mermelstein, 1983) has been validated and widely used in many domains, there is still no validation in sports by comparing athletes and non-athletes and examining related psychometric indices.PurposeThe purpose of this study was to examine the measurement invariance of PSS between athletes and non-athletes, and examine construct validity and reliability in the sports contexts.MethodsStudy 1 sampled 359 college student-athletes (males = 233; females = 126) and 242 non-athletes (males = 124; females = 118) and examined factorial structure, measurement invariance and internal consistency. Study 2 sampled 196 student-athletes (males = 139, females = 57,Mage = 19.88 yrs, SD = 1.35) and examined discriminant validity and convergent validity of PSS. Study 3 sampled 37 student-athletes to assess test-retest reliability of PSS.ResultsResults found that 2-factor PSS-10 fitted the model the best and had appropriate reliability. Also, there was a measurement invariance between athletes and non-athletes; and PSS positively correlated with athletic burnout and life stress but negatively correlated with coping efficacy provided evidence of discriminant validity and convergent validity. Further, the test-retest reliability for PSS subscales was significant (r = .66 andr = .50).DiscussionIt is suggested that 2-factor PSS-10 can be a useful tool in assessing perceived stress either in sports or non-sports settings. We suggest future study may use 2-factor PSS-10 in examining the effects of stress on the athletic injury, burnout, and psychiatry disorders.

Download Full-text

Test–Retest Reliability and Measurement Invariance of Executive Function Tasks in Young Children With and Without ADHD

Journal of Attention Disorders ◽

10.1177/1087054715627488 ◽

2016 ◽

Vol 24 (13) ◽

pp. 1891-1904 ◽

Cited By ~ 5

Author(s):

Sarah L. Karalunas ◽

Karen L. Bierman ◽

Cynthia L. Huang-Pollock

Keyword(s):

Executive Function ◽

Young Children ◽

Measurement Invariance ◽

Latent Variable ◽

Retest Reliability ◽

Mimic Models ◽

Multiple Indicators ◽

Confirmatory Factor ◽

Two Factors ◽

Test Retest Reliability

Objective: Measurement reliability is assumed when executive function (EF) tasks are used to compare groups or to examine relationships between cognition and etiologic and maintaining factors of psychiatric disorders. However, the test–retest reliabilities of many commonly used EF tasks have rarely been examined in young children. Furthermore, measurement invariance between typically developing and psychiatric populations has not been examined. Method: Test–retest reliability of a battery of commonly used EF tasks was assessed in a group of children between the ages of 5 and 6 years old with ( n = 63) and without ( n = 44) ADHD. Results: Few individual tasks achieved adequate reliability. However, confirmatory factor analysis (CFA) models identified two factors, working memory and inhibition, with test–retest correlations approaching 1.0. Multiple indicators multiple causes (MIMIC) models confirmed configural measurement invariance between the groups. Conclusion: Problems created by poor reliability, including reduced power to detect group differences, index change over time, or to identify relationships with other measures, may be mitigated using latent variable approaches.

Download Full-text

Psychometric Evaluation of Two Short Versions of the Revised Child Anxiety and Depression Scale

10.21203/rs.2.13956/v2 ◽

2019 ◽

Author(s):

Leonie Klaufus ◽

Eva Verlinden ◽

Marcel van der Wal ◽

Mia Kösters ◽

Pim Cuijpers ◽

...

Keyword(s):

Construct Validity ◽

Internal Consistency ◽

Child Anxiety ◽

Depression Scale ◽

Anxiety And Depression ◽

Structural Validity ◽

Retest Reliability ◽

Test Retest Reliability ◽

Internal Consistency Alpha ◽

Short Versions

Abstract Background Anxiety and depression are common in children and adolescents, which can be detected via self-report questionnaires in non-clinical settings like the school environment. Two short versions of the Revised Child Anxiety and Depression Scale (i.e., RCADS-25 and RCADS-20) seem to be feasible for administering at schools. This study evaluated the psychometric properties of the RCADS-25 and RCADS-20 used as screening instruments for anxiety and depression in a general population of schoolchildren and adolescents. Methods The RCADS-25 was completed by 69,487 schoolchildren and adolescents age 8 to 18 years. The RCADS-25 and RCADS-20 broad anxiety scales are equal (15 items), but there are two versions of the major depressive disorder (MDD) scale: the RCADS-25 MDD scale (10 items) and the RCADS-20 MDD scale (5 items). The three scales were assessed on structural validity, internal consistency, test-retest reliability, criterion validity, and hypotheses about construct validity. Results The RCADS-25/RCADS-20 broad anxiety scale demonstrated a sufficient structural validity (CFI = 0.98, TLI = 0.99, RMSEA = 0.03, SRMR = 0.03), internal consistency (alpha = 0.82), test-retest reliability (ICC = 0.73), criterion validity (AUC = 0.79), and all four hypotheses concerning construct validity were confirmed. The RCADS-25 MDD scale demonstrated a sufficient test-retest reliability (ICC=0.70), and three out of four hypotheses testing construct validity were confirmed. Its structural validity was suspect (CFI = 0.89, TLI = 0.94, RMSEA = 0.09, SRMR = 0.06). The RCADS-20 MDD scale demonstrated a sufficient structural validity (CFI = 0.97, TLI = 0.97, RMSEA = 0.08, SRMR = 0.04) and internal consistency (alpha = 0.72). Two out of four hypotheses concerning construct validity were confirmed. The test-retest reliability (ICC = 0.60) was insufficient. Since both MDD scales showed shortcomings, the shortening of the RCADS-25 MDD scale was re-examined post hoc by principal component and reliability analyses. The result was an MDD scale with seven items. Conclusions The RCADS-25/RCADS-20 broad anxiety scale is valid and reliable for screening schoolchildren and adolescents, but the RCADS-25 and RCADS-20 MDD scales showed shortcomings. An MDD scale of seven items showed acceptable psychometric properties.

Download Full-text