Measurement invariance of a household water insecurity metric in Greater Accra, Ghana: Implications for test-retest reliability

The My Children’s Future Scale (MCFS) measures the support provided by parents for their children’s careers. The aim of this study was to adapt the MCFS to Turkish and examine its psychometric characteristics in a study conducted in the Turkish context. Participants consisted of 280 parents (190 mothers and 90 fathers). The factor structure of the MCFS and measurement invariance across parent gender were examined. The unidimensional factor structure was confirmed and the scale was invariant across parent gender. In addition, the reliability of the MCFS was assessed for internal consistency and test-retest reliability. Cronbach’s alpha and McDonald’s omega coefficients were calculated as .87, and test-retest reliability coefficient as .83. Our findings suggested that the Turkish form of the MCFS can be considered a valid and reliable data collection tool for use in Turkey to measure the support provided by parents for their children’s careers.

Download Full-text

An Empirical Comparison of Four Generalized Trust Scales: Test–Retest Reliability, Measurement Invariance, Predictive Validity, and Replicability

Sociological Methods & Research ◽

10.1177/00491241211055765 ◽

2021 ◽

pp. 004912412110557

Author(s):

Blaine G. Robbins

Keyword(s):

Measurement Invariance ◽

Predictive Validity ◽

Social Trust ◽

Self Report ◽

Generalized Trust ◽

Retest Reliability ◽

Measurement Validation ◽

Test Retest Reliability ◽

Trust Scale ◽

Reliability Measurement

The Stranger Face Trust scale (SFT) and Imaginary Stranger Trust scale (IST) are two new self-report measures of generalized trust that assess trust in strangers—both real and imaginary—across four trust domains. Prior research has established the reliability and validity of SFT and IST, but a number of measurement validation tests remain. Across three separate studies, I assess the test–retest reliability, measurement invariance, predictive validity, and replicability of SFT and IST, with the misanthropy scale (MST) and generalized social trust scale (GST) serving as benchmarks. First, tests of internal consistency, test–retest reliability, and longitudinal measurement invariance established that all four generalized trust scales were acceptably reliable, with SFT and IST yielding greater overall reliability than MST and GST. Second, tests of multiple group measurement invariance revealed that SFT and IST were equivalent across gender, race, education, and age groups, while MST and GST were non-equivalent across the same sociodemographic groups. Third, an investment game established the predictive validity of SFT and MST, with IST and GST yielding poor predictive validity. Fourth, tests of factor structure and measurement invariance indicated that all four generalized trust scales replicated across samples. The present findings bolster the validity, reliability, and measurement equivalence of SFT and IST, while illustrating the compromised validity and measurement non-equivalence of MST and GST. Implications for the measurement of generalized trust are discussed.

Download Full-text

Evidence for the Brief Mysticism Scale: Psychometric Properties, and Moderation and Mediation Effects in Predicting Spiritual Self-identification

10.31234/osf.io/6bx2s ◽

2021 ◽

Author(s):

Heinz Streib ◽

Zhuo Job Chen

Keyword(s):

Psychometric Properties ◽

Measurement Invariance ◽

Psychometric Property ◽

Good Test ◽

Mediation Effects ◽

Retest Reliability ◽

Efficient Measurement ◽

Spiritual Self ◽

Test Retest Reliability ◽

Over Time

How are mystical experiences related to self-rated spirituality? Is the recently developed short 8-item version of Hood’s (1975) Mysticism Scale an efficient measurement? The current study expands evidence for both questions using N = 1,582 American and N = 1,492 German samples measured in three waves, average 4 to 5 years apart. Results show that the 8-item brief M-Scale has good psychometric property evidenced by 1) measurement invariance across time, and 2) good test-retest reliability. Results further demonstrate that the 8-item brief M-Scale 3) moderates the effect of self-rated religiosity on self-rated spirituality, and 4) mediates the prediction of self-rated religiosity on self-rated spirituality over time. We conclude that the M-Scale can be used as a measure for self-attributed spirituality and that the 8-item brief version of the M-Scale can be used, when questionnaire length is an issue.

Download Full-text

Psychometric properties of the perceived stress scale (PSS): measurement invariance between athletes and non-athletes and construct validity

10.7287/peerj.preprints.2268v2 ◽

2016 ◽

Author(s):

Yi-Hsiang Chiu ◽

Frank Jing-Horng Lu ◽

Ju-Han Lin ◽

Chiao-Lin Nien ◽

Ya-Wen Hsu ◽

...

Keyword(s):

Construct Validity ◽

Measurement Invariance ◽

Perceived Stress ◽

Convergent Validity ◽

Student Athletes ◽

Discriminant Validity ◽

Perceived Stress Scale ◽

Retest Reliability ◽

Stress Scale ◽

Test Retest Reliability

Background: Although Perceived Stress Scale (PSS, Cohen, Kamarack, Mermelstein, 1983) has been validated and widely used in many domains, there is still no validation in sports by comparing athletes and non-athletes and examining related psychometric indices. Purpose: The purpose of this study was to examine the measurement invariance of PSS between athletes and non-athletes, and examine construct validity and reliability in the sports contexts. Methods: Study 1 sampled 359 college student-athletes (males = 233; females = 126) and 242 non-athletes (males=124; females=118) and examined factorial structure, measurement invariance and internal consistency. Study 2 sampled 196 student-athletes (males = 139, females = 57, Mage =19.88 yrs, SD = 1.35) and examined discriminant validity and convergent validity of PSS. Study 3 sampled 37 student-athletes to assess test-retest reliability of PSS. Results: Results found that 2-factor PSS-10 fitted the model the best and had appropriate reliability. Also, there was a measurement invariance between athletes and non-athletes; and PSS positively correlated with athletic burnout and life stress but negatively correlated with coping efficacy provided evidence of discriminant validity and convergent validity. Further, the test-retest reliability for PSS subscales was significant (r=.66 and r=.50). Discussion: It is suggested that 2-factor PSS-10 can be a useful tool in assessing perceived stress either in sports or non-sports settings. We suggest future study may use 2-factor PSS-10 in examining the effects of stress on the athletic injury, burnout, and psychiatry disorders.

Download Full-text

Psychometric properties of the Perceived Stress Scale (PSS): measurement invariance between athletes and non-athletes and construct validity

PeerJ ◽

10.7717/peerj.2790 ◽

2016 ◽

Vol 4 ◽

pp. e2790 ◽

Cited By ~ 9

Author(s):

Yi-Hsiang Chiu ◽

Frank Jing-Horng Lu ◽

Ju-Han Lin ◽

Chiao-Lin Nien ◽

Ya-Wen Hsu ◽

...

Keyword(s):

Construct Validity ◽

Measurement Invariance ◽

Perceived Stress ◽

Convergent Validity ◽

Student Athletes ◽

Discriminant Validity ◽

Perceived Stress Scale ◽

Retest Reliability ◽

Stress Scale ◽

Test Retest Reliability

BackgroundAlthough Perceived Stress Scale (PSS, Cohen, Kamarack & Mermelstein, 1983) has been validated and widely used in many domains, there is still no validation in sports by comparing athletes and non-athletes and examining related psychometric indices.PurposeThe purpose of this study was to examine the measurement invariance of PSS between athletes and non-athletes, and examine construct validity and reliability in the sports contexts.MethodsStudy 1 sampled 359 college student-athletes (males = 233; females = 126) and 242 non-athletes (males = 124; females = 118) and examined factorial structure, measurement invariance and internal consistency. Study 2 sampled 196 student-athletes (males = 139, females = 57,Mage = 19.88 yrs, SD = 1.35) and examined discriminant validity and convergent validity of PSS. Study 3 sampled 37 student-athletes to assess test-retest reliability of PSS.ResultsResults found that 2-factor PSS-10 fitted the model the best and had appropriate reliability. Also, there was a measurement invariance between athletes and non-athletes; and PSS positively correlated with athletic burnout and life stress but negatively correlated with coping efficacy provided evidence of discriminant validity and convergent validity. Further, the test-retest reliability for PSS subscales was significant (r = .66 andr = .50).DiscussionIt is suggested that 2-factor PSS-10 can be a useful tool in assessing perceived stress either in sports or non-sports settings. We suggest future study may use 2-factor PSS-10 in examining the effects of stress on the athletic injury, burnout, and psychiatry disorders.

Download Full-text

Test–Retest Reliability and Measurement Invariance of Executive Function Tasks in Young Children With and Without ADHD

Journal of Attention Disorders ◽

10.1177/1087054715627488 ◽

2016 ◽

Vol 24 (13) ◽

pp. 1891-1904 ◽

Cited By ~ 5

Author(s):

Sarah L. Karalunas ◽

Karen L. Bierman ◽

Cynthia L. Huang-Pollock

Keyword(s):

Executive Function ◽

Young Children ◽

Measurement Invariance ◽

Latent Variable ◽

Retest Reliability ◽

Mimic Models ◽

Multiple Indicators ◽

Confirmatory Factor ◽

Two Factors ◽

Test Retest Reliability

Objective: Measurement reliability is assumed when executive function (EF) tasks are used to compare groups or to examine relationships between cognition and etiologic and maintaining factors of psychiatric disorders. However, the test–retest reliabilities of many commonly used EF tasks have rarely been examined in young children. Furthermore, measurement invariance between typically developing and psychiatric populations has not been examined. Method: Test–retest reliability of a battery of commonly used EF tasks was assessed in a group of children between the ages of 5 and 6 years old with ( n = 63) and without ( n = 44) ADHD. Results: Few individual tasks achieved adequate reliability. However, confirmatory factor analysis (CFA) models identified two factors, working memory and inhibition, with test–retest correlations approaching 1.0. Multiple indicators multiple causes (MIMIC) models confirmed configural measurement invariance between the groups. Conclusion: Problems created by poor reliability, including reduced power to detect group differences, index change over time, or to identify relationships with other measures, may be mitigated using latent variable approaches.

Download Full-text

An Empirical Comparison of Four Generalized Trust Scales: Tests-Retest Reliability, Measurement Invariance, Predictive Validity, and Replicability

10.31235/osf.io/9ch5m ◽

2020 ◽

Author(s):

Blaine G Robbins

Keyword(s):

Measurement Invariance ◽

Predictive Validity ◽

Social Trust ◽

Self Report ◽

Generalized Trust ◽

Retest Reliability ◽

Measurement Validation ◽

Test Retest Reliability ◽

Trust Scale ◽

Reliability Measurement

The Stranger Face Trust scale (SFT) and Imaginary Stranger Trust scale (IST) are two new self-report measures of generalized trust that assess trust in strangers—both real and imaginary—across four trust domains. Prior research has established the reliability and validity of SFT and IST, but a number of measurement validation tests remain. Across three separate studies, I assess the test-retest reliability, measurement invariance, predictive validity, and replicability of SFT and IST, with the misanthropy scale (MST) and generalized social trust scale (GST) serving as benchmarks. First, tests of internal consistency, test-retest reliability, and longitudinal measurement invariance established that all four generalized trust scales were acceptably reliable, with SFT and IST yielding greater overall reliability than MST and GST. Second, tests of multiple group measurement invariance revealed that SFT and IST were invariant across gender, race, education, and age-groups, while MST and GST were nonequivalent across the same sociodemographic groups. Third, an investment game established the predictive validity of SFT and—to a lesser extent—MST, with IST and GST yielding poor predictive validity. Fourth, tests of factor structure and measurement invariance indicated that all four generalized trust scales replicated across samples. The present findings bolster the validity, reliability, and measurement invariance of SFT and IST, while illustrating the compromised validity and measurement invariance of MST and GST. Implications for the measurement of generalized trust are discussed.

Download Full-text

Psychometric properties of the perceived stress scale (PSS): measurement invariance between athletes and non-athletes and construct validity

10.7287/peerj.preprints.2268 ◽

2016 ◽

Author(s):

Yi-Hsiang Chiu ◽

Frank Jing-Horng Lu ◽

Ju-Han Lin ◽

Chiao-Lin Nien ◽

Ya-Wen Hsu ◽

...

Keyword(s):

Construct Validity ◽

Measurement Invariance ◽

Perceived Stress ◽

Convergent Validity ◽

Student Athletes ◽

Discriminant Validity ◽

Perceived Stress Scale ◽

Retest Reliability ◽

Stress Scale ◽

Test Retest Reliability

Background: Although Perceived Stress Scale (PSS, Cohen, Kamarack, Mermelstein, 1983) has been validated and widely used in many domains, there is still no validation in sports by comparing athletes and non-athletes and examining related psychometric indices. Purpose: The purpose of this study was to examine the measurement invariance of PSS between athletes and non-athletes, and examine construct validity and reliability in the sports contexts. Methods: Study 1 sampled 359 college student-athletes (males = 233; females = 126) and 242 non-athletes (males=124; females=118) and examined factorial structure, measurement invariance and internal consistency. Study 2 sampled 196 student-athletes (males = 139, females = 57, Mage =19.88 yrs, SD = 1.35) and examined discriminant validity and convergent validity of PSS. Study 3 sampled 37 student-athletes to assess test-retest reliability of PSS. Results: Results found that 2-factor PSS-10 fitted the model the best and had appropriate reliability. Also, there was a measurement invariance between athletes and non-athletes; and PSS positively correlated with athletic burnout and life stress but negatively correlated with coping efficacy provided evidence of discriminant validity and convergent validity. Further, the test-retest reliability for PSS subscales was significant (r=.66 and r=.50). Discussion: It is suggested that 2-factor PSS-10 can be a useful tool in assessing perceived stress either in sports or non-sports settings. We suggest future study may use 2-factor PSS-10 in examining the effects of stress on the athletic injury, burnout, and psychiatry disorders.

Download Full-text

Measuring “Language Access Profiles” in Deaf and Hard-of-Hearing Children With the DHH Language Exposure Assessment Tool

Journal of Speech Language and Hearing Research ◽

10.1044/2020_jslhr-20-00439 ◽

2020 ◽

pp. 1-25

Author(s):

Matthew L. Hall ◽

Stephanie De Anda

Keyword(s):

Cluster Analysis ◽

Exposure Assessment ◽

Hard Of Hearing ◽

Assessment Tool ◽

Communication Mode ◽

Developmental Potential ◽

Language Access ◽

Retest Reliability ◽

Language Exposure ◽

Test Retest Reliability

Purpose The purposes of this study were (a) to introduce “language access profiles” as a viable alternative construct to “communication mode” for describing experience with language input during early childhood for deaf and hard-of-hearing (DHH) children; (b) to describe the development of a new tool for measuring DHH children's language access profiles during infancy and toddlerhood; and (c) to evaluate the novelty, reliability, and validity of this tool. Method We adapted an existing retrospective parent report measure of early language experience (the Language Exposure Assessment Tool) to make it suitable for use with DHH populations. We administered the adapted instrument (DHH Language Exposure Assessment Tool [D-LEAT]) to the caregivers of 105 DHH children aged 12 years and younger. To measure convergent validity, we also administered another novel instrument: the Language Access Profile Tool. To measure test–retest reliability, half of the participants were interviewed again after 1 month. We identified groups of children with similar language access profiles by using hierarchical cluster analysis. Results The D-LEAT revealed DHH children's diverse experiences with access to language during infancy and toddlerhood. Cluster analysis groupings were markedly different from those derived from more traditional grouping rules (e.g., communication modes). Test–retest reliability was good, especially for the same-interviewer condition. Content, convergent, and face validity were strong. Conclusions To optimize DHH children's developmental potential, stakeholders who work at the individual and population levels would benefit from replacing communication mode with language access profiles. The D-LEAT is the first tool that aims to measure this novel construct. Despite limitations that future work aims to address, the present results demonstrate that the D-LEAT represents progress over the status quo.

Download Full-text