scholarly journals Valid and Reliable Measures of Generalized Trust: Evidence from a Nationally Representative Survey and Behavioral Experiment

2022 ◽  
Author(s):  
Blaine G Robbins
Keyword(s):  
Convergent Validity ◽  
Discriminant Validity ◽  
Reliability And Validity ◽  
Self Report ◽  
Behavioral Experiment ◽  
Generalized Trust ◽  
Sociological Knowledge ◽  
Measurement Validation ◽  
Nationally Representative ◽  
Trust Scale

Across the social sciences, generalized trust has been one of the most frequently examined constructs since researchers first introduced measures of it in the 1950s. Despite its significance, there is growing consensus that conventional measures of generalized trust are prone to measurement invalidity and non-equivalence, which places sociological knowledge about generalized trust in serious doubt. In this article, I advance trust research in sociology by (1) refining two new self-report measures of generalized trust—the Stranger Face Trust scale (SFT) and the Imaginary Stranger Trust scale (IST)—and (2) assessing their empirical performance on a nationally representative probability sample (N = 1,264). I compare the reliability and validity of SFT, IST, and traditional measures of generalized trust across a number of measurement validation tests (convergent validity, discriminant validity, known-groups validity, and predictive validity). Results suggest that SFT provides the most accurate and consistent measure of generalized trust. I conclude by discussing the implications of my findings for sociological knowledge.

scholarly journals NCOG-70. RELIABILITY AND VALIDITY OF A NEW SELF-REPORT INDEX OF COGNITIVE CONCERNS IN BRAIN TUMOR PATIENTS

2020 ◽  
Vol 22 (Supplement_2) ◽  
pp. ii145-ii145
Author(s):  
Giuliana Zarrella ◽  
Alice Perez ◽  
Jorg Dietrich ◽  
Michael Parsons
Keyword(s):  
Brain Tumor ◽  
Verbal Memory ◽  
Cognitive Abilities ◽  
Convergent Validity ◽  
Discriminant Validity ◽  
Reliability And Validity ◽  
Cognitive Testing ◽  
Self Report ◽  
Measurement Information ◽  
Patient Reported

Abstract INTRODUCTION Subjective cognitive dysfunction is an important outcome measure in neuro-oncology and may provide additional information beyond performance-based neuropsychological testing. The Functional Assessment of Cancer Therapy-Brain (FACT-Br) is a frequently used quality of life (QoL) measure that includes indices of physical, emotional, social, and neurologic aspects of disease, but does not measure cognitive concerns. This study seeks to develop and validate an index of self-reported cognition derived from existing items on the FACT-Br. METHODS 145 patients (Mage=51.08, Medu=15.63) with heterogeneous brain tumor diagnoses completed neuropsychological evaluation including cognitive testing and self-report measures. Nine FACT-Br items regarding cognition were combined to form the Cognitive Index (CI). Reliability of the CI was measured with Cronbach’s alpha. Concurrent validity was assessed by correlating the CI with the Patient-Reported Outcomes Measurement Information System (PROMIS) Cognitive Abilities-8 or PROMIS Cognitive Concerns-8. Discriminant validity was assessed by correlation of the CI with other FACT-Br indices and the Beck Depression and Anxiety Inventories (BDI, BAI). RESULTS Internal consistency within the CI was high (Cronbach’s a 0.864). The CI correlated strongly with the PROMIS-Abilities (r =.680; p< 0.001) and PROMIS-Concerns (r=.780; p< 0.001) indicating high convergent validity. Moderate correlations were observed between the CI and the physical and functional subscales of the FACT (r=.453 and .555), whereas correlations with the social and emotional functioning subscales were weaker (r=.381 and .325). The FACT-Br-CI correlated strongly with BDI (r=-.622) and more weakly with the BAI (r=-.344). Consistent with prior literature, the CI showed modest correlations with neuropsychological measures, including verbal memory encoding (r=.300), verbal fluency (r=.252) and a composite measure of cognition (r=.249; all p’s< .01). CONCLUSIONS The FACT-Br-CI is a reliable and valid measure of self-reported cognition. Studies that include the FACT-Br could be retrospectively analyzed to assess self-reported cognitive outcomes, enriching the information gained from prior research.

scholarly journals An Empirical Comparison of Four Generalized Trust Scales: Test–Retest Reliability, Measurement Invariance, Predictive Validity, and Replicability

2021 ◽  
pp. 004912412110557
Author(s):  
Blaine G. Robbins
Keyword(s):  
Measurement Invariance ◽  
Predictive Validity ◽  
Social Trust ◽  
Self Report ◽  
Generalized Trust ◽  
Retest Reliability ◽  
Measurement Validation ◽  
Test Retest Reliability ◽  
Trust Scale ◽  
Reliability Measurement

The Stranger Face Trust scale (SFT) and Imaginary Stranger Trust scale (IST) are two new self-report measures of generalized trust that assess trust in strangers—both real and imaginary—across four trust domains. Prior research has established the reliability and validity of SFT and IST, but a number of measurement validation tests remain. Across three separate studies, I assess the test–retest reliability, measurement invariance, predictive validity, and replicability of SFT and IST, with the misanthropy scale (MST) and generalized social trust scale (GST) serving as benchmarks. First, tests of internal consistency, test–retest reliability, and longitudinal measurement invariance established that all four generalized trust scales were acceptably reliable, with SFT and IST yielding greater overall reliability than MST and GST. Second, tests of multiple group measurement invariance revealed that SFT and IST were equivalent across gender, race, education, and age groups, while MST and GST were non-equivalent across the same sociodemographic groups. Third, an investment game established the predictive validity of SFT and MST, with IST and GST yielding poor predictive validity. Fourth, tests of factor structure and measurement invariance indicated that all four generalized trust scales replicated across samples. The present findings bolster the validity, reliability, and measurement equivalence of SFT and IST, while illustrating the compromised validity and measurement non-equivalence of MST and GST. Implications for the measurement of generalized trust are discussed.

scholarly journals Reliability, Validity, and Measurement Invariance of Attitudinal and Social Norm Factors in Math

2018 ◽  
Vol 8 (3) ◽  
pp. 37
Author(s):  
Soung Hwa Walker
Keyword(s):  
Social Norms ◽  
Convergent Validity ◽  
International Student ◽  
Discriminant Validity ◽  
Student Assessment ◽  
Reliability And Validity ◽  
Future Research ◽  
International Student Assessment ◽  
Average Variance ◽  
Nationally Representative

The purpose of the present study was to provide a deeper understanding of multidimensional aspects of attitudes and social norms in educational contexts. Specifically, the current investigation aimed to (1) examine reliability and validity of factorial structure of math attitudes (Affective, Behavioral, and Cognitive factors) and perceived math social norms (Parent, Peer, and Teacher factors) and (2) test whether measurement of all factors would be invariant across national groups. Three nationally representative sample data (USA, Hong Kong, and Singapore; N = 15,019) were obtained from the 2012 Programme of International Student Assessment (PISA) database. High values in Cronbach’s Alpha, Composite Reliability scores, and factor loadings indicated strong internal consistency and convergent validity of all factors. Estimated correlations among latent factors were ranged from small to moderate in value (rs = .21 - .51, ps < .001) and each square root of average variance extracted turned out to be greater than all bivariate correlations (.71 - .85), which supported clear discriminant validity. Furthermore, the results of Multigroup Confirmatory Factor Analysis (MGCFA) yielded that measurement of the six factors was equivalent across national groups at the level of strong (scalar) factorial invariance. Implications for math education and future research are discussed.

The Reliability and Validity of the Psychopathy Checklist–Revised in a Sample of Female Offenders

2002 ◽  
Vol 29 (2) ◽  
pp. 202-231 ◽  
Author(s):  
Jennifer E. Vitale ◽  
Stevens S. Smith ◽  
Chad A. Brinkley ◽  
Joseph P. Newman
Keyword(s):  
Criminal Behavior ◽  
Convergent Validity ◽  
Discriminant Validity ◽  
Female Offenders ◽  
Reliability And Validity ◽  
Self Report ◽  
Behavioral Measures ◽  
Psychopathy Checklist ◽  
Psychopathy Checklist Revised ◽  
Validity Measures

The reliability and validity of the Psychopathy Checklist–Revised (PCL–R) was examined in a sample of 528 nonpsychotic female offenders participating in a study assessing the generalizability of the instrument to females using personality, attitudinal, and laboratory behavioral measures. Results showed good interrater reliability and adequate internal consistency. Correlations with a number of self-report validity measures and previous criminal behavior provide support for the convergent validity of the instrument. A lack of association with general psychopathology provides support for the discriminant validity of the instrument. However, significant correlations with anxiety, negative affectivity, and intelligence run counter to expectations and to findings with male offenders. Furthermore, the low base rate of psychopathy in this sample, relative to base rates among male prisoners, raises the concern that either psychopathy is less prevalent in females than in males or the PCL–R is not adequately assessing the construct in female offenders.

scholarly journals An Empirical Comparison of Four Generalized Trust Scales: Tests-Retest Reliability, Measurement Invariance, Predictive Validity, and Replicability

2020 ◽  
Author(s):  
Blaine G Robbins
Keyword(s):  
Measurement Invariance ◽  
Predictive Validity ◽  
Social Trust ◽  
Self Report ◽  
Generalized Trust ◽  
Retest Reliability ◽  
Measurement Validation ◽  
Test Retest Reliability ◽  
Trust Scale ◽  
Reliability Measurement

The Stranger Face Trust scale (SFT) and Imaginary Stranger Trust scale (IST) are two new self-report measures of generalized trust that assess trust in strangers—both real and imaginary—across four trust domains. Prior research has established the reliability and validity of SFT and IST, but a number of measurement validation tests remain. Across three separate studies, I assess the test-retest reliability, measurement invariance, predictive validity, and replicability of SFT and IST, with the misanthropy scale (MST) and generalized social trust scale (GST) serving as benchmarks. First, tests of internal consistency, test-retest reliability, and longitudinal measurement invariance established that all four generalized trust scales were acceptably reliable, with SFT and IST yielding greater overall reliability than MST and GST. Second, tests of multiple group measurement invariance revealed that SFT and IST were invariant across gender, race, education, and age-groups, while MST and GST were nonequivalent across the same sociodemographic groups. Third, an investment game established the predictive validity of SFT and—to a lesser extent—MST, with IST and GST yielding poor predictive validity. Fourth, tests of factor structure and measurement invariance indicated that all four generalized trust scales replicated across samples. The present findings bolster the validity, reliability, and measurement invariance of SFT and IST, while illustrating the compromised validity and measurement invariance of MST and GST. Implications for the measurement of generalized trust are discussed.

Freemium business model: construct development and measurement validation

2016 ◽  
Vol 26 (3) ◽  
pp. 604-625 ◽  
Author(s):  
Hao-Chen Huang
Keyword(s):  
Standardized Testing ◽  
Business Model ◽  
Convergent Validity ◽  
Discriminant Validity ◽  
Reliability And Validity ◽  
Network Effect ◽  
Internal Quality ◽  
Measurement Tool ◽  
Content Type ◽  
Measurement Validation

Purpose – In recent years, the freemium model is popular with online users in internet markets. Regarding operation, the characteristics of the freemium business model are the focus of all websites and software managers. However, research lacks the literature on the development of the dimensions of the freemium business model and validation of measurement. Hence, the purpose of this paper is to probe into the development of the dimensions of the freemium business model and validate the measurement. Design/methodology/approach – First, by related literature and practical observations, this study reorganizes the characteristics of the freemium business model and develops dimensions and items of the freemium business model to design the items of scale. The development of scale is based on the procedures of standardized testing, including draft, expert consultation, and pretest and test analysis, in order to test the reliability and validity of the scale. This study treated online users as the questionnaire subjects and analyzed 1,016 valid questionnaires. Findings – Regarding empirical analysis, confirmatory factor analysis is conducted to test the internal quality of the model, including composite reliability, convergent validity, and discriminant validity. According to the empirical result, the freemium business model can be divided into basic free tier, two-sided markets, revenue sharing, service convenience, and network effect, which are the key factors of users’ selection of freemium products or services. This study developed 25 items of scale for the freemium business model. Originality/value – Finally, this study plans to develop a scale of the freemium business model, which can serve as an appropriate measurement tool to measure the freemium business model, as well as help websites and software developers to plan or execute the introduction of freemium products and services. Hence, it can develop and design products and services meeting the needs of online consumers. Website and software managers can adjust their products and services to satisfy online users’ needs.

Compensatory Cognitive Strategy Use by Young Adults: A Psychometric Evaluation of Self-Report Measures

Assessment ◽  
2020 ◽  
pp. 107319112098176
Author(s):  
Justin E. Karr
Keyword(s):  
Young Adults ◽  
Convergent Validity ◽  
Discriminant Validity ◽  
Short Form ◽  
Cognitive Strategies ◽  
Reliability And Validity ◽  
Cognitive Strategy ◽  
Strategy Use ◽  
Self Report ◽  
Full Sample

This study examined the reliability and validity of scores from questionnaires assessing compensatory cognitive strategy use by young adults. Participants ( N = 783; 79.6% women; 77.4% White; Age: M = 18.7 ± 0.9 years) completed the Compensatory Cognitive Strategies Scale (CCSS), Metamemory Questionnaire–Strategies (MMQ-S), Neuro-Quality of Life (Neuro-QoL) v2.0 Short Form–Cognitive Function, and Difficulties in Emotion Regulation Scale (DERS). Reliability estimates were acceptable for the CCSS (α = .85) and MMQ-S (α = .86) in the full sample and comparable in subsamples stratified by gender and self-reported mental health conditions. The CCSS and MMQ-S scores showed evidence for convergent validity ( r range: .60 to .70) and discriminant validity in the full sample and subsamples ( r with DERS range: .13 to .33). Greater compensatory strategy use had small-to-medium associations with greater subjective cognitive concerns on the Neuro-QOL for the full sample and subsamples ( r range: −.19 to −.49). The CCSS and MMQ-S scores showed acceptable properties for use with young adults.

Examining the Link Between Character Strengths and Positive and Negative Mental Health Indicators in Iranian Adolescents

2021 ◽  
pp. 073428292110053
Author(s):  
Mahsa Jabbari ◽  
Shahriar Shahidi ◽  
Leili Panaghi ◽  
Mohammad Ali Mazaheri ◽  
Eva Oberle
Keyword(s):  
Convergent Validity ◽  
Character Strengths ◽  
Reliability And Validity ◽  
Health Indicators ◽  
Well Being ◽  
Self Report ◽  
Positive Development ◽  
Response Patterns ◽  
Confirmatory Factor ◽  
Grade Level Differences

Character strengths are an important foundation for positive development and thriving in adolescence. Most research on character strengths has been conducted with youths in Western cultures. We examined character strengths in relation to positive and negative well-being indicators in a sample of Iranian youths. We investigated the reliability and validity of the Farsi version of the Values in Action Inventory of Strengths for Youth (VIA Y-96)—a self-report survey commonly used in Western contexts. Participants were adolescents in Iran ( N = 1,359; 48.5% female; M age = 13.54, SD = 1.00) who completed the VIA Y-96 and questionnaires assessing life satisfaction, positive/negative experiences, depression, anxiety, and stress. We found that reliability coefficients were acceptable for most of the VIA subscales. A confirmatory factor analysis (CFA), as well as a second-order CFA, supported the construct validity of the Farsi VIA Y-96. Correlations between the character strengths and positive and negative well-being indicators supported convergent validity. Measurement invariance for the VIA Y-96 was established in this study comparing boys’ and girls’ response patterns. Sex and grade level differences were found for some of the subscales. Overall, the Farsi VIA Y-96 had acceptable psychometric properties, suggesting that it can be used in research on character strengths with Iranian youths.

scholarly journals Development and Validation of the Adolescent Insomnia Questionnaire

2019 ◽  
Author(s):  
Maggie H Bromberg ◽  
Rocio de la Vega ◽  
Emily F Law ◽  
Chuan Zhou ◽  
Tonya M Palermo
Keyword(s):  
Psychometric Properties ◽  
Convergent Validity ◽  
Discriminant Validity ◽  
Clinical Decision Making ◽  
Clinical Decision ◽  
Parent Report ◽  
Self Report ◽  
Cutoff Score ◽  
Screening Measure ◽  
Brief Screening

Abstract Objective Insomnia is a highly prevalent sleep disorder that is particularly common among adolescents with health conditions. We aimed to develop and validate a brief screening measure of insomnia in adolescents that can be used across clinical and community samples. We hypothesized that we would identify evidence supporting reliability, convergent/discriminant validity, and that we would determine preliminary clinical cutoff scores. Methods A team of experts in behavioral sleep medicine developed a 13-item brief screening measure of insomnia in adolescents (Adolescent Insomnia Questionnaire [AIQ]). We evaluated the psychometric properties of the AIQ in a sample of 315 youth (11–18 years old, Mean = 14.90, SD = 2.02; 64% female) who had chronic pain (n = 37), headache (n = 170), insomnia diagnosed by a sleep specialist (n = 22), or were otherwise healthy (n = 86). Results Using Exploratory and Confirmatory Factor Analysis, we identified three subscales consistent with major diagnostic criteria of insomnia. As expected, the measure showed strong reliability through high internal consistency (α =.91). We also found strong convergent validity through expected positive relationships between the AIQ and self-report measures of sleep disturbance, and divergent validity via weak relationships with parent-report of snoring. Results of receiver operating characteristic (ROC) identified a clinical cutoff score that may assist in clinical decision making. Conclusions We found that the AIQ has sound psychometric properties in a large heterogeneous sample of treatment-seeking youth and youth from the community. The AIQ can quickly screen adolescent insomnia and could address an important clinical need in identifying youth in need of insomnia treatment in pediatric practice settings.

The Reliability and Factorial Validity of a Multidimensional Measure of Psychological Symptomatology in South Africa

1994 ◽  
Vol 24 (4) ◽  
pp. 194-200 ◽  
Author(s):  
John Duckitt
Keyword(s):  
South African ◽  
Reliability And Validity ◽  
Internal Consistency Reliability ◽  
Self Report ◽  
Factorial Validity ◽  
Depression And Anxiety ◽  
Symptom Index ◽  
South Africans ◽  
Good Internal Consistency ◽  
Nationally Representative

The Psychiatric Symptom Index (PSI) was originally developed and validated on a large sample of Chicago residents as a 29-item self-report measure of psychological distress (Ilfeld, 1976b). It has a number of advantages that make it suitable for use in community surveys: relative brevity, a clear and meaningful multidimensional structure, and promising initial evidence for reliability and validity. Since there appears to have been little cross-validation of the PSI, the present study set out to assess its reliability and factorial validity in a large, nationally representative sample of white South Africans ( N = 782). The findings indicated good internal consistency reliability, and excellent factorial validity for the four subscales of anger, anxiety, depression, and cognitive disturbance. The PSI scales also showed an appropriate degree of independence from each other except for depression and anxiety where the intercorrelation was somewhat high. It was found that shorter depression and anxiety subscales would be adequately reliable and reduce this overlap. Finally, normative data are reported for use with white South African samples.

Sign in / Sign up

Export Citation Format

Share Document