The Strengths Use Scale: Psychometric Properties, Longitudinal Invariance and Criterion Validity

Strengths use is an essential personal resource to consider when designing higher-educational programs and interventions. Strengths use is associated with positive outcomes for both the student (e.g., study engagement) and the university (e.g., academic throughput/performance). The Strengths Use Scale (SUS) has become a popular psychometric instrument to measure strengths use in educational settings, yet its use has been subjected to limited psychometric scrutiny outside of the U.S. Further, its longitudinal stability has not yet been established. Given the wide use of this instrument, the goals of this study were to investigate (a) longitudinal factorial validity and the internal consistency of the scale, (b) its equivalence over time, and (c) criterion validity through its relationship with study engagement over time. Data were gathered at two-time points, 3 months apart, from a sample of students in the Netherlands (n = 360). Longitudinal confirmatory factor analyses showed support for a two-factor model for overall strengths use, comprised of Affinity for Strengths and Strengths Use Behaviors. The SUS demonstrated high levels of internal consistency at both the lower- and upper bound limits at both time points. Further, strict longitudinal measurement invariance was established, which confirmed the instrument's temporal stability. Finally, criterion validity was established through relating strengths use to study engagement at different time stamps. These findings support the use of the SUS in practice to measure strengths use and to track the effectiveness of strengths use interventions within the higher education sector.

Download Full-text

Longitudinal Validation of the Levenson Self-Report Psychopathy (LSRP) Scale in a High-Risk Dutch Community Sample

Assessment ◽

10.1177/1073191120975130 ◽

2020 ◽

pp. 107319112097513

Author(s):

Sophie A. Wissenburg ◽

Carlo Garofalo ◽

Arjan A. J. Blokland ◽

H. Palmen ◽

Martin Sellbom

Keyword(s):

Construct Validity ◽

Factor Structure ◽

Factor Model ◽

Psychopathic Traits ◽

Self Report ◽

Longitudinal Measurement Invariance ◽

Time Points ◽

Longitudinal Measurement ◽

Three Factor ◽

Over Time

The Levenson Self-Report Psychopathy (LSRP) scale is a self-report measure that can be used to assess psychopathic traits in community samples, and recent research suggested that its three-factor model (Egocentricity, Callousness, and Antisocial) has promising psychometric properties. However, no study to date has validated the LSRP in a longitudinal framework. The present study sought to validate the LSRP scale in a longitudinal design using a sample of Dutch emerging adults ( ns = 970 and 693 at time points 1 and 2, respectively). We assessed longitudinal measurement invariance and the stability of psychopathic traits over an 18-month time period, from age 20 to age 21.6. Furthermore, we replicated and extended findings on the factor structure, reliability, and construct validity of the Dutch LSRP scale. Confirmatory factor analysis revealed that the three-factor model fit the data well. Evidence of partial longitudinal measurement invariance was observed, which means that the Dutch translation of the LSRP scale is measuring an equivalent construct (and overall latent factor structure) over time. Psychopathic traits were relatively stable over time. The three LSRP subscales showed largely acceptable levels of internal consistency at both time points and showed conceptually expected patterns of construct validity and predictive validity, with a few notable exceptions.

Download Full-text

TEMPORAL CHANGES IN THE EVALUATION OF POLITICAL PARTIES: DOES EVALUATION OF POLITICAL PARTIES REFLECT ATTITUDINAL IDEOLOGIES?

Primenjena psihologija ◽

10.19090/pp.2017.4.499-520 ◽

1970 ◽

Vol 10 (4) ◽

pp. 499 ◽

Cited By ~ 1

Author(s):

Boban Petrović ◽

Janko Međedović

Keyword(s):

Political Parties ◽

Political Ideology ◽

Temporal Stability ◽

Principal Component ◽

Time Points ◽

Three Samples ◽

Self Interest ◽

Sources Of Authority ◽

Democratic Parties ◽

Over Time

Previous research has shown that since the beginning of the 1990s, differentiation in the ideological orientations of political parties in Serbia has been increased. Comparing three samples, we explored the temporal stability of relations between evaluations of Serbian political parties (DSS, DS, SRS, SPS, SNS, and LDP) and lexically derived ideological dimensions: Traditional and Religious Sources of Authority, Unmitigated Self-Interest, Communal Rationalism, and Subjective Spirituality. We hypothesize that: 1) political parties should be divided into conservative and socio-liberal parties, and this structure should become stable over time; 2) the evaluation of political parties should consistently reflect their political ideology orientation : conservative parties should be related to an indicator of conservative ideology, Traditional Religiosity, while socio-liberal parties should be related to a humanistic ideological orientation, Communal Rationalism. Data was collected in three time-points: 2010 (N = 102), 2014/15 (N = 358) and 2016 (N = 117) from university students in Serbia. In all three studies principal component analyses of evaluations of political parties showed that two components were extracted and interpreted as evaluations of the National-Conservative Parties and Socio-Liberal Parties (in 2010 and 2014), i.e. Democratic parties (in 2016). However, while the structure of evaluations of the National-Conservative Parties remained stable, the congruence of evaluations of the Socio-Liberal Parties decreased over time. Additionally, the results of regression analyses showed that evaluations of the National-Conservative Parties were rooted in Traditional and Religious Sources of Authority and Unmitigated Self-interest, but the percentage of explained variance decreased over time. The evaluations of the Socio-Liberal Parties had much weaker relations with ideological orientations throughout all three time-points. The findings suggested that there was some kind of ‘’ideological crisis’’ in Serbia, primarily regarding the Socio-Liberal Parties and their supporters.

Download Full-text

Factor structure of the SDQ and longitudinal associations from pre-school to pre-teen in New Zealand

PLoS ONE ◽

10.1371/journal.pone.0247932 ◽

2021 ◽

Vol 16 (3) ◽

pp. e0247932

Author(s):

John M. D. Thompson ◽

Rebecca F. Slykerman ◽

Clare R. Wall ◽

Rinki Murphy ◽

Edwin A. Mitchell ◽

...

Keyword(s):

Factor Analysis ◽

New Zealand ◽

Factor Structure ◽

Internal Consistency ◽

Strengths And Difficulties Questionnaire ◽

Self Report ◽

Time Points ◽

Strengths And Difficulties ◽

Over Time

Objective The objective of this study was to assess the validity of the Strengths and Difficulties Questionnaire in a cohort of New Zealand children followed from birth to the age of eleven. The study also aimed to assess the stability of the child data in relation to behavioural outcomes during this period. Methods Children in the Auckland Birthweight Collaborative Study were assessed at approximately 3½, 7 and 11 years of age. At all time-points parents completed the parent version of the Strengths and Difficulties Questionnaire, and the children themselves completed the self-report version at 11 years of age. The validity and internal consistency were assessed using exploratory factor analysis, Cronbach’s alpha, and McDonald’s Omega. Cross tabulations and Chi-square statistics were used to determine whether Total Difficulty scores, as per accepted cut-offs, remained stable over time (between normal and abnormal/borderline categories). Results The factor structure remained relatively consistent across all three time-points, though several questions did not load as per the originally published factor analysis at the earliest age. The internal consistency of the Strengths and Difficulties Questionnaire was good at all time-points and for parent- and child-completed versions. There was low agreement in the total scores between time points. Conclusions The factor analysis shows that the Strengths and Difficulties Questionnaire has a similar factor structure, particularly in older ages, to that previously published and shows good internal consistency. At the pre-school follow up, a larger than expected proportion of children were identified with high scores, particularly in the conduct sub-scale. Children’s behaviour changes over time, with only poor to moderate agreement between those identified as abnormal or borderline over the longitudinal follow up.

Download Full-text

Reliability and Validity of a Bilingual Measure of Religiosity in English and Vietnamese: Preliminary Results from a Pilot Study

Psychological Reports ◽

10.2466/07.17.pr0.108.3.756-762 ◽

2011 ◽

Vol 108 (3) ◽

pp. 756-762 ◽

Cited By ~ 4

Author(s):

Thanh V. Tran ◽

Keith Chan ◽

Thuc-Nhi Nguyen

Keyword(s):

Hurricane Katrina ◽

Internal Consistency ◽

Factor Model ◽

Reliability And Validity ◽

Religious Involvement ◽

Criterion Validity ◽

Vietnamese Americans ◽

Community Based ◽

Confirmatory Factor ◽

Good Internal Consistency

This study reports preliminary psychometric findings for a seven-item religiosity scale in a community-based sample of Vietnamese Americans ages 18 to 83 years ( N = 119; 58% women, 42% men). A bilingual survey was distributed to Vietnamese who were evacuated during Hurricane Katrina and had returned after the disaster. Internal consistency, factorial structure validity, and criterion validity were evaluated on the scale items. The bilingual scale had good internal consistency. While exploratory and confirmatory factor analysis results provided support for a two-factor structure which captured Religious Involvement and Religious Coping, a one-factor model had slightly better fit. Individuals who scored high on the religiosity scale reported a significantly lower score on their stressful experiences during the hurricane, providing evidence of criterion validity.

Download Full-text

A Scale for Measuring Students' Anti-Intellectualism

Psychological Reports ◽

10.2466/pr0.2001.89.2.387 ◽

2001 ◽

Vol 89 (2) ◽

pp. 387-402 ◽

Cited By ~ 15

Author(s):

Martin E. Eigenberger ◽

Karen A. Sealander

Keyword(s):

Social Desirability ◽

Internal Consistency ◽

Factor Model ◽

Five Factor Model ◽

Temporal Stability ◽

Test Reliability ◽

Factorial Structure ◽

Response Set ◽

Unidimensional Structure ◽

Item Scale

Two studies were conducted which report the development and testing of the Student Anti-Intellectualism Scale, designed as a measure of anti-intellectual attitudes in students enrolled in higher education. The first study analyzed an initial 25-item scale to assess internal consistency and factorial structure. The second study examining a final version of the scale was conducted to test reliability and factorial structure, in addition to assessing evidence of construct validity. The second study also assessed temporal stability and social desirability response set. The studies indicated the scale had a fundamentally unidimensional structure and considerable internal consistency and also provided support for the validity of the anti-intellectualism construct. Anti-intellectualism is discussed in the context of personality theory, and suggestions are offered with reference to establishing anti-intellectualism as a trait relative to the five-factor model of personality.

Download Full-text

Latent Markov Factor Analysis: A Mixture Modeling Approach for Evaluating Within- and Between-Person Measurement Model Differences in Intensive Longitudinal Data

10.31234/osf.io/q3dgc ◽

2022 ◽

Author(s):

Leonie V. D. E. Vogelsmeier

Keyword(s):

Factor Analysis ◽

Longitudinal Data ◽

Factor Model ◽

Experience Sampling ◽

Response Styles ◽

New Approach ◽

Intensive Longitudinal Data ◽

Time Points ◽

Depressive Episodes ◽

Over Time

SUMMARY DOCTORAL DISSERTATION: Experience sampling methodology, in which participants are repeatedly questioned via smartphone apps, is popular for studying psychological constructs or “factors” (e.g., well-being or depression) within persons over time. The validity of such studies (e.g., concerning treatment decisions) may be hampered by distortions of the measurement of the relevant constructs due to response styles or item interpretations that change over time and differ across persons. In this PhD project, we developed a new approach to evaluate person- and time-point-specific distortions of the construct measurements, taking into account the specific characteristics of (time-intensive) longitudinal data inherent to experience sampling studies. Our new approach, latent Markov factor analysis, extends mixture factor analysis and clusters time-points within persons according to their factor model. The factor model describes how well items measure the constructs. With the new approach, researchers can examine how many and which factor models underlie the data, for which persons and time-points they apply, and thus which observations are validly comparable. Such insights can also be interesting in their own right. In personalized healthcare, for example, detecting changes in response styles is critical for accurate decisions about treatment allocation over time, as response styles may be related to the occurrence of depressive episodes.

Download Full-text

Psychometric Properties of the Youth Risk Behavior Survey (YRBS) Instrument in Brazilian College Students

Paidéia (Ribeirão Preto) ◽

10.1590/1982-4327e3006 ◽

2020 ◽

Vol 30 ◽

Author(s):

Celina Aparecida Gonçalves Lima ◽

Maria de Fatima Matos Maia ◽

Maria Fernanda Santos Figueiredo Brito ◽

Lucineia de Pinho ◽

Marise Fagundes Silveira

Keyword(s):

College Students ◽

Psychometric Properties ◽

Risk Behavior ◽

Internal Consistency ◽

Convergent Validity ◽

Intraclass Correlation ◽

Temporal Stability ◽

Criterion Validity ◽

Youth Risk Behavior Survey ◽

Youth Risk Behavior

Abstract Considering the importance of health risk behaviors (HRB) and the need for reliable instruments to evaluate them, this study was designed to evaluate the psychometric properties of the items of the Youth Risk Behavior Survey (YRBS) in a sample of 902 college students. Convergent validity, criterion, internal consistency, and temporal stability were evaluated. Higher correlations were observed between use of other drugs and use of marijuana (ρ = 0.537), and alcohol consumption and tobacco use (ρ = 0.418). Criterion validity was observed, with significant differences between domain scores according to gender. Adequate internal consistency, Cronbach’s alpha = 0.770 for overall scale. Most of the domains (82%) showed intraclass correlation coefficient ≥ 0.75 and 64.1% of the items showed kappa ≥ 0.60. The instrument seems to have indicators of criterion validity, internal consistency and temporal stability with satisfactory levels. We recommend that HRB assessment using YRBS should be performed separately on each domain.

Download Full-text

Female sexual function varies over time and is dependent on partner-specific factors: a population-based longitudinal analysis of six sexual function domains

Psychological Medicine ◽

10.1017/s0033291716002488 ◽

2016 ◽

Vol 47 (2) ◽

pp. 341-352 ◽

Cited By ~ 9

Author(s):

A. Gunst ◽

D. Ventus ◽

A. Kärnä ◽

P. Salo ◽

P. Jern

Keyword(s):

Sexual Function ◽

Temporal Stability ◽

Population Based ◽

Single Women ◽

Female Sexual Function ◽

Full Sample ◽

Time Points ◽

Cross Domain ◽

Specific Factors ◽

Over Time

BackgroundMost studies examining female sexual functions (FSFs) have used cross-sectional designs, not allowing for studying temporal stability and possible relationships between different FSFs over time. Our aim was to study these relationships using a longitudinal approach.MethodThe study sample consisted of 2173 Finnish women from two large-scale, population-based data collections 7 years apart. The Female Sexual Function Index was used. Analyses were further conducted separately for women in different relationship constellations.ResultsStandardized autoregressive paths ranged from 0.136 (sexual satisfaction) to 0.447 (orgasm function) in the full sample, suggesting that most of the variance in FSF was explained by something other than previous function. Orgasm, desire and satisfaction were the strongest predictors of other functions in the full sample and for women in the same relationship at both time points (higher orgasm function predicted higher function in other domains; greater sexual desire and satisfaction predicted lower function in other domains), however, with small effects sizes. For single women, orgasm function and sexual desire were the only significant autoregressive paths. Significant unidirectional cross-domain paths were found for women in the same relationship at both time points. One significant cross-domain path, not confirmed as unidirectional, was found for single women.ConclusionsFSFs varied considerably over 7 years and relationship status was of importance when assessing temporal stability and cross-domain effects. Our results advocate tailored psychobehavioural treatment interventions for female sexual dysfunctions that take partner-specific factors into account.

Download Full-text

Propiedades psicométricas de la Escala de Dependencia al Ejercicio–Revisada (EDS-R) en usuarios colombianos de gimnasios (Psychometric properties of the Exercise Dependence Scale –Revised (EDS-R) in Colombian gyms users)

Retos ◽

10.47197/retos.v41i0.86228 ◽

2021 ◽

Vol 41 ◽

pp. 782-790

Author(s):

Jorge Emiro Restrepo ◽

Tatiana Castañeda Quirama ◽

Gina Paula Cuartas Montoya

Keyword(s):

Physical Exercise ◽

Internal Consistency ◽

Convergent Validity ◽

Goodness Of Fit ◽

Discriminant Validity ◽

Factor Model ◽

Criterion Validity ◽

Exercise Dependence ◽

Fit Indices ◽

Dependence Scale

El artículo presenta un estudio psicométrico de la Escala de Dependencia al Ejercicio Físico –Revisada (EDS-R) en usuarios de gimnasios colombianos con el objetivo de analizar su estructura factorial, consistencia interna, confiabilidad de constructo y su validez convergente, discriminante y de criterio. Se realizó una investigación instrumental en la que participaron 515 usuarios de gimnasios (44.3 % hombres y 55.7 % mujeres) con edades entre los 18 y los 58 años (Md = 25; RIQ = 21-30) de la ciudad de Medellín. Se analizó la versión en español (Sicilia & González-Cutre, 2011) de la Escala de Dependencia al Ejercicio Físico –Revisada (EDS-R) (Downs, Hausenblas & Nigg, 2004). Se ejecutaron análisis factoriales confirmatorios y exploratorios. Resultados: la estructura original de la EDS-R mostró una adecuada consistencia interna y validez factorial, confirmada a través de los índices de bondad de ajuste para el modelo de siete dimensiones. El alfa de Cronbach fue de .917 y el coeficiente de dos mitades de Guttman fue de .924. Los índices de bondad de ajuste para la versión original fueron: PCMIN/DF = 2.291; RMR = .091; GFI = .917; AGFI = .886; CFI = .951; RMSEA = .056 (90% CI = .049 - .063); PCLOSE = .093. Sin embargo, los valores de la varianza media extraída, la máxima varianza compartida y la fiabilidad máxima pusieron en evidencia dificultades con la confiabilidad de constructo, la validez convergente y validez discriminante. Tampoco hubo buenos resultados al analizar la validez de criterio. Para analizar si los datos en la muestra se ajustaban mejor a una estructura factorial diferente, se realizó un análisis factorial exploratorio complementario que llegó a un modelo de cinco factores, con los mismos 21 ítems. Sin embargo, la evaluación de la fiabilidad compuesta, validez convergente y validez discriminante arrojó mejores resultados que el modelo de siete factores. Abstract: The article presents a psychometric study of the Physical Exercise Dependence Scale-Revised (EDS-R) in Colombian gym users with the aim of analyzing its factorial structure, internal consistency, construct reliability and its convergent, discriminant and criterion validity. An instrumental research was carried out with the participation of 515 gym users (44.3 % men and 55.7 % women) aged between 18 and 58 years (Md = 25; RIQ = 21-30) from the city of Medellín. The Spanish version (Sicilia & González-Cutre, 2011) of the Physical Exercise Dependence Scale-Revised (EDS-R) (Downs, Hausenblas & Nigg, 2004) was analyzed. Confirmatory and exploratory factor analyses were performed. Results: The original structure of the EDS-R showed adequate internal consistency and factorial validity, confirmed through the goodness-of-fit indices for the seven-dimensional model. Cronbach's alpha was .917 and the Guttman two-half coefficient was .924. The goodness-of-fit indices for the original version were: PCMIN/DF = 2.291; RMR = .091; GFI = .917; AGFI = .886; CFI = .951; RMSEA = .056 (90% CI = .049 - .063); PCLOSE = .093. However, the values for mean variance extracted, maximum shared variance and maximum reliability revealed difficulties with construct reliability, convergent validity and discriminant validity. There were also no-good results when analyzing criterion validity. To analyze whether the data in the sample fit better to a different factor structure, a complementary exploratory factor analysis was performed that arrived at a five-factor model, with the same 21 items. However, the assessment of composite reliability, convergent validity and discriminant validity yielded better results than the seven-factor model.

Download Full-text

Internal Structure of the Spanish Adaptation of the Eating Disorder Inventory-3

European Journal of Psychological Assessment ◽

10.1027/1015-5759/a000087 ◽

2012 ◽

Vol 28 (1) ◽

pp. 25-31 ◽

Cited By ~ 7

Author(s):

Paula Elosua ◽

Alicia López-Jáuregui

Keyword(s):

Eating Disorders ◽

Eating Disorder ◽

Internal Structure ◽

Internal Consistency ◽

Clinical Sample ◽

Temporal Stability ◽

Second Order ◽

Order Structure ◽

Eating Disorder Inventory ◽

High Internal Consistency

In this study the Eating Disorder Inventory-3 was adapted to Spanish and analyzed the internal psychometric properties of the test in a clinical sample of females with eating disorders. The results showed a high internal consistency of the scores as well as high temporal stability. The factor structure of the scale composites was analyzed using confirmatory factor analysis. The results supported the existence of a second-order structure beyond the psychological composites. The second-order factor showed high correlation with the factor related to eating disorders. Overall, the Spanish version of the EDI-3 showed good psychometric qualities in terms of internal consistency, temporal stability and internal structure.

Download Full-text