To Reverse Item Orientation or Not to Reverse Item Orientation, That Is the Question

Assessment ◽  
2021 ◽  
pp. 107319112110176
Author(s):  
David M. Dueber ◽  
Michael D. Toland ◽  
John Eric Lingat ◽  
Abigail M. A. Love ◽  
Chen Qiu ◽  
...  
Keyword(s):  
Factor Model ◽  
Measurement Model ◽  
Self Esteem ◽  
Experimental Conditions ◽  
Path Coefficients ◽  
Reliability Estimates ◽  
Item Functioning ◽  
Influence Measurement ◽  
Item Orientation ◽  
Amazon's Mechanical Turk

To investigate the effect of using negatively oriented items, we wrote semantic reversals of the items in the Rosenberg Self Esteem Scale, UCLA Loneliness Scale, and the General Belongingness Scale and used them to create four experimental conditions. Participants ( N = 2,019) were recruited through Amazon’s Mechanical Turk. Data were assessed for dimensionality, item functioning, instrument properties, and associations with other variables. Regarding dimensionality, although a two-factor model (positively vs. negatively oriented factors) exhibits better fit than a unidimensional model across all conditions, bifactor indices were used to argue that a unidimensional interpretation of the data can be employed. With respect to item functioning, factor loadings were found to be nearly invariant across conditions, but thresholds were not. Concerning instrument properties, inclusion of negatively oriented items results in lower mean scores and higher score variances. Instruments with both positively and negatively oriented items demonstrated lower reliability estimates than those with only one orientation. For associations with other variables, path coefficients in a model where loneliness mediates the effects of belongingness on life satisfaction and self-esteem were found to vary across conditions. Findings suggest that negatively oriented items have minor impact on instrument quality, but influence measurement model and path coefficients.

scholarly journals Inventář tendence k vině a hanbě (ITVAH): pilotní studie

E-psychologie ◽  
2020 ◽  
Vol 14 (3) ◽  
pp. 49-65
Author(s):  
Patrik Rudolf ◽  
◽  
Petra Hubatková ◽  
David Kremeník ◽  
Vít Kratochvíl ◽  
...  
Keyword(s):  
Pilot Study ◽  
Factor Model ◽  
Negative Relationship ◽  
Measurement Model ◽  
Self Esteem ◽  
Affective Component ◽  
Self Evaluation ◽  
Self Forgiveness ◽  
Behavioural Reaction ◽  
Factor Measurement

This paper constitutes a pilot study of a novel measure for assessing proneness to guilt and proneness to shame, Inventář tendence k vině a hanbě (ITVAH, Inventory of Proneness to Guilt and Shame). ITVAH is a scenario-based method distinguishing affective and behavioural components of guilt and shame and also considering the private or public experience of guilt and shame, respectively. Two items (affective and behavioural reaction) were created for each of the 16 scenarios, resulting in total of 32 items. A four-factor measurement model was assumed – Negative behaviour evaluation (NBE), Reparation, Negative self-evaluation (NSE), Withdrawal. Next, we assumed negative correlations of NSE and Withdrawal with self-esteem and self-forgiveness and positive correlations of NBE and Reparation with self-forgiveness. The pilot study was carried out on 249 Czech-speaking adults (67 % women, aged 18–75, Md = 22). An ordinal confirmatory factor analysis with residual covariances between items connected to the same scenarios was conducted. The hypothesized four-factor model was found acceptable. However, we found limited evidence for the hypothesized relationships with self-esteem and self-forgiveness – in contrast to theoretical expectations we found a medium-strong negative relationship between self-forgiveness and affective component of guilt. For further use of the measure in the Czech and Slovak environment it is necessary to assess additional evidence of construct validity and concurrent validity with The Test of Self-Conscious Affect-3 (TOSCA-3).

Question Wording Effects in the Assessment of Global Self-Esteem

2000 ◽  
Vol 16 (1) ◽  
pp. 13-19 ◽  
Author(s):  
Martin Dunbar ◽  
Graeme Ford ◽  
Kate Hunt ◽  
Geoff Der
Keyword(s):  
Reading Ability ◽  
Factor Model ◽  
Self Esteem ◽  
Reading Scores ◽  
Poor Reading ◽  
Method Effect ◽  
Two Samples ◽  
Positive Item ◽  
Method Effects ◽  
Best Fit

Summary: Marsh (1996) produced evidence that method effects associated with negatively worded items might be responsible for the results of earlier factor analytic studies that reported finding positive and negative self-esteem factors in the Rosenberg Global self-esteem scale ( Rosenberg, 1965 ). He analyzed data collected from children using a 7-item self-esteem measure. This report details attempts to replicate Marsh 's analysis in data collected from two samples of adults who completed the full 10-item Global Self-Esteem (GSE) scale. The results reported here are similar to those given by Marsh in so much as a correlated uniquenesses model produced a superior fit to the data than the simple one factor model (without correlated uniquenesses) or the often reported two factor (positive and negative self-esteem) model. However, whilst Marsh reported that the best fit was produced by allowing negative item uniquenesses to correlate with each other, the model that produced the best fit to these data was one that contained correlated positive item uniquenesses. Supporting his claim that differential responding to negative and positive self-esteem items reflects a method effect associated with reading ability, Marsh also showed that factors associated with negative and positive items were most distinct among children who had poor reading scores. We report a similar effect among a sample of older adults where the correlation between these factors was compared across two groups who were selected according to their scores on a test of verbal reasoning.

Validation of the Short Dark Triad in a German Sample

2020 ◽  
pp. 1-12
Author(s):  
Caroline Wehner ◽  
Ulrike Maaß ◽  
Marius Leckelt ◽  
Mitja D. Back ◽  
Matthias Ziegler
Keyword(s):  
Sensation Seeking ◽  
Factor Model ◽  
Structural Models ◽  
Self Esteem ◽  
Dark Triad ◽  
Fit Indices ◽  
Nomological Network ◽  
Competitive Test ◽  
Three Factor ◽  
Behavioral Criteria

Abstract. The structure, correlates, and assessment of the Dark Triad are widely discussed in several fields of psychology. Based on the German version of the Short Dark Triad (SDT), we add to this by (a) providing a competitive test of existing structural models, (b) testing the nomological network, and (c) proposing an ultrashort 9-item version of the SDT (uSDT). A sample of N = 969 participants provided data on the SDT and a range of further measures. Our competitive test of five structural models revealed that fit indices and nomological network assumptions were best met in a three-factor model, with separate factors for psychopathy, Machiavellianism, and narcissism. The results provided an extensive overview of the raw, unique, and shared associations of Dark Triad dimensions with narcissism facets, sadism, impulsivity, self-esteem, sensation seeking, the Big Five, maladaptive personality traits, sociosexual orientation, and behavioral criteria. Finally, the uSDT exhibited satisfactory psychometric properties. The highest overlap in expected relations between SDT and uSDT, and convergent and discriminant measures was also found for the three-factor model. Our study underlines the utility of a three-factor model of the Dark Triad, extends findings on its nomological network, and provides an ultrashort instrument.

STEREOTYPE THREAT AND STEREOTYPE LIFT: THE CASE OF 10 YEAR OLD GIRLS AND BOYS

2016 ◽  
Vol 12 (4) ◽  
pp. 21-32
Author(s):  
Anna Kwiatkowska ◽  
Małgorzata Mróz
Keyword(s):  
Stereotype Threat ◽  
Cognitive Performance ◽  
Significant Interaction ◽  
Self Esteem ◽  
The Self ◽  
Experimental Conditions ◽  
Significant Interaction Effect ◽  
Significant Drop ◽  
Stereotype Lift ◽  
And Performance

The aim of this study was to examine the effects of stereotypical and counter-stereotypicalinformation on the self-esteem and cognitive performance of 10-year-old children. Our sampleconsisted of 37 girls and 37 boys. Children were presented with 10 “mathematical” puzzles in threeexperimental conditions: stereotypical (boys are better), counter-stereotypical (girls are better), andthe control condition (no particular information). Self-esteem was measured using a non-verbaltask. The results showed a significant interaction effect of “condition x sex” on self-esteem andperformance. Girls revealed no significant differences between control and experimental conditions,while boys showed a significant drop in self-esteem and performance in the counter-stereotypicalcondition as compared to the control condition and a significant lift in self-esteem and performancein the stereotypical condition as compared to the control condition.

scholarly journals How Downward and Upward Comparisons on Facebook Influence Grandiose and Vulnerable Narcissists’ Self-Esteem—A Priming Study

2021 ◽  
Vol 11 (3) ◽  
pp. 39
Author(s):  
Phillip Ozimek ◽  
Hans-Werner Bierhoff ◽  
Elke Rohmann
Keyword(s):  
Social Networking Sites ◽  
Online Survey ◽  
Social Comparisons ◽  
Past Research ◽  
Self Esteem ◽  
Self Report ◽  
Control Group ◽  
Experimental Conditions ◽  
Vulnerable Narcissism ◽  
And Control

Past research showed that social networking sites represent perfect platforms to satisfy narcissistic needs. The present study aimed to investigate how grandiose (GN) and vulnerable narcissism (VN) as well as social comparisons are associated with Facebook activity, which was measured with a self-report on three activity dimensions: Acting, Impressing, and Watching. In addition, the state self-esteem (SSE) was measured with respect to performance, social behavior, and appearance. One hundred and ten participants completed an online survey containing measures of SSE and Facebook activity and a priming procedure with three experimental conditions embedded in a social media context (upward comparison, downward comparison, and control group). Results indicated, as expected, that high VN was negatively associated with SSE on each subscale and the overall score. In addition, it was found that VN, but not GN, displayed positive associations with frequency of Facebook activities. Finally, it was proposed and confirmed that VN in interaction with the priming of downward comparisons negatively affected SSE. The conclusion drawn is that VN represents a key variable for the prediction of self-esteem as well as for the frequency of Facebook activity.

scholarly journals Development and Validation of the Yonsei Lifestyle Profile-Satisfaction (YLP-S) Using the Rasch Measurement Model

2021 ◽  
Vol 58 ◽  
pp. 004695802110176
Author(s):  
Kang-Hyun Park ◽  
Ickpyo Hong ◽  
Ji-Hyuk Park
Keyword(s):  
Older Adults ◽  
Rasch Analysis ◽  
Age Groups ◽  
Internal Validity ◽  
Measurement Model ◽  
Limited Evidence ◽  
Fit Statistics ◽  
Item Functioning ◽  
Development And Validation ◽  
The Rasch Model

Lifestyle plays an important role in determining health and vitality among older adults. However, there is limited evidence regarding lifestyle assessment. This study examined the psychometric properties of the Yonsei Lifestyle Profile-Satisfaction (YLP-S). The participants in the study included 156 older adults. Rasch analysis was used to test unidimensionality, fit statistics, and the precision of the YLP-S. The YLP-S demonstrated a unidimensional measurement construct, and 18 items fit the Rasch model. The YLP-S illustrated reasonable precision (person strata = 5.37). Only 4 items showed differential item functioning by sex or age groups. The findings indicate that the YLP-S demonstrated sound internal validity and can be used by health professionals to measure the multifaceted lifestyle of older adults.

The Fear of COVID-19 Scale: A Reliability Generalization Meta-Analysis

Assessment ◽  
2021 ◽  
pp. 107319112199416
Author(s):  
Desirée Blázquez-Rincón ◽  
Juan I. Durán ◽  
Juan Botella
Keyword(s):  
Predictive Model ◽  
Meta Analysis ◽  
Classical Test Theory ◽  
Measurement Model ◽  
Rasch Measurement ◽  
Test Theory ◽  
Reliability Estimate ◽  
Reliability Generalization ◽  
Reliability Estimates ◽  
Total Variability

A reliability generalization meta-analysis was carried out to estimate the average reliability of the seven-item, 5-point Likert-type Fear of COVID-19 Scale (FCV-19S), one of the most widespread scales developed around the COVID-19 pandemic. Different reliability coefficients from classical test theory and the Rasch Measurement Model were meta-analyzed, heterogeneity among the most reported reliability estimates was examined by searching for moderators, and a predictive model to estimate the expected reliability was proposed. At least one reliability estimate was available for a total of 44 independent samples out of 42 studies, being that Cronbach’s alpha was most frequently reported. The coefficients exhibited pooled estimates ranging from .85 to .90. The moderator analyses led to a predictive model in which the standard deviation of scores explained 36.7% of the total variability among alpha coefficients. The FCV-19S has been shown to be consistently reliable regardless of the moderator variables examined.

Measuring Parental Barriers to Childhood Immunizations: The Development and Validation of the Searching for Hardships and Obstacles to Shots (SHOTS) Instrument

2010 ◽  
Vol 18 (1) ◽  
pp. 26-35 ◽  
Author(s):  
Victoria P. Niederhauser
Keyword(s):  
Factor Model ◽  
Item Analysis ◽  
Temporal Stability ◽  
Psychometric Evaluation ◽  
Cross Sectional Study ◽  
Design Data ◽  
Cross Sectional ◽  
Childhood Immunizations ◽  
Reliability Estimates ◽  
Parental Barriers

There is a plethora of literature on barriers to immunizations; however, these studies lack standardization of measurement. The aim of this study was to develop and establish an initial psychometric evaluation of an instrument to measure parental barriers to childhood immunizations. This was a cross-sectional study design. Data analysis included descriptive statistics, reliability estimates, item analysis, and factor analysis. Six hundred and fifty-five participants completed the survey. The Searching for Hardships and Obstacles to Shots instrument was developed with 60 items and reduced to 23 items thorough multiple statistical computations; the best factor model was a three-factor solution (Access to Shots, Concerns About Shots, and Importance of Shots) with a total variance explained of 59.4%. The Cronbach’s alpha reliability estimates ranged from .86 to .93, and temporal stability was adequate (r = .85). This study supports exceptional initial psychometric properties of an instrument to measure parental barriers to childhood immunizations.

Underlying Common Factors of Adolescent Problem Behaviors

2002 ◽  
Vol 29 (2) ◽  
pp. 161-182 ◽  
Author(s):  
Lening Zhang ◽  
John W. Welte ◽  
William F. Wieczorek
Keyword(s):  
Problem Behaviors ◽  
Latent Variable ◽  
Factor Model ◽  
Common Factor ◽  
Measurement Model ◽  
First Order ◽  
Adolescent Problem Behaviors ◽  
The Common ◽  
Order Factor ◽  
Second Order Factor Analysis

The Buffalo Longitudinal Study of Young Men was used to address the possibility of a common factor underlying adolescent problem behaviors. First, a measurement model with a single first-order factor was compared to a model with three separate correlated first-order factors. The three-factor model was better supported, making it logical to conduct a second-order factor analysis, which confirmed the logic. Second, a substantive model was estimated in each of two waves with psychopathic state as the common factor predicting drinking, drug use, and delinquency. Psychopathic state was stable across waves. The theory that a single latent variable accounts for large covariance among adolescent problem behaviors was supported.

Sign in / Sign up

Export Citation Format

Share Document