Detecting Measurement Invariance in Organizational Surveys* * The original data upon which this paper is based are available at www.hhpub.com/journals/ejpa

2000 ◽  
Vol 16 (1) ◽  
pp. 20-30 ◽  
Author(s):  
Michael Eid ◽  
Michael Rauber
Keyword(s):  
Measurement Invariance ◽  
Class Size ◽  
Original Data ◽  
Response Styles ◽  
Future Research ◽  
Latent Classes ◽  
Response Scale ◽  
Distribution Models ◽  
Extreme Response ◽  
Organizational Surveys

Summary: The problem of measurement invariance in organizational surveys is discussed, and it is shown how mixture distribution models can be used to detect response styles in organizational surveys. The results of an analysis of a leadership performance scale with the polytomous mixed Rasch model is reported (N = 4578). The results revealed that two latent classes differing in response styles could be detected: One class (size: 71%) using the whole response scale without a strong preference for specific categories and one class (size: 29%) preferring the extreme response categories and avoiding the middle ones. Furthermore, it was shown that the two latent classes differ in demographic and other organizational variables. Finally, the implications of this study for comparing individuals across divisions and organizations as well as for future research on organizational assessment methods are discussed.

scholarly journals The Effect of Extreme Response and Non-extreme Response Styles on Testing Measurement Invariance

2017 ◽  
Vol 8 ◽  
Author(s):  
Min Liu ◽  
Allen G. Harbaugh ◽  
Jeffrey R. Harring ◽  
Gregory R. Hancock
Keyword(s):  
Measurement Invariance ◽  
Response Styles ◽  
Extreme Response

Do Individual Response Styles Matter?

2013 ◽  
Vol 34 (2) ◽  
pp. 69-81 ◽  
Author(s):  
Eunike Wetzel ◽  
Jan R. Böhnke ◽  
Claus H. Carstensen ◽  
Matthias Ziegler ◽  
Fritz Ostendorf
Keyword(s):  
Differential Item Functioning ◽  
Response Style ◽  
Response Styles ◽  
Individual Response ◽  
Latent Classes ◽  
Complete Sample ◽  
Men And Women ◽  
Item Functioning ◽  
Extreme Response ◽  
Different Response

The occurrence of differential item functioning (DIF) for gender indicates that an instrument may not be functioning equivalently for men and women. Aside from DIF effects, item responses in personality questionnaires can also be influenced by response styles. This study analyzes the German NEO-PI-R regarding its differential item functioning for men and women while taking response styles into account. To this end, mixed Rasch models were estimated first to identify latent classes that differed in their response style. These latent classes were identified as extreme response style (ERS) and nonextreme response style (NERS). Then, DIF analyses were conducted separately for the different response styles and compared with DIF results for the complete sample. Several items especially on Neuroticism, Agreeableness, and Conscientiousness facets showed gender-DIF and thus function differentially between men and women. DIF results differed mainly in size between the complete sample and the response style subsamples, though DIF classification was overall consistent between ERS, NERS, and the complete sample.

New Evidence on the Construct Validity of the ASI-3 and the Dimensional Conceptualization of Trait Anxiety Sensitivity From IRT Modeling

2017 ◽  
Vol 33 (3) ◽  
pp. 181-189 ◽  
Author(s):  
Christoph J. Kemper ◽  
Michael Hock
Keyword(s):  
Construct Validity ◽  
Anxiety Sensitivity ◽  
Latent Class ◽  
Dimensional Structure ◽  
Sensitivity Index ◽  
Response Scale ◽  
Established Risk Factor ◽  
Irt Models ◽  
Level Data ◽  
Extreme Response

Abstract. Anxiety Sensitivity (AS) denotes the tendency to fear anxiety-related sensations. Trait AS is an established risk factor for anxiety pathology. The Anxiety Sensitivity Index-3 (ASI-3) is a widely used measure of AS and its three most robust dimensions with well-established construct validity. At present, the dimensional conceptualization of AS, and thus, the construct validity of the ASI-3 is challenged. A latent class structure with two distinct and qualitatively different forms, an adaptive form (normative AS) and a maladaptive form (AS taxon, predisposing for anxiety pathology) was postulated. Item Response Theory (IRT) models were applied to item-level data of the ASI-3 in an attempt to replicate previous findings in a large nonclinical sample (N = 2,603) and to examine possible interpretations for the latent discontinuity observed. Two latent classes with a pattern of distinct responses to ASI-3 items were found. However, classes were indicative of participant’s differential use of the response scale (midpoint and extreme response style) rather than differing in AS content (adaptive and maladaptive AS forms). A dimensional structure of AS and the construct validity of the ASI-3 was supported.

Theorising Sleep Practices and Later Life: Moving to Sheltered Housing

2007 ◽  
Vol 12 (5) ◽  
pp. 214-224 ◽  
Author(s):  
Eileen Fairhurst
Keyword(s):  
Older People ◽  
Textual Analysis ◽  
Later Life ◽  
Original Data ◽  
Sheltered Housing ◽  
Future Research ◽  
Special Issue ◽  
Professional Discourse ◽  
Interesting Topic

This paper re-analyses data from a study of older people and sheltered housing which combined textual analysis of professional discourse with interviews. There were only two references salient to ‘sleep’ in that paper and I offered no analytic comment upon them. At that time, then, sleep as a sociologically interesting topic, was, for me a taken for granted matter. It is that taken for grantedness that is examined here. On being invited to contribute to this special issue, I went back to the original data and interrogated it for ‘sleep’. I realised that, with this different concern, the texts and interviews contained much more about the ‘doing’ of sleep in later life than I had appreciated, especially where, when and how sleeping practices occur. Sleeping ‘upstairs’ or ‘downstairs’, in a single- or double-bed and on which side of the bed were all matters of relevance when older people were considering a move to sheltered housing. Older people's own sleeping practices are contrasted with those offered in texts produced by architects designing sheltered housing. The paper concludes by considering the methodological implications of re-analysing research materials for emerging sociological topics and by giving pointers to future research on sleep practices in later life.

The Use of E-Questionnaires in Organizational Surveys

2013 ◽  
pp. 1-23
Author(s):  
Yael Brender-Ilan ◽  
Gideon Vinitzky
Keyword(s):  
Principal Component Analysis ◽  
Cluster Analysis ◽  
Human Resource ◽  
Principal Component ◽  
Point Of View ◽  
Future Research ◽  
Advantages And Disadvantages ◽  
Organizational Surveys ◽  
Exploratory Survey ◽  
Hr Managers

In recent years, there has been an increase in academic studies that examine the advantages and disadvantages of using e-questionnaires in organizations, but these studies have tended to ignore the potential differences between human resource (HR) managers and HR consultants with regards to using this tool. This chapter examines the use of e-questionnaires from the point of view of both types of practitioners. The study includes a qualitative exploratory survey, as well as a quantitative survey. T-tests, cluster analysis, and principal component analysis are performed and results support the three propositions that are presented. Specifically, it was found that (a) HR consultants and HR managers differ in the ranking of factors they think are important when deciding whether to use e-questionnaires; (b) preference differences exist between HR managers and HR consultants - managers are more directed by organizational constraints than consultants; and (c) the groupings for e-questionnaire preferences, compared to paper-and-pencil questionnaires, are consistent with Caldwell’s (2003) four roles of HR managers. The chapter concludes with implications and suggestions for future research.

Response Biases

2016 ◽  
pp. 349-363 ◽  
Author(s):  
Eunike Wetzel ◽  
Jan R. Böhnke ◽  
Anna Brown
Keyword(s):  
Cultural Differences ◽  
Test Construction ◽  
Response Styles ◽  
Cross Cultural Differences ◽  
Extreme Response ◽  
Trait Level ◽  
Item Responses ◽  
Item Content ◽  
General Response ◽  
Response Biases

Response biases comprise a variety of systematic tendencies of responding to questionnaire items. Response biases exert an influence on item responses in addition to any constructs that the questionnaire is designed to measure and can therefore potentially bias the corresponding trait level estimates. This chapter addresses general response biases that are independent of item content, including response styles (e.g., extreme response style, acquiescence) and rater biases (halo effect, leniency/severity bias), as well as response biases that are related to item content and depend strongly on the context (socially desirable responding). The chapter summarizes research on correlates of response biases and research on inter-individual and cross-cultural differences in engaging in response styles and rater biases. It describes different methods that can be applied at the test construction stage to prevent or minimize the occurrence of response biases. Finally, it depicts methods developed for correcting for the effects of response biases.

scholarly journals THE TRUTH ABOUT AGE DIFFERENCES IN PERFORMANCE ON VARYING LENGTHS OF LIKERT-TYPE TEST ITEMS

2019 ◽  
Vol 3 (Supplement_1) ◽  
pp. S707-S707
Author(s):  
Julie Lutz ◽  
Aaron Metzger ◽  
Nicholas A Turiano ◽  
Rachael Spalding ◽  
Emma Katz ◽  
...  
Keyword(s):  
Older Adults ◽  
Measurement Invariance ◽  
Convergent Validity ◽  
Age Groups ◽  
Community Dwelling ◽  
Self Report ◽  
Amazon Mechanical Turk ◽  
Response Scale ◽  
Type Response ◽  
Scale Length

Abstract Guidelines for self-report assessment with older adults emphasize the use of shorter Likert-type or agree/disagree response formats to reduce cognitive load (e.g., Yesavage et al., 1983). However, these suggestions are not founded on empirical studies directly comparing younger and older adults’ responses on different scales. Thus, the current study tested differential responding on varying Likert-type response scale lengths between younger, middle-aged, and older adults. Participants completed three versions of the International Personality Item Pool (IPIP) Neuroticism scale with 3, 5, and 7 Likert-type response scale lengths in counterbalanced orders with other questionnaires between versions. Six multi-group confirmatory factor analyses (CFAs) assessed measurement invariance across scale lengths and age groups. Invariance of convergent validity networks was also assessed with multi-group CFAs of the associations between the IPIP and measures of depression, anxiety, anger, worry, and affect. The final sample consisted of 835 adults (327 18-44; 279 45-64; and 229 65 or older) via Amazon Mechanical Turk. Measurement invariance was supported in analyses by age within each scale length and by scale length within each age group, indicating that response patterns across all scale lengths and age groups did not significantly differ. Analyses of convergent validity also supported invariance, suggesting that responses across all scale lengths and age groups reflect the same underlying construct. This study indicates that, among community-dwelling adults, shortened response scale lengths do not yield significantly different or more valid responses for older adults compared to younger adults.

scholarly journals Improving the psychometric properties of the dissociative experiences scale (DES-II): a Rasch validation study

2020 ◽  
Vol 20 (1) ◽  
Author(s):  
Aristide Saggino ◽  
Giorgia Molinengo ◽  
Guyonne Rogier ◽  
Carlo Garofalo ◽  
Barbara Loera ◽  
...  
Keyword(s):  
Psychometric Properties ◽  
Measurement Invariance ◽  
High Reliability ◽  
Community Dwelling ◽  
Test Theory ◽  
Self Report ◽  
Theory Approach ◽  
Response Scale ◽  
Dissociative Experiences Scale ◽  
Dissociative Experiences

Abstract Background The Dissociative Experiences Scale-II (DES-II) is a self-report questionnaire that measures dissociative experiences such as derealization, depersonalization, absorption and amnesia. The DES-II has been prevalently used as a screening tool in patients suffering from psychotic disorders or schizophrenia. However, dissociative experiences can also be part of normal psychological life. Despite its popularity, the most problematic aspect of the DES-II is the inconsistency in its factor structure, which is probably due to the tendency to treat ordinal responses as responses on an interval scale, as it is assumed in the Classical Test Theory approach. In order to address issues related to the inconsistency of previous results, the aim of the present study was to collect new psychometric evidence to improve the properties of the DES-II using Rasch analysis, i.e. analyzing the functioning of the response scale. Methods Data were obtained on a sample composed by 320 Italian participants (122 inmates and 198 community-dwelling individuals) and were analyzed with the Rasch model. This model allows the estimation of participants’ level of dissociation, the degree of misfit of each item, the reliability of each item, and their measurement invariance. Moreover, Rasch estimation allows to determine the best response scale, in terms of response modalities number and their discriminant power. Results Three items of the scale had strong misfit. After their deletion, the resulting scale was composed by 25 items, which had low levels of misfit and high reliability, and showed measurement invariance. Participants tended to select more often lower categories of the response scale. Conclusions Results provided new knowledge on the DES-II structure and its psychometric properties, contributing to the understanding and measurement of the dissociation construct.

Heritability of Acquiescence Bias and Item Keying Response Style Associated With the HEXACO Personality Scale

2013 ◽  
Vol 16 (4) ◽  
pp. 790-798 ◽  
Author(s):  
Chester Kam ◽  
Julie Aitken Schermer ◽  
Juliette Harris ◽  
Philip A. Vernon
Keyword(s):  
Environmental Effects ◽  
Response Style ◽  
Response Styles ◽  
Future Research ◽  
Shared Environment ◽  
Personality Measure ◽  
Personality Scale ◽  
Actual Content ◽  
Common Response ◽  
Response Behaviors

The current research investigates the heritability of two of the most common response styles: acquiescence bias (tendency to agree or disagree with survey items regardless of the items’ actual content) and item keying (differential responding related to the use of regular- and reverse-keyed items). We estimated response styles from a common personality measure (HEXACO) and examined the heritability of each with univariate genetics analyses. The results show item keying effect was heritable but acquiescence bias was not. Neither response style was strongly influenced by the shared environment of the twins. Unique environmental effects were found to be substantial for response styles. The current findings have important implications for future research of response behaviors that are often overlooked by behavioral geneticists.

Sign in / Sign up

Export Citation Format

Share Document