The Impact of Item Parceling Ratios and Strategies on the Internal Structure of Assessment Center Ratings

2021 ◽  
Vol 20 (1) ◽  
pp. 1-16
Author(s):  
Anne Buckett ◽  
Jürgen Reiner Becker ◽  
Gert Roodt

Abstract. The aim of the present study was to investigate whether using item parcels instead of single indicators would increase support for the factorial validity of assessment center (AC) ratings in factor analytic applications. Factor analytic analyses of AC ratings are often plagued by poor model fit as well as admissibility and termination problems. In the present study, three purposive item parceling strategies, in conjunction with three parceling approaches (specifying different ratios of indicators to dimensions), were investigated in relation to five confirmatory factor analysis specifications of AC ratings across two AC samples (Sample 1: N = 244; Sample 2: N = 320). The findings were equivocal across the two samples. Nonetheless, a three-parcel approach using a factorial allocation strategy performed better that a one-parcel approach (akin to the postexercise dimension rating).

1979 ◽  
Vol 9 (4) ◽  
pp. 359-375 ◽  
Author(s):  
Tom Hickey ◽  
Stephen M. Bragg ◽  
William Rakowski ◽  
David F. Hultsch

The factor analytic model of the practitioner-oriented Opinions About People (OAP) was tested with a population of gerontological practitioners (N = 558). A confirmatory factor analysis was performed to ascertain the degree-of-fit between these data and the published OAP factor model. After results supported the hypothesis that the two samples differed, a second factor analysis was designed to yield estimates of communalities by a least squares multiple regression technique. This analysis eliminated nine items not warranting inclusion in the instrument, redistributed the factors, and brought out a completely new factor. Finally, to test the hypothesis that attitudes toward aging and the aged are uncorrected, a third analysis was performed in which the six scales of the oblique solution were refactored. The resulting higher order dimensions tended to support this hypothesis.


2015 ◽  
Vol 41 (1) ◽  
Author(s):  
Petrus Nel ◽  
Marieta Du Plessis ◽  
Leon Bosman

Orientation: Given the interest in the importance of emotional intelligence in employees and leaders with regard to performance of their jobs, it is imperative to use reliable and validinstruments to operationalise emotional intelligence.Research purpose: The purpose of the study was to assess the psychometric properties of three different versions of the Rahim emotional intelligence index (EQI), specifically withregard to its factor structure and reliability, using two different samples.otivation for the study: No previous study has investigated which version of the Rahim EQI is the most appropriate for conducting research within South African organisations. Inaddition, the question of whether the Rahim EQI measures a strong general factor has notbeen answered.Research approach, design, and method: A cross-sectional quantitative research design wasused. Two samples were used (n = 470 and n = 308). The first sample completed the 40-itemversion of the Rahim EQI, whilst the second sample completed the 30-item version of the Rahim EQI. The measurement model, representing the 22-item version of the Rahim EQI, was also fitted to both these samples. Confirmatory factor analysis was used to compare thedifferent versions, as well as conceptualisations, of the Rahim EQI.Main findings: The 22-item version of the Rahim EQI exhibited better model fit than the 40-item and 30-item versions. In addition, the bifactor model suggested that the Rahim EQIseems to measure a strong general factor (emotional intelligence) with very little evidence ofthe presence of unique group factors (self-awareness, self-regulation, motivation, empathy and social skills).Practical/managerial implications: Both the reliability and factor structure of the 22-item version of the Rahim EQI have been confirmed. The bifactor structure should inform researchers and practitioners that, in order to understand emotional intelligence, it is better to conceptualise it as a unidimensional construct.Contribution/value-add: In order to identify the most appropriate conceptualisation associated with the Rahim EQI, various goodness-of-fit statistics (e.g. comparative fit indexand root mean square error of approximation) should be consulted. The impact of the removalof items from instruments should be investigated with regard to the accuracy with which the construct is to be measured. The current study has also contributed to the literature byexamining the psychometric properties of the Rahim EQI in a South African sample.


2009 ◽  
Vol 25 (4) ◽  
pp. 239-243
Author(s):  
Roberto Nuevo ◽  
Andrés Losada ◽  
María Márquez-González ◽  
Cecilia Peñacoba

The Worry Domains Questionnaire was proposed as a measure of both pathological and nonpathological worry, and assesses the frequency of worrying about five different domains: relationships, lack of confidence, aimless future, work, and financial. The present study analyzed the factor structure of the long and short forms of the WDQ (WDQ and WDQ-SF, respectively) through confirmatory factor analysis in a sample of 262 students (M age = 21.8; SD = 2.6; 86.3% females). While the goodness-of-fit indices did not provide support for the WDQ, good fit indices were found for the WDQ-SF. Furthermore, no source of misspecification was identified, thus, supporting the factorial validity of the WDQ-SF scale. Significant positive correlations between the WDQ-SF and its subscales with worry (PSWQ), anxiety (STAI-T), and depression (BDI) were found. The internal consistency was good for the total scale and for the subscales. This work provides support for the use of the WDQ-SF, and potential uses for research and clinical purposes are discussed.


Methodology ◽  
2011 ◽  
Vol 7 (4) ◽  
pp. 157-164
Author(s):  
Karl Schweizer

Probability-based and measurement-related hypotheses for confirmatory factor analysis of repeated-measures data are investigated. Such hypotheses comprise precise assumptions concerning the relationships among the true components associated with the levels of the design or the items of the measure. Measurement-related hypotheses concentrate on the assumed processes, as, for example, transformation and memory processes, and represent treatment-dependent differences in processing. In contrast, probability-based hypotheses provide the opportunity to consider probabilities as outcome predictions that summarize the effects of various influences. The prediction of performance guided by inexact cues serves as an example. In the empirical part of this paper probability-based and measurement-related hypotheses are applied to working-memory data. Latent variables according to both hypotheses contribute to a good model fit. The best model fit is achieved for the model including latent variables that represented serial cognitive processing and performance according to inexact cues in combination with a latent variable for subsidiary processes.


2007 ◽  
Author(s):  
Robert Orazem ◽  
Claire Hebenstreit ◽  
Daniel King ◽  
Lynda King ◽  
Arieh Shalev ◽  
...  

2021 ◽  
pp. 001316442110089
Author(s):  
Yuanshu Fu ◽  
Zhonglin Wen ◽  
Yang Wang

Composite reliability, or coefficient omega, can be estimated using structural equation modeling. Composite reliability is usually estimated under the basic independent clusters model of confirmatory factor analysis (ICM-CFA). However, due to the existence of cross-loadings, the model fit of the exploratory structural equation model (ESEM) is often found to be substantially better than that of ICM-CFA. The present study first illustrated the method used to estimate composite reliability under ESEM and then compared the difference between ESEM and ICM-CFA in terms of composite reliability estimation under various indicators per factor, target factor loadings, cross-loadings, and sample sizes. The results showed no apparent difference in using ESEM or ICM-CFA for estimating composite reliability, and the rotation type did not affect the composite reliability estimates generated by ESEM. An empirical example was given as further proof of the results of the simulation studies. Based on the present study, we suggest that if the model fit of ESEM (regardless of the utilized rotation criteria) is acceptable but that of ICM-CFA is not, the composite reliability estimates based on the above two models should be similar. If the target factor loadings are relatively small, researchers should increase the number of indicators per factor or increase the sample size.


2020 ◽  
Vol 5 (2) ◽  
pp. 121
Author(s):  
Nandlia Fauzia ◽  
Sri Maslihah ◽  
Diah Zaleha Wyandini

Penelitian ini bertujuan untuk mengembangkan alat ukur nilai kearifan lokal trisilas yang berasal dari falsafah budaya suku Sunda. Responden pada penelitian ini adalah masyarakat suku Sunda sebanyak 310 orang. Jumlah butir skala nilai kearifan lokal trisilas sebelum diujikan adalah 45 butir, lalu setelah diujikan berjumlah 17 butir. Penelitian ini menggunakan analisis faktor yaitu dengan metode CFA (Confirmatory Factor Analysis) untuk dapat menganalisis validitas konstruk. CFA ini digunakan untuk menguji model faktor alat ukur nilai kearifan lokal Trisilas berdasarkan pada indeks kecocokan parameter model fit. CFA menunjukkan kecocokan model yang baik diantaranya nilai RMSEA sebesar 0.066, nilai GFI sebesar 0.904 serta nilai CFI sebesar 0.890 yang mana seluruh parameter yang digunakan peneliti untuk menganalisis faktor alat ukur nilai kearifan lokal Trisilas telah sesuai dengan kriteria minimum nilai indeks kecocokan suatu model. Kata kunci: Confirmatory Factor Analysis, masyarakat suku Sunda, nilai kearifan lokal trisilas


Sign in / Sign up

Export Citation Format

Share Document