scholarly journals Construct Validity and Measurement Invariance of Computerized Adaptive Testing: Application to Measures of Academic Progress (MAP) Using Confirmatory Factor Analysis

Author(s):  
Shudong Wang ◽  
Marty McCall ◽  
Hong Jiao ◽  
Gregg Harris
2020 ◽  
Vol ahead-of-print (ahead-of-print) ◽  
Author(s):  
Hakan Görür ◽  
Cem Oktay Güzeller

PurposeThe main purpose of this study is to create a reliable and valid scale to assess the destination food image perceived by the tourists regarding the food in Turkey within the cognitive and affective image component framework. In line with this purpose, both scale development and scale adaptation studies are conducted, and measurement invariance of the scale for gender is analyzed.Design/methodology/approachThis study uses the survey model among quantitative research methods. Scale development processes are used to assess the cognitive image; the construct validity is analyzed with exploratory factor analysis (n = 328), confirmatory factor analysis (n = 425) and convergent and discriminant validity. Scale adaptation processes are followed to assess the affective image, and construct validity is tested with confirmatory factor analysis (n = 425). The reliability of both scales is investigated with Cronbach's alpha. Cochran–Mantel–Haenszel (CMH) analysis is conducted for measurement invariance for gender.FindingsConstruct validity and reliability provided the desired values in all processes. Measurement invariance results proved that the scale does not change according to genders.Research limitations/implicationsThe data obtained in this study have geographical limitations, and the data represent tourists visiting Antalya, an important tourism destination in Turkey.Practical implicationsThe scale will provide concrete information about the destination food image and help practitioners to test the model and develop future strategies for the destination.Originality/valueThis study presents an integrated approach to understanding the destination food image and expands theoretical and empirical evidence by creating a scale that measures both cognitive and affective image component. Scale-invariant shows that there is no item bias for analyzed gender and contributes to generalizability.


2020 ◽  
Author(s):  
Tirth R Bhatta ◽  
Eva Kahana ◽  
Nirmala Lekhak ◽  
Boaz Kahana ◽  
Elizabeth Midlarsky

Abstract Background and Objectives Scholarly research has established the role of altruism in facilitating human cooperation and prosocial behaviors and highlighted its contribution to psychological well-being. Given the health significance of altruistic attitudes and orientations, we developed a valid and reliable measure of this construct that is suitable for use with older adults. Research Design and Methods Based on data from a long-term panel study on adaptation to frailty among older adults (n = 366; mean age = 86 years), we used confirmatory factor analysis to perform construct validation of a five-item Elderly Care Research Center (ECRC) Altruism Scale among older adults (e.g., “Seeing others prosper makes me happy”). Moreover, we examined the invariance of the scale’s factor structure across time and gender using nested models. Results Composite reliability (coefficient omega = 0.78), factor loadings (>0.45 with eigenvalue = 2.84) from exploratory factor analysis, and model fit indices (e.g., comparative fit index = 0.999) from confirmatory factor analysis suggest a single factor, supporting a unidimensional reliable construct of altruistic orientation at baseline. The results provided support for configural, metric, and scalar invariance across time. Findings pertaining to measurement invariance across gender confirmed full configural invariance but only offered support for partial metric, scalar, and residual invariance at baseline. Strong correlations among the altruism scale, salient personality traits, psychological well-being, religiosity, and meaning in life help establish construct validity. Discussion and Implications The availability of a reliable and valid measure of altruistic attitudes enables a comprehensive evaluation of altruism’s influence on later-life health and well-being.


SLEEP ◽  
2021 ◽  
Vol 44 (Supplement_2) ◽  
pp. A201-A202
Author(s):  
Kristina Puzino ◽  
Susan Calhoun ◽  
Allison Harvey ◽  
Julio Fernandez-Mendoza

Abstract Introduction The Sleep Inertia Questionnaire (SIQ) was developed and validated in patients with mood disorders to evaluate difficulties with becoming fully awake after nighttime sleep or daytime naps in a multidimensional manner. However, few data are available regarding its psychometric properties in clinical samples with sleep disorders. Methods 211 patients (43.0±16.4 years old, 68% female, 17% minority) evaluated at the Behavioral Sleep Medicine (BSM) program of Penn State Health Sleep Research & Treatment Center completed the SIQ. All patients were diagnosed using ICSD-3 criteria, with 111 receiving a diagnosis of chronic insomnia disorder (CID), 48 of a central disorder of hypersomnolence (CDH), and 52 of other sleep disorders (OSD). Structural equation modelling was used to conduct confirmatory factor analysis (CFA) of the SIQ. Results CFA supported four SIQ dimensions of “physiological”, “cognitive”, “emotional” and “response to” (RSI) sleep inertia with adequate goodness-of-fit (TLI=0.90, CFI=0.91, GFI=0.85, RMSEA=0.08). Internal consistency was high (α=0.94), including that of its dimensions (physiological α=0.89, cognitive α=0.94, emotional α=0.67, RSI α=0.78). Dimension inter-correlations were moderate to high (r=0.42–0.93, p<0.01), indicating good construct validity. Convergent validity showed moderate correlations with Epworth sleepiness scale (ESS) scores (r=0.38) and large correlations with Flinders fatigue scale (FFS) scores (r=0.65). Criterion validity showed significantly (p<0.01) higher scores in subjects with CDH (69.0±16.6) as compared to those with CID (54.4±18.3) or OSD (58.5±20.0). A SIQ cut-off score ≥57.5 provided a sensitivity/specificity of 0.77/0.65, while a cut-off score ≥61.5 provided a sensitivity/specificity of 0.71/0.70 to identify CDH vs. ESS<10 (AUC=0.76). Conclusion The SIQ shows satisfactory indices of reliability and construct validity in a clinically-diverse sleep disorders sample. Its criterion validity is supported by its divergent association with hypersomnia vs. insomnia disorders, as well as its adequate sensitivity/specificity to identify patients with CDH. The SIQ can help clinicians easily assess the complex dimensionality of sleep inertia and target behavioral sleep treatments. Future studies should confirm the best SIQ cut-off score by including good sleeping controls, while clinical studies should determine its minimal clinically important difference after pharmacological or behavioral treatments. Support (if any):


2018 ◽  
Vol 26 (4) ◽  
pp. 530-536 ◽  
Author(s):  
Ka-Man Leung ◽  
Pak-Kwong Chung ◽  
Tin-Lok Yuen ◽  
Jing Dong Liu ◽  
Donggen Wang

This study evaluated the psychometric properties of a Chinese version of the 24-item Social Environment Questionnaire (SEQ-C). Confirmatory factor analysis was used to examine the factor validity and measurement invariance (Purpose 1) of the SEQ-C in 453 older adults in Hong Kong. Convergent validity (Purpose 2) and test–retest reliability (Purpose 3) were also measured. The results of the confirmatory factor analysis and measurement invariance supported the four-factor structure (representing companionship, encouragement, neighborhood social cohesion, and role models) of the SEQ-C, in a 15-item model that closely fitted the data. The SEQ-C was also found to have acceptable to satisfactory internal consistency, test–retest reliability, composite reliability, and moderate convergent validity in correlating perceived social support. This study showed that the SEQ-C is a suitable means of measuring the social environments of older adults in Hong Kong.


Author(s):  
Wenjie Li ◽  
Linting Zhang ◽  
Ning Jia ◽  
Feng Kong

The Hedonic and Eudaimonic Motives for Activities-Revised scale (HEMA-R) is one of the most extensively used instruments to assess how people pursue well-being. The main aims of the present research were to translate HEMA-R into Chinese and test its construct and predictive validity as well as measurement invariance across gender. In Study 1, we conducted confirmatory factor analysis with data containing 1090 Chinese undergraduates, and replicated the two-factor model which has been found in other studies. Furthermore, the measurement invariance across gender was supported throughout the multi-group confirmatory factor analysis. Study 2 replicated these results and further found the HEMA-R had satisfactory predictive validity in measures of well-being, social support and smartphone addiction. All the findings indicate that the HEMA-R is reliable and valid to measure hedonic and eudaimonic motives, and it could be applied generally across gender in Chinese adults.


1988 ◽  
Vol 4 (1) ◽  
pp. 49-59
Author(s):  
Joanne M. Gardner

The purpose of this study was to examine the construct validity (internal structure) of the Kaufman Assessment Battery for Children (K-ABC) for use with Cantonese, English, and Punjabi speaking Canadians. A confirmatory factor analysis revealed that the sequential/simultaneous theoretical model was supported by the English and Punjabi data: however, the Cantonese data did not exhibit a good fit with this model. Similarly, the results of the exploratory factor analysis suggested that sequential and simultaneous factors could apply when describing the factor structure of the English and Punjabi data, but not for the Cantonese data. Implications of these findings are discussed.


2021 ◽  
Vol 6 (1) ◽  
Author(s):  
Stanley W. Wanjala ◽  
Derrick Ssewanyana ◽  
Patrick N. Mwangala ◽  
Carophine Nasambu ◽  
Esther Chongwo ◽  
...  

Abstract Background There is a dearth of instruments that have been developed and validated for use with children living with HIV under the age of 17 years in the Kenyan context. We examined the psychometric properties and measurement invariance of a short version of the Berger HIV stigma scale administered to perinatally HIV-infected adolescents in a rural setting on the Kenyan coast. Methods A cross-sectional study was conducted among 201 perinatally HIV-infected adolescents aged 12–17 years between November 2017 and October 2018. A short version of the Berger HIV stigma scale (HSS-40) containing twelve items (HSS-12) covering the four dimensions of stigma was evaluated. The psychometric assessment included exploratory factor analysis, confirmatory factor analysis (CFA), and multi-group CFA. Additionally, scale reliability was evaluated as internal consistency by calculating Cronbach’s alpha. Results Evaluation of the reliability and construct validity of the HSS-12 indicated insufficient reliability on three of the four subscales. Consequently, Exploratory Factor Analysis (EFA) was conducted to identify problematic items and determine ways to enhance the scale’s reliability. Based on the EFA results, two items were dropped. The Swahili version of this new 10-item HIV stigma scale (HSS-10) demonstrated excellent internal consistency with a Cronbach alpha of 0.86 (95% confidence interval (CI) 0.84–0.89). Confirmatory Factor Analysis indicated that a unidimensional model best fitted the data. The HSS-10 presented a good fit (overall Comparative Fit Index = 0.976, Tucker Lewis Index = 0.969, Root Mean Square Error of Approximation = 0.040, Standardised Root Mean Residual = 0.045). Additionally, multi-group CFA indicated measurement invariance across gender and age groups at the strict invariance level as ΔCFI was ≤ 0.01. Conclusion Our findings indicate that the HSS-10 has good psychometric properties and is appropriate for evaluating HIV stigma among perinatally HIV-infected adolescents on the Kenyan coast. Further, study results support the unidimensional model and measurement invariance across gender and age groups of the HSS-10 measure.


Sign in / Sign up

Export Citation Format

Share Document