scholarly journals An Application of Reliability Estimation in Longitudinal Designs Through Modeling Item-Specific Error Variance

2019 ◽  
Vol 79 (6) ◽  
pp. 1038-1063
Author(s):  
Georgios D. Sideridis ◽  
Ioannis Tsaousis ◽  
Abdullah Al-Sadaawi
Keyword(s):  
Internal Consistency ◽  
Population Distribution ◽  
Composite Index ◽  
Error Variance ◽  
Internal Consistency Reliability ◽  
Reliability Estimation ◽  
Reliability Estimates ◽  
Percentage Improvement ◽  
Confirmatory Factor ◽  
The Difference

The purpose of the present study was to apply the methodology developed by Raykov on modeling item-specific variance for the measurement of internal consistency reliability with longitudinal data. Participants were a randomly selected sample of 500 individuals who took on a professional qualifications test in Saudi Arabia over four different occasions. Data were analyzed by use of confirmatory factor analysis, and item error variance was corrected for item specificity. The estimation of reliability involved composite index omega. Results indicated that the initially low and unacceptable levels of internal consistency reliability approached acceptable levels after accounting for item-specific variance. Findings were verified by testing whether the difference estimates of internal consistency reliability deviated from a zero-mean distribution using 10,000 replicated samples assuming a known (symmetric) or unknown (asymmetric) population distribution of the difference reliability coefficients. Percentage improvement reliability estimates indices were also estimated along with their 95% confidence intervals. Two appendices provide annotated Mplus syntax files for future use.

The Structure of Thalbourne's Brief Manic-Depressive Scale

2010 ◽  
Vol 106 (3) ◽  
pp. 901-904 ◽  
Author(s):  
James R. Rogers ◽  
David Lester
Keyword(s):  
Factor Analysis ◽  
Confirmatory Factor Analysis ◽  
Internal Consistency ◽  
Internal Consistency Reliability ◽  
Clinical Use ◽  
Manic Depressive ◽  
Reliability Estimates ◽  
Confirmatory Factor ◽  
Psychometric Analyses ◽  
Cast Doubt

Data from 1,376 respondents on a 1994 scale to measure depressive and manic experiences devised by Thalbourne, Delin, and Basset (1994) were analyzed. Internal consistency reliability estimates for the Total scale (.66), the Depressive subscale (.63), and the Manic subscale (.45) were poor to marginal, and a confirmatory factor analysis did not support the two-subscale structure of the scale. These results, considered in conjunction with those of previous psychometric analyses of the Manic-Depressive Scale, cast doubt on its usefulness for research and clinical use.

On the Inappropriateness of Using Items to Calculate Total Scale Score Reliability via Coefficient Alpha for Multidimensional Scales

2014 ◽  
Vol 30 (2) ◽  
pp. 130-139 ◽  
Author(s):  
Gilles E. Gignac
Keyword(s):  
Scale Score ◽  
Internal Consistency ◽  
Correlation Matrix ◽  
Internal Consistency Reliability ◽  
Reliability Estimation ◽  
Unit Level ◽  
Reliability Estimates ◽  
Score Reliability ◽  
Scale Scores ◽  
Total Scale Score

Researchers have the implicit option of calculating internal consistency reliability (coefficient α) for total scale scores derived from multidimensional inventories based on either the inter-item correlation matrix (item unit-level) or the inter-subscale correlation matrix (subscale unit-level). It is demonstrated that item unit-level and subscale unit-level reliability estimates often diverge substantially in practice. Specifically, the item unit-level reliability estimation is often larger than the corresponding subscale unit-level estimate. It is recommended that if researchers calculate total scale score reliability at the item unit-level, then a model-based approach to the estimation of internal consistency reliability (i.e., omega hierarchical) should be applied, when the underlying model is multidimensional. If omega hierarchical cannot be applied for any particular reason, it is recommended that total scale score reliabilities be calculated at the subscale unit-level of analysis, not the item unit-level.

A Comparison of Reliability Estimation Based on Confirmatory Factor Analysis and Exploratory Structural Equation Models

2021 ◽  
pp. 001316442110089
Author(s):  
Yuanshu Fu ◽  
Zhonglin Wen ◽  
Yang Wang
Keyword(s):  
Factor Analysis ◽  
Confirmatory Factor Analysis ◽  
Structural Equation ◽  
Reliability Estimation ◽  
Model Fit ◽  
Equation Modeling ◽  
Factor Loadings ◽  
Reliability Estimates ◽  
Confirmatory Factor ◽  
Composite Reliability

Composite reliability, or coefficient omega, can be estimated using structural equation modeling. Composite reliability is usually estimated under the basic independent clusters model of confirmatory factor analysis (ICM-CFA). However, due to the existence of cross-loadings, the model fit of the exploratory structural equation model (ESEM) is often found to be substantially better than that of ICM-CFA. The present study first illustrated the method used to estimate composite reliability under ESEM and then compared the difference between ESEM and ICM-CFA in terms of composite reliability estimation under various indicators per factor, target factor loadings, cross-loadings, and sample sizes. The results showed no apparent difference in using ESEM or ICM-CFA for estimating composite reliability, and the rotation type did not affect the composite reliability estimates generated by ESEM. An empirical example was given as further proof of the results of the simulation studies. Based on the present study, we suggest that if the model fit of ESEM (regardless of the utilized rotation criteria) is acceptable but that of ICM-CFA is not, the composite reliability estimates based on the above two models should be similar. If the target factor loadings are relatively small, researchers should increase the number of indicators per factor or increase the sample size.

Reliability of the Jackson Personality Inventory

1977 ◽  
Vol 40 (2) ◽  
pp. 613-614 ◽  
Author(s):  
Douglas N. Jackson
Keyword(s):  
College Students ◽  
Internal Consistency ◽  
Internal Consistency Reliability ◽  
Personality Inventory ◽  
Reliability Estimates ◽  
Two Samples

Internal consistency reliability estimates were obtained for two samples of college students for the Jackson Personality Inventory using Bender's coefficient theta. In the California sample ( n = 82), values ranged from .84 to .95, with a median of .93. The Pennsylvania sample ( n = 307) yielded a range of .75 to .93, with a median of .90.

scholarly journals Validity and reliability of Korean version of the Grit Scale for Korean nursing students

2020 ◽  
Vol 26 (3) ◽  
pp. 322-331
Author(s):  
Hyo-Suk Song ◽  
So-Hee Lim
Keyword(s):  
Factor Analysis ◽  
Nursing Students ◽  
Confirmatory Factor Analysis ◽  
Exploratory Factor Analysis ◽  
Internal Consistency ◽  
Item Analysis ◽  
Internal Consistency Reliability ◽  
Validity And Reliability ◽  
Korean Version ◽  
Confirmatory Factor

Purpose: The purpose of this study was to investigate the validity and reliability of the Korean Version of the Grit (Grit-K) scale for nursing students in Korea.Methods: The participants in the study were 277 nursing students. Their grit was verified by using self-reports and the results of a questionnaire. Grit was translated into Korean and its content validity was verified by five experts. The validity of the instrument was verified through item analysis, exploratory factor analysis, and confirmatory factor analysis. Reliability verification was analyzed by using internal consistency reliability.Results: Two factors were identified through exploratory factor analysis and six items of the original instrument were found to be valid. In the confirmatory factor analysis, the validity of the instrument was verified as the model. The internal consistency reliability was also acceptable and Grit was found to be an applicable instrument.Conclusion: This study shows that the Korean Version of the Grit Questionnaire is a valid and reliable instrument to assess nursing students in Korea.

: Evaluation of the Validity and Reliability of the Suicide Opinion Questionnaire as a Measure of Korean Nurses’ Attitudes toward Suicide

2017 ◽  
Vol 5 (4) ◽  
pp. 454 ◽  
Author(s):  
Eun Nam Lee ◽  
Jang Mi Kim
Keyword(s):  
Construct Validity ◽  
Internal Consistency ◽  
Goodness Of Fit ◽  
Mean Squared Error ◽  
Internal Consistency Reliability ◽  
Validity And Reliability ◽  
Korean Version ◽  
Confirmatory Factor ◽  
Attitudes Toward Suicide ◽  
Fit Index

Background: The aim of this study was to investigate the validity and reliability of the Korean version of the Suicide Opinion Questionnaire to measure Korean nurses’ attitudes toward suicide attempters.Methods: The questionnaire data were collected from 191 nurses who worked in emergency rooms, emergency wards and psychiatry wards. The internal consistency reliability and construct validity were evaluated using exploratory and confirmatory factor analysis.Results: The Cronbach’s α values regarding internal consistency were 0.51-0.79 for the subscales of the Korean version of the Suicide Opinion Questionnaire. The factor loadings of 18 items on the 6 subscales ranged from 0.54 to 0.84. The 6 subscale model was validated by a confirmatory factor analysis. The goodness-of-fit indexes were verified to be χ2/df = 1.56, root mean square residual = 0.04, goodness of fit index = 0.91, adjusted goodness of fit index = 0.86, Tucker-Lewis index = 0.9, comparative fit index = 0.92 and root mean squared error of approximation = 0.05.Conclusion: The findings indicated relatively satisfactory construct validity for the Korean version of the Suicide Opinion Questionnaire, whereas the reliability was not high. The current study indicates that the questionnaire should be used with caution when measuring nurses’ attitudes toward suicide attempters.

scholarly journals Confirmatory Factor Analysis of the Malay Version of the Smartphone Addiction Scale among Medical Students in Malaysia

2020 ◽  
Vol 17 (11) ◽  
pp. 3820 ◽  
Author(s):  
Siti Rubiaehtul Hassim ◽  
Wan Nor Arifin ◽  
Yee Cheng Kueh ◽  
Nor Azwany Yaacob
Keyword(s):  
Factor Analysis ◽  
Medical Students ◽  
Confirmatory Factor Analysis ◽  
Internal Consistency ◽  
Concurrent Validity ◽  
Five Factor Model ◽  
Internal Consistency Reliability ◽  
Smartphone Addiction ◽  
Correlated Errors ◽  
Confirmatory Factor

Background: At present, the validity and reliability evidence of the Malay version of the Smartphone Addiction Scale (SAS-M) is only available by exploratory factor analysis (EFA). The aim of this study is to validate and determine the psychometric properties of the SAS-M by confirmatory factor analysis (CFA). Methods: A cross-sectional study was conducted among 323 medical students in Universiti Sains Malaysia. The students were given questionnaire forms consisting of socio-demographic information, the SAS-M and the Malay version of the Internet Addiction Test (MVIAT). The CFA was conducted using robust maximum likelihood estimator. The internal consistency reliability was determined by Raykov’s rho coefficient. The concurrent validity was assessed by the Pearson’s correlations between the factor scores of the SAS-M and the MVIAT. Results: The analysis showed the five-factor model of the SAS-M has an acceptable model fit after the inclusion of 12 correlated errors (SRMR = 0.067, RMSEA 0.059 (90% CI: 0.054, 0.065), CFI = 0.895, TLI = 0.882). The factor loadings ranged from 0.320 to 0.875. The internal consistency reliability was good (Raykov’s rho = 0.713 to 0.858) and it showed good concurrent validity with the MVIAT. Conclusions: The CFA showed that the SAS-M is a valid and reliable self-administered questionnaire to measure the level of smartphone addiction among medical students.

Statistical Significance and Reliability of Single-Subtest and Cluster Deviation Scores

2008 ◽  
Vol 102 (1) ◽  
pp. 43-46 ◽  
Author(s):  
Leonard S. Feldt ◽  
Richard A. Charter
Keyword(s):  
Internal Consistency ◽  
Statistical Significance ◽  
Internal Consistency Reliability ◽  
Composite Score ◽  
Deviation Score ◽  
Small Set ◽  
The Mean ◽  
The Difference

Suppose one has a battery of K subtests and a composite for the battery is defined as the mean of the K standardized subtest scores. An individual's single-subtest deviation score is the difference between the individual's score on any single subtest and his composite score. A cluster deviation score is the difference between an examinee's average for a small set (cluster) of subtests and his composite. Formulas are given for the test of statistical significance of the individual's subtest or cluster deviation score and the internal consistency reliability of such deviation scores.

Reliability Estimates for the Arabic Versions of the Cancer Behavior Inventory-Brief and the Functional Assessment of Cancer Therapy-Breast

2016 ◽  
Vol 24 (3) ◽  
pp. 388-398 ◽  
Author(s):  
Maaidah M. Algamdi ◽  
Sandra K. Hanneman
Keyword(s):  
Cancer Therapy ◽  
Internal Consistency ◽  
Functional Assessment ◽  
Cognitive Interview ◽  
Internal Consistency Reliability ◽  
Preliminary Evidence ◽  
Community Dwelling ◽  
Test Reliability ◽  
Cross Sectional ◽  
Reliability Estimates

Purpose: The study aims were to (a) test reliability of the Arabic versions of the Cancer Behavior Inventory-Brief Arabic (CBI-BA) among patients diagnosed with any type of cancer and the Functional Assessment of Cancer Therapy-Breast (FACT-BA) in women with breast cancer and (b) assess participant understanding of CBI-BA items. Methods: A cross-sectional design was used to assess preliminary evidence for internal consistency reliability of the CBI-BA and the FACT-BA in a community-dwelling sample of Arabic-speaking persons diagnosed with cancer. Participants were randomly selected for cognitive interview. Results: Cronbach’s alphas were ≥.76 for the CBI-BA, .91 for the FACT-BA, and .43–.89 for the FACT-BA subscales. Cognitive interviews revealed several CBI-BA items required revision. Conclusion: The total CBI-BA and the FACT-BA scales have adequate internal consistency reliability estimates.

Sign in / Sign up

Export Citation Format

Share Document