scholarly journals Is Adequate Model Fit Indicative of an Adequate Factor Analytic Model? Recognizing Construct Heterogeneity and Model Misspecification in Factor Analytic Research

2021 ◽  
Author(s):  
Kasey Stanton ◽  
Ashley L. Watts ◽  
Holly Frances Levin-Aspenson ◽  
Ryan Carpenter ◽  
Noah N Emery
Keyword(s):  
Model Misspecification ◽  
Factor Loading ◽  
Model Fit ◽  
Self Report ◽  
Adequate Model ◽  
Factor Analytic Model ◽  
Factor Analytic ◽  
Model Fit Indices ◽  
Self Report Data ◽  
Analytic Models

This study builds upon recent research indicating that focusing narrowly on model fit when evaluating factor analytic models can lead to problematic inferences regarding the nature of item sets, as well as how models should be applied to inform measure development and validation. Specifically, we demonstrate that an overreliance on model fit may lead to (a) incorrect conclusions that heterogeneous item sets reflect narrower homogeneous constructs and (b) the retention of potentially problematic items when developing assessment measures. We use both interview data from adult outpatients (N = 2,149) and self-report data from adults recruited online (N = 547) to demonstrate the importance of these issues across sample types and assessment methods. Following demonstrations with these data, we make recommendations focusing on how theory and other model characteristics (e.g., factor loading patterns) should be considered in addition to information provided by model fit indices when evaluating factor analytic models.

scholarly journals The psychometric properties of the Compassionate Love Scale and the validation of the English and German 7-item Compassion for Others Scale (COS-7)

2020 ◽  
Author(s):  
Marco Schlosser ◽  
Natalie G. Pfaff ◽  
Stefan R. Schweinberger ◽  
Natalie L. Marchant ◽  
olga klimecki
Keyword(s):  
Psychometric Properties ◽  
Internal Consistency ◽  
Content Validity ◽  
Model Fit ◽  
Self Report ◽  
German Version ◽  
Divergent Validity ◽  
Adequate Model ◽  
Compassionate Love ◽  
Psychometric Quality

An increasing body of scientific research on the nature, correlates, and effects of compassion has accrued over recent years. Expert agreement has not yet been reached on the conceptualisation of compassion for others, and existing self-report measures of compassion for others have often lacked psychometric quality and content validity. Recent publications of longer compassion measures represent significant strides towards ameliorating these issues. However, there is a need for psychometrically sound short scales for measuring compassion in time-constrained research settings. To meet this need, one can assess the psychometric qualities of existing scales in order to develop robust short adaptations of such scales. Study 1 (N = 501) empirically assessed the psychometric properties of the widely cited Compassionate Love Scale (CLS) to validate a new short scale of compassion for others (strangers) comprised of items from the CLS – the 7-item Compassion for Others Scale (COS-7). Study 2 (N = 332) addressed the absence of a German measure of compassion for others by validating a German version of the COS-7. The CLS did not display adequate model fit. Both the English and German versions of the COS-7 demonstrated adequate model fit, factor loadings, internal consistency, interpretability, convergent/divergent validity, and no floor/ceiling effects. Findings provide support for the English and German versions of the COS-7 as adequate short scales for measuring compassion for others. The German COS-7 is the first German measure of compassion for others published to date.

Evaluating the construct validity and internal consistency of the Sickness Questionnaire in a Swedish sample of adults with longstanding pain

2021 ◽  
Vol 0 (0) ◽  
Author(s):  
Jenny Åström ◽  
Linda Holmström ◽  
Bianka Karshikoff ◽  
Anna Andreasson ◽  
Mike K. Kemani
Keyword(s):  
Construct Validity ◽  
Internal Consistency ◽  
Behavioral Responses ◽  
Sickness Behavior ◽  
Model Fit ◽  
Self Report ◽  
Low Grade ◽  
Structural Validity ◽  
Adequate Model ◽  
Swedish Sample

Abstract Objectives Low-grade inflammation is a possible contributing factor in the development and persistence of chronic primary pain syndromes. Related to inflammatory activity is sickness behavior, a set of behavioral responses including increased pain sensitivity, fatigue, malaise, fever, loss of appetite, as well as depressive behavior and anhedonia. To capture these behavioral responses and their relation to longstanding pain, psychometrically sound self-report questionnaires are needed. The Sickness Questionnaire (SicknessQ) was developed to assess self-reported sickness behavior based on studies on acute immune activation while maintaining relevance for persistent conditions. The aim of the current study was to evaluate aspects of the validity and reliability of the SicknessQ in a Swedish sample of persons with longstanding pain. Methods Aspects of construct validity were evaluated by means of performing a confirmatory factor analysis (CFA) (testing structural validity) and by relevant hypothesis testing i.e., that ratings of sickness behavior in combination with other related factors (e.g., depression and anxiety) would be significantly related to ratings of avoidance. Reliability was evaluated by means of analyzing the internal consistency of items. Results Following the CFA, a non-significant Chi-Square test (χ2 [32, N=190] = 42.95, p=0.094) indicated perfect model fit. Also, the relative fit indices supported adequate model fit (CFI = 0.978; TLI = 0.969; RMSEA = 0.0430). Sickness behavior (p<0.0001), depression (p<0.05) and pain duration (p<0.05) significantly contributed to the regression model, explaining 45% of the total variance in avoidance. Internal consistency was adequate, as indicated by a Cronbach’s α value of 0.82 for the entire questionnaire. Conclusions Results indicate that the SicknessQ has adequate structural validity as well as adequate internal consistency, and is significantly associated with avoidance. The SicknessQ appears to have utility as a self-report questionnaire to assess symptoms of sickness behavior for adults with longstanding pain.

scholarly journals Pembuktian Validitas terkait Struktur Tes Potensi Akademik Pascasarjana (PAPS) Universitas Gadjah Mada

2019 ◽  
Vol 46 (2) ◽  
pp. 145
Author(s):  
Wahyu Widhiarso
Keyword(s):  
Factor Analysis ◽  
Confirmatory Factor Analysis ◽  
Factor Loading ◽  
Model Fit ◽  
The Other ◽  
Fit Indices ◽  
Confirmatory Factor ◽  
Model Fit Indices ◽  
Academic Potential ◽  
Potential Test

This study examined the construct validity of the Graduate Academic Potential Test (PAPS). The examination was performed on all existing PAPS series (6 forms) to identify the consistency of dimensionality structure of PAPS. Data of this study were analyzed using confirmatory factor analysis (CFA). The results of the analysis support assumption that the structure of the PAPS test is unidimensional. All of the model fit indices support the decision that the unidimensional model fit the data. The study also examined factor loading that the non-verbal components, especially the quantitative components that had a higher factor weight than the other components.

scholarly journals Can passive measurement of physiological distress help better predict suicidal thinking?

2021 ◽  
Vol 11 (1) ◽  
Author(s):  
Evan M. Kleiman ◽  
Kate H. Bentley ◽  
Joseph S. Maimone ◽  
Hye-In Sarah Lee ◽  
Erin N. Kilbury ◽  
...  
Keyword(s):  
Negative Affect ◽  
Suicide Risk ◽  
Electrodermal Activity ◽  
Model Fit ◽  
Self Report ◽  
Outcome Variable ◽  
Physiological Data ◽  
Suicidal Thinking ◽  
Report Data ◽  
Self Report Data

AbstractThere has been growing interest in using wearable physiological monitors to passively detect the signals of distress (i.e., increases in autonomic arousal measured through increased electrodermal activity [EDA]) that may be imminently associated with suicidal thoughts. Before using these monitors in advanced applications such as creating suicide risk detection algorithms or just-in-time interventions, several preliminary questions must be answered. Specifically, we lack information about whether: (1) EDA concurrently and prospectively predicts suicidal thinking and (2) data on EDA adds to the ability to predict the presence and severity of suicidal thinking over and above self-reports of emotional distress. Participants were suicidal psychiatric inpatients (n = 25, 56% female, M age = 33.48 years) who completed six daily assessments of negative affect and suicidal thinking duration of their psychiatric inpatient stay and 28 days post-discharge, and wore on their wrist a physiological monitor (Empatica Embrace) that passively detects autonomic activity. We found that physiological data alone both concurrently and prospectively predicted periods of suicidal thinking, but models with physiological data alone had the poorest fit. Adding physiological data to self-report models improved fit when the outcome variable was severity of suicidal thinking, but worsened model fit when the outcome was presence of suicidal thinking. When predicting severity of suicidal thinking, physiological data improved model fit more for models with non-overlapping self-report data (i.e., low arousal negative affect) than for overlapping self-report data (i.e., high arousal negative affect). These findings suggest that physiological data, under certain contexts (e.g., when combined with self-report data), may be useful in better predicting—and ultimately, preventing—acute increases in suicide risk. However, some cautious optimism is warranted since physiological data do not always improve our ability to predict suicidal thinking.

scholarly journals Examining Measurement invariance for Parental Creativity Nurturing Behaviour (PCNB) across middle-East Nations and South-east Asian Nations

2021 ◽  
Author(s):  
Ekta Sharma ◽  
Sandeep Sharma ◽  
Muhammad Al-Kudah ◽  
Angham Al-Tamimi
Keyword(s):  
Middle East ◽  
Measurement Invariance ◽  
East Asian ◽  
Factor Loading ◽  
Model Fit ◽  
Fit Indices ◽  
Chi Square ◽  
Model Fit Indices ◽  
The One ◽  
Fit Index

Abstract Background and Objectives Examining the Usefulness of the Psychological instruments / scales /framework which are developed in one nation for other nations is vital step in establishing generalization for use across nations of Parental creativity nurturing behavior , Who are going to play most important role to develop Creative potential of children in 21st century.However The instrument used to measure the parental creativity nurturing behavior and the theoretical constructs of the subject exhibits good cross nation equivalence of PCNB scale.We reviewed various forms of measurement invariance for sample of parents , systematically, scientifically analyzed, and statistically proved the measurement invariance ,across gender, Age , culture ,Language of the PCNB scale by comparing MEN and SEAN . This would benefit the Parents in middle east Nations (MEN) and South-east Asian Nations(SEAN) . It will help parents to monitor their creativity nurturing behavior (CNB) and take appropriate steps to enrich PCNB and play important role to help their child lead a creativity accompanied life in 21st century.It will also Approve the wider use and acceptability of the PCNB scale.Research design and methodBased on data of 931 { 423 & 508 parents respectively from South East Asian Nations(SEAN ,Representing Nation -India) and Middle East Nations (MEN, representing nation Jordon)} ,we used PCNB Scale(Sharma & Sharma 2021) that focused on 4 major factors that are crucial to examine and assess validity and reliability of PCNB scale. Multisampling confirmatory factor analysis was done to identify the factors and then the model fit for the construct of PCNB. The selection of India as representative nation for Southeast Asian Nations and Jordon as representative nation of Middle east nations was done randomly as both are emerging educational nations in respective geographical areas in Asia.ResultsThe scale was found to be both valid and reliable with an excellent model fit with composite reliability (CR-SEAN) (CR factor1 =0.818 , CR factor2 =0.872 , CR factor3 =0.670 , CR factor4 =0.729), factor loading (>0.4 ) , Cronbach Alpha(SEAN)=0.712 and model fit indices SEAN (comparative fit index(CFI)=0.967,Chi-square/df=1.492, GFI=0.942,TLI=0.95,RFI=0.861,RMSEA=0.059,IFI=0.961,SRMR=0.051 ).This suggests four factors model ,supporting the one-dimensional reliable construct of PCNB at baseline.The scale was found to be both valid and reliable with an excellent model fit with composite reliability (CR-MEN) (CR factor1 =0.955 , CR factor2 =0.950 , CR factor3 =0.918 , CR factor4 =0.857), factor loading (>0.4 ) , Cronbach Alpha(MEN)=0.57 and model fit indices MEN (comparative fit index(CFI)=0.967,Chi-square/df=1.492, GFI=0.942,TLI=0.95,RFI=0.861,RMSEA=0.059,IFI=0.961,SRMR=0.038 ).This suggests four factors ,supporting the one-dimensional reliable construct of PCNB at baseline.Discussion and implicationsPCNB is a valid and reliable measure of creativity nurturing behavior of parents and thus enables a comprehensive evaluation of measure of creativity nurturing behavior in Parents. This scale would prove to be an important tool for assessment of parental creativity nurturing behavior and their parenting style. Once put to use on large-scale, would benefit and help the parents to identify their behavior and nurture creativity behavior in children well before they join the school, and would continue to nurture creativity even during the schooling and further. Basically this would help parents identify the need to get counseled (trained) formally or informally to nurture creativity in their child. SignificancePCNB Scale is a valid and reliable scale that would be globally useful for assessment of Parents creativity nurturing behavior (PCNB) across gender, countries, cultures, and age. This scale is available with strong psychometric properties and can prove useful for planning parent counseling programs to help them exhibit creativity nurturing behavior, and thus contribute to society by identifying parents to nurture creativity in children for finding creative solutions to different problems and challenges that world faces in the times to come. This could also help to develop new teaching methods and pedagogies in the direction of creativity nurturing. This research will add to Current sciences of Creativity nurturing behavior of parents.

scholarly journals Can Passive Measurement of Physiological Distress Help Better Predict Suicidal Thinking?

2021 ◽  
Author(s):  
Evan Kleiman ◽  
Kate Bentley ◽  
Joseph Maimone ◽  
Sarah Lee ◽  
Erin Kilbury ◽  
...  
Keyword(s):  
Negative Affect ◽  
Suicide Risk ◽  
Electrodermal Activity ◽  
Model Fit ◽  
Self Report ◽  
Outcome Variable ◽  
Physiological Data ◽  
Suicidal Thinking ◽  
Report Data ◽  
Self Report Data

Abstract There has been growing interest in using wearable physiological monitors to passively detect the signals of distress (i.e., increases in autonomic arousal measured through increased electrodermal activity [EDA]) that may be imminently associated with suicidal thoughts. Before using these monitors in advanced applications such as creating suicide risk detection algorithms or just-in-time interventions, several preliminary questions must be answered. Specifically, we lack information about whether: (1) EDA concurrently and prospectively predicts suicidal thinking and (2) data on EDA adds to the ability to predict the presence and severity of suicidal thinking over and above self-reports of emotional distress. Participants (n=25, 56% female, M age= 33.48 years) completed six daily assessments of negative affect and suicidal thinking duration of their psychiatric inpatient stay and 28 days post-discharge, and wore on their wrist a physiological monitor (Empatica Embrace) that passively detects autonomic activity. We found that physiological data alone both concurrently and prospectively predicted periods of suicidal thinking, but models with physiological data alone had the poorest fit. Adding physiological data to self-report models improved fit when the outcome variable was severity of suicidal thinking, but worsened model fit when the outcome was presence of suicidal thinking. When predicting severity of suicidal thinking, physiological data improved model fit more for models with non-overlapping self-report data (i.e., low arousal negative affect) than for overlapping self-report data (i.e., high arousal negative affect).These findings suggest that physiological data, under certain contexts, may be useful in better predicting -- and ultimately, preventing -- acute increases in suicide risk. However, some cautious optimism is warranted since physiological data do not always improve our ability to predict suicidal thinking

Depression, Anxiety, and Stress: How Should Clinicians Interpret the Total and Subscale Scores of the 21-Item Depression, Anxiety, and Stress Scales?

2018 ◽  
Vol 122 (4) ◽  
pp. 1550-1575 ◽  
Author(s):  
Eu Gene Chin ◽  
Erin M. Buchanan ◽  
Chad Ebesutani ◽  
John Young
Keyword(s):  
Undergraduate Students ◽  
Model Misspecification ◽  
The United States ◽  
Self Report ◽  
Underlying Structure ◽  
Multidimensional Modeling ◽  
Factor Analytic ◽  
Confirmatory Factor ◽  
Sensitivity Specificity ◽  
Report Measure

The 21-item Depression, Anxiety, and Stress Scales (DASS-21) is a self-report measure that is easy to administer, quick to score, and is freely available. Widely used in diverse settings and populations, confirmatory factor analytic evidence has accumulated for a bifactor model underlying this multidimensional measure. Studies employing an exploratory bifactor approach to more closely examine its underlying structure and inter-relations of factors, however, have been scarce. This is unfortunate because confirmatory techniques often employ indirect ways of handling model misspecification, whereas exploratory methods enable more direct approaches. Moreover, more precise approaches to modeling an exploratory bifactor structure have not been examined with the DASS-21. Based on several large samples of undergraduate students in the United States, the first two parts of the paper (Studies 1 and 2) utilized both exploratory ( M = 19.7 years of age) and confirmatory factor analytic methods ( M = 19.7 years of age) following those presented by contemporary multidimensional modeling theorists. Building upon these results, the third part of the paper (Study 3; M = 20.0 years of age) examined sensitivity-/specificity-related indices to provide cut-off score recommendations for a revised DASS-21 instrument based on a newly identified and supported bifactor structure. Implications of these results are discussed in terms of taxonomy, challenges inherent in multidimensional modeling, and potential use of the revised DASS-21 measure as a component of an actuarial decision-making strategy to inform clinical referrals.

scholarly journals Sibling Bullying in Turkish Adolescents: Translation and Cross-Cultural Validation of the Sibling Bullying Questionnaire

2021 ◽  
Author(s):  
Emre Deniz ◽  
Pelin Derinalp ◽  
Ilayda Gulkanat ◽  
Cagla Kaz ◽  
Neslihan Özhan ◽  
...  
Keyword(s):  
Factor Structure ◽  
Convergent Validity ◽  
Correlation Coefficients ◽  
Model Fit ◽  
Self Report ◽  
First Order ◽  
Translation Validation ◽  
Confirmatory Factor ◽  
Report Data ◽  
Self Report Data

Purpose: The primary aim of this study was to translate the Sibling Bullying Questionnaire (SBQ) into Turkish and validate it. A secondary aim was to estimate the prevalence of sibling bullying in Turkish adolescents. Methods: The SBQ was forward and backwards translated by a team of English-Turkish bilinguals. Following this, self-report data were collected from Turkish adolescents (N=301) aged 10 to 18 years old (mean age=14.25 years, SD=2.46). Confirmatory factor analysis (CFA) was used to confirm the factor structure of the newly translated Turkish SBQ (T-SBQ). Descriptive analyses were then conducted to report the characteristics of the sample and the prevalence of sibling bullying. Results: CFA confirmed the original two-factor structure of the T-SBQ indicating that a first-order correlated two-factor (victimisation and perpetration) model show the best model fit: x2=160.33 (p &lt;.001), df=61, RMSEA=.07, CFI=.95 and TLI=.93. The T-SBQ also showed satisfactory levels of internal consistency in victimisation (α=.84) and perpetration (α=.83) subscales with excellent reliability for the overall test scale (α=.90). The convergent validity of the scale was also high as demonstrated by the inter-scale correlation coefficients between the T-SBQ and Revised Sibling Bullying Questionnaire (α=.79). In terms of sibling bullying prevalence, approximately half of the adolescents (51%) reported having been involved in some form of sibling bullying in the preceding six months, either as pure-victim (18%), pure-bully (3%) or bully-victim (30%).Conclusions: The T-SBQ is valid and reliable in measure sibling bullying in Turkish adolescents and sibling bullying is prevalent in the lives of Turkish adolescents.Keywords. Sibling bullying, prevalence Turkish questionnaire, translation, validation

Bifactor Structure for the Categorical Chinese Rosenberg Self-Esteem Scale

2016 ◽  
Vol 19 ◽  
Author(s):  
Menglin Xu ◽  
Shing-On Leung
Keyword(s):  
Factor Loading ◽  
Self Esteem ◽  
Bifactor Model ◽  
Model Fit ◽  
Fit Indices ◽  
Usual Model ◽  
Sum Score ◽  
Loading Patterns ◽  
Model Fit Indices ◽  
Method Effects

AbstractRecently, the bifactor model was suggested for the latent structure of the Rosenberg Self-Esteem Scale (RSES). The present paper investigates (i) the differences among bifactor, bifactor negative and other models; (ii) the effects of treating data as both categorical vs continuous; (iii) whether a problematic item in the Chinese RSES should be removed; and (iv) whether the final scoring would be affected. With a sample of 1.734 grade 4–6 school pupils in Hong Kong, we used BIC differences in addition to the usual model fit indices, and found that there was strong evidence for using the bifactor model (RMSEA = .052, 90% CI [.043, .062], CFI = .992, TLI = .984 for 9-item RSES categorical). Little difference is found between treating data as categorical or continuous for fit indices, but the factor loading patterns are better in categorical case. Keeping a problematic item has little effect on fit indices, but would lead to unexpected negative loading. The ranking of loadings within positive and negative items across different conditions are the same, which has important effects on scoring. Loadings in the method effects in the bifactor models are all positive (p < .001), which is different from previous research. All models show similar results on scoring, and support the usual simple sum score in most practice.

scholarly journals A new perspective and assessment measure for common dissociative experiences: ‘Felt Sense of Anomaly’

PLoS ONE ◽  
2021 ◽  
Vol 16 (2) ◽  
pp. e0247037
Author(s):  
Emma Černis ◽  
Esther Beierl ◽  
Andrew Molodynski ◽  
Anke Ehlers ◽  
Daniel Freeman
Keyword(s):  
Convergent Validity ◽  
Model Fit ◽  
Self Report ◽  
Cronbach’S Alpha ◽  
Adequate Model ◽  
Cronbach's Alpha ◽  
Dissociative Experiences ◽  
Assessment Measure ◽  
Conceptual Clarity ◽  
Felt Sense

Background Dissociative experiences occur across a range of mental health disorders. However, the term ‘dissociation’ has long been argued to lack conceptual clarity and may describe several distinct phenomena. We therefore aimed to conceptualise and empirically establish a discrete subset of dissociative experiences and develop a corresponding assessment measure. Methods First, a systematic review of existing measures was carried out to identify themes across dissociative experiences. A theme of ‘Felt Sense of Anomaly’ (FSA) emerged. Second, assessment items were generated based on this construct and a measure developed using exploratory (EFA) and confirmatory (CFA) factor analyses of 8861 responses to an online self-report survey. Finally, the resulting measure was validated via CFA with data from 1031 patients with psychosis. Results ‘Felt sense of anomaly’ (FSA) was identified as common to many dissociative experiences, affecting several domains (e.g. body) and taking different forms (‘types’; e.g. unfamiliarity). Items for a novel measure were therefore systematically generated using a conceptual framework whereby each item represented a type-by-domain interaction (e.g. ‘my body feels unfamiliar’). Factor analysis of online responses found that FSA-dissociation manifested in seven ways: anomalous experiences of the self, body, and emotion, and altered senses of familiarity, connection, agency, and reality (Χ2 (553) = 4989.435, p<0.001, CFI = 0.929, TLI = 0.924, RMSEA = 0.052, SRMR = 0.047). Additionally, a single-factor ‘global FSA’ scale was produced (Χ2 (9) = 312.350, p<0.001, CFI = 0.970, TLI = 0.950, RMSEA = 0.107, SRMR = 0.021). Model fit was adequate in the clinical (psychosis) group (Χ2 (553) = 1623.641, p<0.001, CFI = 0.927, TLI = 0.921, RMSEA = 0.043, SRMR = 0.043). The scale had good convergent validity with a widely used dissociation scale (DES-II) (non-clinical: r = 0.802), excellent internal reliability (non-clinical: Cronbach’s alpha = 0.98; clinical: Cronbach’s alpha = 0.97), and excellent test-retest reliability (non-clinical: ICC = 0.92). Further, in non-clinical respondents scoring highly on a PTSD measure, CFA confirmed adequate model fit (Χ2 (553) = 4758.673, CFI = 0.913, TLI = 0.906, RMSEA = 0.052, SRMR = 0.054). Conclusions The Černis Felt Sense of Anomaly (ČEFSA) scale is a novel measure of a subset of dissociative experiences that share a core feature of FSA. It is psychometrically robust in both non-clinical and psychosis groups.

Sign in / Sign up

Export Citation Format

Share Document