scholarly journals Interpreting Action Research Arm Test Assessment Scores to Plan Treatment

2018 ◽  
Vol 39 (1) ◽  
pp. 64-73 ◽  
Author(s):  
Emily S. Grattan ◽  
Craig A. Velozo ◽  
Elizabeth R. Skidmore ◽  
Stephen J. Page ◽  
Michelle L. Woodbury
Keyword(s):  
Action Research ◽  
Clinical Assessment ◽  
Item Difficulty ◽  
Secondary Analysis ◽  
Measurement Properties ◽  
Factor Loadings ◽  
Assessment Scores ◽  
Confirmatory Factor ◽  
Rasch Analyses ◽  
Point Measure

Rasch keyforms can help interpret clinical assessment scores. The Action Research Arm Test (ARAT) is a commonly used assessment, yet no keyform currently exists. The aim is to provide a keyform for the ARAT and demonstrate how a clinician can use the keyform to design optimally challenging rehabilitation sessions. Secondary analysis of ARAT data ( n = 122) using confirmatory factor and Rasch analyses were used to examine the measurement properties and generate a keyform. The item standardized factor loadings were >0.40 (range = 0.82-0.96) and R2 values were >.60 (range = .65-.96). All items exhibited adequate infit statistics with point measure correlations >.60 (range = .72-.97). Person reliability was .98, and person separation was 7.07. Item-difficulty measures ranged from −2.78 logits to 2.64 logits. The ARAT has strong measurement properties, and a keyform was provided. We showed how the keyform can be utilized by clinicians to interpret scores, set goals, and plan treatment.

Hierarchical Modelling of Facial Perceptions: A Secondary Analysis of Aggressiveness Ratings

2020 ◽  
Author(s):  
Mark Christopher Adkins ◽  
Nataly Beribisky ◽  
Stephan Bonfield ◽  
Linda Farmus
Keyword(s):  
Factor Analysis ◽  
Mixed Model ◽  
Structural Information ◽  
Secondary Analysis ◽  
Specific Factor ◽  
Primary Analysis ◽  
Model Framework ◽  
Psychological Science ◽  
Individual Traits ◽  
Confirmatory Factor

The Psychological Science Accelerator’s (PSA) primary project tested for latent structure using exploratory factor analysis and confirmatory factor analysis but we decided to diverge from this approach and model individual traits separately. Our interest mainly was in examining the interplay between “stimulus ethnicity” and “stimulus sex” to discover how differing levels of these criterion differ across region, country, lab etc. While the necessary and prerequisite hierarchical structural information about each trait could certainly be found within the primary project’s dataset, we did not assume that any specific factor structure from the PSA’s primary analysis would necessarily hold, therefore we based our decision to model the data from each trait separately using a mixed model framework.

scholarly journals Patient-reported anxiety and depression measures for use in Indian head and neck cancer populations: a psychometric evaluation

2021 ◽  
Vol 5 (1) ◽  
Author(s):  
Chindhu Shunmugasundaram ◽  
Haryana M. Dhillon ◽  
Phyllis N. Butow ◽  
Puma Sundaresan ◽  
Mahati Chittem ◽  
...  
Keyword(s):  
Head And Neck ◽  
Convergent Validity ◽  
Psychometric Evaluation ◽  
Measurement Properties ◽  
Anxiety And Depression ◽  
Factor Analyses ◽  
Factor Solution ◽  
Confirmatory Factor Analyses ◽  
Culturally Adapted ◽  
Confirmatory Factor

Abstract Background Head and neck cancers (HNC) are one of the most traumatic forms of cancer because they affect essential aspects of life such as speech, swallowing, eating and disfigurement. HNCs are common in India, with over 100,000 cases being registered each year. HNC and treatment are both associated with considerable anxiety and depression. With increasing multinational research, no suitable measures in Indian languages are available to assess anxiety and depression in Indian HNC patients. This study evaluated the psychometric properties of cross-culturally adapted versions of Zung’s self-rating Anxiety Scale (SAS) and the Patient health questionnaire – 9 (PHQ-9) in Tamil, Telugu and Hindi speaking Indian HNC populations. Methods HNC patients were recruited from three tertiary cancer centres in India. Patients completed the cross-culturally adapted versions of SAS and PHQ-9. We assessed targeting, scaling assumptions, construct validity (exploratory and confirmatory factor analyses), convergent validity, and internal consistency reliability. Results The study sample included 205 Tamil, 216 Telugu and 200 Hindi speaking HNC patients. Exploratory and confirmatory factor analyses indicated a two-factor solution for PHQ-9 and four-factor solution for SAS in all three languages. Cronbach’s alpha coefficients ranged between 0.717 and 0.890 for PHQ-9 and between 0.803 and 0.868 for SAS, indicating good reliability. Correlations between hypothesized scales were as expected providing evidence towards convergent validity. Conclusions This first psychometric evaluation of the measurement properties of Tamil, Telugu and Hindi versions of the SAS and PHQ-9 in large, Indian HNC populations supported their use as severity and outcome measures across the disease and treatment continuum.

A Comparison of Reliability Estimation Based on Confirmatory Factor Analysis and Exploratory Structural Equation Models

2021 ◽  
pp. 001316442110089
Author(s):  
Yuanshu Fu ◽  
Zhonglin Wen ◽  
Yang Wang
Keyword(s):  
Factor Analysis ◽  
Confirmatory Factor Analysis ◽  
Structural Equation ◽  
Reliability Estimation ◽  
Model Fit ◽  
Equation Modeling ◽  
Factor Loadings ◽  
Reliability Estimates ◽  
Confirmatory Factor ◽  
Composite Reliability

Composite reliability, or coefficient omega, can be estimated using structural equation modeling. Composite reliability is usually estimated under the basic independent clusters model of confirmatory factor analysis (ICM-CFA). However, due to the existence of cross-loadings, the model fit of the exploratory structural equation model (ESEM) is often found to be substantially better than that of ICM-CFA. The present study first illustrated the method used to estimate composite reliability under ESEM and then compared the difference between ESEM and ICM-CFA in terms of composite reliability estimation under various indicators per factor, target factor loadings, cross-loadings, and sample sizes. The results showed no apparent difference in using ESEM or ICM-CFA for estimating composite reliability, and the rotation type did not affect the composite reliability estimates generated by ESEM. An empirical example was given as further proof of the results of the simulation studies. Based on the present study, we suggest that if the model fit of ESEM (regardless of the utilized rotation criteria) is acceptable but that of ICM-CFA is not, the composite reliability estimates based on the above two models should be similar. If the target factor loadings are relatively small, researchers should increase the number of indicators per factor or increase the sample size.

scholarly journals MEASUREMENT PROPERTIES OF A STANDARDIZED ELICITED IMITATION TEST: AN INTEGRATIVE DATA ANALYSIS

2021 ◽  
pp. 1-27
Author(s):  
Daniel R. Isbell ◽  
Young-A Son
Keyword(s):  
Second Language ◽  
Data Analysis ◽  
Second Language Acquisition ◽  
Item Difficulty ◽  
Measurement Properties ◽  
Linguistic Features ◽  
Elicited Imitation ◽  
Integrative Data Analysis ◽  
Rater Severity ◽  
Study Participants

Abstract Elicited Imitation Tests (EITs) are commonly used in second language acquisition (SLA)/bilingualism research contexts to assess the general oral proficiency of study participants. While previous studies have provided valuable EIT construct-related validity evidence, some key gaps remain. This study uses an integrative data analysis to further probe the validity of the Korean EIT score interpretations by examining the performances of 318 Korean learners (198 second language, 79 foreign language, and 41 heritage) on the Korean EIT scored by five different raters. Expanding on previous EIT validation efforts, this study (a) examined both inter-rater reliability and differences in rater severity, (b) explored measurement bias across subpopulations of language learners, (c) identified relevant linguistic features which relate to item difficulty, and (d) provided a norm-referenced interpretation for Korean EIT scores. Overall, findings suggest that the Korean EIT can be used in diverse SLA/bilingualism research contexts, as it measures ability similarly across subgroups and raters.

scholarly journals The English and Chinese language versions of the Short Form 12-item Health Survey are equivalent

2021 ◽  
Vol 19 (1) ◽  
Author(s):  
Daniel Y. T. Fong ◽  
Janet Y. H. Wong ◽  
Edmond P. H. Choi ◽  
K. F. Lam ◽  
C. Kwok
Keyword(s):  
Measurement Invariance ◽  
Health Survey ◽  
Short Form ◽  
Cross Sectional Study ◽  
Measurement Properties ◽  
University Campus ◽  
Cross Sectional ◽  
Multiple Group ◽  
Confirmatory Factor ◽  
The Difference

Abstract Background The Short Form 12-item Health Survey (SF-12v2) was originally developed in English, but it is also available in Hong Kong (HK) Chinese. While both language versions had their measurement properties well assessed in their respective populations, their measurement invariance in scores has not been examined. Therefore, we aimed to assess their measurement invariance. Methods We conducted a cross-sectional study on individuals aged 18 years or older at a university campus. Those who were bilingual in English and Chinese were randomly assigned to self-complete either the standard English or the HK Chinese SF-12v2. Measurement invariance of the two components and eight scales of the SF-12v2 was concluded if the corresponding 90% confidence interval (CI) for the difference between the two language versions entirely fell within the minimal clinically important difference of ± 3 units. Multiple-group confirmatory factor analysis (CFA) was also performed. Results A total of 1013 participants completed the SF-12v2 (496 in English and 517 in HK Chinese), with a mean age of 22 years (Range 18–58), and 626 participants (62%) were female. There were no significant differences in demographics. Only the physical and mental components and the mental health (MH) scale had their 90% CIs (0.21 to 1.61, − 1.00 to 0.98, and − 0.86 to 2.84, respectively) completely fall within the ± 3 units. The multiple-group CFA showed partial strict invariance. Conclusions The English and HK Chinese versions of the SF-12v2 can be used in studies with their two components and MH scores pooled in the analysis.

Embracing supply base complexity: the contingency role of strategic purchasing

2021 ◽  
Vol ahead-of-print (ahead-of-print) ◽  
Author(s):  
Melek Akın Ateş ◽  
Huriye Memiş
Keyword(s):  
Performance Criteria ◽  
Measurement Properties ◽  
Hierarchical Regression ◽  
Structured Interviews ◽  
Negative Effects ◽  
Content Type ◽  
Strategic Purchasing ◽  
Positive Effects ◽  
Confirmatory Factor

PurposeThis paper aims to empirically examine the moderating role of strategic purchasing on the relationship between supply base complexity (SBC) and purchasing performance.Design/methodology/approachSurvey data were collected from 209 firms listed in the Capital Top 500 Firms of Turkey. Measurement properties were assessed via confirmatory factor analysis, and the conceptual model was tested via hierarchical regression analysis. A supplementary analysis based on 14 semi-structured interviews was conducted to provide further insights on the survey findings.FindingsRegarding structural SBC, the results suggest that horizontal complexity and supplier interaction improve purchasing performance, but only in firms with high strategic purchasing. By contrast, spatial complexity reduces purchasing performance in firms with high strategic purchasing, while supplier differentiation does not have any effect. Regarding dynamic SBC, the results show that both delivery complexity and supplier instability reduce purchasing performance when firms have low strategic purchasing. Interviews further suggest that firms with high strategic purchasing leverage the positive effects and mitigate the negative effects of SBC by having a long-term focus, considering multiple performance criteria and adopting advanced purchasing practices.Practical implicationsIn contrast to what is widely posited in the existing literature, the nuanced findings of this study reveal that complexity is not always detrimental. The results suggest that practitioners should aim for high levels of strategic purchasing to suppress the negative effects of SBC while leveraging its benefits.Originality/valueBy investigating the contingency role of strategic purchasing, this study provides novel insights into the under-investigated issue of how to best “manage” SBC.

scholarly journals Evaluating the measurement properties of the 26-item Expanded Prostate Cancer Index Composite (EPIC-26) with a multicenter cohort

2019 ◽  
Vol 14 (4) ◽  
Author(s):  
R. Trafford Crump ◽  
Alex Peterson ◽  
Camille Charbonneau ◽  
Kevin V. Carlson ◽  
Jason M. Sutherland ◽  
...  
Keyword(s):  
Quality Of Life ◽  
Prostate Cancer ◽  
Factor Analysis ◽  
Confirmatory Factor Analysis ◽  
Construct Validity ◽  
Localized Prostate Cancer ◽  
Measurement Properties ◽  
Confirmatory Factor ◽  
Ceiling Effects

Introduction: We aimed to evaluate the psychometric properties of the 26-item Expanded Prostate Cancer Index Composite (EPIC-26) for measuring the quality of life in patients treated for localized prostate cancer. The EPIC-26 is a patient-reported outcome instrument recommended for use with patients treated for localized prostate cancer. Methods: This study is based on data collected prospectively between September 2014 and February 2017 in Alberta, Canada. Men were treated with either radical prostatectomy or radiation therapy and administered the EPIC-26. Responses to the EPIC-26 were the primary outcome. Construct validity was measured using confirmatory factor analysis. Reliability was measured using Chronbach’s alpha and item-total correlation. Ceiling and floor effects were also investigated. Results: EPIC-26 response data from 205 participants (prostatectomy =138; radiation=60; both=7) were used in this analysis. The EPIC-26 was administered an average of 33.8 weeks after treatment. The confirmatory factor analysis model did not meet the threshold for adequate fit. Several items had near-zero factor loadings and were non-significant. Four out of the EPIC- 26’s five domains met the acceptable reliability threshold based on Cronbach’s alpha. Ceiling effects were observed in four out of five domains. Conclusions: The EPIC-26 demonstrated poor construct validity, adequate reliability, and large ceiling effects. Several issues were observed, suggesting that the instrument’s five domains were not well-defined by their respective items. The original EPIC’s conceptual framework should be reviewed and the shortened instrument revised to improve its performance for measuring post-treatment quality of life.

scholarly journals Does the Order of Item Difficulty of the Addenbrooke's Cognitive Examination Add Anything to Subdomain Scores in the Clinical Assessment of Dementia

2015 ◽  
Vol 5 (1) ◽  
pp. 155-169 ◽  
Author(s):  
Sarah McGrory ◽  
John M. Starr ◽  
Susan D. Shenkin ◽  
Elizabeth J. Austin ◽  
John R. Hodges
Keyword(s):  
Factor Analysis ◽  
Factor Model ◽  
Item Difficulty ◽  
Principal Component ◽  
Scaling Analysis ◽  
Degenerative Disorders ◽  
Two Samples ◽  
Confirmatory Factor ◽  
The One ◽  
Addenbrooke’S Cognitive Examination

Background: The Addenbrooke's Cognitive Examination (ACE) is used to measure cognition across a range of domains in dementia. Identifying the order in which cognitive decline occurs across items, and whether this varies between dementia aetiologies could add more information to subdomain scores. Method: ACE-Revised data from 350 patients were split into three groups: Alzheimer's type (n = 131), predominantly frontal (n = 119) and other frontotemporal lobe degenerative disorders (n = 100). Results of factor analysis and Mokken scaling analysis were compared. Results: Principal component analysis revealed one factor for each group. Confirmatory factor analysis found that the one-factor model fit two samples poorly. Mokken analyses revealed different item ordering in terms of difficulty for each group. Conclusion: The different patterns for each diagnostic group could aid in the separation of these different types of dementia.

Revisiting the Structure of the Short Dark Triad

Assessment ◽  
2017 ◽  
Vol 26 (1) ◽  
pp. 3-16 ◽  
Author(s):  
Björn N. Persson ◽  
Petri J. Kajonius ◽  
Danilo Garcia
Keyword(s):  
Dark Triad ◽  
Specific Factor ◽  
General Factor ◽  
Confirmatory Factor Analyses ◽  
Factor Loadings ◽  
The Past ◽  
S Factor ◽  
Confirmatory Factor ◽  
Best Fitting ◽  
Fitting Model

In the past decade, extensive interest has been directed toward the Dark Triad (i.e., Machiavellianism, narcissism, and psychopathy), popularly assessed by the Short Dark Triad (SD3). Nevertheless, relatively little research has been conducted on the SD3’s factor structure. We investigated the SD3’s psychometric properties in three studies with three independent samples, using exploratory and confirmatory factor analyses ( N1 = 1,487; N2 = 17,740; N3 = 496). In all three studies, Machiavellianism and psychopathy items displayed large general factor loadings, and narcissism larger specific factor loadings. In subsequent studies, two- and three-factor models fitted the data similarly, with the best fitting model being a bifactor model with items from Machiavellianism and psychopathy modelled as one specific factor, and narcissism as a second specific factor. On this basis, we suggest that the SD3 does not seem to capture the different mental processes theorized to underlie the similar behaviors generated by Machiavellianism and psychopathy. Additionally, we recommend the use of a single SD3 composite score, and not subscale scores, as subscales contain small amounts of reliable variance beyond the general factor.

Sign in / Sign up

Export Citation Format

Share Document