scholarly journals Cronbach’s Alpha under Insufficient Effort Responding: An Analytic Approach

Stats ◽  
2018 ◽  
Vol 2 (1) ◽  
pp. 1-14 ◽  
Author(s):  
Stephen Carden ◽  
Trevor Camper ◽  
Nicholas Holtzman

Surveys commonly suffer from insufficient effort responding (IER). If not accounted for, IER can cause biases and lead to false conclusions. In particular, Cronbach’s alpha has been empirically observed to either deflate or inflate due to IER. This paper will elucidate how IER impacts Cronbach’s alpha in a variety of situations. Previous results concerning internal consistency under mixture models are extended to obtain a characterization of Cronbach’s alpha in terms of item validities, average variances, and average covariances. The characterization is then applied to contaminating distributions representing various types of IER. The discussion will provide commentary on previous simulation-based investigations, confirming some previous hypotheses for the common types of IER, but also revealing possibilities from newly considered responding patterns. Specifically, it is possible that the bias can change from negative to positive (and vice versa) as the proportion of contamination increases.

2021 ◽  
pp. 001316442199253
Author(s):  
Robert C. Foster

This article presents some equivalent forms of the common Kuder–Richardson Formula 21 and 20 estimators for nondichotomous data belonging to certain other exponential families, such as Poisson count data, exponential data, or geometric counts of trials until failure. Using the generalized framework of Foster (2020), an equation for the reliability for a subset of the natural exponential family have quadratic variance function is derived for known population parameters, and both formulas are shown to be different plug-in estimators of this quantity. The equivalent Kuder–Richardson Formulas 20 and 21 are given for six different natural exponential families, and these match earlier derivations in the case of binomial and Poisson data. Simulations show performance exceeding that of Cronbach’s alpha in terms of root mean square error when the formula matching the correct exponential family is used, and a discussion of Jensen’s inequality suggests explanations for peculiarities of the bias and standard error of the simulations across the different exponential families.


2020 ◽  
Vol 8 (1) ◽  
Author(s):  
Melis Orhan ◽  
Nicole Korten ◽  
Ralph Kupka ◽  
Patricia van Oppen ◽  
Max Stek ◽  
...  

Abstract Background Many frequently used instruments fail to assess psychosocial functioning in patients with bipolar disorder. The Functioning Assessment Short Test (FAST) was developed in order to tackle this problem and to assess the main functioning problems experienced by patients with bipolar disorder. However, the original FAST is not fully applicable in older adults due to the domain of occupational functioning. The aim of our study was to validate an adapted version for Older adults (FAST-O) in a group of older adults with bipolar disorder (OABD). Methods 88 patients aged 50 years and over diagnosed with bipolar disorder were included. We adapted the items in the area of “work-related functioning” of the FAST into items assessing “societal functioning”. Several measurements were conducted in order to analyse the psychometric qualities of the FAST-O (confirmatory factor analysis for internal structure, Cronbach’s alpha for internal consistency, Spearman’s rho for concurrent validity, Mann–Whitney U test for discriminant validity). Results Mean age in the study sample was 65.3 (SD = 7.5) and 57.3% was female. The internal structure was most similar to the internal structure of the original FAST. The internal consistency was excellent (Cronbach’s alpha = .93). The concurrent validity when correlated with the Social and Occupational Functioning Assessment Scale was low, but significant. The FAST-O was also able to distinguish between euthymic and symptomatic OABD patients. Conclusions The FAST-O has strong psychometric qualities. Based on our results, we can conclude that the FAST-O is a short, efficient solution in order to replace global rating scales or extensive test batteries in order to assess daily functioning of older psychiatric patients in a valid and reliable manner.


2021 ◽  
Vol 9 (1) ◽  
Author(s):  
Rebecca Horn ◽  
Kanykey Jailobaeva ◽  
Stella Arakelyan ◽  
Alastair Ager

Abstract Background Studies of psychological distress in Sierra Leone have typically used measures which were developed for use in other contexts, and which often have not been adapted or validated for use in Sierra Leone. This has resulted in a lack of reliable information about the patterns of psychological distress within the population, which is a barrier to the development of effective and appropriate mental health services. The aim of the study was to develop a locally-appropriate measure of psychological distress for Sierra Leone. Methods The new measure consists of two instruments: the Sierra Leone Psychological Distress Scale (SLPDS) and a gendered measure of ability to carry out daily tasks—a Function scale—as an indication of the severity of distress. A three-phase mixed methods exploratory sequential study was conducted. Phase 1 was item generation and testing, leading to the development of a set of potential items for both instruments. Phase 2 was a small pilot study (N = 202) leading to the selection of the final set of items for both measures. Phase 3 was a validation phase where the SLPDS and the Function scale were administered with a larger sample of 904 respondents. Item analysis was used to assess the internal consistency of the scales, and Exploratory Factor Analysis to explore the properties of the SLPDS. Results Exploratory factor analysis using the principal axis factoring with an oblique rotation identified a three-factor structure for the 18-item SLPDS. Internal consistency for the SLPDS (Cronbach’s alpha = 0.89) and three subscales was good (Cronbach’s alpha > 0.73). The internal reliability of the male and female versions of the Function scale was also found to be acceptable (Cronbach’s alpha = 0.90 for the female scale and 0.79 for the male scale). Conclusions Together the SLPD and Function scales provide a locally-validated tool which will enable government bodies and local and international non-governmental organisations in Sierra Leone to assess mental health and psychosocial needs. This will support both effective service provision and the evaluation of initiatives designed to improve mental health and psychosocial wellbeing.


2021 ◽  
Vol 10 (10) ◽  
pp. 2081
Author(s):  
Edyta Kinel ◽  
Krzysztof Korbel ◽  
Piotr Janusz ◽  
Mateusz Kozinoga ◽  
Dariusz Czaprowski ◽  
...  

The study aimed to carry on the process of the cultural adaptation of the Italian Spine Youth Quality of Life Questionnaire (ISYQOL) into Polish (ISYQOL-PL). The a priori hypothesis was: the ISYQOL-PL questionnaire is reliable and appropriate for adolescents with a spinal deformity. Fifty-six adolescents (mean age 13.8 ± 1.9) with idiopathic scoliosis (AIS) with a mean Cobb angle 29.1 (±9.7) and two with Scheuermann juvenile kyphosis (SJK) with a kyphosis angle 67.5 (±17.7) degrees were enrolled. All patients had been wearing a corrective TLSO brace for an average duration of 2.3 (±1.8) years. The Institutional Review Board approved the study. The cross-cultural adaptation of the ISYQOL-PL was performed following the guidelines set up by the International Quality of Life Assessment Project. The reliability was assessed using internal consistency (the Cronbach’s alpha coefficient) and test–retest reliability (intraclass correlation coefficient ICC2.1, CI = 95%); moreover, floor and ceiling effects were calculated. The internal consistency was satisfactory (Cronbach’s alpha coefficient 0.8). The test–retest revealed high reliability with the value of ICC2.1 for the entire group 0.90, CI (0.84 to 0.94). There was neither floor nor ceiling effect for the ISYQOL-PL overall score. The ISYQOL-PL is reliable and can be used in adolescents with spinal deformity.


2016 ◽  
Vol 65 (3) ◽  
pp. 201-208 ◽  
Author(s):  
Eliane Traebert ◽  
Karoliny dos Santos ◽  
Luciana Müller Carvalho ◽  
Jane da Silva ◽  
Jefferson Traebert

ABSTRACT Objective To carry out the preliminary stages of the cross-cultural adaptation of the Family Assessment Device (FAD) to Brazilian Portuguese language and examine its reliability. Methods The translation and cross-cultural adaptation of the FAD were developed according to the methods internationally recommended. The resulting product was applied to 80 individuals who completed the questionnaire on two different occasions, seven days apart. Internal consistency was obtained through Cronbach’s alpha, and reliability was estimated by using the Bland and Altman method. Results The internal consistency obtained was very good (Cronbach’s alpha = 0.910). The mean differences of FAD dimensions found in the Bland and Altman test were the following: -0.21 (Problem Solving); -0.32 (Communication); -0.17 (Roles); 0.2 (Affective Responsiveness); -0.27 (Affective Involvement); -0.08 (Behavior Control); -0.02 (General Functioning). Conclusion The processes of translation and cross-cultural adaptation were successful. Assessment of the structural validity and external construct validity is recommended for the improvement of the Brazilian version.


2014 ◽  
Vol 48 (1) ◽  
pp. 25-33 ◽  
Author(s):  
Noélle de Oliveira Freitas ◽  
Marina Paes Caltran ◽  
Rosana Aparecida Spadoti Dantas ◽  
Lidia Aparecida Rossi

This methodological study aimed to describe the process of translation and cultural adaptation of the Perceived stigmatization Questionnaire (PSQ) and analyze the internal consistency of the items in the step of pre-testing. The PSQ was developed to evaluate the perception of stigmatizing behaviors of burn victims. The adaptation process was carried out from August 2012 to February 2013, comprising the steps outlined in the literature. As part of this process, the pre-test with 30 adult burn victims was held. All participants at this step reported to understand the instrument items and the scale of responses. There were no suggestions or changes in the tested version. The value of Cronbach’s alpha at pre-test was 0.87. The contribution of this study is to describe the operation of each of the steps of this methodological process and show the internal consistency of the items in the pre-test.


2018 ◽  
Vol 43 (1) ◽  
pp. 80-87 ◽  
Author(s):  
Robert Gailey ◽  
Anat Kristal ◽  
Jennifer Lucarevic ◽  
Shane Harris ◽  
Brooks Applegate ◽  
...  

Background: Prosthetic socket fit is an important element associated with successful ambulation and use of a prosthesis. Prosthetists and rehabilitation clinicians would benefit from an assessment tool that discriminates between and quantifies the multiple determinants that influence the lower limb amputee’s performance and satisfaction of a prosthetic socket. Objectives: To determine the internal consistency of the comprehensive lower limb amputee socket survey, a new self-report measure of prosthetic socket satisfaction that quantifies suspension, stability, comfort, and appearance. Study design: Cross-sectional sample of active amputees. Methods: Interviews were conducted with prosthetists, physical therapists, and lower limb amputees to identify clinical concerns and common activities influencing socket fit. An expert panel of five clinicians reviewed the items and constructed the original version of the comprehensive lower limb amputee socket survey which was then administered to a convenience sample of 47 active lower limb amputees. Item analysis and Cronbach’s alpha were used to determine the final version of the comprehensive lower limb amputee socket survey. Results: Following item raw score-to-total score correlation with Cronbach’s alpha for comprehensive lower limb amputee socket survey determinants, internal consistency improved when nine questions were eliminated. Conclusion: The comprehensive lower limb amputee socket survey is a self-report measure of prosthetic socket satisfaction with very good internal consistency. Clinical relevance When socket problems occur, the ability to determine the specific cause can reduce modification time, enhance socket fit, and promote patient satisfaction. A standardized multi-dimensional assessment measure of socket satisfaction enables prosthetists to quantify the multiple determinants of socket satisfaction, improve patient communication, and demonstrate the value of socket interventions.


2017 ◽  
Vol 41 (S1) ◽  
pp. S255-S255
Author(s):  
B. Alansari ◽  
T. AlAli

IntroductionThe Oxford Happiness Inventory (OHI) 29-Item, each involving the selection of four options that are different for each item. Although there is an Arabic version, it is not identical to the original version in terms of the number of items and response.Objectivesto evaluate the psychometric properties of the Arabic adaptation OHI and its factorial structure in undergraduate sample.MethodsThe participants were 720 first year undergraduate Kuwaitis: 360 males mean age = 20.38 ± 1.60 and 360 females; mean age = 19.71 ± 1.39 (t = 5.87, P < 0.001). The Arabic version of OHI (Argyle, Martin, & Crossland) was administered to participants. The internal consistency reliability, factor structure, and convergent validity of the OHI with Life Orientation Test (LOT-R, Adult Hope Scale (AHS), Satisfaction With Life Scale (SWLS) were assessed as well as divergent validity of the OHI with Beck Depression Inventory-II (BDI-II)ResultsInternal consistency was satisfactory for the OHI (Cronbach's alpha = 0.87) for males and (Cronbach's alpha = 0.86) for females. The results revealed no significant gender differences on happiness (F = 1.77, P > 05). Principal component analyses (PCA) showed that a seven-component solution explains %50.50 of the total variance for males and 51.47% for females. The OHI positively correlates with the following variables: SWLS (r = .52), LOT-R (r = 0.56) AHS (r = .48) while the OHI correlates negatively with BDI-II (r = -54).ConclusionsFindings confirm that the OHI provides satisfactory validation, and thus it can be recommended as a measure of happiness among Arab samples.Disclosure of interestThe authors have not supplied their declaration of competing interest.


Author(s):  
Lourrany Borges Costa ◽  
Shamyr Sulyvan de Castro ◽  
Diovana Ximenes Cavalcante Dourado ◽  
Bruna Soares Praxedes ◽  
Thayná Custódio Mota ◽  
...  

Abstract: Introduction: Clinical teaching is based on a real work environment, in professional practice settings, such as health services and units, under the supervision of the preceptor. Providing medical teachers with an assessment of their teaching skills is a powerful tool for improving clinical learning for students in training. In this context, the EFFECT (Evaluation and Feedback for Effective Clinical Teaching) questionnaire was developed by Dutch researchers in 2012 for teacher evaluation, being validated based on the literature about medical teaching in the workplace and incorporates the skills of the Canadian competency-based medical curriculum. Objective: To translate and cross-culturally adapt into Brazilian Portuguese and to validate the EFFECT questionnaire for teacher evaluation by Medical students. Method: Cross-cultural adaptation with the following steps: initial translation of the English version, synthesis of translated versions, back-translation, creation of a consensual version in Brazilian Portuguese, with adaptation, review, and analysis of content validity by an expert committee, pre-test with retrospective clarification interview, and reliability analysis by factorial analysis and internal consistency test (Cronbach’s alpha coefficient). Result: In the translation and back-translation stages, the disagreements were related to the use of synonyms and none of the items were modified in terms of their understanding, but in terms of adaptation into the Brazilian context. The evaluation of the expert committee showed the versions maintained the semantic and idiomatic equivalences of the content. Eighty-nine students participated in the pre-test. The internal consistency of the EFFECT questionnaire in Brazilian Portuguese was excellent for all domains, with Cronbach’s alpha coefficient ranging from 0.82 to 0.94. Conclusion: The translated and adapted version of the EFFECT questionnaire into Brazilian Portuguese is equivalent to the original instrument and has evidence of high validity and reliability, being able to constitute a national tool to evaluate the efficiency of clinical medicine teaching.


2018 ◽  
Vol 14 (1) ◽  
pp. 70-77 ◽  
Author(s):  
Giulia Cossu ◽  
Emilio Loi ◽  
Mauro Giovanni Carta ◽  
Alessia Bramanti

Background: The physical activity has been indicated as an experience that can help achieve positive, self-oriented own body awareness. This awareness is an aspect that tends to get worse with age. Objective: Our study aims to verify the internal consistency of a questionnaire on physical awareness in a sample of Italian elders; a secondary objective is to measure if there is a relationship between physical awareness and perceived level of physical activity. Methods: Cross sectional study on a consecutive sample of elderly people was administered the “Physical Body Experiences Questionnaire simplified for active aging (PBE-QAG)”, inspired by the “Physical Body Experiences Questionnaire”, modified, simplified and adapted to be used in the elderly over 65. To elderly people the International Physical Activity Questionnaire. Cronbach’s alpha was also used to assess internal reliability of the total PBE-QAG. The factor structure was evaluated through Confirmatory Factor Analyses (CFAs). Results: The Cronbach’s alpha was 0.8 for the “body-mind relationship” scale, 0.81 for the “accepting your body” scale, 0.83 for the “awareness of physical skills” scale, and 0.65 for the “awareness of physical limits” scale. Cronbach’s alpha for the total PBE-QAG was 0.89. The CFA indicated a model with the 4 factors (CFI = 0.989, TLI = 0.984, RMSEA = 0.076). People who conducted physical activity assiduously or regularly and over 10 minutes showed a better score to the PBE-QAG than those who declared a sporadic activity and for “less than 10 minute”, respectively. Conclusion: Our study revealed that the PBE-QAG shows an excellent total internal consistency. In the Italian sample of elderly people the questionnaire shows the model with the 4 factors described in literature.


Sign in / Sign up

Export Citation Format

Share Document