scholarly journals Psychometric Properties of the Critical Thinking Disposition Assessment Test Amongst Medical Students in China: A Cross-Sectional Study

2020 ◽  
Author(s):  
Liyuan Cui ◽  
Yaxin Zhu ◽  
Jinglou Qu ◽  
Liming Tie ◽  
Ziqi Wang ◽  
...  

Abstract Background: Critical thinking disposition helps medical students and professionals overcome the effects of personal values and beliefs when exercising clinical judgment. The lack of effective instruments to measure critical thinking disposition in medical students has become an obstacle for training and evaluating students in undergraduate programs in China. The aim of this study was to evaluate the psychometric properties of the CTDA test.Methods: A total of 278 students participated in this study and responded to the CTDA test. Cronbach’s a coefficient, internal consistency, test-retest reliability, floor effects and ceiling effects were measured to assess the reliability of the questionnaire. Construct validity of the pre-specified three-domain structure of the CTDA was evaluated by explanatory factor analysis (EFA) and confirmatory factor analysis (CFA). The convergent validity and discriminant validity were also analyzed.Results: Cronbach’s alpha coefficient for the entire questionnaire was calculated to be 0.92, all of the domains showed acceptable internal consistency (0.81-0.86), and the test-retest reliability indicated acceptable intra-class correlation coefficients (ICCs) (0.93, p<0.01). The EFA and the CFA demonstrated that the three-domain model fitted the data adequately. The test showed satisfactory convergent and discriminant validity.Conclusions: The CTDA is a reliable and valid questionnaire to evaluate the disposition of medical students towards critical thinking in China and can reasonably be applied in critical thinking programs and medical education research.

2021 ◽  
Vol 21 (1) ◽  
Author(s):  
Liyuan Cui ◽  
Yaxin Zhu ◽  
Jinglou Qu ◽  
Liming Tie ◽  
Ziqi Wang ◽  
...  

Abstract Background Critical thinking disposition helps medical students and professionals overcome the effects of personal values and beliefs when exercising clinical judgment. The lack of effective instruments to measure critical thinking disposition in medical students has become an obstacle for training and evaluating students in undergraduate programs in China. The aim of this study was to evaluate the psychometric properties of the CTDA test. Methods A total of 278 students participated in this study and responded to the CTDA test. Cronbach’s α coefficient, internal consistency, test-retest reliability, floor effects and ceiling effects were measured to assess the reliability of the questionnaire. Construct validity of the pre-specified three-domain structure of the CTDA was evaluated by explanatory factor analysis (EFA) and confirmatory factor analysis (CFA). The convergent validity and discriminant validity were also analyzed. Results Cronbach’s alpha coefficient for the entire questionnaire was calculated to be 0.92, all of the domains showed acceptable internal consistency (0.81–0.86), and the test-retest reliability indicated acceptable intra-class correlation coefficients (ICCs) (0.93, p < 0.01). The EFA and the CFA demonstrated that the three-domain model fitted the data adequately. The test showed satisfactory convergent and discriminant validity. Conclusions The CTDA is a reliable and valid questionnaire to evaluate the disposition of medical students towards critical thinking in China and can reasonably be applied in critical thinking programs and medical education research.


2020 ◽  
Author(s):  
Liyuan Cui ◽  
Yaxin Zhu ◽  
Jinglou Qu ◽  
Liming Tie ◽  
Ziqi Wang ◽  
...  

Abstract Background: Critical thinking disposition helps medical students and professionals overcome the effects of personal values and beliefs when exercising clinical judgment. The lack of effective instruments to measure critical thinking disposition in medical students has become an obstacle for training and evaluating students in undergraduate programs in China. The aim of this study was to evaluate the psychometric properties of the CTDA test.Methods: A total of 278 students participated in this study and responded to the CTDA test. Cronbach’s a coefficient, internal consistency, test-retest reliability, floor effects and ceiling effects were measured to assess the reliability of the questionnaire. Construct validity of the pre-specified three-domain structure of the CTDA was evaluated by explanatory factor analysis (EFA) and confirmatory factor analysis (CFA). The convergent validity and discriminant validity were also analyzed.Results: Cronbach’s alpha coefficient for the entire questionnaire was calculated to be 0.92, all of the domains showed acceptable internal consistency (0.81-0.86), and the test-retest reliability indicated acceptable intra-class correlation coefficients (ICCs) (0.93, p<0.01). The EFA and the CFA demonstrated that the three-domain model fitted the data adequately. The test showed satisfactory convergent and discriminant validity.Conclusions: The CTDA is a reliable and valid questionnaire to evaluate the disposition of medical students towards critical thinking in China and can reasonably be applied in critical thinking programs and medical education research.


2020 ◽  
Author(s):  
Liyuan Cui ◽  
Yaxin Zhu ◽  
Jinglou Qu ◽  
Liming Tie ◽  
Ziqi Wang ◽  
...  

Abstract Background: Critical thinking helps medical students and professionals overcome the effects of personal values and beliefs when exercising clinical judgment. The lack of effective instruments to measure critical thinking disposition in medical students has become an obstacle for training and evaluating students in undergraduate programs in China. The aim of this study was to evaluate the psychometric properties of the CTDA test.Methods: A total of 278 students participated in this study and responded the CTDA test. Cronbach’s a coefficient, internal consistency, test-retest reliability, floor effects and ceiling effects were measured to assess the reliability of the questionnaire. Construct validity of the pre-specified three-domain structure of the CTDA was evaluated by the confirmatory factor analysis (CFA). The concurrent validity, convergent validity and discriminant validity were also analyzed.Results: Cronbach’s alpha coefficient for the entire questionnaire was 0.923, all of the domains showed excellent internal consistency (0.814-0.861), and the test-retest reliability indicated acceptable intra-class correlation coefficients (ICCs) (0.710-0.795, p<0.01). The CFA demonstrated that the three-domain model fitted the data adequately. All dimensions were significantly correlated with the Self-assessment Scale on Active Learning and Critical Thinking (SSACT) and subscales (p<0.01), and the instrument showed satisfactory convergent and discriminant validity.Conclusions: The CTDA has acceptable psychometric characteristics and is a reliable and valid questionnaire to evaluate medical students’ disposition towards critical thinking in China. The CTDA could be applied in critical thinking programs and medical education research.


2017 ◽  
Vol 32 (2) ◽  
Author(s):  
Shannon Gwin ◽  
Paul Branscum ◽  
E. Laurette Taylor

The purpose of this study was to create a valid and reliable instrument to evaluate theory-basedbeliefs towards physical activity among clergy members. Data were collected from 174 clergy that par-ticipated in a 15-item online and paper-based survey. Psychometric properties of the instrument includedconfirmatory factor analysis (construct validity), and cronbach’s alpha (internal consistency reliability).In addition, the stability (test-retest reliability) of each subscale was evaluated with a sub-sample of 30participants. Results show the instrument was both valid and reliable, and will be useful in future studiestargeting this population. Future implications are discussed.


2020 ◽  
Vol 20 (1) ◽  
Author(s):  
Madeline Romaniuk ◽  
Gina Fisher ◽  
Chloe Kidd ◽  
Philip J. Batterham

Abstract Background The transition out of military service and subsequent reintegration to civilian life has been established as a period associated with an increased risk of psychological adjustment difficulties, psychiatric disorders and suicide risk, yet no tool exists to measure cultural and psychological adjustment following permanent separation from the military. This study describes the two-phase mixed-methods development and validation of the self-report Military-Civilian Adjustment and Reintegration Measure (M-CARM). Methods In Phase I, four focus groups (n = 20) and semi-structured one-on-one interviews (n = 80) enabled thematic analysis and generation of 53 initial items that were reviewed by an expert multidisciplinary panel (n = 12) and piloted for clarity and relevance in an Australian service-veteran sample (n = 11). In Phase II, psychometric properties of the 47 items resulting from Phase I were evaluated with online assessment of a convenience sample of transitioned Australian Defence Force veterans (n = 725). Analyses included exploratory and confirmatory factor analyses, as well as evaluation of test-retest reliability, internal consistency, and convergent, divergent and discriminant validity. Results Exploratory factor analysis on a randomized split-half sample (n = 357), resulted in a 21-item, five-factor solution of Purpose and Connection, Help seeking, Beliefs about civilians, Resentment and regret, and Regimentation, explaining 53.22% of the variance. Confirmatory factor analysis (n = 368) verified this factor structure without modification (χ2 = 304.96, df = 160; CFI = .96, TLI = .94, NFI = .91, RMSEA = .05). Strong convergent, divergent and discriminant validity was demonstrated as M-CARM scores significantly correlated with related constructs assessed by standardised clinical measures as well as differentiated groups based on three binary reintegration items, with large effect sizes (d = > 1). Strong test-retest reliability for the total score (n = 186, r = .93) and excellent internal consistency (n = 725, a = .90) were also found. Conclusions Results provide promising evidence the M-CARM is a valid, reliable measure of psychological and cultural reintegration to civilian life, with potential for considerable clinical and research application.


Author(s):  
Negar Nikbakht ◽  
◽  
Mehdi Rezaee ◽  
Seyed Mehdi Tabatabaee ◽  
Gholam-Ali Shahidi ◽  
...  

Introduction: There is a need to have appropriate information about the ability of Parkinson's disease (PD) patients to perform cognitive instrumental activities of daily living (IADL). The purpose of the present study was to assess the psychometric properties of the Persian version of the Penn Parkinson's Daily Activities Questionnaire-15 (PDAQ-15). Methods: A total of 165 knowledgeable informants of PD patients completed the PDAQ-15. The Clinical Dementia Rating Scale, Hoehn and Yahr staging, Hospital Anxiety and Depression Scale (HADS) and Lawton IADL scale were included in the study. Internal consistency and test-retest reliability were evaluated by Cronbach's alpha coefficient and intraclass correlation coefficient (ICC), respectively. To examine the dimensionality of the questionnaire, exploratory factor analysis was used. The construct validity was assessed using Spearman rank correlation test. To assess the discriminative validity, PDAQ-15 scores were compared across cognitive stages. Results: The PDAQ-15 showed strong internal consistency (Cronbach's α = 0.99) and test-retest reliability (ICC= 0.99). Only one dimension identified for the PDAQ-15 in the factor analysis. There was strong correlation between PDAQ-15 with depression domain of HADS scale and Lawton IADL scale. (rs = |0.71–0.95|). The correlation of PDAQ-15 with anxiety domain of HADS scale was moderate (rs = 0.66). Discriminative validity analysis showed that the PDAQ-15 has significant power to discriminate between PD patients across cognitive stages. Conclusion: These results suggest that the PDAQ-15 is a valid and reliable PD-specific instrument that can be useful in clinical and research settings.


Author(s):  
Cheng Chen ◽  
Susanne Weyland ◽  
Julian Fritsch ◽  
Alexander Woll ◽  
Claudia Niessner ◽  
...  

Objective: The purposes of this paper were to (a) develop a new short, theory-driven, version of the physical activity enjoyment scale (PACES-S) using content analysis; and (b) subsequently to measure the psychometric properties (construct validity, internal consistency, test–retest reliability, and concurrent validity) of the PACES-S for adolescents. Methods: Six experts used a four-point Likert scale to assess the content validity of each of the 16 items of the physical activity enjoyment scale according to a provided definition of physical activity enjoyment. Based on the results, exploratory factor analysis was used to analyze survey data from a longitudinal study of 182 individuals (Measure 1 of Study 1: 15.75 ± 3.39 yrs; 56.6% boys, 43.4% girls), and confirmatory factor analysis (Measure 2 of Study 1: 15.69 ± 3.44 yrs; 56.3% boys, 43.7% girls) was used to analyze the survey data from a cross-sectional study of 3219 individuals (Study 2; 15.99 ± 3.10 yrs; 47.8% boys, 52.2% girls) to assess the construct validity of the new measure. To assess the reliability, test–retest reliability was assessed in Study 1 and internal consistency in Study 1 and 2. For the concurrent validity, correlations with self-reported and device-based physical activity behavior were assessed in both studies. Results: Four out of sixteen items were selected for PACES-S. Exploratory factor analysis and confirmatory factor analyses identified and supported its factorial validity (χ2 = 53.62, df = 2, p < 0.001; RMSEA = 0.073; CFI = 0.99; RFI = 0.96; NFI = 0.99; TLI = 0.96; IFI = 0.99). Results showed good test–retest reliability (r = 0.76) and internal consistency (a = 0.82 to 0.88). Regarding concurrent validity, the results showed positive correlations with a physical activity questionnaire (Study 1: r = 0.36), with a physical activity diary (Study 1: r = 0.44), and with accelerometer-recorded data (Study 1: r = 0.32; Study 2: r = 0.21). Conclusions: The results indicate that PACES-S is a reliable and valid instrument that may be particularly useful to measure physical activity enjoyment in large-scale studies. It shows comparable measurement properties as the long version of PACES.


2021 ◽  
pp. 105477382110368
Author(s):  
Kuei-Min Chen ◽  
Meng-Chin Chen ◽  
Hui-Fen Hsu ◽  
Frank Belcastro ◽  
Wei-Yun Chang

This study aimed to verify the factorial structure, internal consistency, test-retest reliability, and discriminant validity of the High-need Community-dwelling Older Adults Screening Scale (HCOASS). A 20-item HCOASS covering five domains was used with a systematic random sample of 818 community-dwelling older adults. After the analyses, the Exploratory Factor Analysis suggested a removal of two items, resulting in 5 domains with 18 items, and the Confirmatory Factor Analysis yielded satisfactory results with Goodness of Fit Index of .98. The HCOASS demonstrated acceptable internal consistency (Kuder-Richardson Formula 20 α = .75) and excellent test-retest reliability (0.94; 95% CI [0.91, 0.97]). The area under the Receiver Operating Characteristic (ROC) curve was 0.90 (95% CI [0.84, 0.95]) and the optimal cut-off score was 4/5. The HCOASS is a valid and reliable screening tool. It has the potential for consistent and efficient administration to be used by non-healthcare professionals in the community.


2015 ◽  
Vol 2015 ◽  
pp. 1-8 ◽  
Author(s):  
Sedat Batmaz ◽  
Sibel Kocbiyik ◽  
Ozgur Ahmet Yuncu

Cognitive distortions are interrelated with all layers of cognitions, and they may be part of the treatment once they are accessed, identified, labeled, and changed. From both a research and a clinical perspective, it is of utmost importance to disentangle cognitive distortions from similar constructs. Recently, the Cognitive Distortions Questionnaire (CD-Quest), a brief and comprehensive measure, was developed to assess both the frequency and the intensity of cognitive distortions. The aim of the present study was to assess the psychometric properties of the Turkish version of the CD-Quest in a psychiatric outpatient sample. Demographic and clinical data of the participants were analyzed by descriptive statistics. For group comparisons, Student’st-test was applied. An exploratory principal components factor analysis was performed, followed by an oblique rotation. To assess the internal consistency of the scale Cronbach’sαwas computed. The correlation coefficient was calculated for test-retest reliability over a 4-week period. For concurrent validity, bivariate Pearson correlation analyses were conducted with the measures of mood severity and negatively biased cognitions. The results revealed that the scale had excellent internal consistency, good test-retest reliability, unidimensional factor structure, and evidence of concurrent and discriminant validity.


2014 ◽  
Vol 42 (2) ◽  
pp. 303-311 ◽  
Author(s):  
Shao-Ping Yuan ◽  
Hung-Chang Liao ◽  
Ya-huei Wang ◽  
Ming-Jen Chou

Our aim was to develop the Critical Thinking Disposition Assessment (CTDA) scale to assess medical care professionals' or students' level of critical thinking disposition and to validate the psychometric properties of this instrument. A total of 775 medical care professionals and students agreed to respond to the survey instrument. Exploratory factor analysis extracted 3 factors; systematicity and analyticity, inquisitiveness and conversance, and maturity and skepticism, accounting for 63.40% of the variance. The final scale comprised 19 statements rated on a 7-point Likert scale. Reliability analysis produced Cronbach's alpha coefficients ranging from .86 to .94 for the 3 factors and the overall scale, indicating acceptable reliability for the instrument. The concurrent validity analysis was also conducted to compare the instrument with other measures. In light of these findings, the CTDA was found to be a valid and reliable instrument to measure the critical thinking disposition of medical care professionals and students.


Sign in / Sign up

Export Citation Format

Share Document