Reaching performance scale for stroke – Test‐retest reliability, measurement error, concurrent and discriminant validity

PM&R ◽  
2021 ◽  
Author(s):  
Sandeep K. Subramanian ◽  
Melanie C. Baniña ◽  
Andrea Turolla ◽  
Mindy F. Levin
Keyword(s):  
Measurement Error ◽  
Discriminant Validity ◽  
Retest Reliability ◽  
Test Retest Reliability ◽  
Reliability Measurement ◽  
Performance Scale

scholarly journals Psychometric properties of the critical thinking disposition assessment test amongst medical students in China: a cross-sectional study

2021 ◽  
Vol 21 (1) ◽  
Author(s):  
Liyuan Cui ◽  
Yaxin Zhu ◽  
Jinglou Qu ◽  
Liming Tie ◽  
Ziqi Wang ◽  
...  
Keyword(s):  
Factor Analysis ◽  
Critical Thinking ◽  
Medical Students ◽  
Psychometric Properties ◽  
Internal Consistency ◽  
Discriminant Validity ◽  
Retest Reliability ◽  
Critical Thinking Disposition ◽  
Thinking Disposition ◽  
Test Retest Reliability

Abstract Background Critical thinking disposition helps medical students and professionals overcome the effects of personal values and beliefs when exercising clinical judgment. The lack of effective instruments to measure critical thinking disposition in medical students has become an obstacle for training and evaluating students in undergraduate programs in China. The aim of this study was to evaluate the psychometric properties of the CTDA test. Methods A total of 278 students participated in this study and responded to the CTDA test. Cronbach’s α coefficient, internal consistency, test-retest reliability, floor effects and ceiling effects were measured to assess the reliability of the questionnaire. Construct validity of the pre-specified three-domain structure of the CTDA was evaluated by explanatory factor analysis (EFA) and confirmatory factor analysis (CFA). The convergent validity and discriminant validity were also analyzed. Results Cronbach’s alpha coefficient for the entire questionnaire was calculated to be 0.92, all of the domains showed acceptable internal consistency (0.81–0.86), and the test-retest reliability indicated acceptable intra-class correlation coefficients (ICCs) (0.93, p < 0.01). The EFA and the CFA demonstrated that the three-domain model fitted the data adequately. The test showed satisfactory convergent and discriminant validity. Conclusions The CTDA is a reliable and valid questionnaire to evaluate the disposition of medical students towards critical thinking in China and can reasonably be applied in critical thinking programs and medical education research.

scholarly journals The 2014 Ontario Child Health Study Emotional Behavioural Scales (OCHS-EBS) Part I: A Checklist for Dimensional Measurement of Selected DSM-5 Disorders

2018 ◽  
Vol 64 (6) ◽  
pp. 423-433 ◽  
Author(s):  
Laura Duncan ◽  
Katholiki Georgiades ◽  
Li Wang ◽  
Jinette Comeau ◽  
Mark A. Ferro ◽  
...  
Keyword(s):  
General Population ◽  
Child Health ◽  
Conduct Disorder ◽  
Discriminant Validity ◽  
Health Study ◽  
Retest Reliability ◽  
Dimensional Measurement ◽  
Dsm 5 ◽  
Convergent And Discriminant Validity ◽  
Test Retest Reliability

Objectives: To describe the development and psychometric properties of the 2014 Ontario Child Health Study Emotional Behavioural Scales (OCHS-EBS) for dimensional measurement of 7 disorders based on criteria from the fifth edition of the Diagnostic and Statistical Manual of Mental Disorders ( DSM-5). Methods: Scale items were selected by agreement among 19 child psychologists and psychiatrists rating the correspondence between item descriptions and DSM-5 symptoms. Psychometric evaluation of the item properties and parent/caregiver and youth scales came from a general population study of 10,802 children and youth aged 4 to 17 years in 6537 families. Test-retest reliability data were collected from a subsample of 280 children and their caregivers who independently completed the OCHS-EBS checklist on 2 occasions 7 to 14 days apart. Structural equation modelling was used to assess internal and external convergent and discriminant validity—the latter tested against the Mini International Neuropsychiatric Interview for Children and Adolescents (MINI-KID). Results: Confirmatory factor analyses exhibited adequate item fit to all scales. Except for conduct disorder and youth-assessed separation anxiety disorder, internal (Cronbach’s α) and test-retest reliability (Pearson’s r) for scale scores were 0.70 or above. Except for youth-assessed conduct disorder, the OCHS-EBS met criteria for internal and convergent and discriminant validity. Compared with the MINI-KID, the OCHS-EBS met criteria for external convergent and discriminant validity. Conclusions: The OCHS-EBS provide reliable and valid dimensional measurement of 7 DSM-5 disorders assessed by caregivers and youth in the general population. Part II describes use of the OCHS-EBS as a categorical (present/absent) measure of disorder.

scholarly journals The Relevance of Insomnia in the Diagnosis of Perinatal Depression: Validation of the Italian Version of the Insomnia Symptom Questionnaire

2021 ◽  
Vol 18 (23) ◽  
pp. 12507
Author(s):  
Lavinia De Chiara ◽  
Cristina Mazza ◽  
Eleonora Ricci ◽  
Alexia Emilia Koukopoulos ◽  
Georgios D. Kotzalidis ◽  
...  
Keyword(s):  
Convergent Validity ◽  
Predictive Power ◽  
Discriminant Validity ◽  
Late Pregnancy ◽  
Italian Version ◽  
Retest Reliability ◽  
Dsm 5 ◽  
Insomnia Symptom ◽  
Symptom Questionnaire ◽  
Test Retest Reliability

Background. Sleep disorders are common in perinatal women and may underlie or trigger anxiety and depression. We aimed to translate and validate and evaluate the psychometric properties of the Italian version of the Insomnia Symptom Questionnaire (ISQ), in a sample of women during late pregnancy and 6-months postpartum according to the DSM-5 criteria. Methods. The ISQ was administered to 292 women prenatally along with other measures of sleep quality, depression, and anxiety, to examine its construct and convergent validity. Women were readministered the ISQ six months postdelivery to assess test–retest reliability. Women were divided into DSM-5 No-Insomnia (N = 253) and Insomnia (N = 39) groups. Results. The insomnia group had received more psychopharmacotherapy, had more psychiatric family history, increased rates of medically assisted reproduction, of past perinatal psychiatric disorders, and scored higher on almost all TEMPS-A dimensions, on the EPDS, HCL-32, PSQI, and on ISQ prenatally and postnatally. ISQ scores correlated with all scales, indicating adequate convergent and discriminant validity; furthermore, it showed antenatal–postnatal test–retest reliability, 97.5% diagnostic accuracy, 79.5% sensitivity, 94.9% specificity, 70.5% positive predictive power, and 92.8% negative predictive power. Conclusions. The ISQ is useful, valid, and reliable for assessing perinatal insomnia in Italian women. The Italian version showed equivalent properties to the original version.

scholarly journals Translation and Cross-Cultural Adaptation of the Aphasia Check List (ACL) for Farsi-Speaking Persons with Aphasia

2021 ◽  
Author(s):  
Ahmad Reza Khatoonabadi ◽  
◽  
Amin Modarres Zadeh ◽  
Azar Mehri ◽  
Elke Kalbe ◽  
...  
Keyword(s):  
Internal Consistency ◽  
Discriminant Validity ◽  
Control Group ◽  
Check List ◽  
Time Saving ◽  
Cross Sectional ◽  
Retest Reliability ◽  
Ceiling Effects ◽  
Language And Cognition ◽  
Test Retest Reliability

The Aphasia Check List (ACL) test is a comprehensive, time-saving tool for language evaluation in aphasia, including a cognitive assessment part. This cross-sectional study aimed to translate this test into Farsi and analyze the psychometric features of the translated version. The original version of the ACL was translated and adapted from German; its psychometric features were then determined. Twenty participants with aphasia (PWA) and 50 age- and education-matched, cognitively healthy controls participated. Possible floor and ceiling effects, discriminant validity, test-retest reliability, and internal consistency were analyzed in addition to the evaluation of internal correlations between the test parts (Language and Cognition). Regarding the performance of PWAs in the language section and the cognitive subtests assessing attention, memory, and reasoning, there were no floor and ceiling effects. Adequate discriminant validities for the language section of the test (i.e., total score: [Mann-Whitney U= 6.000, p<0.001]; diagnostic subtests scores: [U=3.000, p<0.001]; and each subtest individually) and for the attention subtest of the cognition section [U=16.500, p<0.001] were observed. There was no difference between the control group and the patient group in the subtests of memory [U=497.500, p=0.973] and reasoning [U=3.000, p=308]. The test-retest reliability was acceptable in all subtests (ICCagreement =0.573-0.984). The ACL-P test showed appropriate internal consistency (Cronbach’s alpha=0.761 for test and retest scores). There were also significant correlations between language and cognition in the control and patient groups. The ACL-P test showed sufficient reliability and validity for the evaluation of Farsi-speaking PWAs and used in studies on this population

scholarly journals Assessing psychological adjustment and cultural reintegration after military service: development and psychometric evaluation of the post-separation Military-Civilian Adjustment and Reintegration Measure (M-CARM)

2020 ◽  
Vol 20 (1) ◽  
Author(s):  
Madeline Romaniuk ◽  
Gina Fisher ◽  
Chloe Kidd ◽  
Philip J. Batterham
Keyword(s):  
Factor Analysis ◽  
Phase I ◽  
Psychological Adjustment ◽  
Internal Consistency ◽  
Military Service ◽  
Discriminant Validity ◽  
Civilian Life ◽  
Retest Reliability ◽  
Confirmatory Factor ◽  
Test Retest Reliability

Abstract Background The transition out of military service and subsequent reintegration to civilian life has been established as a period associated with an increased risk of psychological adjustment difficulties, psychiatric disorders and suicide risk, yet no tool exists to measure cultural and psychological adjustment following permanent separation from the military. This study describes the two-phase mixed-methods development and validation of the self-report Military-Civilian Adjustment and Reintegration Measure (M-CARM). Methods In Phase I, four focus groups (n = 20) and semi-structured one-on-one interviews (n = 80) enabled thematic analysis and generation of 53 initial items that were reviewed by an expert multidisciplinary panel (n = 12) and piloted for clarity and relevance in an Australian service-veteran sample (n = 11). In Phase II, psychometric properties of the 47 items resulting from Phase I were evaluated with online assessment of a convenience sample of transitioned Australian Defence Force veterans (n = 725). Analyses included exploratory and confirmatory factor analyses, as well as evaluation of test-retest reliability, internal consistency, and convergent, divergent and discriminant validity. Results Exploratory factor analysis on a randomized split-half sample (n = 357), resulted in a 21-item, five-factor solution of Purpose and Connection, Help seeking, Beliefs about civilians, Resentment and regret, and Regimentation, explaining 53.22% of the variance. Confirmatory factor analysis (n = 368) verified this factor structure without modification (χ2 = 304.96, df = 160; CFI = .96, TLI = .94, NFI = .91, RMSEA = .05). Strong convergent, divergent and discriminant validity was demonstrated as M-CARM scores significantly correlated with related constructs assessed by standardised clinical measures as well as differentiated groups based on three binary reintegration items, with large effect sizes (d = > 1). Strong test-retest reliability for the total score (n = 186, r = .93) and excellent internal consistency (n = 725, a = .90) were also found. Conclusions Results provide promising evidence the M-CARM is a valid, reliable measure of psychological and cultural reintegration to civilian life, with potential for considerable clinical and research application.

scholarly journals NIH Toolbox Cognitive Battery (NIHTB-CB): The NIHTB Pattern Comparison Processing Speed Test

2014 ◽  
Vol 20 (6) ◽  
pp. 630-641 ◽  
Author(s):  
Noelle E. Carlozzi ◽  
David S. Tulsky ◽  
Nancy D. Chiaravalloti ◽  
Jennifer L. Beaumont ◽  
Sandra Weintraub ◽  
...  
Keyword(s):  
Construct Validity ◽  
Processing Speed ◽  
Discriminant Validity ◽  
Composite Index ◽  
Good Test ◽  
Validation Data ◽  
Retest Reliability ◽  
Speed Test ◽  
Pattern Comparison ◽  
Test Retest Reliability

AbstractThe NIH Toolbox (NIHTB) Pattern Comparison Processing Speed Test was developed to assess processing speed within the NIHTB for the Assessment of Neurological Behavior and Function Cognition Battery (NIHTB-CB). This study highlights validation data collected in adults ages 18–85 on this measure and reports descriptive data, test–retest reliability, construct validity, and preliminary work creating a composite index of processing speed. Results indicated good test–retest reliability. There was also evidence for both convergent and discriminant validity; the Pattern Comparison Processing Speed Test demonstrated moderate significant correlations with other processing speed tests (i.e., WAIS-IV Coding, Symbol Search and Processing Speed Index), small significant correlations with measures of working memory (i.e., WAIS-IV Letter-Number Sequencing and PASAT), and non-significant correlations with a test of vocabulary comprehension (i.e., PPVT-IV). Finally, analyses comparing and combining scores on the NIHTB Pattern Comparison Processing Speed Test with other measures of simple reaction time from the NIHTB-CB indicated that a Processing Speed Composite score performed better than any test examined in isolation. The NIHTB Pattern Comparison Processing Speed Test exhibits several strengths: it is appropriate for use across the lifespan (ages, 3–85 years), it is short and easy to administer, and it has high construct validity. (JINS, 2014,20, 1–12)

scholarly journals Brazilian version of the Quality of Care Scale: the perspective of people with disabilities

2014 ◽  
Vol 48 (4) ◽  
pp. 583-593 ◽  
Author(s):  
Juliana Bredemeier ◽  
Marilyn Agranonik ◽  
Tatiana Spalding Perez ◽  
Marcelo Pio de Almeida Fleck
Keyword(s):  
Quality Of Care ◽  
Intellectual Disabilities ◽  
Principal Components ◽  
Discriminant Validity ◽  
Physical Disabilities ◽  
Metropolitan Region ◽  
Retest Reliability ◽  
Two Samples ◽  
Test Retest Reliability

OBJECTIVE To analyze evidence of the validity and reliability of a Brazilian Portuguese version of the Quality of Care Scale from the perspective of people with physical and intellectual disabilities.METHODS There were 162 people with physical disabilities and 156 with intellectual disabilities from Porto Alegre and metropolitan region, who participated in the study in 2008. Classical psychometrics was used to independently analyze the two samples. Hypotheses for evidence of criterion validity (concurrent type) were tested with the Mann-Whitney test for non-normal distributions. Principal components analysis was used to explore factorial models. Evidence of reliability was calculated with Cronbach alpha for the scales and subscales. Test-retest reliability was analyzed for individuals with intellectual disabilities through intra-class correlation coefficient and the Willcoxon test.RESULTS The principal components in the group with physical disabilities replicated the original model presented as a solution to the international project data. Evidence of discriminant validity and test-retest reliability was found.CONCLUSIONS The transcultural factor model found within the international sample project seems appropriate for the samples investigated in this study, especially the physical disabilities group. Depression, pain, satisfaction with life and disability may play a mediating role in the evaluation of quality of care. Additional research is needed to add to evidence of the validity of the instruments.

scholarly journals Development and Validity of the Questionnaire of Patients' Experiences in Postacute Outpatient Physical Therapy Settings

2015 ◽  
Vol 95 (5) ◽  
pp. 767-777 ◽  
Author(s):  
Francesc Medina-Mirapeix ◽  
María Elena del Baño-Aledo ◽  
Jacinto Javier Martínez-Payá ◽  
María Carmen Lillo-Navarro ◽  
Pilar Escolar-Reina
Keyword(s):  
Factor Structure ◽  
Health Care Quality ◽  
Discriminant Validity ◽  
Care Delivery ◽  
Intraclass Correlation ◽  
Care Quality ◽  
Validity And Reliability ◽  
Study Objective ◽  
Retest Reliability ◽  
Test Retest Reliability

BackgroundPatient feedback surveys are increasingly seen as a key component of health care quality monitoring and improvement.ObjectiveThe study objective was to describe the development and initial psychometric evaluation of a fixed-length questionnaire about the experiences of patients receiving physical therapist treatment in postacute outpatient settings.DesignThis was an instrument development study with validity and reliability testing.MethodsA total of 465 participants attending 3 rehabilitation centers for musculoskeletal conditions completed the questionnaire. A cognitive pretest was applied to the draft version (n=94), and a revised version was evaluated for test-retest reliability (n=90). Analyses to evaluate variance and nonresponse rates for items, the factor structure of the questionnaire, and the metric properties of multi-item scales were conducted.ResultsExploratory factor analyses yielded evidence for a 7-factor structure of the questionnaire, with 3 factors that may be conceptually viewed as professionals' attitudes and behavior (providing information and education, sensitivity to patients' changes, and emotional support) and 4 factors that conceptually reflect organizational environment (duration of attendance, interruptions during care delivery, waiting times, and patient safety). Item-scale correlations ranged from .70 to .93. The percentage of scaling success was 100% for all of the scales. Cronbach alpha coefficients ranged from .70 to .87. Intraclass correlation coefficients ranged from .57 to .80 (median=.68).LimitationsGeneralization to other patients is not known.ConclusionsThe questionnaire has test-retest reliability, and the scales have internal consistency and convergent and discriminant validity. All of the scales are distinct and unidimensional.

scholarly journals Reliability and Construct Validity of Self-Report Questionnaires for Patients With Pelvic Girdle Pain

2012 ◽  
Vol 92 (1) ◽  
pp. 111-123 ◽  
Author(s):  
Margreth Grotle ◽  
Andrew M. Garratt ◽  
Hanne Krogstad Jenssen ◽  
Britt Stuge
Keyword(s):  
Construct Validity ◽  
Internal Consistency ◽  
Discriminant Validity ◽  
Pelvic Girdle ◽  
Self Report ◽  
Pelvic Girdle Pain ◽  
Consistency Test ◽  
Retest Reliability ◽  
Sf 36 ◽  
Test Retest Reliability

Background There is little evidence for the measurement properties of instruments commonly used for women with pelvic girdle pain. Objective The aim of this study was to examine the internal consistency, test-retest reliability, and construct validity of instruments used for women with pelvic girdle pain. Design This was a cross-sectional methodology study, including test-retest reliability assessment. Methods Women with pelvic girdle pain in pregnancy and after delivery participated in a postal survey that included the Pelvic Girdle Questionnaire (PGQ), Oswestry Disability Index (ODI), Disability Rating Index (DRI), Fear-Avoidance Beliefs Questionnaire (FABQ), Pain Catastrophizing Scale (PCS), and 8-item version of the Medical Outcomes Study 36-Item Short-Form Health Survey questionnaire (SF-36). Test-retest reliability was assessed with a random subsample 1 week later. Internal consistency was assessed with the Cronbach alpha, and test-retest reliability was assessed with the intraclass correlation coefficient (ICC) and minimal detectable change (MDC). Construct validity based on hypotheses was assessed by correlation analysis. Discriminant validity was assessed with the area under the receiver operating characteristic curve. Results All participants responded to the main (N=87) and test-retest (n=42) surveys. Cronbach alpha values ranged from .88 to .94, and ICCs ranged from .78 to .94. The MDC at the individual level constituted about 7% to 14% of total scores for the 8-item version of the SF-36, ODI, and PGQ activity subscale; about 18% to 22% for the DRI, PGQ symptom subscale, and PCS; and about 25% for the FABQ. Hypotheses were mostly confirmed by correlations between the instruments. The PGQ was the only instrument that significantly discriminated participants who were pregnant from participants who were not pregnant as well as pain locations. Limitations A comparison of responsiveness to change of the various instruments used in this study was not undertaken, but will be carried out in a future study. Conclusions Self-report instruments for assessing health showed good internal consistency, test-retest reliability, and construct validity for women with pelvic girdle pain. The PGQ was the only instrument with satisfactory discriminant validity, thus, it is recommended for evaluating symptoms and disability in patients with pelvic girdle pain.

Sign in / Sign up

Export Citation Format

Share Document