Psychometric proprieties of a color-shape version of the switch task

The impact of concussions on an individual's cognitive functioning has become a growing health concern over the past several years; however, the search for sensitive tests persists. The task-switching paradigm is known to be sensitive to various medical conditions, including concussion. Accordingly, we developed 2 versions of the color-shape switch task. Three different costs are computed from the raw scores: global switch cost, which is thought to be a measure of global cognitive control; local switch cost, which is believed to be a measure of cognitive flexibility; and working memory cost. The aim of this study was to evaluate psychometric characteristics of these costs. An ANOVA revealed a main effect of sex on local latency switch cost, with females exhibiting longer latencies than males, p = 0.05. No main effect of sex was observed on any other switch costs. Moreover, no main effect of experimenter or version of the task was observed. Local switch cost was significantly correlated with trails 4 and 5 of the Comprehensive Trail Making Test (rs > 0.21, ps < 0.04). No other significant correlation between costs and established neuropsychological tests was observed, indicating low convergent validity. The intraclass correlation coefficient estimates ranged from 0.23 to 0.77, suggesting low-to-moderate 1-week test-retest reliability. Results indicated a low switch costs; convergent validity. Moreover, results show that the traditionally computed switch costs are less reliable than the primary outcomes (i.e., reaction time and accuracy). Researchers and clinicians should rely on primary variables from the task-switching paradigm rather than computing the traditional switch costs to increase the psychometric properties of the tasks which is critical to advances in theoretical models of executive functions and evaluations of clinical populations.

Download Full-text

Validity and reliability of the Mandarin version of the Treatment Burden Questionnaire among stroke patients in Mainland China

Family Practice ◽

10.1093/fampra/cmab004 ◽

2021 ◽

Author(s):

Qi Zhang ◽

Ke Zhang ◽

Miao Li ◽

Jiaxin Gu ◽

Xintong Li ◽

...

Keyword(s):

Internal Consistency ◽

Convergent Validity ◽

Intraclass Correlation ◽

Reliability And Validity ◽

Therapeutic Interventions ◽

Treatment Burden ◽

Validity And Reliability ◽

Stroke Patients ◽

Retest Reliability ◽

Test Retest Reliability

Abstract Objectives To examine the validity and reliability of the Mandarin version of the Treatment Burden Questionnaire (TBQ) among stroke patients. Background Stroke patients need long-term management of symptoms and life situation, and treatment burden has recently emerged as a new concept that can influence the health outcomes during the rehabilitation process. Methods The convenience sampling method was used to recruit 187 cases of stroke patients in a tertiary grade hospital in Tianjin for a formal investigation. Item analysis, reliability and validity tests were carried out. The reliability test included internal consistency and test–retest reliability. And as well as content, structure and convergent validity were performed for the validity test. Results Of the 187 completed questionnaires, only 180 (96.3%) were suitable for analysis. According to the experts’ evaluation, the I-CVI of each item was from 0.833 to 1.000, and the S-CVI was 0.967. The exploratory factor analysis yielded three-factor components with a cumulative variation of 53.054%. Convergent validity was demonstrated using measures of Morisky’s Medication Adherence Scale 8 (r = –0.450, P < 0.01). All correlations between items and global scores ranged from 0.403 to 0.638. Internal consistency reliability and test–retest reliability were found to be acceptable, as indicated by a Cronbach’s α of 0.824 and an intraclass correlation coefficient of 0.846, respectively. Conclusions The Mandarin TBQ had acceptable validity and reliability. The use of TBQ in the assessment of treatment burden of stroke survivor may benefit health resources allocation and provide tailor therapeutic interventions to construct minimally disruptive care.

Download Full-text

Adaptation and Psychometric Evaluation of the Chinese Counseling Competencies Scale-Revised

Frontiers in Psychology ◽

10.3389/fpsyg.2021.688539 ◽

2021 ◽

Vol 12 ◽

Author(s):

Wei Xia ◽

William Ho Cheung Li ◽

Tingna Liang ◽

Yuanhui Luo ◽

Laurie Long Kwan Ho ◽

...

Keyword(s):

Concurrent Validity ◽

Convergent Validity ◽

Intraclass Correlation ◽

Correlation Coefficients ◽

Psychometric Evaluation ◽

Counseling Competencies ◽

Counselors In Training ◽

Rater Reliability ◽

Retest Reliability ◽

Test Retest Reliability

Objectives: This study conducted a linguistic and psychometric evaluation of the Chinese Counseling Competencies Scale-Revised (CCS-R).Methods: The Chinese CCS-R was created from the original English version using a standard forward-backward translation process. The psychometric properties of the Chinese CCS-R were examined in a cohort of 208 counselors-in-training by two independent raters. Fifty-three counselors-in-training were asked to undergo another counseling performance evaluation for the test-retest. The confirmatory factor analysis (CFA) was conducted for the Chinese CCS-R, followed by internal consistency, test-retest reliability, inter-rater reliability, convergent validity, and concurrent validity.Results: The results of the CFA supported the factorial validity of the Chinese CCS-R, with adequate construct replicability. The scale had a McDonald's omega of 0.876, and intraclass correlation coefficients of 0.63 and 0.90 for test-retest reliability and inter-rater reliability, respectively. Significantly positive correlations were observed between the Chinese CCS-R score and scores of performance checklist (Pearson's γ = 0.781), indicating a large convergent validity, and knowledge on drug abuse (Pearson's γ = 0.833), indicating a moderate concurrent validity.Conclusion: The results support that the Chinese CCS-R is a valid and reliable measure of the counseling competencies.Practice implication: The CCS-R provides trainers with a reliable tool to evaluate counseling students' competencies and to facilitate discussions with trainees about their areas for growth.

Download Full-text

The effect of performing versus preparing a task on the subsequent switch cost

Psychological Research ◽

10.1007/s00426-019-01254-7 ◽

2019 ◽

Cited By ~ 1

Author(s):

Rachel Swainson ◽

Laura Prosser ◽

Kostadin Karavasilev ◽

Aleksandra Romanczuk

Keyword(s):

Task Switching ◽

Relative Size ◽

Limited Extent ◽

Two Stage ◽

Subsequent Performance ◽

Sequence Of Events ◽

Switch Costs ◽

Task Preparation ◽

Switching Models ◽

The Impact

Abstract Behaviour occurs not as isolated incidents, but within an ongoing sequence of events. The task-switching paradigm provides a useful way to investigate the impact of different events upon subsequent performance. An implication of two-stage task-switching models is that preparing a task without performing it might affect task readiness only to a limited extent. However, recent research has surprisingly shown larger switch costs following preparation (“cue-only” trials) than following performance (“completed” trials). We set out to conduct a rigorous comparison of the size of switch costs following cue-only versus completed trials. In Experiments 1 and 2, we controlled the timing between critical trial events. This had the effect of roughly equating, but not reversing, the relative size of switch costs. In Experiment 3, we restructured the paradigm to equate the predictability of cue and target events. Switch costs following cue-only trials were now smaller than those following completed trials. These studies confirm that task preparation alone is sufficient to drive subsequent switch costs. They also indicate that task performance might increase the size of these costs, consistent with two-stage task-switching models. Switch costs appear to be affected by both the timing and predictability of trial events.

Download Full-text

The Health of the Nation Outcome Scales for Children and Adolescents in an Adolescent In-Patient Sample

Australian & New Zealand Journal of Psychiatry ◽

10.1080/j.1440-1614.2005.01533.x ◽

2005 ◽

Vol 39 (3) ◽

pp. 129-135 ◽

Cited By ~ 30

Author(s):

Paul H. Harnett ◽

Natalie J. Loxton ◽

Trevor Sadler ◽

Leanne Hides ◽

Andrea Baldwin

Keyword(s):

Children And Adolescents ◽

Convergent Validity ◽

Psychiatric Treatment ◽

Reliability And Validity ◽

Global Functioning ◽

Internal Reliability ◽

Length Of Treatment ◽

Test Retest Reliability ◽

The Impact

Objective: The primary aims of the study were to examine the reliability and validity of the Health of the Nation Outcome Scales for Children and Adolescents (HoNOSCA) in a sample of adolescents requiring medium to long-term in-patient psychiatric treatment and to examine the association between HoNOSCA scores and age, gender and length of treatment. Methods: A multidisciplinary team completed the HoNOSCA for 51 adolescent patients at intake and at 3- and 6-months following admission to the unit. Results: The study provided support for the test-retest reliability, concurrent and convergent validity, but not the internal reliability, of the HoNOSCA. Total HoNOSCA scores at intake were similar to those found in adolescent outpatient samples, although there were some differences at the level of individual items. Similarly, while the total HoNOSCA score showed some sensitivity to change, using the total HoNOSCA score obscured important changes in specific domains of functioning over the course of admission. Conclusion: The HoNOSCA was found to be a valid measure of global functioning at intake, thereby supporting its use in an adolescent psychiatric unit. However, focusing on individual items, rather than total score, appears more useful in evaluating the impact of inpatient psychiatric treatment on adolescents.

Download Full-text

Test-Retest Reliability and Validity of the Six Minute Stepper Test to Evaluate Functional Exercise Capacity in Patients with Ankylosing Spondylitis

Modern Rheumatology ◽

10.1093/mr/roab094 ◽

2021 ◽

Author(s):

Selin Bayram ◽

Deran Oskay ◽

Nurten Gizem Tore ◽

Fulden Sari ◽

Devrim Can Saraç ◽

...

Keyword(s):

Ankylosing Spondylitis ◽

Exercise Capacity ◽

Convergent Validity ◽

Pearson Correlation ◽

Physiological Responses ◽

Intraclass Correlation ◽

Reliability And Validity ◽

Rank Test ◽

Retest Reliability ◽

Test Retest Reliability

ABSTRACT Objectives The 6-minute stepper test (6MST) is a submaximal test that requires little space to assess exercise capacity compared to the 6-minute walk test (6MWT). The study aims to investigate the test-retest reliability and convergent validity of 6MST and to compare physiological responses, dyspnea, fatigue perception with 6MST and 6MWT in patients with ankylosing spondylitis (AS). Methods To test the convergent validity of 6MST, 65 patients performed both 6MWT and 6MST on the first day and correlation between two tests were assessed with Pearson correlation test. In order to investigate the test-retest reliability of the 6MST, thirty-two of the 65 patients performed 6MST one week later and intraclass correlation coefficients (ICC) were calculated. Dyspnea and fatigue perception were analyzed with using Wilcoxon signed-rank test, physiological responses were analyzed using paired sample t-test. Results Excellent test-retest reliability was observed for 6MST (ICC: 0.988). There was a significant correlation between 6MST and 6MWT (r: 0.725, p<0.001). Dyspnea and leg fatigue perception were significantly higher in 6MST (p<0.05). Physiological responses and fatigue perception were similar in both 6MST and 6MWT (p>0.05). Conclusion This study demonstrated that the 6MST is reliable and valid method to evaluate exercise capacity in patients with AS. 6MST can be used to evaluate exercise capacity of patients with AS.

Download Full-text

Development and psychometric testing of the Thai impact and burden of care scale for caregivers of persons with schizophrenia and co-occurring methamphetamine use

F1000Research ◽

10.12688/f1000research.52288.1 ◽

2021 ◽

Vol 10 ◽

pp. 484

Author(s):

Ek-uma Imkome

Keyword(s):

Convergent Validity ◽

Theoretical Models ◽

Burden Of Care ◽

Research Subjects ◽

Research Education ◽

Methamphetamine Use ◽

Bartlett’S Test ◽

Potential Benefits ◽

Persons With Schizophrenia ◽

The Impact

Objective: The objective of the present study was to develop the Thai version of the Impact and Burden of Care Scale for Caregivers of Persons with Schizophrenia and Co-occurring Methamphetamine Use (TIBSCSM) and test its psychometric properties. Methods: This instrument development research subjects were 142 caregivers of persons with schizophrenia and co-occurring methamphetamine use. Sample size adequacy was tested by Kaiser–Meyer–Olkin (KMO), and Bartlett's test of sphericity tested the adequacy of the item correlation matrix. The second-order confirmatory factor analysis (CFA) was used to test the theoretical model. Results The 32-item TIBSCSM showed convergent validity correlations with two quality-of-life measures. Additionally, KMO=0.9, Bartlett’s Test of Sphericity χ2=5248.5, df=496, p<0.001, and internal consistency reliability was high (α=0.9). The CFA has shown that the findings are supported by the theoretical models (χ2=325.2, df=287, p<0.001, RMSEA=0.0, CFI =0.9). Conclusion: The TIBSCSM scale has potential benefits for psychiatric nurses and psychiatric care teams to measure the impact and care burden of caregivers of persons with schizophrenia and methamphetamine use in the areas of nursing, research, education, and clinical determination. The test results suggested that The TIBSCSM scale has potential benefits for psychiatric and mental health care team to assess the impact and burden care of schizophrenic caregiver for both research and clinical purposes, especially during the COVID-19 pandemic for providing care to relieve the impact and burden of care.

Download Full-text

Test-retest reliability of the human functional connectome over consecutive days: identifying highly reliable portions and assessing the impact of methodological choices

Network Neuroscience ◽

10.1162/netn_a_00148 ◽

2020 ◽

Vol 4 (3) ◽

pp. 925-945

Author(s):

Leonardo Tozzi ◽

Scott L. Fleming ◽

Zachary D. Taylor ◽

Cooper D. Raterink ◽

Leanne M. Williams

Keyword(s):

Human Brain ◽

Functional Neuroimaging ◽

Intraclass Correlation ◽

Good Reliability ◽

Retest Reliability ◽

Methodological Choices ◽

Functional Connectome ◽

Global Signal ◽

Test Retest Reliability ◽

The Impact

Countless studies have advanced our understanding of the human brain and its organization by using functional magnetic resonance imaging (fMRI) to derive network representations of human brain function. However, we do not know to what extent these “functional connectomes” are reliable over time. In a large public sample of healthy participants ( N = 833) scanned on two consecutive days, we assessed the test-retest reliability of fMRI functional connectivity and the consequences on reliability of three common sources of variation in analysis workflows: atlas choice, global signal regression, and thresholding. By adopting the intraclass correlation coefficient as a metric, we demonstrate that only a small portion of the functional connectome is characterized by good (6–8%) to excellent (0.08–0.14%) reliability. Connectivity between prefrontal, parietal, and temporal areas is especially reliable, but also average connectivity within known networks has good reliability. In general, while unreliable edges are weak, reliable edges are not necessarily strong. Methodologically, reliability of edges varies between atlases, global signal regression decreases reliability for networks and most edges (but increases it for some), and thresholding based on connection strength reduces reliability. Focusing on the reliable portion of the connectome could help quantify brain trait-like features and investigate individual differences using functional neuroimaging.

Download Full-text

The Mandarin Voice Handicap Index for Laryngectomees With Pneumatic Artificial Laryngeal and Esophageal Speech

American Journal of Speech-Language Pathology ◽

10.1044/2021_ajslp-20-00241 ◽

2021 ◽

pp. 1-12

Author(s):

Chen-Chi Wang ◽

Jia-Shiou Liao ◽

Hsiu-Chin Lai ◽

Yi-Hsuan Lo

Keyword(s):

Internal Consistency ◽

Intraclass Correlation ◽

Correlation Coefficients ◽

Voice Handicap Index ◽

Good Test ◽

Retest Reliability ◽

Related Quality ◽

Valid Instrument ◽

Test Retest Reliability ◽

The Impact

Purpose The Voice Handicap Index (VHI) questionnaire assesses the impact of total laryngectomy on voice-related quality of life. This study evaluates the Mandarin VHI, including its internal consistency, test–retest reliability, content validity, and differences in scores for Mandarin alaryngeal patients with pneumatic artificial laryngeal (PA) and esophageal (ES) speech. Method Translation and validation of the VHI questionnaire was performed through the forward–backward translation technique. This study used a sample of 78 PA and 23 ES participants from Taiwan who completed the Mandarin VHI. Forty-two of the alaryngeal participants completed the Mandarin VHI twice over a period of 7–63 days. Results The measurement of the internal consistency of the Mandarin VHI showed a high Cronbach's alpha coefficient for the total score (.975) and the functional (.930), physical (.939), and emotional (.938) subscales. Based on the results of the intraclass correlation coefficients, good test–retest reliability for the total and domain scores was found (intraclass correlation coefficient = .827–.863). Conclusion The Mandarin VHI was validated as an instrument with proper internal consistency and reliability, which supports the Mandarin VHI as a valid instrument for the self-evaluation of handicaps related to voice problems in PA and ES speakers.

Download Full-text

Psychometric properties of the Mental Health Recovery Star

The British Journal of Psychiatry ◽

10.1192/bjp.bp.111.107946 ◽

2012 ◽

Vol 201 (1) ◽

pp. 65-70 ◽

Cited By ~ 34

Author(s):

Helen Killaspy ◽

Sarah White ◽

Tatiana L. Taylor ◽

Michael King

Keyword(s):

Mental Health ◽

Psychometric Properties ◽

Convergent Validity ◽

Interrater Reliability ◽

Pearson Correlation ◽

Intraclass Correlation ◽

Community Services ◽

Mental Health Recovery ◽

Retest Reliability ◽

Test Retest Reliability

BackgroundThe Mental Health Recovery Star (MHRS) is a popular outcome measure rated collaboratively by staff and service users, but its psychometric properties are unknown.AimsTo assess the MHRS's acceptability, reliability and convergent validity.MethodA total of 172 services users and 120 staff from in-patient and community services participated. Interrater reliability of staff-only ratings and test–retest reliability of staff-only and collaborative ratings were assessed using intraclass correlation coefficients (ICCs). Convergent validity between MHRS ratings and standardised measures of social functioning and recovery was assessed using Pearson correlation. The influence of collaboration on ratings was assessed using descriptive statistics and ICCs.ResultsThe MHRS was relatively quick and easy to use and had good test–retest reliability, but interrater reliability was inadequate. Collaborative ratings were slightly higher than staff-only ratings. Convergent validity suggests it assesses social function more than recovery.ConclusionsThe MHRS cannot be recommended as a routine clinical outcome tool but may facilitate collaborative care planning.

Download Full-text

Psychometric Properties of the Dutch Chronic Fatigue Syndrome–Activities and Participation Questionnaire (CFS-APQ)

Physical Therapy ◽

10.1093/ptj/83.5.444 ◽

2003 ◽

Vol 83 (5) ◽

pp. 444-454 ◽

Cited By ~ 31

Author(s):

Jo Nijs ◽

Peter Vaes ◽

Neil McGregor ◽

Elke Van Hoof ◽

Kenny De Meirleir

Keyword(s):

Chronic Fatigue Syndrome ◽

Content Validity ◽

Convergent Validity ◽

Intraclass Correlation ◽

Correlation Coefficients ◽

Chronic Fatigue ◽

Intraclass Correlation Coefficients ◽

Fatigue Syndrome ◽

Visual Analog Scales ◽

Test Retest Reliability

Abstract Background and Purpose. The Chronic Fatigue Syndrome–Activities and Participation Questionnaire (CFS-APQ) is a recently developed disease-specific assessment tool for monitoring activity limitations and participation restrictions in patients with chronic fatigue syndrome (CFS). In this study, the convergent validity, content validity, and test-retest reliability of data obtained with the Dutch-language version of the questionnaire were examined. Subjects and Methods. One hundred eleven consecutive patients with CFS were enrolled, of whom 47 fulfilled all inclusion criteria. The subjects were first asked to rate their pain, fatigue, and ability to concentrate using 3 visual analog scales, to list at least 5 activities that had become difficult to perform due to their complaints, and to complete the CFS-APQ. Furthermore, subjects were asked to complete a modified version of the CFS-APQ at home and return it to the investigators. The content of the questionnaire was reviewed using the World Health Organization's International Classification of Impairments, Disability and Health (ICIDH) beta II draft. Spearman rank correlation coefficients (R) were used for the convergent validity analysis, and intraclass correlation coefficients were computed for the assessment of the test-retest data. Results. Overall scores on the CFS-APQ correlated with the scores from the visual analog scales for pain (R=.51, P<.001) and fatigue (R=.50, P<.001). The majority of the responses (157 out of 183 answers [85.8%]) to the request to “list difficult activities” matched the content of the CFS-APQ. Using the ICIDH beta II draft, 21 out of 26 questions were found to address activities, and the remaining 5 questions measured the participation level. The Cronbach alpha coefficient was .94, and intraclass correlation coefficients for test-retest reliability of the overall scores were ≥.95 (P<.001). Discussion and Conclusion. The results substantiate the convergent validity, content validity, and reliability of the CFS-APQ scores for patients with CFS.

Download Full-text