The Scale for Assessing Emotional Disturbance–Third Edition: Reliability and Validity of the Screener

The Scales for Assessing Emotional Disturbance Screener–Third Edition ( SAED-3) is a standardized, norm-referenced measure designed to identify school-aged students at risk of emotional and behavioral problems. Four studies are reported to address the psychometric status of the SAED-3 Screener. Study 1 examined the internal consistency of the Screener using a sample of 1,430 students. Study 2 investigated the interrater reliability of the Screener results across 123 pairs of teachers who had worked with the student for at least 2 months. Study 3 assessed the extent to which the results from the Screener are consistent over time by examining test–retest reliability. Study 4 examined convergent validity by comparing the Screener to the Strength and Difficulties Questionnaire ( SDQ). Across all studies, samples were drawn from populations of students included in the nationally representative normative sample. The averaged coefficient alpha for the Screener was .88. Interrater reliability coefficient for the composite was .83. Test–retest reliability of the composite was .83. Correlations with the SDQ subscales ranged from .74 to .99, and the correlation of the Screener to the SDQ composite was .99. Limitations and implications for use of the Screener are discussed.

Download Full-text

The Scales for Assessing Emotional Disturbance—Third Edition: Internal Reliability, Interrater Reliability, and Test–Retest Reliability

Behavioral Disorders ◽

10.1177/0198742920969152 ◽

2020 ◽

pp. 019874292096915

Author(s):

Jacqueline Huscroft-D’Angelo ◽

Jessica Wery ◽

Jodie Diane Martin ◽

Corey Pierce ◽

Lindy Crawford

Keyword(s):

Emotional Disturbance ◽

Interrater Reliability ◽

Rating Scale ◽

Composite Score ◽

Future Research ◽

Internal Reliability ◽

Retest Reliability ◽

Nationally Representative ◽

Test Retest Reliability ◽

Reliability Coefficients

The Scales for Assessing Emotional Disturbance—Third Edition Rating Scale (SAED-3 RS; Epstein et al.) is a standardized, norm-referenced measure designed to aid in the identification process by providing useful data to professionals determining eligibility of students with an emotional disturbance (ED). Three studies are reported to address the reliability of the SAED-3 RS. Study 1 investigated the internal reliability of the SAED-3 RS using data from a nationally representative sample of 1,430 students and 441 with ED. Study 2 examined interrater reliability between 123 pairs of educators who had worked with the student for at least 2 months. Study 3 assessed the test–retest reliability over a 2-week period to determine stability of the SAED-3 RS. Across all studies, scores collected from the SAED-3 RS were determined to be a reliable, stable for measuring the emotional and behavioral functioning of students. Specifically, the averaged coefficient alpha for internal consistency ranged from .79 to .92 for each subscale and .96 for the composite score; interrater reliability coefficients ranged from .77 to .89 for each subscale and .89 for the composite score, and test–retest reliability coefficients ranged from .79 to .92 for each subscale and .96 for the composite score. Limitations, future research and implications for use of the SAED-3 RS are discussed.

Download Full-text

Validity and reliability of the Mandarin version of the Treatment Burden Questionnaire among stroke patients in Mainland China

Family Practice ◽

10.1093/fampra/cmab004 ◽

2021 ◽

Author(s):

Qi Zhang ◽

Ke Zhang ◽

Miao Li ◽

Jiaxin Gu ◽

Xintong Li ◽

...

Keyword(s):

Internal Consistency ◽

Convergent Validity ◽

Intraclass Correlation ◽

Reliability And Validity ◽

Therapeutic Interventions ◽

Treatment Burden ◽

Validity And Reliability ◽

Stroke Patients ◽

Retest Reliability ◽

Test Retest Reliability

Abstract Objectives To examine the validity and reliability of the Mandarin version of the Treatment Burden Questionnaire (TBQ) among stroke patients. Background Stroke patients need long-term management of symptoms and life situation, and treatment burden has recently emerged as a new concept that can influence the health outcomes during the rehabilitation process. Methods The convenience sampling method was used to recruit 187 cases of stroke patients in a tertiary grade hospital in Tianjin for a formal investigation. Item analysis, reliability and validity tests were carried out. The reliability test included internal consistency and test–retest reliability. And as well as content, structure and convergent validity were performed for the validity test. Results Of the 187 completed questionnaires, only 180 (96.3%) were suitable for analysis. According to the experts’ evaluation, the I-CVI of each item was from 0.833 to 1.000, and the S-CVI was 0.967. The exploratory factor analysis yielded three-factor components with a cumulative variation of 53.054%. Convergent validity was demonstrated using measures of Morisky’s Medication Adherence Scale 8 (r = –0.450, P < 0.01). All correlations between items and global scores ranged from 0.403 to 0.638. Internal consistency reliability and test–retest reliability were found to be acceptable, as indicated by a Cronbach’s α of 0.824 and an intraclass correlation coefficient of 0.846, respectively. Conclusions The Mandarin TBQ had acceptable validity and reliability. The use of TBQ in the assessment of treatment burden of stroke survivor may benefit health resources allocation and provide tailor therapeutic interventions to construct minimally disruptive care.

Download Full-text

Psychometric Properties of Functional Balance Assessment in Children With Cerebral Palsy

Neurorehabilitation and Neural Repair ◽

10.1177/1545968308316474 ◽

2008 ◽

Vol 22 (6) ◽

pp. 745-753 ◽

Cited By ~ 78

Author(s):

Sue-Mae Gan ◽

Li-Chen Tung ◽

Yue-Her Tang ◽

Chun-Hou Wang

Keyword(s):

Cerebral Palsy ◽

Motor Function ◽

Convergent Validity ◽

Interrater Reliability ◽

Walking Speed ◽

Retest Reliability ◽

Functional Balance ◽

Sit To Stand ◽

Children With Cerebral Palsy ◽

Test Retest Reliability

Background. Children with cerebral palsy often suffer from a lack of balance compared with typically developing children. Because balance capacity is relevant to functional activities, reliable and valid functional balance measures are crucial for the pediatric clinical setting. Objective. This study examined the reliability and validity of 3 functional balance measures. Methods. Thirty children aged 60 to 142 months with Gross Motor Function Classification System (GMFCS) levels of I to IV were recruited. For test-retest reliability, the same physical therapist administered the Functional Reach Test (FRT), Berg Balance Scale (BBS), and Timed Up and Go (TUG) twice. For interrater reliability, the testing processes were video recorded and later scored by another therapist. For convergent validity, children with cerebral palsy received the Gross Motor Function Measures (GMFM), walking speed, and 10-second sit-to-stand test within 1 week and the results evaluated. Results. The 3 functional balance measures had excellent test-retest reliability (intraclass correlation coefficient [ICC] >0.95) and interrater reliability (ICC = 0.98-1.00). With regard to convergent validity, the BBS and the TUG were highly correlated with GMFM total score, walking speed, and the 10-second sit-to-stand test. The discriminate validity indicates that the FRT can distinguish children with cerebral palsy with different GMFCS levels, whereas the BBS total score and TUG failed to distinguish between children with cerebral palsy with GMFCS levels of I and II. Conclusion. The 3 functional balance measures are simple, valid, and reliable for examining children with cerebral palsy and are thus suitable for clinical practice.

Download Full-text

Psychometric Properties of a Structured Diagnostic Interview for DSM-5 Anxiety, Mood, and Obsessive-Compulsive and Related Disorders

Assessment ◽

10.1177/1073191116638410 ◽

2016 ◽

Vol 25 (1) ◽

pp. 3-13 ◽

Cited By ~ 36

Author(s):

David F. Tolin ◽

Christina Gilliam ◽

Bethany M. Wootton ◽

William Bowe ◽

Laura B. Bragdon ◽

...

Keyword(s):

Convergent Validity ◽

Interrater Reliability ◽

Diagnostic Interview ◽

Self Report ◽

Obsessive Compulsive ◽

Reliability Data ◽

Retest Reliability ◽

Dsm 5 ◽

Structured Diagnostic Interview ◽

Test Retest Reliability

Three hundred sixty-two adult patients were administered the Diagnostic Interview for Anxiety, Mood, and OCD and Related Neuropsychiatric Disorders (DIAMOND). Of these, 121 provided interrater reliability data, and 115 provided test–retest reliability data. Participants also completed a battery of self-report measures that assess symptoms of anxiety, mood, and obsessive-compulsive and related disorders. Interrater reliability of DIAMOND anxiety, mood, and obsessive-compulsive and related diagnoses ranged from very good to excellent. Test–retest reliability of DIAMOND diagnoses ranged from good to excellent. Convergent validity was established by significant between-group comparisons on applicable self-report measures for nearly all diagnoses. The results of the present study indicate that the DIAMOND is a promising semistructured diagnostic interview for DSM-5 disorders.

Download Full-text

Test-Retest Reliability and Validity of the Six Minute Stepper Test to Evaluate Functional Exercise Capacity in Patients with Ankylosing Spondylitis

Modern Rheumatology ◽

10.1093/mr/roab094 ◽

2021 ◽

Author(s):

Selin Bayram ◽

Deran Oskay ◽

Nurten Gizem Tore ◽

Fulden Sari ◽

Devrim Can Saraç ◽

...

Keyword(s):

Ankylosing Spondylitis ◽

Exercise Capacity ◽

Convergent Validity ◽

Pearson Correlation ◽

Physiological Responses ◽

Intraclass Correlation ◽

Reliability And Validity ◽

Rank Test ◽

Retest Reliability ◽

Test Retest Reliability

ABSTRACT Objectives The 6-minute stepper test (6MST) is a submaximal test that requires little space to assess exercise capacity compared to the 6-minute walk test (6MWT). The study aims to investigate the test-retest reliability and convergent validity of 6MST and to compare physiological responses, dyspnea, fatigue perception with 6MST and 6MWT in patients with ankylosing spondylitis (AS). Methods To test the convergent validity of 6MST, 65 patients performed both 6MWT and 6MST on the first day and correlation between two tests were assessed with Pearson correlation test. In order to investigate the test-retest reliability of the 6MST, thirty-two of the 65 patients performed 6MST one week later and intraclass correlation coefficients (ICC) were calculated. Dyspnea and fatigue perception were analyzed with using Wilcoxon signed-rank test, physiological responses were analyzed using paired sample t-test. Results Excellent test-retest reliability was observed for 6MST (ICC: 0.988). There was a significant correlation between 6MST and 6MWT (r: 0.725, p<0.001). Dyspnea and leg fatigue perception were significantly higher in 6MST (p<0.05). Physiological responses and fatigue perception were similar in both 6MST and 6MWT (p>0.05). Conclusion This study demonstrated that the 6MST is reliable and valid method to evaluate exercise capacity in patients with AS. 6MST can be used to evaluate exercise capacity of patients with AS.

Download Full-text

Psychometric properties of the Mental Health Recovery Star

The British Journal of Psychiatry ◽

10.1192/bjp.bp.111.107946 ◽

2012 ◽

Vol 201 (1) ◽

pp. 65-70 ◽

Cited By ~ 34

Author(s):

Helen Killaspy ◽

Sarah White ◽

Tatiana L. Taylor ◽

Michael King

Keyword(s):

Mental Health ◽

Psychometric Properties ◽

Convergent Validity ◽

Interrater Reliability ◽

Pearson Correlation ◽

Intraclass Correlation ◽

Community Services ◽

Mental Health Recovery ◽

Retest Reliability ◽

Test Retest Reliability

BackgroundThe Mental Health Recovery Star (MHRS) is a popular outcome measure rated collaboratively by staff and service users, but its psychometric properties are unknown.AimsTo assess the MHRS's acceptability, reliability and convergent validity.MethodA total of 172 services users and 120 staff from in-patient and community services participated. Interrater reliability of staff-only ratings and test–retest reliability of staff-only and collaborative ratings were assessed using intraclass correlation coefficients (ICCs). Convergent validity between MHRS ratings and standardised measures of social functioning and recovery was assessed using Pearson correlation. The influence of collaboration on ratings was assessed using descriptive statistics and ICCs.ResultsThe MHRS was relatively quick and easy to use and had good test–retest reliability, but interrater reliability was inadequate. Collaborative ratings were slightly higher than staff-only ratings. Convergent validity suggests it assesses social function more than recovery.ConclusionsThe MHRS cannot be recommended as a routine clinical outcome tool but may facilitate collaborative care planning.

Download Full-text

The Brazilian Portuguese Version of the Saving Inventory–Revised: Internal Consistency, Test-Retest Reliability, and Validity of a Questionnaire to Assess Hoarding

Psychological Reports ◽

10.2466/pr0.106.1.279-296 ◽

2010 ◽

Vol 106 (1) ◽

pp. 279-296 ◽

Cited By ~ 11

Author(s):

Isabela S. Fontenelle ◽

Bernard P. Rangé ◽

Angélica M. Prazeres ◽

Manuela C. Borges ◽

Marcio Versiani ◽

...

Keyword(s):

Internal Consistency ◽

Convergent Validity ◽

Clinical Sample ◽

Reliability And Validity ◽

Assessment Instrument ◽

Obsessive Compulsive ◽

Retest Reliability ◽

Compulsive Disorder ◽

Brazilian Version ◽

Test Retest Reliability

Pathological hoarding results in clutter that precludes normal activities and creates distress or dysfunction. It may lead to an inability to complete household functions, health problems, social withdrawal, and even death. The aim of this study was to describe the validation of the Brazilian version of the hoarding assessment instrument, the Saving Inventory–Revised. Sixty-five patients with obsessive-compulsive disorder (OCD) and 70 individuals from the community were assessed using the Structured Clinical Interview for the Diagnosis of DSM–IV (clinical sample), the Saving Inventory–Revised, the Obsessive-Compulsive Inventory–Revised, the Beck Depression Inventory, and the Beck Anxiety Inventory. The Brazilian version of the Saving Inventory–Revised exhibited high internal consistency (Cronbach's alpha = .94 for OCD and .84 for controls), high to moderate test-retest reliability and, using the hoarding dimension of the Obsessive-Compulsive Inventory–Revised as a reference point, high to moderate convergent validity. The Saving Inventory–Revised total scores also correlated significantly with comorbid anxiety and depressive symptoms.

Download Full-text

Translation and validation of the Revised Dental Beliefs Questionnaire (DBS-R) in China

10.21203/rs.2.9975/v1 ◽

2019 ◽

Author(s):

Lei Wu ◽

Heather Buchanan

Keyword(s):

Convergent Validity ◽

Dental Anxiety ◽

Reliability And Validity ◽

Small Sample ◽

Future Research ◽

Chinese Adults ◽

Retest Reliability ◽

Dental Attendance ◽

Test Retest Reliability ◽

Chinese Standard

Abstract Background Patient perceptions of behaviours and attitudes of dentists are associated with dental fear and poor dental attendance in Western countries. However, there is a paucity of research exploring patients' perceptions of the dentist in China. One reason for this may be the lack of a valid and reliable scale in Chinese (Standard Mandarin) to measure this. This study aimed to translate the Revised Dental Beliefs Survey (DBS-R) into Chinese and then explore the reliability and validity of this measure (both the short and longer versions) in a Chinese population.   Methods: We translated the DBS-R using the forwards-backwards method and pilot tested it on a small sample of adults in China. Following this, 480 Chinese adults completed the newly translated scale, as well as well as a standardised dental anxiety questionnaire (the Modified Dental Anxiety Scale Chinese version) to test convergent validity. 109 participants completed the DBS-R again 2 weeks later for test-retest reliability.  Results: Both versions of the Chinese DBS-R were internally consistent, demonstrated convergent validity and test-retest reliability was good. Conclusion Although both versions of the scale performed similarly, it is suggested the 28-item version may be the scale of choice as this version has items relating to the technical competence of the dentist which appear important to Chinese adults. Future research in China should test this measure in the clinical context.

Download Full-text

Reliability and Validity of the Spanish Language Measures of the NIH Toolbox Cognition Battery

Archives of Clinical Neuropsychology ◽

10.1093/arclin/acz029.18 ◽

2019 ◽

Vol 34 (7) ◽

pp. 1251-1251

Author(s):

R Fox ◽

J Hook ◽

M J Marquine ◽

J Manly ◽

B Correia ◽

...

Keyword(s):

Oral Reading ◽

Convergent Validity ◽

Linear Models ◽

Reliability And Validity ◽

The United States ◽

Spanish Language ◽

Good Test ◽

Retest Reliability ◽

Language Measures ◽

Test Retest Reliability

Abstract Objective The NIH Toolbox for Assessment of Neurological and Behavioral Function (NIHTB) was developed under contract from the National Institutes of Health to create a set of easy-to-administer neuropsychological measures, for use across the lifespan (ages 3-85). The NIHTB Cognition Battery (NIHTB-CB) includes two language measures that were developed, calibrated, and normed separately in English and Spanish. This analysis presents the test-retest reliability and construct validity of the Spanish-language picture vocabulary test (S-PVT) and oral reading recognition test (S-ORRT) among adults. Participants and Method Participants were adults age 18-85 who took part in the NIHTB norming study in Spanish (N = 408, Age: M = 44.1, SD = 16.7; Education: M = 10.7, SD = 4.3; 65.0% female). Of these, 48 repeated the battery 1 week later. Both the S-PVT and the S-ORRT were administered using computer adaptive testing and scored using item response theory. Spearman’s correlations were used to evaluate test-retest reliability. Convergent validity was evaluated by correlating S-PVT scores with scores on the Batería-III Woodcock-Muñoz Vocabulario Sobre Dibujos, and by correlating S-ORRT scores with scores on a 48-item version of the Word Accentuation Test. Adjusted Spearman’s correlations and general linear models related scores to age, education, and sex. Results Both the S-PVT (ρ = 0.87, p < .001) and the S-ORRT (ρ = 0.88, p < .001) demonstrated good test-retest reliability. Good convergent validity was found for both the S-PVT (ρ = 0.76, p < .001) and the S-ORRT (ρ = 0.65, p < .001). Scores on the S-PVT were positively related to education (ρ = 0.38, p < .001), and scores on the S-ORRT were negatively related to age (ρ = -0.18, p < .01) and positively related to education (ρ = 0.30, p < .001). Conclusions The Spanish language measures of the NIHTB-CB demonstrated acceptable reliability and validity, suggesting they can be used to measure language ability among Spanish-speaking adults in the United States.

Download Full-text

A Reliable Tool for Assessing MCI and Dementia: Validation Study of DemTect for Turkish Population

American Journal of Alzheimer s Disease & Other Dementias® ◽

10.1177/1533317520949805 ◽

2020 ◽

Vol 35 ◽

pp. 153331752094980

Author(s):

Gozde Sengul Aycicek ◽

Hatice Çalıskan ◽

Cemile Ozsurekci ◽

Pelin Unsal ◽

Josef Kessler ◽

...

Keyword(s):

Cognitive Impairment ◽

Mild Cognitive Impairment ◽

Interrater Reliability ◽

Intraclass Correlation ◽

Reliability And Validity ◽

Screening Tools ◽

Turkish Version ◽

Retest Reliability ◽

Reliable Tool ◽

Test Retest Reliability

Background and Aim: Mild cognitive impairment (MCI) and dementia prevalence are expected to increase with aging. The DemTect is a very quick and easy tool to administer and recognize the early stages of dementia and MCI. In this study we aimed to evaluate the reliability and validity of a Turkish version of the DemTect and define cut off values for different age and educational levels. One of our aims is also to compare the sensitivity and specifity of the DemTect to other common screening tools. Patients and Methods: Fifty-four patients with MCI, 55 patients with dementia and 91 patients with subjective memory complaints (SMC) were enrolled in the study. The DemTect was translated into Turkish by forward-backward translation and compared with the Mini Mental State Examination (MMSE), the Quick Mild Cognitive Impairment Turkish version (QMCI-TR) and the Montreal Cognitive Assessment (MoCA). In order to test interrater reliability, the DemTect was administered to 11 patients, on the same day, by 2 trained raters. To establish test–retest reliability, the same rater scored the tool a second time on 11 patients within 2 weeks. Results: The median age of the patients was 73 (min-max: 65–90) years, 54.5% were female. We found a strong correlation between DemTect scores and the MMSE, the QMCI, and the MoCA (r = 0.725, r = 0.816, r = 0.821, respectively; p < 0.001). In ROC analysis, the cut-off point of the DemTect to differentiate MCI from SMC was 11.5 with 92.6% sensitivity, 91.2% specificity, AUC 0.973 and the cut-off point of the DemTect to differentiate dementia from SMC was 9.5 with 96.4% sensitivity, 100% specificity, AUC 0.916. Cronbach α was 0.823. Intraclass correlation coefficient was 0.873 (95% CI: 0.598–0.964) for interrater reliability and 0.966 (95% 0.777–0.982) for test-retest reliability (Cronbach α = 0.932, 0.966 respectively). Conclusion: The DemTect is a very reliable tool to assess Turkish patients with MCI and dementia.

Download Full-text