Examining the Technical Adequacy of the Social, Academic, and Emotional Behavior Risk Screener

Many schools attempt to identify and service students at risk for poor mental health outcomes within a multi-tiered system of support (MTSS). Universal screening within a MTSS requires technically adequate tools. The Social, Academic, and Emotional Behavior Risk Screener (SAEBRS) has been put forth as a technically adequate screener. Researchers have examined the factor structure, diagnostic accuracy, criterion validity, and internal consistency of SAEBRS data. However, previous research has not examined its temporal stability or replicated the criterion validity results with a racially/ethnically diverse urban elementary school sample. This study examined the test–retest reliability, convergent validity, and predictive validity of teacher-completed SAEBRS ratings with racially/ethnically diverse group students enrolled in first through fifth grade in an urban elementary school. Reliability analyses resulted in significant test–retest reliability coefficients across four weeks for all SAEBRS scales. Furthermore, nonsignificant paired samples t tests were observed with the exception of the third-grade Emotional subscale. Validity analyses yielded significant concurrent and predictive Pearson correlation coefficients between SAEBRS ratings, oral reading fluency, and office discipline referrals. Limitations and implications of the results are discussed.

Download Full-text

Test-Retest Reliability and Validity of the Six Minute Stepper Test to Evaluate Functional Exercise Capacity in Patients with Ankylosing Spondylitis

Modern Rheumatology ◽

10.1093/mr/roab094 ◽

2021 ◽

Author(s):

Selin Bayram ◽

Deran Oskay ◽

Nurten Gizem Tore ◽

Fulden Sari ◽

Devrim Can Saraç ◽

...

Keyword(s):

Ankylosing Spondylitis ◽

Exercise Capacity ◽

Convergent Validity ◽

Pearson Correlation ◽

Physiological Responses ◽

Intraclass Correlation ◽

Reliability And Validity ◽

Rank Test ◽

Retest Reliability ◽

Test Retest Reliability

ABSTRACT Objectives The 6-minute stepper test (6MST) is a submaximal test that requires little space to assess exercise capacity compared to the 6-minute walk test (6MWT). The study aims to investigate the test-retest reliability and convergent validity of 6MST and to compare physiological responses, dyspnea, fatigue perception with 6MST and 6MWT in patients with ankylosing spondylitis (AS). Methods To test the convergent validity of 6MST, 65 patients performed both 6MWT and 6MST on the first day and correlation between two tests were assessed with Pearson correlation test. In order to investigate the test-retest reliability of the 6MST, thirty-two of the 65 patients performed 6MST one week later and intraclass correlation coefficients (ICC) were calculated. Dyspnea and fatigue perception were analyzed with using Wilcoxon signed-rank test, physiological responses were analyzed using paired sample t-test. Results Excellent test-retest reliability was observed for 6MST (ICC: 0.988). There was a significant correlation between 6MST and 6MWT (r: 0.725, p<0.001). Dyspnea and leg fatigue perception were significantly higher in 6MST (p<0.05). Physiological responses and fatigue perception were similar in both 6MST and 6MWT (p>0.05). Conclusion This study demonstrated that the 6MST is reliable and valid method to evaluate exercise capacity in patients with AS. 6MST can be used to evaluate exercise capacity of patients with AS.

Download Full-text

Psychometric properties of the Mental Health Recovery Star

The British Journal of Psychiatry ◽

10.1192/bjp.bp.111.107946 ◽

2012 ◽

Vol 201 (1) ◽

pp. 65-70 ◽

Cited By ~ 34

Author(s):

Helen Killaspy ◽

Sarah White ◽

Tatiana L. Taylor ◽

Michael King

Keyword(s):

Mental Health ◽

Psychometric Properties ◽

Convergent Validity ◽

Interrater Reliability ◽

Pearson Correlation ◽

Intraclass Correlation ◽

Community Services ◽

Mental Health Recovery ◽

Retest Reliability ◽

Test Retest Reliability

BackgroundThe Mental Health Recovery Star (MHRS) is a popular outcome measure rated collaboratively by staff and service users, but its psychometric properties are unknown.AimsTo assess the MHRS's acceptability, reliability and convergent validity.MethodA total of 172 services users and 120 staff from in-patient and community services participated. Interrater reliability of staff-only ratings and test–retest reliability of staff-only and collaborative ratings were assessed using intraclass correlation coefficients (ICCs). Convergent validity between MHRS ratings and standardised measures of social functioning and recovery was assessed using Pearson correlation. The influence of collaboration on ratings was assessed using descriptive statistics and ICCs.ResultsThe MHRS was relatively quick and easy to use and had good test–retest reliability, but interrater reliability was inadequate. Collaborative ratings were slightly higher than staff-only ratings. Convergent validity suggests it assesses social function more than recovery.ConclusionsThe MHRS cannot be recommended as a routine clinical outcome tool but may facilitate collaborative care planning.

Download Full-text

‘I don't have to go to the gym because I ate very healthy today’: the development of a scale to assess diet-related compensatory health beliefs

Public Health Nutrition ◽

10.1017/s1368980012002650 ◽

2012 ◽

Vol 16 (2) ◽

pp. 267-273 ◽

Cited By ~ 11

Author(s):

Maartje P Poelman ◽

Willemijn M Vermeer ◽

Ellis L Vyth ◽

Ingrid HM Steenhuis

Keyword(s):

Energy Intake ◽

Health Beliefs ◽

Convergent Validity ◽

Pearson Correlation ◽

Overweight And Obesity ◽

Cross Sectional ◽

Retest Reliability ◽

Nutritional Interventions ◽

Portion Sizes ◽

Test Retest Reliability

AbstractObjectiveNutritional interventions to decrease energy intake, aimed at portion sizes and front-of-package labelling, are effective only if people do not compensate for their reduced energy intake. Since several observational studies indicate that these interventions could prompt compensation behaviour, it is important to assess underlying beliefs. Therefore, the purpose of the two studies reported here was to develop a Diet-related Compensatory Health Beliefs Scale (Diet-CHBS).DesignCross-sectional surveys were conducted for the scale development. Study 1 provided data on the factor analysis and convergent validity, while Study 2 assessed the Diet-CHBS’ test–retest reliability.SettingsVU University Amsterdam (Study 1) and twenty-five worksite cafeterias in the Netherlands (Study 2).SubjectsStudy 1 was conducted among 179 students and their parents; Study 2 was conducted among 119 worksite cafeteria visitors.ResultsThe results of Study 1 showed that the scale consisted of the hypothesized factors of compensation beliefs with regard to portion sizes (α = 0·73), front-of-package health logos (α = 0·77) and exercise (α = 0·75). The scale's overall Cronbach's α was 0·82. The Diet-CHBS had a Pearson correlation of 0·32 with a general health compensatory beliefs scale, signifying satisfactory convergent validity. Study 2 showed that the intra-class correlation coefficient between T1 and T2 was 0·69, indicating adequate test–retest reliability.ConclusionThe Diet-CHBS is a valid and reliable instrument for assessing diet-related compensatory health beliefs in response to nutritional interventions. It is important to take such beliefs into account in further intervention studies aimed at preventing overweight and obesity.

Download Full-text

Psychometric Properties of the Persian Version of COVID Stress Scales (CSS) in the Iranian Population

10.21203/rs.3.rs-417409/v1 ◽

2021 ◽

Author(s):

Fereshte Momeni ◽

Mobina Hoseinpour Moqadam ◽

Mohammadreza Davoudi ◽

Nooshindokht MobarakAbadi ◽

Samaneh Hosseinzadeh

Keyword(s):

Factor Analysis ◽

Psychometric Properties ◽

Convergent Validity ◽

Online Survey ◽

Pearson Correlation ◽

Brief Symptom Inventory ◽

Iranian Population ◽

Retest Reliability ◽

Persian Version ◽

Test Retest Reliability

Abstract Background: Recently, 36-item COVID Stress Scales (CSS) was designed for assessing anxiety and stress related to COVID-19 outbreak. The present study aimed to evaluate the psychometric properties of the Persian version of CSS in the Iranian population.Methods: A total of 393 participants volunteered to cooperate in the present study via an online survey. They completed a collection of scales, including the CSS, COVID-19 Phobia Scale (C19P-S), and Brief Symptom Inventory (BSI). The CSS reliability was determined by calculating Cronbach alpha and test-retest reliability. The validity assessed by Pearson correlation among the CSS and its subscales with C19P-S and BSI. Exploratory Factor Analysis (EFA) and Confirmatory factor analysis (CFA) was used to evaluate the structure of CSS. All analysis assessed by SPSS-26 software.Results: Results showed that 45.3% of the participant’s age were in 18-25 years. Moreover, 72.8 % of the participants were female. Also, Cronbach’s alpha for all subscale was between0.83 to 0.92. The test-retest reliability coefficient of CSS was 0.87. The correlation between the CSS, BSI and C19P-S showed that CSS has suitable convergent validity. CFA and EFA showed that the 5-factor of CSS is the best model. Conclusion: To conclude, Persian version of CSS has suitable psychometric properties for utilizing in Iranian population.

Download Full-text

Validation of the Social Inclusion Scale with Students

Social Inclusion ◽

10.17645/si.v3i4.121 ◽

2015 ◽

Vol 3 (4) ◽

pp. 52-62 ◽

Cited By ~ 8

Author(s):

Ceri Wilson ◽

Jenny Secker

Keyword(s):

Construct Validity ◽

Internal Consistency ◽

Gold Standard ◽

Convergent Validity ◽

Social Inclusion ◽

Standard Measure ◽

Mental Wellbeing ◽

Retest Reliability ◽

The Social ◽

Test Retest Reliability

Interventions (such as participatory arts projects) aimed at increasing social inclusion are increasingly in operation, as social inclusion is proving to play a key role in recovery from mental ill health and the promotion of mental wellbeing. These interventions require evaluation with a systematically developed and validated measure of social inclusion; however, a “gold-standard” measure does not yet exist. The Social Inclusion Scale (SIS) has three subscales measuring social isolation, relations and acceptance. This scale has been partially validated with arts and mental health project users, demonstrating good internal consistency. However, test-retest reliability and construct validity require assessment, along with validation in the general population. The present study aimed to validate the SIS in a sample of university students. Test-retest reliability, internal consistency, and convergent validity (one aspect of construct validity) were assessed by comparing SIS scores with scores on other measures of social inclusion and related concepts. Participants completed the measures at two time-points seven-to-14 days apart. The SIS demonstrated high internal consistency and test-retest reliability, although convergent validity was less well-established and possible reasons for this are discussed. This systematic validation of the SIS represents a further step towards the establishment of a “gold-standard” measure of social inclusion.

Download Full-text

Using photos of basic facial expressions as a new approach to measuring implicit attitudes

PLoS ONE ◽

10.1371/journal.pone.0250922 ◽

2021 ◽

Vol 16 (5) ◽

pp. e0250922

Author(s):

Klara Malinakova ◽

Richard Korinek ◽

Peter Tavel ◽

Iva Polackova Solcova ◽

Harold G. Koenig ◽

...

Keyword(s):

Internal Consistency ◽

Convergent Validity ◽

Online Survey ◽

Discriminant Validity ◽

Implicit Attitudes ◽

Selection Process ◽

Reliability And Validity ◽

Criterion Validity ◽

Retest Reliability ◽

Test Retest Reliability

Background Measuring implicit attitudes is difficult due to social desirability (SD). A new method, the Emotion Based Approach (EBA), can solve this by using emotions from a display of faces as response categories. We applied this on an EBA Spirituality tool (EBA-SPT) and an Actual Situation tool (EBA-AST). Our aim was to assess the structure, reliability and validity of the tools and to compare two EBA assessment approaches, i.e., an explicit one (only assessing final replies to items) and an implicit one (assessing also the selection process). Methods We obtained data on a sample of Czech adults (n = 522, age 30.3±12.58; 27.0% men) via an online survey; cortisol was assessed in 46 participants. We assessed the structure and psychometric properties (internal consistency and test-retest reliability; convergent, discriminant, and criterion validity) of the EBA, and examined the differences between explicit vs. implicit EBA approaches. Results We found an acceptable-good internal consistency reliability of the EBA tools, acceptable discriminant validity between them and low (neutral expression) to good (joy) test-retest reliability for concrete emotions assessed by the tools. An implicit EBA approach showed stronger correlations between emotions and weaker convergent validity, but higher criterion validity, than an explicit approach and standard questionnaires. Conclusion Compared to standard questionnaires, EBA is a more reliable approach for measuring attitudes, with an implicit approach that reflects the selection process yielding the best results.

Download Full-text

Test–retest reliability and convergent validity of the test of nonverbal intelligence-fourth edition in patients with schizophrenia

BMC Psychiatry ◽

10.1186/s12888-021-03041-4 ◽

2021 ◽

Vol 21 (1) ◽

Author(s):

Kuan-Wei Chen ◽

Ya-Chen Lee ◽

Tzu-Ying Yu ◽

Li-Jung Cheng ◽

Chien-Yu Chao ◽

...

Keyword(s):

Convergent Validity ◽

Fluid Intelligence ◽

Stable Condition ◽

Practice Effect ◽

Minimal Detectable Change ◽

Nonverbal Intelligence ◽

Fourth Edition ◽

Random Measurement Error ◽

Retest Reliability ◽

Test Retest Reliability

Abstract Background Fluid intelligence deficits affect executive functioning and social behaviors in patients with schizophrenia. To help clinicians manage fluid intelligence deficits, a psychometrically sound measure is needed. The purposes of this study were to examine the test–retest reliability and convergent validity of the Test of Nonverbal Intelligence-Fourth Edition (TONI-4) assessing fluid intelligence in patients with schizophrenia. Methods A total of 103 patients with stable condition were assessed with the TONI-4 twice with a 4-week interval to examine the test–retest reliability. We further used the Montreal Cognitive Assessment (MoCA) and the Tablet-Based Symbol Digit Modalities Test (T-SDMT) to examine the convergent validity of the TONI-4. Results The intra-class correlation coefficient was 0.73 for the TONI-4. The percentages of standard error of measurement and minimal detectable change for the TONI-4 were 5.1 and 14.2%, respectively. The practice effect of the TONI-4 was small (Cohen’s d = − 0.03). Convergent validity showed small to moderate significant correlations between the TONI-4 and the MoCA as well as the T-SDMT (r = 0.35, p = .011 with the T-SDMT and r = 0.61, p < .001 with the MoCA). The results demonstrated that the TONI-4 had good test–retest reliability, limited random measurement error, and a trivial practice effect. The convergent validity of the TONI-4 was good. Conclusions These findings indicate that the TONI-4 has potential to be a reliable and valid assessment of fluid intelligence in patients with schizophrenia.

Download Full-text

Validity and reliability of the Mandarin version of the Treatment Burden Questionnaire among stroke patients in Mainland China

Family Practice ◽

10.1093/fampra/cmab004 ◽

2021 ◽

Author(s):

Qi Zhang ◽

Ke Zhang ◽

Miao Li ◽

Jiaxin Gu ◽

Xintong Li ◽

...

Keyword(s):

Internal Consistency ◽

Convergent Validity ◽

Intraclass Correlation ◽

Reliability And Validity ◽

Therapeutic Interventions ◽

Treatment Burden ◽

Validity And Reliability ◽

Stroke Patients ◽

Retest Reliability ◽

Test Retest Reliability

Abstract Objectives To examine the validity and reliability of the Mandarin version of the Treatment Burden Questionnaire (TBQ) among stroke patients. Background Stroke patients need long-term management of symptoms and life situation, and treatment burden has recently emerged as a new concept that can influence the health outcomes during the rehabilitation process. Methods The convenience sampling method was used to recruit 187 cases of stroke patients in a tertiary grade hospital in Tianjin for a formal investigation. Item analysis, reliability and validity tests were carried out. The reliability test included internal consistency and test–retest reliability. And as well as content, structure and convergent validity were performed for the validity test. Results Of the 187 completed questionnaires, only 180 (96.3%) were suitable for analysis. According to the experts’ evaluation, the I-CVI of each item was from 0.833 to 1.000, and the S-CVI was 0.967. The exploratory factor analysis yielded three-factor components with a cumulative variation of 53.054%. Convergent validity was demonstrated using measures of Morisky’s Medication Adherence Scale 8 (r = –0.450, P < 0.01). All correlations between items and global scores ranged from 0.403 to 0.638. Internal consistency reliability and test–retest reliability were found to be acceptable, as indicated by a Cronbach’s α of 0.824 and an intraclass correlation coefficient of 0.846, respectively. Conclusions The Mandarin TBQ had acceptable validity and reliability. The use of TBQ in the assessment of treatment burden of stroke survivor may benefit health resources allocation and provide tailor therapeutic interventions to construct minimally disruptive care.

Download Full-text

Test–Retest Reliability of Social Cognition Screening Questionnaire–Taiwan Version in People With Schizophrenia

American Journal of Occupational Therapy ◽

10.5014/ajot.2021.75s2-po23 ◽

2021 ◽

Vol 75 (Supplement_2) ◽

pp. 7512500023p1-7512500023p1

Author(s):

Shu-Chun Lee ◽

Yi-Ching Wu ◽

David Leland Roberts ◽

Kuang-Pei Tseng ◽

Wen-Yin Chen

Keyword(s):

Social Cognition ◽

Random Measurement Error ◽

Good Test ◽

Retest Reliability ◽

Screening Questionnaire ◽

The Core ◽

Random Measurement ◽

The Social ◽

Test Retest Reliability ◽

Multiple Domains

Abstract Date Presented 04/19/21 The Social Cognition Screening Questionnaire–Taiwan version (SCSQT) was designed to assess multiple domains of social cognition in people with schizophrenia in Taiwan. The SCSQT contains five subscales and provides estimates of the core domains of mentalizing and social perception and an overall social cognition score. Our validation of SCSQT indicated that the SCSQT had good test–retest reliability, acceptable random measurement error, and negligible practice effects. Primary Author and Speaker: Shu-Chun Lee Additional Authors and Speakers: Trudy Mallinson Contributing Authors: Alison M. Cogan, Ann Guernon, Katherine O'Brien, and Piper Hansen

Download Full-text

Validation of the NARCOMS Registry: pain assessment

Multiple Sclerosis Journal ◽

10.1191/1352458505ms1167oa ◽

2005 ◽

Vol 11 (3) ◽

pp. 338-342 ◽

Cited By ~ 28

Author(s):

Ruth Ann Marrie ◽

Gary Cutter ◽

Tuula Tyry ◽

Olympia Hadjimichael ◽

Timothy Vollmer

Keyword(s):

Multiple Sclerosis ◽

Convergent Validity ◽

Disease Duration ◽

Self Report ◽

Research Committee ◽

Retest Reliability ◽

The North ◽

Disability Status ◽

Pain Question ◽

Test Retest Reliability

The North American Research Committee on Multiple Sclerosis (NARCOMS) Registry is a multiple sclerosis (MS) self-report registry with more than 24 000 participants. Participants report disability status upon enrolment, and semi-annually using Performance Scales (PS), Patient Determined Disease Steps (PDDS) and a pain question. In November 2000 and 2001, we also collected the Pain Effects Scale (PES). Our aim was to validate the NARCOMS pain question using the PES as our criterion measure. We measured correlations between the pain question and age, disease duration, various PS subscales and PDDS to assess construct validity. We correlated pain question responses in participants who reported no change in PDSS or the PS subscales between questionnaires to determine test—retest reliability. We measured responsiveness in participants who reported a substantial change in the sensory, spasticity PS subscales. The correlation between the pain question and PES was r=0.61 in November 2000, and r=0.64 in November 2001 (both P<0.0001). Correlations between the pain question and age, and disease duration were low, indicating divergent validity. Correlations between the pain question and spasticity, sensory PS subscales and PDSS were moderate, indicating convergent validity. Test—retest reliability was r=0.84 (P<0.0001). Responsiveness was 70.7%. The pain question is a valid self-report measure of pain in MS.

Download Full-text