Structural Validity and Reliability of Social, Academic, and Emotional Behavior Risk Screener–Student Rating Scale Scores: A Replication Study

2020 ◽  
pp. 153450842090952 ◽  
Author(s):  
Stephen P. Kilgus ◽  
Katie Eklund ◽  
Nathaniel P. von der Embse ◽  
Madison Weist ◽  
Alexandra J. Barber ◽  
...  
Keyword(s):  
Social Behavior ◽  
Internal Consistency ◽  
Rating Scale ◽  
Bifactor Model ◽  
Emotional Behavior ◽  
Student Rating ◽  
General Factor ◽  
Structural Validity ◽  
Acceptable Internal Consistency ◽  
Total Behavior

The purpose of this study was to evaluate the structural validity, internal consistency, and measurement invariance of scores from the Social, Academic, and Emotional Behavior Risk Screener–Student Rating Scale (mySAEBRS), a student self-report universal screening tool. Participants included 24,094 K–12 students who completed the mySAEBRS. Confirmatory factor analyses (CFAs) supported the fit of a bifactor model, wherein each item corresponding to both a general factor (i.e., Total Behavior) and one of three narrow factors (i.e., Social Behavior, Academic Behavior, and Emotional Behavior). Such model fit was superior to that of alternative factor structures (i.e., unidimensional, correlated-factor, and higher order). A review of pattern coefficients suggested items were relatively split, with some items loading higher on the general factor and others loading higher on their narrow factor. A series of multigroup CFAs supported the configural and metric invariance of the bifactor model, while yielding less consistent support for scalar/threshold invariance. Omega reliability coefficients indicated each mySAEBRS scale was associated with acceptable internal consistency (>.70). However, when accounting for other factors, only the Total Behavior, Social Behavior, and Emotional Behavior scales demonstrated acceptable internal consistency (i.e., >.50). Implications for practice and directions for future research are discussed.

Social, Academic,and Emotional Behavior Risk Screener–Student Rating Scale

2017 ◽  
Author(s):  
Nathaniel P. von der Embse ◽  
Stephanie Iaccarino ◽  
Ariel Mankin ◽  
Stephen P. Kilgus ◽  
Eran Magen
Keyword(s):  
Rating Scale ◽  
Emotional Behavior ◽  
Student Rating

scholarly journals Application of S-1 Bifactor Model to Evaluate the Structural Validity of TMMS-24

2021 ◽  
Vol 18 (14) ◽  
pp. 7427
Author(s):  
Daniel Ondé ◽  
Jesús M. Alvarado ◽  
Santiago Sastre ◽  
Carolina M. Azañedo
Keyword(s):  
Emotional Intelligence ◽  
Internal Structure ◽  
Internal Consistency ◽  
Structural Complexity ◽  
Bifactor Model ◽  
General Factor ◽  
Hierarchical Relationship ◽  
Promising Tool ◽  
Sum Score ◽  
Specific Factors

(1) Background: Recent studies have shown that the internal structure of TMMS-24 can be conceptualized as a bifactor. However, these studies, based exclusively on the evaluation of the fit of the model, fail to show the existence of a general factor of strong emotional intelligence and have neglected the evaluation of the specific factors of attention, clarity and repair. The main goal of this work is to evaluate the degree of determination and reliability of the specific factors of TMMS-24 using a bifactor S-1 model. (2) Methods: We administered TMMS-24 to a sample of 384 students from middle and high schools (58.1% girls; mean age = 15.5; SD = 1.8). (3) Results: The specific TMMS-24 factors are better determined and present a higher internal consistency than the general factor. Furthermore, the bifactor S-1 model shows the existence of a hierarchical relationship between the attention factor and the clarity and repair factors. The S-1 bifactor model is the only one that was shown to be invariant as a function of the sex of the participants. (4) Conclusions: The S-1 bifactor model has proven to be a promising tool for capturing the structural complexity of TMMS-24. Its application indicates that it is not advisable to use the sum score of the items, since it would be contaminated by the attention factor. In addition, this score would not be invariant either, that is, comparisons by sex would be invalid.

scholarly journals An examination of the psychometric properties of the occupational identity questionnaire for community-living elderly who require care

2021 ◽  
pp. 156918612199793
Author(s):  
Masataka Shikata ◽  
Hiroyuki Notoh ◽  
Kazuya Shinohara ◽  
Kenji Yabuwaki ◽  
Yoshikazu Ishii ◽  
...  
Keyword(s):  
Factor Analysis ◽  
Psychometric Properties ◽  
Internal Consistency ◽  
Goodness Of Fit ◽  
Rating Scale ◽  
Criterion Validity ◽  
Scale Model ◽  
Occupational Identity ◽  
Structural Validity ◽  
Validity Criterion

Introduction Authors created an Occupational Identity Questionnaire Provisional version (OIQ-P) to assess occupational identity for elderly individuals. The purpose of this study was to examine the psychometric properties of the OIQ-P. Methods Participants included 135 (42 males) elderly who lived locally and required care or support. OIQ-P was evaluated in terms of structural validity, criterion validity and internal consistency. Results Based on the results of an exploratory factor analysis and confirmatory factor analysis, an OIQ with a factor structure of 3 factors and 14 items was created. Rasch rating scale model revealed that 14 participants and 1 item did not fit the goodness of fit, nevertheless, the overall result was good. Spearman's rank correlation coefficient indicates that there was a law correlation between OIQ and the occupational identity scale of the Occupational Performance History Interview Version 2. In terms of internal consistency, the person separation index and person separation reliability coefficient were 2.30 and 0.84, respectively. Conclusion This study confirmed the structural validity, criterion validity and internal consistency for the OIQ. To enhance the clinical utility of the OIQ, it is necessary to examine the interpretability and conduct an intervention study using the OIQ.

Development and Validation of the Social, Academic, and Emotional Behavior Risk Screener–Student Rating Scale

2016 ◽  
Vol 42 (3) ◽  
pp. 186-192 ◽  
Author(s):  
Nathaniel P. von der Embse ◽  
Stephanie Iaccarino ◽  
Ariel Mankin ◽  
Stephen P. Kilgus ◽  
Eran Magen
Keyword(s):  
Mental Health ◽  
Rating Scale ◽  
Teacher Rating ◽  
Emotional Behavior ◽  
Student Rating ◽  
Future Research ◽  
School Students ◽  
School Based ◽  
The Social ◽  
Psychometric Evidence

School systems are the primary providers for the increasing number of children with mental health needs. School-based universal screening offers a valuable way to identify children that would benefit from school-based mental health services. However, many existing screening systems rely on teacher ratings alone and do not incorporate student self-ratings. The current study evaluates the psychometric properties of the Social, Academic, and Emotional Behavior Risk Screener–Student Rating Scale (SAEBRS-SRS), a new 20-item multidimensional universal screener intended to provide assessment data on students’ social, academic, and emotional functioning. The SAEBRS-SRS complements the SAEBRS Teacher Rating Scale (TRS), which has previously demonstrated robust psychometric evidence. In the current study, data were collected from a racially and ethnically diverse sample of middle school students. Confirmatory factor analyses supported a bifactor structure consistent with the SAEBRS-TRS, with items corresponding to internally consistent Social, Academic, and Emotional Behaviors subscales, as well as an overall Total Behavior scale. The current analyses yield promising initial support for the development of the SAEBRS-SRS. Implications and the need for future research to provide additional psychometric evidence are discussed.

Social, Academic, and Emotional Behavior Risk Screener--Parent Rating Scale

2019 ◽  
Author(s):  
Crystal N. Taylor ◽  
Amanda Allen ◽  
Stephen P. Kilgus ◽  
Nathaniel P. von der Embse ◽  
Andrew S. Garbacz
Keyword(s):  
Rating Scale ◽  
Emotional Behavior ◽  
Parent Rating ◽  
Parent Rating Scale

scholarly journals Cross-cultural adaptation and psychometric properties of the Kessler Distress Scale (K10): an application of the rating scale model

2021 ◽  
Vol 34 (1) ◽  
Author(s):  
Evandro Morais Peixoto ◽  
Daniela Sacramento Zanini ◽  
Josemberg Moura de Andrade
Keyword(s):  
Psychological Distress ◽  
Psychometric Properties ◽  
Rating Scale ◽  
Self Report ◽  
Clinical Population ◽  
Scale Model ◽  
General Factor ◽  
Measurement Models ◽  
Distress Scale ◽  
Rating Scale Model

Abstract Background The Kessler Distress Scale (K10) is a self-report scale for the assessment of non-specific psychological distress in the general and clinical population. Because of its ease of application and good psychometric properties, the K10 has been adapted to several cultures. The present study seeks to adapt the K10 to Brazilian Portuguese and estimate its validity evidence and reliability. Methods A total of 1914 individuals from the general population participated in the study (age = 34.88, SD = 13.61, 77.7% female). The adjustment indices were compared among three different measurement models proposed for the K10 through confirmatory factor analysis (CFA). The items’ properties were analyzed by Andrich’s Rating Scale Model (RSM). Furthermore, evidence based on relations to other variables (depression, stress, anxiety, positive and negative affects, and satisfaction with life) was estimated. Results CFA indicated the adequacy of the bifactor model (CFI= 0.985; TLI= 0.973; SMR= 0.019; RMSEA= 0.050), composed of two specific factors (depression and anxiety) and one general factor (psychological distress), corresponding to the theoretical hypothesis. Additionally, it was observed multiple-group invariance by gender and age range. The RSM provided an understanding of the organization of the continuum represented by the psychological distress construct (items difficulty), which varied from −0.89 to 1.00; good adjustment indexes; infit between 0.67 and 1.32; outfit between 0.68 and 1.34; and desirable reliability, α= 0.87. Lastly, theoretically coherent associations with the external variables were observed. Conclusions It is concluded that the Brazilian version of the K10 is a suitable measure of psychological distress for the Brazilian population.

The Relationship Between Career Adaptability and Job-Search Self-Efficacy of Graduates: The Bifactor Approach

2021 ◽  
pp. 106907272110022
Author(s):  
Marijana Matijaš ◽  
Darja Maslić Seršić
Keyword(s):  
Job Search ◽  
Self Efficacy ◽  
Cross Sectional Study ◽  
Sem Analysis ◽  
Bifactor Model ◽  
Specific Factor ◽  
General Factor ◽  
Career Adaptability ◽  
Cross Sectional ◽  
Interview Performance

Career adaptability is an important resource for dealing with career transitions such as the transition from university to work. Previous research emphasized the importance of focusing on career adapt-abilities instead only on general career adaptability. The aim of this research was to investigate whether career adaptability can be conceptualized as a bifactor model and whether general and specific dimensions of career adaptability have a relationship with job-search self-efficacy of graduates. In an online cross-sectional study, 667 graduates completed the Career Adapt-Abilities Scale and Job Search Skill and Confidence Scale. The CFA analysis showed that the bifactor model of career adaptability had a good fit where general factor explained most of the items’ variance. The SEM analysis revealed that general career adaptability and the specific factor of confidence positively correlated with job-search and interview performance self-efficacy. Control only correlated with interview performance self-efficacy. Neither concern nor curiosity showed a significant relationship with job-search and interview performance self-efficacy.

scholarly journals Cross-cultural adaptation, reliability and validity of the Fremantle Knee Awareness Questionnaire in Italian subjects with painful knee osteoarthritis

2021 ◽  
Vol 19 (1) ◽  
Author(s):  
Marco Monticone ◽  
Cristiano Sconza ◽  
Igor Portoghese ◽  
Tomohiko Nishigami ◽  
Benedict M. Wand ◽  
...  
Keyword(s):  
Construct Validity ◽  
Knee Osteoarthritis ◽  
Pain Intensity ◽  
Internal Consistency ◽  
Structural Validity ◽  
Retest Reliability ◽  
Knee Oa ◽  
Pain Catastrophising ◽  
Test Retest Reliability ◽  
Painful Knee

Abstract Background and aim Growing attention is being given to utilising physical function measures to better understand and manage knee osteoarthritis (OA). The Fremantle Knee Awareness Questionnaire (FreKAQ), a self-reported measure of body-perception specific to the knee, has never been validated in Italian patients. The aims of this study were to culturally adapt and validate the Italian version of the FreKAQ (FreKAQ-I), to allow for its use with Italian-speaking patients with painful knee OA. Methods The FreKAQ-I was developed by means of forward–backward translation, a final review by an expert committee and a test of the pre-final version to evaluate its comprehensibility. The psychometric testing included: internal structural validity by Rasch analysis; construct validity by assessing hypotheses of FreKAQ correlations with the knee injury and osteoarthritis outcome score (KOOS), a pain intensity numerical rating scale (PI-NRS), the pain catastrophising scale (PCS), and the Hospital anxiety and depression score (HADS) (Pearson’s correlations); known-group validity by evaluating the ability of FreKAQ scores to discriminate between two groups of participants with different clinical profiles (Mann–Whitney U test); reliability by internal consistency (Cronbach’s alpha) and test–retest reliability (intraclass correlation coefficient, ICC2.1); and measurement error by calculating the minimum detectable change (MDC). Results It took one month to develop a consensus-based version of the FreKAQ-I. The questionnaire was administered to 102 subjects with painful knee OA and was well accepted. Internal structural validity confirmed the substantial unidimensionality of the FreKAQ-I: variance explained was 53.3%, the unexplained variance in the first contrast showed an eigenvalue of 1.8, and no local dependence was detected. Construct validity was good as all of the hypotheses were met; correlations: KOOS (rho = 0.38–0.51), PI-NRS (rho = 0.35–0.37), PCS (rho = 0.47) and HADS (Anxiety rho = 0.36; Depression rho = 0.43). Regarding known-groups validity, FreKAQ scores were significantly different between groups of participants demonstrating high and low levels of pain intensity, pain catastrophising, anxiety, depression and the four KOOS subscales (p ≤ 0.004). Internal consistency was acceptable (α = 0.74) and test–retest reliability was excellent (ICC = 0.92, CI 0.87–0.94). The MDC95 was 5.22 scale points. Conclusion The FreKAQ-I is unidimensional, reliable and valid in Italian patients with painful knee OA. Its use is recommended for clinical and research purposes.

scholarly journals Validity, reliability, and calibration of the physical activity unit 7 item screener (PAU-7S) at population scale

2021 ◽  
Vol 18 (1) ◽  
Author(s):  
Helmut Schröder ◽  
Isaac Subirana ◽  
Julia Wärnberg ◽  
María Medrano ◽  
Marcela González-Gross ◽  
...  
Keyword(s):  
Physical Activity ◽  
Predictive Validity ◽  
Internal Consistency ◽  
Regression Models ◽  
Weighted Kappa ◽  
Linear Regression Models ◽  
Retest Reliability ◽  
Activity Unit ◽  
Test Retest Reliability ◽  
Acceptable Internal Consistency

Abstract Background Validation of self-reported tools, such as physical activity (PA) questionnaires, is crucial. The aim of this study was to determine test-retest reliability, internal consistency, and the concurrent, construct, and predictive validity of the short semi-quantitative Physical Activity Unit 7 item Screener (PAU-7S), using accelerometry as the reference measurement. The effect of linear calibration on PAU-7S validity was tested. Methods A randomized sample of 321 healthy children aged 8–16 years (149 boys, 172 girls) from the nationwide representative PASOS study completed the PAU-7S before and after wearing an accelerometer for at least 7 consecutive days. Weight, height, and waist circumference were measured. Cronbach alpha was calculated for internal consistency. Test-retest reliability was determined by intra-class correlation (ICC). Concurrent validity was assessed by ICC and Spearman correlation coefficient between moderate to vigorous PA (MVPA) derived by the PAU-7S and by accelerometer. Concordance between both methods was analyzed by absolute agreement, weighted kappa, and Bland-Altman statistics. Multiple linear regression models were fitted for construct validity and predictive validity was determined by leave-one-out cross-validation. Results The PAU-7S overestimated MVPA by 18%, compared to accelerometers (106.5 ± 77.0 vs 95.2 ± 33.2 min/day, respectively). A Cronbach alpha of 0.76 showed an acceptable internal consistency of the PAU-7S. Test-retest reliability was good (ICC 0.71 p < 0.001). Spearman correlation and ICC coefficients of MVPA derived by the PAU-7S and accelerometers increased from 0.31 to 0.62 and 0.20 to 0.62, respectively, after calibration of the PAU-7S. Between-methods concordance improved from a weighted kappa of 0.24 to 0.50 after calibration. A slight reduction in ICC, from 0.62 to 0.60, yielded good predictive validity. Multiple linear regression models showed an inverse association of MVPA with standardized body mass index (β − 0.162; p < 0.077) and waist to height ratio (β − 0.010; p < 0.014). All validity dimensions were somewhat stronger in boys compared to girls. Conclusion The PAU-7S shows a good test-retest reliability and acceptable internal consistency. All dimensions of validity increased from poor/fair to moderate/good after calibration. The PAU-7S is a valid instrument for measuring MVPA in children and adolescents. Trial registration Trial registration numberISRCTN34251612.

Sign in / Sign up

Export Citation Format

Share Document