Criterion Validity of a Computer Adaptive Universal Screener to an End-of-Year State Mathematics Assessment

2020 ◽  
pp. 1-17
Author(s):  
Corey Peltier ◽  
Kimberly J. Vannest ◽  
Brianne R. Tomaszewski ◽  
Kristi Morin ◽  
Mary Rose Sallese ◽  
...  
Author(s):  
Ling-Yu Guo ◽  
Phyllis Schneider ◽  
William Harrison

Purpose This study provided reference data and examined psychometric properties for clausal density (CD; i.e., number of clauses per utterance) in children between ages 4 and 9 years from the database of the Edmonton Narrative Norms Instrument (ENNI). Method Participants in the ENNI database included 300 children with typical language (TL) and 77 children with language impairment (LI) between the ages of 4;0 (years;months) and 9;11. Narrative samples were collected using a story generation task, in which children were asked to tell stories based on six picture sequences. CD was computed from the narrative samples. The split-half reliability, concurrent criterion validity, and diagnostic accuracy were evaluated for CD by age. Results CD scores increased significantly between ages 4 and 9 years in children with TL and those with LI. Children with TL produced higher CD scores than those with LI at each age level. In addition, the correlation coefficients for the split-half reliability and concurrent criterion validity of CD scores were all significant at each age level, with the magnitude ranging from small to large. The diagnostic accuracy of CD scores, as revealed by sensitivity, specificity, and likelihood ratios, was poor. Conclusions The finding on diagnostic accuracy did not support the use of CD for identifying children with LI between ages 4 and 9 years. However, given the attested reliability and validity for CD, reference data of CD from the ENNI database can be used for evaluating children's difficulties with complex syntax and monitoring their change over time. Supplemental Material https://doi.org/10.23641/asha.13172129


2018 ◽  
Vol 34 (2) ◽  
pp. 87-100 ◽  
Author(s):  
Gino Casale ◽  
Robert J. Volpe ◽  
Brian Daniels ◽  
Thomas Hennemann ◽  
Amy M. Briesch ◽  
...  

Abstract. The current study examines the item and scalar equivalence of an abbreviated school-based universal screener that was cross-culturally translated and adapted from English into German. The instrument was designed to assess student behavior problems that impact classroom learning. Participants were 1,346 K-6 grade students from the US (n = 390, Mage = 9.23, 38.5% female) and Germany (n = 956, Mage = 8.04, 40.1% female). Measurement invariance was tested by multigroup confirmatory factor analysis (CFA) across students from the US and Germany. Results support full scalar invariance between students from the US and Germany (df = 266, χ2 = 790.141, Δχ2 = 6.9, p < .001, CFI = 0.976, ΔCFI = 0.000, RMSEA = 0.052, ΔRMSEA = −0.003) indicating that the factor structure, the factor loadings, and the item thresholds are comparable across samples. This finding implies that a full cross-cultural comparison including latent factor means and structural coefficients between the US and the German version of the abbreviated screener is possible. Therefore, the tool can be used in German schools as well as for cross-cultural research purposes between the US and Germany.


Author(s):  
Phil Daro ◽  
Frances Stancavage ◽  
Moreica Ortega ◽  
Lizanne DeStefano ◽  
Robert Linn

2012 ◽  
Author(s):  
Bridget V. Dever ◽  
Tara C. Raines ◽  
Christopher Barclay ◽  
Brian Mitchell ◽  
Randy W. Kamphaus

2016 ◽  
Vol 51 (2) ◽  
pp. 72-82 ◽  
Author(s):  
John Elwood Romig ◽  
William J. Therrien ◽  
John W. Lloyd

We used meta-analysis to examine the criterion validity of four scoring procedures used in curriculum-based measurement of written language. A total of 22 articles representing 21 studies ( N = 21) met the inclusion criteria. Results indicated that two scoring procedures, correct word sequences and correct minus incorrect sequences, have acceptable criterion validity with commercially developed and state- or locally developed criterion assessments. Results indicated trends for scoring procedures at each grade level. Implications for researchers and practitioners are discussed.


2021 ◽  
Vol 11 (1) ◽  
Author(s):  
Antonio Hernández-Martínez ◽  
Sergio Martínez-Vázquez ◽  
Julian Rodríguez-Almagro ◽  
Khalid Saeed Khan ◽  
Miguel Delgado-Rodríguez ◽  
...  

AbstractTo determine the psychometric properties of the Perinatal Post-Traumatic Stress Disorder (PTSD) Questionnaire (PPQ) in Spanish. A cross-sectional study of 432 Spanish puerperal women was conducted, following ethical approval. The PPQ was administered online through midwives' associations across Spain. The Edinburgh Postnatal Depression Scale was used to diagnose postnatal depression for examining criterion validity. Data were collected on sociodemographic, obstetric, and neonatal variables. An exploratory factorial analysis (EFA) was performed with convergence and criterion validation. Internal consistency was evaluated using Cronbach's α. The EFA identified three components that explained 63.3% of variance. The PPQ's convergence validation associated the risk of PTSD with variables including birth plan, type of birth, hospital length of stay, hospital readmission, admission of the newborn to care unit, skin-to-skin contact, maternal feeding at discharge, maternal perception of partner support, and respect shown by healthcare professionals during childbirth and puerperium. The area under the ROC curve for the risk of postnatal depression (criterion validity) was 0.86 (95% CI 0.82–0.91). Internal consistency with Cronbach's α value was 0.896. The PPQ used when screening for PTSD in postpartum Spanish women showed adequate psychometric properties.


SLEEP ◽  
2021 ◽  
Vol 44 (Supplement_2) ◽  
pp. A201-A202
Author(s):  
Kristina Puzino ◽  
Susan Calhoun ◽  
Allison Harvey ◽  
Julio Fernandez-Mendoza

Abstract Introduction The Sleep Inertia Questionnaire (SIQ) was developed and validated in patients with mood disorders to evaluate difficulties with becoming fully awake after nighttime sleep or daytime naps in a multidimensional manner. However, few data are available regarding its psychometric properties in clinical samples with sleep disorders. Methods 211 patients (43.0±16.4 years old, 68% female, 17% minority) evaluated at the Behavioral Sleep Medicine (BSM) program of Penn State Health Sleep Research & Treatment Center completed the SIQ. All patients were diagnosed using ICSD-3 criteria, with 111 receiving a diagnosis of chronic insomnia disorder (CID), 48 of a central disorder of hypersomnolence (CDH), and 52 of other sleep disorders (OSD). Structural equation modelling was used to conduct confirmatory factor analysis (CFA) of the SIQ. Results CFA supported four SIQ dimensions of “physiological”, “cognitive”, “emotional” and “response to” (RSI) sleep inertia with adequate goodness-of-fit (TLI=0.90, CFI=0.91, GFI=0.85, RMSEA=0.08). Internal consistency was high (α=0.94), including that of its dimensions (physiological α=0.89, cognitive α=0.94, emotional α=0.67, RSI α=0.78). Dimension inter-correlations were moderate to high (r=0.42–0.93, p&lt;0.01), indicating good construct validity. Convergent validity showed moderate correlations with Epworth sleepiness scale (ESS) scores (r=0.38) and large correlations with Flinders fatigue scale (FFS) scores (r=0.65). Criterion validity showed significantly (p&lt;0.01) higher scores in subjects with CDH (69.0±16.6) as compared to those with CID (54.4±18.3) or OSD (58.5±20.0). A SIQ cut-off score ≥57.5 provided a sensitivity/specificity of 0.77/0.65, while a cut-off score ≥61.5 provided a sensitivity/specificity of 0.71/0.70 to identify CDH vs. ESS&lt;10 (AUC=0.76). Conclusion The SIQ shows satisfactory indices of reliability and construct validity in a clinically-diverse sleep disorders sample. Its criterion validity is supported by its divergent association with hypersomnia vs. insomnia disorders, as well as its adequate sensitivity/specificity to identify patients with CDH. The SIQ can help clinicians easily assess the complex dimensionality of sleep inertia and target behavioral sleep treatments. Future studies should confirm the best SIQ cut-off score by including good sleeping controls, while clinical studies should determine its minimal clinically important difference after pharmacological or behavioral treatments. Support (if any):


Sign in / Sign up

Export Citation Format

Share Document