Development and Initial Validation of the Early Elementary Writing Rubric to Inform Instruction for Kindergarten and First-Grade Students

2021 ◽  
pp. 153450842110659
Author(s):  
Meaghan McKenna ◽  
Robert F. Dedrick ◽  
Howard Goldstein
Keyword(s):  
Student Performance ◽  
Instrument Development ◽  
Factor Model ◽  
Reliability And Validity ◽  
Internal Consistency Reliability ◽  
First Grade ◽  
Early Elementary ◽  
Response Scale ◽  
Validity Data ◽  
Elementary Writing

This article describes the development of the Early Elementary Writing Rubric ( EEWR), an analytic assessment designed to measure kindergarten and first-grade writing and inform educators’ instruction. Crocker and Algina’s (1986) approach to instrument development and validation was used as a guide to create and refine the writing measure. Study 1 describes the development of the 10-item measure (response scale ranges from 0 = Beginning of Kindergarten to 5 = End of First Grade). Educators participated in focus groups, expert panel review, cognitive interviews, and pretesting as part of the instrument development process. Study 2 evaluates measurement quality in terms of score reliability and validity. Data from writing samples produced by 634 students in kindergarten and first-grade classrooms were collected during pilot testing. An exploratory factor analysis was conducted to evaluate the psychometric properties of the EEWR. A one-factor model fit the data for all writing genres and all scoring elements were retained with loadings ranging from 0.49 to 0.92. Internal consistency reliability was high and ranged from .89 to .91. Interrater reliability between the researcher and participants varied from poor to good and means ranged from 52% to 72%. First-grade students received higher scores than kindergartners on all 10 scoring elements. The EEWR holds promise as an acceptable, useful, and psychometrically sound measure of early writing. Further iterative development is needed to fully investigate its ability to accurately identify the present level of student performance and to determine sensitivity to developmental and instruction gains.

Development and Validation of the Faceted Inventory of the Five-Factor Model (FI-FFM)

Assessment ◽  
2017 ◽  
Vol 26 (1) ◽  
pp. 17-44 ◽  
Author(s):  
David Watson ◽  
Ericka Nus ◽  
Kevin D. Wu
Keyword(s):  
Discriminant Validity ◽  
Factor Model ◽  
Five Factor Model ◽  
Reliability And Validity ◽  
Personality Inventory ◽  
Validity Data ◽  
Neo Personality Inventory ◽  
Convergent And Discriminant Validity ◽  
Three Samples ◽  
Five Phases

The Faceted Inventory of the Five-Factor Model (FI-FFM) is a comprehensive hierarchical measure of personality. The FI-FFM was created across five phases of scale development. It includes five facets apiece for neuroticism, extraversion, and conscientiousness; four facets within agreeableness; and three facets for openness. We present reliability and validity data obtained from three samples. The FI-FFM scales are internally consistent and highly stable over 2 weeks (retest rs ranged from .64 to .82, median r = .77). They show strong convergent and discriminant validity vis-à-vis the NEO, the Big Five Inventory, and the Personality Inventory for DSM-5. Moreover, self-ratings on the scales show moderate to strong agreement with corresponding ratings made by informants ( rs ranged from .26 to .66, median r = .42). Finally, in joint analyses with the NEO Personality Inventory–3, the FI-FFM neuroticism facet scales display significant incremental validity in predicting indicators of internalizing psychopathology.

Assessment of Reliability and Validity of the Turkish Version of Heartland Forgiveness Scale

2012 ◽  
Vol 111 (2) ◽  
pp. 575-584 ◽  
Author(s):  
Asli Bugay ◽  
Ayhan Demir ◽  
Raquel Delevi
Keyword(s):  
Internal Consistency ◽  
Satisfaction With Life ◽  
Pearson Correlation ◽  
Reliability And Validity ◽  
Internal Consistency Reliability ◽  
Criterion Validity ◽  
Satisfaction With Life Scale ◽  
Turkish Version ◽  
Response Scale ◽  
Three Factor

The current study investigated the reliability and validity of the Turkish version of the Heartland Forgiveness Scale (HFS). The Turkish version of the HFS, the Ruminative Response Scale (RRS), and the Satisfaction with Life Scale (SWLS) were administered to 796 Turkish university students (430 women, 366 men) with a mean age of 20.6 yr. ( SD = 2.1). Internal consistency reliability was calculated and Cronbach alpha coefficients ranged between .71 and .82. Criterion validity (Pearson correlation) between the HFS and other scales ranged from −.09 to .34. Additionally, a confirmatory factor analysis was conducted to assess the fit of the standard three-factor solution of the HFS. The results suggested that the Turkish version of the HFS had adequate internal consistency, criterion validity, and reflected the standard three-factor structure, indicating that it can be reliably used to measure forgiveness among a Turkish sample.

Reliability and Validity of the Overeating Tension Scale

2000 ◽  
Vol 8 (2) ◽  
pp. 145-160 ◽  
Author(s):  
Sue Popkess-Vawter ◽  
Mary M. Gerkovich ◽  
Shirley Wendel
Keyword(s):  
Factor Analysis ◽  
Construct Validity ◽  
Instrument Development ◽  
Convergent Validity ◽  
Reliability And Validity ◽  
Internal Consistency Reliability ◽  
Normal Weight ◽  
Reversal Theory ◽  
Final Version ◽  
Motivational States

This study presents the development and testing of the Overeating Tension Scale. Overeating tension was defined operationally as the total discrepancy score resulting from differences between subjects’ ratings of actual and desired feelings before overeating. The 32-item Overeating Tension Scale, derived from Apter’ s Reversal Theory, measures reported overall tension and motivation-specific tension. The scale initially included 48 items, six items for each of eight motivational states. After two instrument development studies (N = 373, N = 208), items were refined and reduced to a total of 32, or four for each of eight motivational states. The final version of the instrument was tested in two additional studies (N = 330, N = 130) that provided evidence to support the internal consistency reliability of the Overeating Tension Scale. There was support for construct validity using contrasted groups (overweight and normal weight subjects), convergent validity, and factor analysis.

Development and validation of the palliative care preferences scale (PCPS).

2018 ◽  
Vol 36 (34_suppl) ◽  
pp. 151-151
Author(s):  
Laura M Perry ◽  
Adina S Kazan ◽  
James Louis Rogers ◽  
Michael Hoerger
Keyword(s):  
Palliative Care ◽  
Internal Consistency ◽  
Convergent Validity ◽  
Factor Model ◽  
Clinical Care ◽  
Reliability And Validity ◽  
Internal Consistency Reliability ◽  
Care Utilization ◽  
Future Research ◽  
Serious Illness

151 Background: Research has not thoroughly examined patient-level factors such as perceptions that could contribute to underutilization of palliative care, which may be due in part to a lack of existing measures for this purpose. Therefore, this investigation aimed to develop and validate a 9-item measure called the Palliative Care Preferences Scale (PCPS-9), which was comprised of three subscales: emotional, cognitive, and behavioral. Methods: Data were collected in three separate online studies of individuals with cancer (study 1: N = 633; study 2: N = 462) or one of the following non-cancer serious illnesses: COPD, heart failure, or kidney failure (study 3: N = 248). Analyses assessed various psychometric properties of the scale in cancer and non-cancer patients, including internal consistency reliability, confirmatory factor analyses (CFAs), multigroup CFAs, and convergent validity associations with related constructs. Results: Across all three studies, results supported the internal consistency reliability for the total scale (αs from 0.76 to 0.83) and subscales: emotional (αs from 0.83 to 0.84), cognitive (αs from 0.60 to 0.77), behavioral (αs from 0.87 to 0.91). CFAs supported the three-factor model of the PCPS-9 (CFI ≥ 0.97, NNFI ≥ 0.96, RMSEA ≤ 0.07, SRMR ≤ 0.04), and a multigroup CFA supported the generalizability of its factor structure across cancer and non-cancer serious illness subgroups (ΔCFIs ≤ 0.006, ΔRMSEA ≤ 0.003). Finally, convergent validity analyses in studies 2 and 3 found that the PCPS-9 was significantly associated with related constructs, including a separate measure of palliative care preferences ( ps < 0.001) and a measure of palliative care knowledge ( ps < 0.001). Conclusions: Findings support the overall reliability and validity of the PCPS-9 in cancer and non-cancer serious illness samples and have implications for increasing palliative care utilization via clinical care and future research efforts.

Reliability and validity of the Social Curiosity Scale among Chinese university students

2019 ◽  
Vol 47 (9) ◽  
pp. 1-7
Author(s):  
Yong Zhang
Keyword(s):  
Factor Analysis ◽  
University Students ◽  
Factor Model ◽  
Reliability And Validity ◽  
Internal Consistency Reliability ◽  
Chinese Version ◽  
Chinese University ◽  
The Social ◽  
Good Internal Consistency ◽  
Chinese University Students

My aim in this study was to investigate the reliability and validity of the Social Curiosity Scale (SCS) among Chinese university students. Social curiosity has been conceptualized as an interest in how other people behave, think, and feel. Students (N = 916) at 3 general universities in Henan Province completed the Chinese version of the SCS. The results showed that the Chinese SCS has good internal consistency reliability. Exploratory factor analysis results indicated that the Chinese SCS presented a clear 2-factor structure, and confirmatory factor analysis results showed that the 2-factor model fitted the data better than the 1-factor model did. These results indicated that the Chinese version of the SCS has good construct validity. Therefore, the Chinese version of the SCS can be used as an effective tool for social curiosity measurement among Chinese university students.

Developing a Measure of Cultural-, Maturity-, or Esteem-Driven Modesty Among Jewish Women

2014 ◽  
Vol 28 (1) ◽  
pp. 9-37
Author(s):  
Caryn Scheinberg Andrews
Keyword(s):  
Instrument Development ◽  
Internal Consistency ◽  
Q Methodology ◽  
Reliability And Validity ◽  
Internal Consistency Reliability ◽  
Good Evidence ◽  
Jewish Women ◽  
Concept Definition ◽  
High Degree ◽  
Instrument Reliability

Understanding modesty and how it relates to religiosity among Jewish women was relatively unexplained, and as part of a larger study, a measure was needed. The purpose of this article is to report on three studies which represent the three stages of instrument development of a measure of modesty among Jewish women, “Your Views of Modesty”: (a) content/concept definition; (b) instrument development; and © evaluation of the psychometric properties of the instrument: reliability and validity. In Study I, Q methodology was used to define the domain and results suggesting that modesty has multidimensions. In Study II, an instrument was developed based on distinctive perspectives from each group or what was important and not so important. This formed a 25-item Likert scale. In Study III, a survey of 300 Jewish women revealed internal consistency estimates with Cronbach’s alpha 0.92, indicating high degree of internal consistency reliability for “Your Views of Modesty.” For construct validity, four factors were found explaining 55% of the variance of modesty: (a) religion-driven, (b) maturity-driven, (c) esteem-driven, and (d) public-based modesty was identified. “Your Views of Modesty” shows good evidence for reliability and validity in this Jewish population.

scholarly journals The Psychometric Properties of the Stress and Anxiety to Viral Epidemics-6 Items: A Test in the U.S. General Population

2021 ◽  
Vol 12 ◽  
Author(s):  
Sangha Lee ◽  
Jihoon Lee ◽  
Soyoung Yoo ◽  
Sooyeon Suh ◽  
Seockhoon Chung ◽  
...  
Keyword(s):  
General Population ◽  
Psychometric Properties ◽  
Factor Model ◽  
Reliability And Validity ◽  
Internal Consistency Reliability ◽  
Validity And Reliability ◽  
English Version ◽  
Cross Sectional ◽  
Patient Health ◽  
The U.S

Objectives: Many individuals around the world are suffering from psychological distress due to the COVID-19 outbreak. The aim of this study is to explore the validity and reliability of the English version of Stress and Anxiety to Viral Epidemics-6 (SAVE-6), which measures the anxiety response of the general population to the viral epidemic.Methods: A cross-sectional web-based study with self-reporting measures was conducted. A total of 314 United States residents were recruited via online platform in exchange for payment. The participants were asked to an anonymous questionnaire, collecting information on demographics, psychiatric history, SAVE-6, Patient Health Questionnaire-4 (PHQ-4), and the Coronavirus Anxiety Scale.Results: The result from confirmatory factor analysis (CFA) demonstrated that a single-factor model [χ(9)2 = 11.53, p = 0.24] yielded excellent fit for all of indices [χ2/df ratio = 1.28; CFI = 1.00; TLI = 1.00; SRMR = 0.02; RMSEA = 0.03 (0.00, 0.07; 90% CI)] and yielded strong internal consistency reliability (Cronbach's α = 0.88). The results from multigroup CFAs showed that there were no gender differences [Δχ(6)2 = 3.20, p = 0.78, ns] and no race differences [Δχ(6)2=3.60, p = 0.73, ns] between the models, along with excellent model fits.Conclusions: The results of this study support the reliability and validity of SAVE-6 with strong psychometric properties for the English version of the U.S. population.

The Interpersonal Relationship Inventory: Continued Psychometric Evaluation

1994 ◽  
Vol 2 (1) ◽  
pp. 63-78 ◽  
Author(s):  
Virginia P. Tilden ◽  
Anne M. Hirsch ◽  
Christine A. Nelson
Keyword(s):  
Social Support ◽  
Instrument Development ◽  
Social Relationships ◽  
Interpersonal Relationship ◽  
Reliability And Validity ◽  
Psychometric Evaluation ◽  
Internal Consistency Reliability ◽  
Compelling Evidence ◽  
The Third ◽  
Psychometric Quality

For norm-referenced measures to be useful in social-behavioral research, investigators who develop measures face several psychometric challenges, including: (a) adequate domain specification; (b) adequate initial evidence of reliability and validity; and (c) ongoing evidence of psychometric quality. The Interpersonal Relationship Inventory (IPRI) was developed in response to gaps in measurement of social relationships, and contributed scales for reciprocity and conflict to a measure of social support. For the IPRI, the first two points were addressed during the period of instrument development. The measure now has been in use for 4 years. This article reports evidence addressing the third challenge: ongoing evidence of psychometric quality. Findings from 19 studies using the IPRI provide compelling evidence for internal consistency reliability and construct validity of the scales.

The Range of Impaired Functioning Tool (LIFE–RIFT): a brief measure of functional impairment

1999 ◽  
Vol 29 (4) ◽  
pp. 869-878 ◽  
Author(s):  
A. C. LEON ◽  
D. A. SOLOMON ◽  
T. I. MUELLER ◽  
C. L. TURVEY ◽  
J. ENDICOTT ◽  
...  
Keyword(s):  
Tool Life ◽  
Functional Impairment ◽  
Factor Model ◽  
Intraclass Correlation ◽  
Empirical Support ◽  
Reliability And Validity ◽  
Internal Consistency Reliability ◽  
Linear Regression Models ◽  
Cross Sectional ◽  
Mixed Effect

Background. The literature documents that functional impairment is associated with affective disorders. Nevertheless, the choice among thorough, yet brief, well-validated assessments of functional impairment is limited. The objective of this study was to evaluate the psychometric properties of a brief scale of functional impairment, the Range of Impaired Functioning Tool (LIFE–RIFT).Method. The study sample included subjects who presented with major depressive disorder at intake into the NIMH Collaborative Depression Study (CDS). The LIFE–RIFT is composed of items that are included in the Longitudinal Interval Follow-up Evaluation (LIFE). The reliability and validity were examined using data from LIFE–RIFT assessments conducted at four points in time: 6, 12, 18 and 24 months after intake into the CDS.Results. Cross-sectional one factor models accounted for the covariance structure among the four scale items. A longitudinal factor model, with an invariant factor structure over time, also fitted the data well and indicated that the scale items are measures of one construct, namely functional impairment. The internal consistency reliability of the scale was supported with alpha coefficients ranging from 0·81 to 0·83. The inter-rater reliability intraclass correlation coefficient (ICC) was 0·94. Mixed-effect linear regression models showed that those in episode were significantly more impaired than those in recovery. Furthermore, in analyses of predictive validity, impairment was positively associated with subsequent recurrence and negatively associated with subsequent recovery.Conclusions. This psychometric evaluation provides empirical support for the reliability and validity of the LIFE–RIFT, a brief measure of functional impairment.

Evidence of Reliability and Validity for the Pictorial Scale of Perceived Movement Skill Competence in Spanish Children

2018 ◽  
Vol 6 (s2) ◽  
pp. S205-S222 ◽  
Author(s):  
Isaac Estevan ◽  
Javier Molina-García ◽  
Gavin Abbott ◽  
Steve J. Bowe ◽  
Isabel Castillo ◽  
...  
Keyword(s):  
Internal Consistency ◽  
Structural Equation ◽  
Factor Model ◽  
Reliability And Validity ◽  
Internal Consistency Reliability ◽  
Play Skills ◽  
Physical Competence ◽  
Motor Competence ◽  
Object Control ◽  
Test Retest Reliability

Perceived motor competence is a subdomain of perceived physical competence that is related to the practice of physical activity and motor skills. The Pictorial Scale of Perceived Movement Skill Competence (PMSC) assesses perceived motor competence (locomotor, object control, and active play skills) in children. The purpose of the present study was twofold: first, to translate the PMSC into Spanish and to test the reliability (internal consistency and test-retest) and construct validity of the aforementioned scale in a Spanish sample; second, to analyze children’s perception of motor competence according to gender. Two hundred and forty-seven typically developed children (51% boys) between 5 and 11 years old participated in the study. Internal consistency reliability was acceptable. Children’s test-retest reliability was between high and excellent. A Bayesian Structural Equation approach showed the original hypothesized three-factor model was a poor fit, but a two-factor model (i.e., locomotion and object control) was an adequate fit. Boys reported higher perception in the object control and overall motor competence, but similar perception in locomotor skills to girls. The PMSC can provide a useful way to study the nature and impact of motor competence perception in young children of Spanish-speaking communities.

Sign in / Sign up

Export Citation Format

Share Document