scholarly journals Developing an observational rubric of writing: Preliminary reliability and validity evidence

2017 ◽  
Vol 19 (3) ◽  
pp. 316-348 ◽  
Author(s):  
Sinéad Harmey ◽  
Jerome D’Agostino ◽  
Emily Rodgers

The purpose of this paper is (1) to report on the design of the early writing observational writing rubric designed to observe and describe change over time in the writing of children emerging into conventional literacy (ages 6–7) within an instructional setting and (2) to investigate the initial reliability and validity of the rubric. We used an extant data set that included 52 videos of writing instruction in Reading Recovery lessons (approximately 520 minutes) and pre- and post-intervention test data, for 24 students, taken at multiple time points across a 20-week period. Dependent sample t-tests and HLM were used to ascertain if the rubric was sensitive to change over occasions. We also considered if the scores correlated with external literacy measures. The findings suggest that the rubric has good initial reliability and validity and is a useful tool for researchers to observe and measure change over time as young children write in an instructional setting; further validation work is required for use in other settings.

2019 ◽  
Author(s):  
Tuong-Van Vu ◽  
Martijn Meeter ◽  
Abe Dirk Hofman ◽  
Brenda Jansen ◽  
Lucía Magis-Weinberg ◽  
...  

The present research investigates the relations between motivation belief, motivational behaviors and academic achievement in educational contexts. The first main question is whether motivational belief is reciprocally related to achievement and whether a cyclic loop of motivation and achievement is formed over time. The second objective is to study the mediating pathway between motivation and achievement by measuring actual effort spent on learning (i.e. motivational behaviors). Third, we examine the causality of these relations by investigating how they are affected when achievement is experimentally manipulated. We design an intensive longitudinal experiment in which participants will learn new English vocabulary and their motivational belief, effort, and achievement are measured at multiple time points. In the second half of the experiment, participants receive rigged feedback that their achievement has dropped which is expected to influence their subsequent motivation, effort, and actual achievement. To study these dynamics, the changes in one construct are related to changes in other constructs over time, and will be analyzed within a latent change score modeling framework. Planned analyses, expected (narrative) results, and a simulated data set are provided.


2018 ◽  
Vol 59 (6) ◽  
pp. 1103-1111 ◽  
Author(s):  
Joukje C Swinkels ◽  
Marjolein I Broese van Groenou ◽  
Alice de Boer ◽  
Theo G van Tilburg

Abstract Background and Objectives The general view is that partner-caregiver burden increases over time but findings are inconsistent. Moreover, the pathways underlying caregiver burden may differ between men and women. This study examines to what degree and why partner-caregiver burden changes over time. It adopts Pearlin’s Caregiver Stress Process Model, as it is expected that higher primary and secondary stressors will increase burden and larger amounts of resources will lower burden. Yet, the impact of stressors and resources may change over time. The wear-and-tear model predicts an increase of burden due to a stronger impact of stressors and lower impact of resources over time. Alternatively, the adaptation model predicts a decrease of burden due to a lower impact of stressors and higher impact of resources over time. Research Design and Methods We used 2 observations with a 1-year interval of 279 male and 443 female partner-caregivers, derived from the Netherlands Older Persons and Informal Caregivers Survey Minimum Data Set. We applied multilevel regression analysis, stratified by gender. Results Adjusted for all predictors, caregiver burden increased over time for both men and women. For female caregivers, the impact of poor spousal health on burden increased and the impact of fulfillment decreased over time. Among male caregivers, the impact of predictors did not change over time. Discussion and Implications The increase of burden over time supports the wear-and-tear model, in particular for women. This study highlights the need for gender-specific interventions that are focused on enabling older partners to be better prepared for long-term partner-care.


2021 ◽  
Vol 2 (1) ◽  
pp. 1-20
Author(s):  
Tamara Sweller ◽  
◽  
Stuart Thomas ◽  
Michael Daffern ◽  
◽  
...  

This study investigated change in behavioural manifestations of dynamic risk factors, in a sample of adult male sexual offenders who completed a custody-based treatment program. A checklist was developed to monitor and determine change in the frequency of behavioural manifestations of dynamic risk factors and prosocial equivalent behaviours. Offenders and custodial staff completed the checklist once each week for the duration of the offender’s period of treatment (range = 26-69 weeks, M = 45). Checklist scores were aggregated into domains based on the organisation of the Risk for Sexual Violence Protocol (Psychological Adjustment; Social Adjustment; Mental Disorder; Manageability). Change over time for individuals and the group was evaluated. Results showed an increase in positive behaviour in all domains, but there was only a decrease in risk-related manifestations in Psychological Adjustment, and this was only according to offenders. Offender self-report and staff observations were compared, revealing different perceptions of change. Using a behavioural checklist that incorporates self-report and observer data to measure change may provide a comprehensive measure of change over time.


2005 ◽  
Vol 68 (8) ◽  
pp. 354-366 ◽  
Author(s):  
Carolyn A Unsworth

Although there is increasing demand for greater accountability from occupational therapists for the outcomes of their practice, there are few quick, simple and psychometrically sound tools available to measure these outcomes. This paper reports on the first data collection exercise using a new outcome measure, the Australian Therapy Outcome Measures for Occupational Therapy (AusTOMs-OT). The aims of this paper are to present the scales, describe the data set and examine whether the scales are sufficiently sensitive to detect change over time in client status. Data were collected with 466 clients at 12 metropolitan and rural health care facilities using the 12 AusTOM-OT scales, which rate the client in relation to the four domains of Impairment, Activity limitation, Participation restriction and Distress/wellbeing. The findings indicated that the most frequently used scales were Self-care, Upper limb use, Transfers and Functional walking and mobility, and that all scales were successful in demonstrating statistically significant client change over time. The AusTOMs-OT can be used to document client outcomes in relation to four important practice domains and thus be of value in research and quality assurance activities seeking to provide evidence that occupational therapy does make a difference to the lives of clients.


2018 ◽  
Author(s):  
Florian Heigwer ◽  
Christian Scheeder ◽  
Thilo Miersch ◽  
Barbara Schmitt ◽  
Claudia Blass ◽  
...  

AbstractContext-dependent changes in genetic vulnerabilities are important to understand the wiring of cellular pathways and variations in different environmental conditions. However, methodological frameworks to investigate the plasticity of genetic networks over time or in response to external stresses are lacking. To analyze the plasticity of genetic interactions, we performed an arrayed combinatorial RNAi screen in Drosophila cells at multiple time points and after pharmacological inhibition of Ras signaling activity. Using an image-based morphology assay to capture a broad range of phenotypes, we assessed the effect of 12768 pairwise RNAi perturbations in six different conditions. We found that genetic interactions form in different trajectories and developed an algorithm, termed MODIFI, to analyze how genetic interactions rewire over time. Using this framework, we identified more statistically significant interactions compared to endpoints assays and further observed several examples of context-dependent crosstalk between signaling pathways such as an interaction between Ras and Rel which is dependent on MEK activity.


2021 ◽  
Author(s):  
Michaela A McCown ◽  
Carolyn Allen ◽  
Daniel D Machado ◽  
Hannah Boekweg ◽  
Yiran Liang ◽  
...  

Chronic Lymphocytic Leukemia (CLL) is a slow progressing disease, characterized by a long asymptomatic stage followed by a symptomatic stage during which patients receive treatment. While proteomic studies have discovered differential pathways in CLL, the proteomic evolution of CLL during the asymptomatic stage has not been studied. In this pilot study, we show that by using small sample sizes comprising ~145 cells, we can detect important features of CLL necessary for studying tumor evolution. Our small samples are collected at two time points and reveal large proteomic changes in healthy individuals over time. A meta-analysis of two CLL proteomic papers showed little commonality in differentially expressed proteins and demonstrates the need for larger control populations sampled over time. To account for proteomic variability between time points and individuals, large control populations sampled at multiple time points are necessary for understanding CLL progression. Data is available via ProteomeXchange with identifier PXD027429.


2019 ◽  
Vol 3 (Supplement_1) ◽  
pp. S631-S631
Author(s):  
Kim Curyto ◽  
Jenefer M Jedele ◽  
Jennifer J Mach ◽  
David C Mohr ◽  
Laura O Wray ◽  
...  

Abstract Persons with dementia frequently demonstrate behavior symptoms of dementia (BSD), associated with poorer outcomes. A measure of BSD was created for routine use in VA Community Living Centers (CLCs). Reliability and validity of Minimum Data Set (MDS 3.0) behavior items was established using exploratory factor analysis and a multitrait, multimethod correlation matrix. 385 CLC residents with BSD were assessed using validated measures of BSD, depression, and anxiety, and team ratings of the frequency and severity of target behaviors identified for intervention. Factor analysis on MDS items closest to baseline resulted in two stable factors. MDS behavior factors related to validated clinical measures in predicted ways at baseline and post-intervention. MDS distress behavior factor sensitivity to change was evaluated by using change score correlations with validated clinical measures. The MDS distress behavior factor can be used routinely, evaluate the impact of intervention effectiveness, and provide quality improvement feedback.


Spine ◽  
1993 ◽  
Vol 18 (13) ◽  
pp. 1723-1727 ◽  
Author(s):  
Paul Stratford ◽  
P. Solomon ◽  
J. Binkley ◽  
E. Finch ◽  
C. Gill

eLife ◽  
2018 ◽  
Vol 7 ◽  
Author(s):  
Florian Heigwer ◽  
Christian Scheeder ◽  
Thilo Miersch ◽  
Barbara Schmitt ◽  
Claudia Blass ◽  
...  

Context-dependent changes in genetic interactions are an important feature of cellular pathways and their varying responses under different environmental conditions. However, methodological frameworks to investigate the plasticity of genetic interaction networks over time or in response to external stresses are largely lacking. To analyze the plasticity of genetic interactions, we performed a combinatorial RNAi screen in Drosophila cells at multiple time points and after pharmacological inhibition of Ras signaling activity. Using an image-based morphology assay to capture a broad range of phenotypes, we assessed the effect of 12768 pairwise RNAi perturbations in six different conditions. We found that genetic interactions form in different trajectories and developed an algorithm, termed MODIFI, to analyze how genetic interactions rewire over time. Using this framework, we identified more statistically significant interactions compared to end-point assays and further observed several examples of context-dependent crosstalk between signaling pathways such as an interaction between Ras and Rel which is dependent on MEK activity.Editorial note: This article has been through an editorial process in which the authors decide how to respond to the issues raised during peer review. The Reviewing Editor's assessment is that all the issues have been addressed (<xref ref-type="decision-letter" rid="SA1">see decision letter</xref>).


Sign in / Sign up

Export Citation Format

Share Document