Short Comparative Interrupted Time Series Using Aggregate School-Level Data in Education Research

2018 ◽  
Vol 47 (5) ◽  
pp. 295-306 ◽  
Author(s):  
Kelly Hallberg ◽  
Ryan Williams ◽  
Andrew Swanlund ◽  
Jared Eno

Short comparative interrupted times series (CITS) designs are increasingly being used in education research to assess the effectiveness of school-level interventions. These designs can be implemented relatively inexpensively, often drawing on publicly available data on aggregate school performance. However, the validity of this approach hinges on a variety of assumptions and design decisions that are not clearly outlined in the literature. This article aims to serve as a practice guide for applied researchers when deciding how and whether to use this approach. We begin by providing an overview of the assumptions needed to estimate causal effects using school-level data, common threats to validity faced in practice and what effects can and cannot be estimated using school-level data. We then examine two analytic decisions researchers face in practice when implementing the design: correctly modeling the pretreatment functional form, which is modeling the preintervention trend, and selecting comparison cases. We then illustrate the use of this design in practice drawing on data from the implementation of the school improvement grant (SIG) program in Ohio. We conclude with advice for applied researchers implementing this design.

2019 ◽  
Vol 4 (3) ◽  
pp. 216-231 ◽  
Author(s):  
Elisha Omoso ◽  
Kim Schildkamp ◽  
Jules Pieters

Purpose The purpose of this paper is to explore the data available and their use by Kenyan secondary school teachers and head teachers. Design/methodology/approach Using a qualitative case study design, this study utilised interviews and documentary evidence to explore the data available and their use within Kenyan schools. Findings The data available in Kenyan schools were similar except for context data which had slight variations between schools. Head teachers mainly used school-level data to monitor school functioning, plan and develop school-level policies which mainly focused on school and curriculum improvement but little on teacher improvement. Teacher improvement attempts were mostly via benchmarking. The results also show that Kenyan head teachers hide inspection reports from teachers and that some head teachers used data creatively than others. For example, one head teacher used data to start a feeding programme to support economically disadvantaged students. Teachers, however, mostly used classroom-level data to plan lessons and monitor students’ progress. Research limitations/implications The study results may be used for data use comparative studies between developing and developed countries. Practical implications Based on the findings, data use training is needed to help Kenyan schools use data to improve teachers and teaching. Originality/value Accountability and data use are at the centre of many school improvement efforts the world over. The last two decades, for example, show pressure on schools to account for the resources invested and for the education they provide to children mainly in the form of data. Regrettably, studies pay little attention to data use in schools within developing countries such as Kenya.


2021 ◽  
Author(s):  
Caroline X Gao ◽  
Jonathan C. Broder ◽  
Sam Brilleman ◽  
Emily Berger ◽  
Jill Ikin ◽  
...  

Background: Disasters and other community-wide events can introduce significant interruptions and trauma to impacted communities. Children and young people can be disproportionately affected with additional educational disruptions. With the increasing threat of climate change, establishing a timely and adaptable framework to evaluate the impact of disasters on academic achievement is needed. However, analytical challenges are posed by the availability issue of individual-level data. Methods: A new method, Bayesian hierarchical meta-regression, was developed to evaluate the impact of the 2014 Hazelwood mine fire (a six-week fire event in Australia) using only aggregated school-level data from the standardised National Assessment Program-Literacy and Numeracy (NAPLAN) test. NAPLAN results and school characteristics (2008-2018) from 69 primary/secondary schools with different levels of mine fire-related smoke exposure were used to estimate the impact of the event. Using an interrupted time-series design, the model estimated immediate effects and post-interruption trend differences with full Bayesian statistical inference. Results: Major academic interruptions across NAPLAN domains were evident in high exposure schools in the year post-mine fire (highest in Writing: 11.09 [95%CI: 3.16-18.93], lowest in Reading: 8.34 [95%CI: 1.07-15.51]). The interruption was comparable to a three to four-month delay in educational attainment and had not fully recovered after several years. Conclusions: Considerable academic delays were found as a result of a mine fire, highlighting the need to provide educational and community-based supports in response to future events. Importantly, this work provides a statistical method using readily available aggregated data to assess the educational impacts in response to other disasters


2015 ◽  
Vol 117 (6) ◽  
pp. 1-34
Author(s):  
Tina Trujillo ◽  
Michelle RenÉE

Background In 2009, the Obama Administration announced its intention to rapidly “turn around” 5,000 of the nation's lowest-performing schools. To do so, it relied on the School Improvement Grant (SIG) program to provide temporary funding for states and schools, and to mandate drastic, school-level reforms. Most of these reforms require massive administrative and teacher layoffs, especially under the “turnaround option.”In the public debate about the SIG program, reforms such as turnarounds have been described as new and innovative. In reality, the nation has significant experience with them, particularly over the past 40 years. Turnaround-style reforms are not only based on unwarranted claims; they ignore contrary research evidence about the potential of mass firings to improve organizational performance. Purpose This paper considers the tensions with democratic education inherent in the federal SIG program's market-based school reforms. It examines the evolution of and intent behind the 2009 federal SIG program. From there, it considers the lessons of forty years of research on educational effectiveness and high-stakes accountability. It builds on this evidence, as well as the growing literature on communities’ engagement in reform, in its analysis of the school turnaround research and practice. The paper culminates in a set of recommendations that are intended to re-center the purposes of public education for low-income students, students of color, and local communities in developing more equitable, democratic school turnarounds. Research Design This article synthesizes forty years of research on school and district effectiveness, high-stakes accountability, and community engagement in school reform to evaluate the federal School Improvement Grant program's potential to cultivate democratic, equitable public schools. It also reviews the small, but rapidly growing literature on school turnarounds, paying particular attention to the ways in which this new field reproduces or departs from earlier literature that examined reform models that are analogous to the current SIG-funded school turnarounds. Conclusions: Based on the provisional lessons that are emerging from current SIG-inspired turnarounds, from research on earlier efforts to improve school and district effectiveness, and from pockets of promising community-based practices that are developing at local and national levels, we propose five steps that federal, state, and local policymakers can take toward fostering more equitable, democratic turnaround processes. First, increase current federal and state spending for public education, particularly as it is allocated for more democratic turnarounds. Second, focus turnaround policies on improving the quality of teaching and learning rather than on technical-structural changes. Third, engage a broad cross-section of schools’ communities—teachers, students, parents, and community organizations—in planning and implementing turnaround strategies that are tailored to each school and district context. Fourth, incorporate multiple indicators of effectiveness—apart from test scores—that reflect the range of purposes for schools. Fifth, support ongoing, systematic research, evaluation, and dissemination examining all aspects of turnaround processes in schools and districts.


2016 ◽  
Vol 49 (5) ◽  
pp. 459-485
Author(s):  
Craig Hochbein ◽  
Bradley Carpenter

This article assesses the association between the Title I School Improvement Grant (SIG) program’s personnel replacement policy and teacher employment patterns within an urban school district. Hannan and Freeman’s population ecology model allowed the authors to consider schools within districts as individual organizations nested within a larger organization. The data are drawn from employment records of 2,470 teachers who worked in 19 high schools in a single school district from 2006 to 2011. The personnel replacement policy of the Title I SIG program appears to have reinforced, and in some cases intensified, existing patterns of teacher selection, retention, and migration.


2017 ◽  
Vol 72 (1) ◽  
pp. 27-33 ◽  
Author(s):  
Louise Marryat ◽  
Lucy Thompson ◽  
Helen Minnis ◽  
Philip Wilson

BackgroundThis paper examines socioeconomic inequalities in mental health at school entry and explores changes in these inequalities over the first 3 years of school.MethodsThe study utilises routinely collected mental health data from education records and demographic data at ages 4 and 7 years, along with administrative school-level data. The study was set in preschool establishments and schools in Glasgow City, Scotland. Data were available on 4011 children (59.4%)at age 4 years, and 3166 of these children were followed at age 7 years (46.9% of the population). The main outcome measure was the teacher-rated Goodman’s Strengths and Difficulties Questionnaire (4–16 version) at age 7 years, which measures social, emotional and behavioural difficulties.ResultsChildren living in the most deprived area had higher levels of mental health difficulties at age 4 years, compared with their most affluent counterparts (7.3%vs4.1% with abnormal range scores). There was a more than threefold widening of this disparity over time, so that by the age of 7 years, children from the most deprived area quintile had rates of difficulties 3.5 times higher than their more affluent peers. Children’s demographic backgrounds strongly predicted their age 7 scores, although schools appeared to make a significant contribution to mental health trajectories.ConclusionsAdditional support to help children from disadvantaged backgrounds at preschool and in early primary school may help narrow inequalities. Children from disadvantaged backgrounds started school with a higher prevalence of mental health difficulties, compared with their more advantaged peers, and this disparity widened markedly over the first 3 years of school.


2021 ◽  
Vol 2 (2) ◽  
pp. 174
Author(s):  
Herizal Herizal

This community service activity aimed to strengthen students’ understanding of  the combinatorics concepts in facing the regency-level of National Science Competition (KSN) in field of mathematics in 2021. The activity was carried out in March-April 2021 for six meetings in the form of training/coaching. The training used both discovery and drilling methods. The location of the activity was at SMAN 1 Muara Batu, North Aceh Regency with four students as the subject who have been selected at the school level and selected to participate in the KSN at the regency level. Data analysis was carried out qualitatively by direct observation to observe the improvement of the students’ comprehension during the learning process. The result obtained was an improvement of the students’ understanding of combinatorics topic. It can be seen in solving problems, the students are able to determine what concepts will be used and able to solve several KSN questions on combinatorics topic.


2021 ◽  
Vol ahead-of-print (ahead-of-print) ◽  
Author(s):  
Lokender Prashad ◽  
Mili Dutta ◽  
Bishnu Mohan Dash

Purpose This study on spatial analysis of child labour in India is a macro level analysis on child labour using the census data, 2011 of Government of India. The population census which is conducted once in 10 years only provides district level data on work-force distribution. The study has spatial analysis of child labour in the age group of 5–14 years in India. To assess the magnitude of the children in the labour force, district level data of Census 2011 has been used in the study. The study has made an attempt to identify the districts where there is high level of children in the labour force. This paper aims to estimate the magnitude and trends of children’s workforce participation using the census data as it is the only data base, which is available at the district level since 1961 onwards. The study has made an attempt to identify the clustering of child labour across districts in India and how child labour is clustered by different background characteristics. Design/methodology/approach The study has used ArcGIS software package, GeoDa software and local indicator of spatial association test. Findings The findings of study reveal that the proportion of rural, total fertility rate (TFR) and poverty headcount ratio is positively associated, whereas female literacy and the pupil-teacher ratio are negatively associated with child labour. It suggests that in the hot-spot areas and areas where there is a high prevalence of child labour, there is need to increase the teacher's number at the school level to improve the teacher-pupil ratio and also suggested to promote the female education, promote family planning practices to reduce TFR in those areas for reducing the incidences of child labour. Research limitations/implications The study also recommends that the incidences of child labour can be controlled by a comprehensive holistic action plan with the active participation of social workers. Practical implications The promulgation of effective legislation, active involvement of judiciary and police, political will, effective poverty alleviation and income generation programmes, sensitisation of parents, corporates and media can play effective role in mitigating the incidences of child labour in India. To achieve the sustainable development goals (SDGs) adopted by world leaders in 2015 to eradicate child labour in all its forms by 2025. Social implications The study aims to achieve the SDGs adopted by world leaders in 2015 to eradicate child labour in all its forms by 2025. Originality/value The study is purely original and there are no such studies in Indian context by using the latest software.


2016 ◽  
Vol 4 (4) ◽  
pp. 98
Author(s):  
Khalil Yusuf Uthman ◽  
Yahya Bn Don ◽  
Abd Latif Kasim

Collaborative, non-traditional leadership practices have attracted little attention in research about sustainable school achievement in Nigerian unity schools.  The involvement of teachers in the administration of schools is well justified and arise from the need to boost school environment for the sake of attaining school achievement. The absence of teachers in the administration of unity schools impedes the proper attainment of school achievement. The purpose of this research is to reports on the outcomes of transformational leadership efforts in Nigerian unity schools aimed at enhancing the use of teachers in the administrative set-up.  This study was carried out in seven selected unity schools all located in the north-eastern part of Nigeria. The study used  Multifactor questionnaire 5x, School level environment questionnaire (SLEQ) and School Improvement questionnaire (SIQ) with 5 Likert-scale that involved the use of 800 questionnaires which were sent in which 790 were returned and 760 found valid for data analysis. Participants were drawn from a wide range of disciplines across the sampled schools. The establishment and operation of these school relied on a transformational leadership methodology by principals that facilitates acts of initiative, innovation, vision and courage through group interaction rather than through designated hierarchical roles. This research used the quantitative approach.  The study found out that transformational leadership approach is effective in overcoming problems associated with lack of involvement of teachers in the building of a fruitful environment capable of bringing a good school achievement through cultivating the habit of a transformational leader, the principals of unity schools enabled teachers and other stake holders to engage in peer-led professional learning, collaborative curriculum and pedagogical development, and to facilitate wider institutional change (school achievement). This paper demonstrates that the transformational leadership model for a high school achievement reported here is effective in building capacity for both teachers and students via involvement of teachers in building the environment. The model is flexible enough for a variety of institutional settings, and hence, recommends the use of teachers in secondary school’s administration.


Author(s):  
Angelo Paletta ◽  
Christopher Bezzina ◽  
Genc Alimehmeti

The changes that are affecting public education imply the need to incorporate into principal’s leadership practices two opposing forces: on the one hand, the accountability systems, which require responsibility for centrally managed achievement testing, compliance with standard procedures of self-evaluation, planning teaching improvement, and reporting of the results; and on the other hand, the expectations that come from within the school, namely those of teachers, students, families, and other stakeholders. This presents the challenge of coproducing authentic learning (problem solving, soft skills, civic knowledge, and citizenship) that is not easily measurable and therefore difficult to bring to light, rationalize, systematize, and report. Principals react differently to the demands of centralized policy-making initiatives. Some see them as opportunities for growth and only formally adopt them, whereas others entrench themselves into particular practices aimed at focusing on the immediate, on being conservative and minimizing risk taking and setting less ambitious goals that can take their schools forward. Managerial accountability can end up “colonizing” the organizations (and those who lead them), with the consequence that time and attention is devoted to what is being measured or observed by the central administrative systems. The “colonized” leaders develop or bend their managerial practices primarily in response to the expectations of accountability systems. On the opposite side, accountability systems can produce the effect of “decoupling”: the actual activities are separated from the rituals of accountability requested by the central or local government. In this case, school principals conform only formally to the demands of accountability systems. Other school leaders can capture opportunities from an accountability system, integrating it into a comprehensive management approach that balances opposing requests and organizational principles into a “systemic” model. Thus, the accountability practices in the field of education introduced in Italy can leave both a positive or negative impact on the way school principals lead their organizations. Studying the impact that the introduction of such policies can have on individuals as a result of the way leaders execute such directives are deemed important as they shed light on the link between policy and practice, and help us gain deeper insights into the so-called theory and practice divide. The move toward greater forms of accountability presents an ideal opportunity for policy makers and educational leaders working at different levels to appreciate the importance of systemic leadership and engage in a discourse that enlightens its value to school improvement initiatives. Rather than focusing on the self, on merely following directives and working independently, the school principal that is able to understand how things and people are connected and can come together to transform their schools can make a difference to school development and school improvement. Bringing policy makers and implementers together can help in understanding the realities faced by educators at the school level, the former often oblivious to the challenges educators face on a day-to-day basis.


Sign in / Sign up

Export Citation Format

Share Document