Using Observational Assessment to Inform Professional Development Decisions: Alternative Scoring for the Danielson Framework for Teaching

2017 ◽  
Vol 44 (2) ◽  
pp. 69-80 ◽  
Author(s):  
Ryan J. Kettler ◽  
Linda A. Reddy

The Framework for Teaching (FFT) is one of the most widely used observational systems for evaluating teacher effectiveness and driving professional development conversations in schools. This study contrasts reliability and validity evidence relevant to the FFT as traditionally scored with evidence relevant to a composite scoring approach that connects to specific practice feedback. The FFT is typically interpreted at the domain level and at an overall total level using four categories of teacher effectiveness—unsatisfactory, basic, proficient, and distinguished—scored without computational rules governing relationships between the 22 components and four domains. For this study, the composite scoring approach was computed by averaging the components nested within each domain. A sample of 156 teachers and 34 trained school administrators from 12 high-poverty charter schools used the FFT as part of regular evaluation practices, yielding an extant set of de-identified data. Results indicate the composite scores were internally consistent at the domain and total levels. In comparison with traditional scores, the composite scores were more stable across time, as well as more predictive of student growth in reading and mathematics achievement. Implications for professional development and educator evaluation are discussed.

2016 ◽  
Vol 2 (2) ◽  
pp. 106-125
Author(s):  
Sarah B. Bush ◽  
Kristin L. Cook ◽  
Robert N. Ronau ◽  
Christopher R Rakes ◽  
Margaret J. Mohr-Schroeder ◽  
...  

This paper reports on a highly-structured Mathematics-Science Partnership (MSP) professional development (PD) program focused on the integration of science, technology, engineering, arts, and mathematics (STEAM) in elementary mathematics and science. With a support system including higher education STEAM education and content faculty, community informal learning partners, an external evaluation team, school administrators, and expert STEAM teachers, twenty-five teachers and five STEAM instructional coaches met together for whole-group PD as they developed and then implemented integrated STEAM problem-based inquiries in their classrooms. This paper describes how the PrimeD framework (Rakes, Bush, Ronau, Mohr-Schroeder, & Saderholm, 2017; Saderholm, Ronau, Rakes, Bush, & Mohr-Schroeder, 2017) guided the STEAM PD program through a collaborative and reflective process. 


1999 ◽  
Vol 10 (4) ◽  
pp. 247-268 ◽  
Author(s):  
Josephine D. Wallace ◽  
Catherine R. Nesbit ◽  
Anne-Courtney S. Miller

2014 ◽  
Vol 20 (6) ◽  
pp. 588-598 ◽  
Author(s):  
Robert K. Heaton ◽  
Natacha Akshoomoff ◽  
David Tulsky ◽  
Dan Mungas ◽  
Sandra Weintraub ◽  
...  

AbstractThis study describes psychometric properties of the NIH Toolbox Cognition Battery (NIHTB-CB) Composite Scores in an adult sample. The NIHTB-CB was designed for use in epidemiologic studies and clinical trials for ages 3 to 85. A total of 268 self-described healthy adults were recruited at four university-based sites, using stratified sampling guidelines to target demographic variability for age (20–85 years), gender, education, and ethnicity. The NIHTB-CB contains seven computer-based instruments assessing five cognitive sub-domains: Language, Executive Function, Episodic Memory, Processing Speed, and Working Memory. Participants completed the NIHTB-CB, corresponding gold standard validation measures selected to tap the same cognitive abilities, and sociodemographic questionnaires. Three Composite Scores were derived for both the NIHTB-CB and gold standard batteries: “Crystallized Cognition Composite,” “Fluid Cognition Composite,” and “Total Cognition Composite” scores. NIHTB Composite Scores showed acceptable internal consistency (Cronbach’s alphas=0.84 Crystallized, 0.83 Fluid, 0.77 Total), excellent test–retest reliability (r: 0.86–0.92), strong convergent (r: 0.78–0.90) and discriminant (r: 0.19–0.39) validities versus gold standard composites, and expected age effects (r=0.18 crystallized, r=−0.68 fluid, r=−0.26 total). Significant relationships with self-reported prior school difficulties and current health status, employment, and presence of a disability provided evidence of external validity. The NIH Toolbox Cognition Battery Composite Scores have excellent reliability and validity, suggesting they can be used effectively in epidemiologic and clinical studies. (JINS, 2014, 20, 1–11)


2016 ◽  
Vol 118 (1) ◽  
pp. 1-46 ◽  
Author(s):  
Rebecca Powell ◽  
Susan Chambers Cantrell ◽  
Victor Malo-Juvera ◽  
Pamela Correll

Background Many scholars have espoused the use of culturally responsive instruction (CRT) for closing achievement gaps, yet there is a paucity of research supporting its effectiveness. In this article, we share results of a mixed methods study that examined the use of the Culturally Responsive Instruction Observation Protocol (CRIOP) as a framework for teacher professional development. The CRIOP is a comprehensive model and evaluation tool that operationalizes culturally responsive instruction around seven elements: Classroom Relationships, Family Collaboration; Assessment; Curriculum/Planned Experiences; Instruction/Pedagogy; Discourse/Instructional Conversation; and Sociopolitical Consciousness/Diverse Perspectives. Focus of Study This study was designed to answer the following questions: (1) Do teachers increase their use of culturally responsive practices as they participate in CRIOP professional development? (2) What is the relationship between implementation of culturally responsive instruction and student achievement in reading and mathematics ?, and (3) What are teachers’ perceptions of their successes and challenges in implementing culturally responsive instruction? Participants Twenty-seven elementary teachers participated in this study. Of the 27 participants, all were female, 26 were White, and all were native speakers of English. Student achievement data were collected from students enrolled in classrooms of participating teachers at the two schools in the study that administered the Measures of Academic Progress (MAP) test. Of the 456 students who were participants, 397 (87.3%) received free or reduced lunch, and 128 (28 % of total sample) were classified as English Language Learners (ELLs). Intervention Three training sessions were held before school began and during the fall semester. Additionally, throughout the school year teachers received individual classroom coaching, on-site professional development, and instructional planning support. Participating teachers received an average of 50.4 hours of classroom-based coaching and mentoring during the intervention, which included observations, meetings with individual teachers and teacher teams, curriculum planning sessions, and collaborative creation of individualized action plans. The CRIOP was used as a professional development framework. The intended outcome of on-site support was to increase the incorporation of culturally responsive instruction in teachers’ daily practices, resulting in more culturally responsive classroom relationships, assessment and instructional practices, and use of discourse. Research Design This study utilized a concurrent triangulation mixed methods design. Data sources included classroom observations, student achievement results, and postobservation teacher interviews. The CRIOP instrument was used for classroom observations to determine the extent of implementation of culturally responsive practices. Following each classroom observation, field researchers conducted an audio-recorded semistructured interview using the CRIOP Post-Observation Teacher Interview Protocol and The CRIOP Family Collaboration Teacher Interview Protocol. These protocols were designed to elicit additional information that might not have been readily apparent from data gleaned during the observation. In addition, participants were interviewed to determine their perceptions of culturally responsive instruction. Three interview questions and responses were transcribed and coded for analysis: How do you define culturally responsive instruction ? What are your biggest successes with using Culturally Responsive Instruction with your students ? What are your biggest challenges with using Culturally Responsive Instruction with your students ? Integration of quantitative and qualitative data occurred during data collection and interpretation. Findings Results of classroom observations showed that teachers had significantly higher levels of CRI implementation in the spring compared to fall. Data on student achievement indicated that students of high implementers of the CRIOP had significantly higher achievement scores in reading and mathematics than students of low implementers. The results of this study also suggest that teachers face several challenges in implementing CRI, including constraints imposed by administrators, high-stakes accountability, language barriers in communicating with families, and the sheer complexity of culturally responsive instruction. Conclusions/Recommendations Although numerous scholars have espoused the value of culturally responsive instruction (CRI), there is limited research on its effectiveness. The results of this investigation suggest that the CRIOP shows promise both as a framework for teacher professional development and as an observation instrument in investigations of culturally responsive instruction. Findings also indicate that one of the biggest challenges in implementing CRI is its multidimensionality in that it includes several components (e.g., student relationships, family collaboration, assessment practices, instructional practices, discourse practices, and sociopolitical consciousness), which together comprise the CRIOP model. Future research including an experimental design is needed to determine the effectiveness of the CRIOP as a measure of culturally responsive instruction and as a framework for intervention.


2012 ◽  
Vol 59 (1) ◽  
Author(s):  
Anna-Maria Wium ◽  
Brenda Louw

Learners in South African schools have been found to perform poorly in mathematics because they do not understand the language used in solving mathematical problems. In order to improve academic performance teachers need to be made aware of the importance of language in the development of numeracy. A continued professional development (CPD) programme addressed this need. The purpose of the research was to understand how the participants implemented the strategies developed during the programme and how they perceived the support provided by the programme. The research was conducted over 2 years in semi-rural and urban contexts. As part of a more comprehensive mixed method study, the qualitative data referred to in this article were obtained through open-ended questions in questionnaires, focus groups, reflections in portfolios, and a research diary. Results showed that numeracy terminology was often used by learners that differed from standard terminology prescribed by the curriculum. The participants themselves did not necessarily understand the numeracy terminology and thus found it a challenge to implement curriculum outcomes. Issues related to language use of the participants in teaching numeracy were associated with the lack of resources available in the language of learning and teaching  (LoLT). Some of the participants taught numeracy in English, rather than LoLT. The results indicated low teacher expectations of the learners. The CPD programme was considered valuable and effective. SLPs in schools need to be expand their role to provide CPD opportunities for teachers.


1976 ◽  
Vol 39 (2) ◽  
pp. 467-480 ◽  
Author(s):  
Stewart B. Shapiro

This paper's purpose was to describe an interview which purports to survey some important areas in life meanings. The “Life-meanings Survey” is a semi-structured, depth interview which has been used to assess the outcomes of various humanistically oriented, confluent educational projects. It attempts to reach a deeper, more personal level of response than the usual paper-and-pencil personality, attitude, or achievement measures by probing into relatively enduring effects which make a difference in the lives of the participants. It investigates some of the major philosophical-psychological domains of what is substantially worth believing in, doing and living for, and what is a coherent, useful philosophy of life. Divided into five areas of meaning, the interview technique includes intentionality, significance, symbols, sense and the meaningful impact of a given project. Research results are reported from three studies: the effects of confluent education on high school students, the outcomes of a humanistically oriented medical program, and the results of a 1-yr. program in confluent education for school administrators. These studies indicate that quantitative assessments can be made using this instrument Rough reliability and validity measures of the interview have also indicated its usefulness and stability.


2020 ◽  
Vol 8 (4) ◽  
pp. 58
Author(s):  
Gurcan Uzal ◽  
Aytekin Erdem

The aim of the study is to investigate the school administrators' views on the professional development needs of teachers regarding the use of technology in physics classes. The participants of the study were 121 executive teachers from the city of Kocaeli. The data for the research was obtained using the survey model and was compiled with the help of a five point Likert type scale. The data collected by a scale with the reliability coefficient of 0.92 were analyzed using descriptive and inferential statistical techniques. As a result of the analysis, it was found that the administrators completely agreed with the use of the LCD panels in the teaching of physics subjects, while only agreeing with the other items. In addition, the opinions of school administrators regarding the professional development needs of teachers for the use of technology in physics classes does not differ according to demographic characteristics, but significantly do however, according to gender and experience. In light of the results, recommendations were made for researchers, administrators and the Ministry of National Education.


Sign in / Sign up

Export Citation Format

Share Document