The Instructional Challenge in Improving Teaching Quality: Lessons from a Classroom Observation Protocol

2014 ◽  
Vol 116 (6) ◽  
pp. 1-32
Author(s):  
Drew Gitomer ◽  
Courtney Bell ◽  
Yi Qi ◽  
Daniel Mccaffrey ◽  
Bridget K. Hamre ◽  
...  
Keyword(s):  
Teacher Evaluation ◽  
Emotional Support ◽  
Teaching And Learning ◽  
Teaching Practice ◽  
Classroom Observation ◽  
Instructional Support ◽  
Teaching Quality ◽  
Self Report ◽  
Classroom Organization ◽  
Observation Protocol

Background/Context Teacher evaluation is a major policy initiative intended to improve the quality of classroom instruction. This study documents a fundamental challenge to using teacher evaluation to improve teaching and learning. Purpose Using an observation instrument (CLASS-S), we evaluate evidence on different aspects of instructional practice in algebra classrooms to consider how much scores vary, how well observers are able to judge practice, and how well teachers are able to evaluate their own practice. Participants The study includes 82 Algebra I teachers in middle and high schools. Five observers completed almost all observations. Research Design Each classroom was observed 4–5 times over the school year. Each observation was coded and scored live and by video. All videos were coded by two independent observers, as were 36% of the live observations. Observers assigned scores to each of 10 dimensions. Observer scores were also compared with master coders for a subset of videos. Participating teachers also completed a self-report instrument (CLASS-T) to assess their own skills on dimensions of CLASS-S. Data Collection and Analysis For each lesson, data were aggregated into three domain scores, Emotional Support, Classroom Organization, and Instructional Support, and then averaged across lessons to create scores for each classroom. Findings/Results Classroom Observation scores fell in the high range of the protocol. Scores for Emotional Support were in the midlevel range, and the lowest scores were for Instructional Support. Scores for each domain were clustered in narrow ranges. Observers were more consistent over time and agreed more when judging Classroom Organization than the other two domains. Teacher ratings of their own strengths and weaknesses were positively related to observation scores for Classroom Organization and unrelated to observation scores for Instructional Support. Conclusions/Recommendations This study identifies a critical challenge for teacher evaluation policy if it is to improve teaching and learning. Aspects of teaching and learning in the observation protocol that appear most in need of improvement are those that are the hardest for observers to agree on, and teachers and external observers view most differently. Reliability is a marker of common understanding about important constructs and observation protocols are intended to provide a common language and structure to inform teaching practice. This study suggests the need to focus our efforts on the instructional and interactional aspects of classrooms through shared conversations and clear images of what teaching quality looks like.

scholarly journals ADAPTATION OF A CLASSROOM OBSERVATION PROTOCOL FOR ACTIVE LEARNING

2021 ◽  
Author(s):  
Allison Van Beek ◽  
Susan McCahan
Keyword(s):  
Active Learning ◽  
Teaching And Learning ◽  
Large Scale ◽  
Teaching Practice ◽  
Classroom Observation ◽  
Learning Activities ◽  
Large Classes ◽  
Space Design ◽  
Observation Protocol ◽  
Future Work

In our work, we are focusing on the use of classroom observation to provide feedback on instructional space design. An initiative to redesign teaching space began a decade ago at a large, research-intensive institution. In September 2018, a large-scale (477 seat) active learning classroom became operational. The affordances of this space are intended to enable active teaching and learning in large classes. However, it is difficult to assess how successful this space is for active learning. A multi-year study has been undertaken to observe teaching practice in situ, with the goalof developing design principles for instructional space and technology that support the development, design, and implementation of teaching activities. Existing teaching observation protocols do not fully capture the interaction between the instructor and the space because such protocols were generally intended for other purposes. The goal is to develop a protocol that captures activities that are both intrinsic and extrinsic to teaching. This paper describes the development and use of an observation protocol. The core of the protocol is the wellknownTeaching Dimensions Observation Tool (TDOP). The scope of the TDOP is extended to active learning activities drawing from the Active Learning Classroom Observation Tool (ALCOT). The resulting extended protocol, TDOP+, was used for coding both live and recorded classroomobservations in the Winter 2020 term. This extended protocol allows the researchers to capture information that characterizes the intersection of pedagogy, space, and technology through Activity Theory. In future work, the data gathered through observations will be analyzed using theDifferentiated Overt Learning Activities (DOLA) framework, to provide insight into what types of teaching activity happens in a large-scale active learning classroom across STEM education and how active learning in large classrooms compares to pedagogy in other spaces.

scholarly journals Classroom Observation: Linking Teacher Evaluation and Professional Development in TESOL

2018 ◽  
Vol III (II) ◽  
pp. 168-195
Author(s):  
Sayyed Rashid Shah ◽  
Roohul Amin ◽  
Hussain Ahmad
Keyword(s):  
Professional Development ◽  
Teacher Evaluation ◽  
Professional Learning ◽  
Teaching And Learning ◽  
English Language ◽  
Classroom Observation ◽  
Small Scale ◽  
Complex Nature ◽  
Structured Interviews ◽  
The Impact

This study examines the impact of increasingly challenging nature of classroom observation as part of teacher evaluation in English Language Teaching (ELT). This paper highlights the complex nature of evaluative classroom observation systems in various educational contexts. It also considers various issues that embody the challenging nature of classroom observation and teacher evaluation in connection to the professional development of teachers. In a small-scale study of Teaching of English to the Speakers of Other Languages (TESOL) professionals in Saudi English as a Foreign Language (EFL) context, it adopts an interpretive approach and utilizes semi-structured interviews to collect data. The results, presented in four major themes provide a detailed account of teachers’ perceptions of the role of classroom observation in their professional learning and development. However, this development has not occurred due to the observation as a tool to elevate teaching and learning standards, alternatively, the managerial demands and the fear of being fired or transferred to remote campuses have stimulated teachers to develop professionally and offset this challenge. Despite their personal drive to professionalize themselves in a collaborative and professional culture, the challenge of observation still prevails owing to the teachers’ lack of autonomy and some insufficiently trained observers’ subjective approach.

A review of the use of portable technologies as observational aids in the classroom

2019 ◽  
Vol 120 (3/4) ◽  
pp. 228-241
Author(s):  
Felicia Goh ◽  
Annemaree Carroll ◽  
Robyn M. Gillies
Keyword(s):  
Teaching And Learning ◽  
Ethical Issues ◽  
Classroom Observation ◽  
Self Report ◽  
Portable Devices ◽  
Time Data ◽  
Content Type ◽  
Learning And Teaching ◽  
Portable Technology ◽  
Observation Strategies

Purpose Current classroom observation strategies include questionnaires, interviews, tests, self-report metrics and live or video review observation. However, these traditional methods are subject to biases from observers in determining behavior nuances, as well as being difficult to analyze for rapid and practical feedback. In addition, the invasiveness of extra body equipment in the classroom may alter the dynamic between students and teachers. The emergence of portable devices into mainstream usage has opened a pathway for a relatively novel source of quantitative data, free from observer bias and often with accompanying analytical tools for convenience. The purpose of this study is to summarize current uses of portable technology and explore how such devices could be used as monitoring tools by both schools and education researchers. Design/methodology/approach Functions based on utility outside the education field are proposed for monitoring student activity, posture and movement, as well as proximity and relationships to others and their environment. Deterrents to device implementation in regular classroom use, such as the importance of considering ethical issues and hardware limitations, are also covered. Findings While current portable technology is unlikely to replace more commonly used techniques of observing classes, they have the capacity to augment qualitative strategies, particularly in the area of real-time data output. Research limitations/implications Ideally, the lack of unbiased observational tools available and increased adoption of portable devices in classrooms could prompt future advances in technology for teaching and learning environments. Originality/value This review summarizes potential uses for portable technology in classroom observation strategies undertaken by researchers and teachers to improve learning and teaching practices.

scholarly journals Teaching towards Design-Based Learning in Manufacturing Technology Course: Sino–Australia Joint Undergraduate Program

2020 ◽  
Vol 12 (9) ◽  
pp. 3522
Author(s):  
Zhigang Jiang ◽  
Siva Chandrasekaran ◽  
Gang Zhao ◽  
Jing Liu ◽  
Yanan Wang
Keyword(s):  
Teaching And Learning ◽  
Teaching Practice ◽  
Recent Decade ◽  
Teaching Quality ◽  
Manufacturing Technology ◽  
Central China ◽  
Engineering Project ◽  
Undergraduate Program ◽  
Regional Universities ◽  
Technology Course

The internationalized higher education in Engineering has made the sustainable future of Chinese regional universities prosper in the recent decade. The teaching practices of engineering courses pose many challenges in Sino–foreign joint undergraduate programs. The design-based learning (DBL) approach addresses students learning challenges in the joint undergraduate program facilitated by the Wuhan University of Science and Technology (WUST) in central China along with Deakin University (DU), Australia. Following the seven general principles of DBL, a project of process planning was performed for teaching and learning in the Manufacturing Technology course. An implicit meta-cognitive competence was developed through performing the engineering project tutoring, diverse learning tasks and normative assessment criteria. The DBL pedagogy succeeds in bridging the diverse knowledge systems in the specialized courses of Manufacturing Technology between Chinese and Australian programs in Mechanical Engineering. Many achievements and awards won by the students demonstrate a satisfactory result in the case study on the teaching practice towards DBL. The pedagogy towards DBL truly improves the teaching quality of the courses in joint programs and further strengthens the internationalized engineering education for the sustainable development of regional universities in China.

scholarly journals Performativity and the Power of Shame: Lesson Observations, Emotional Labour and Professional Habitus

2016 ◽  
Vol 21 (1) ◽  
pp. 136-150 ◽  
Author(s):  
Ursula Edgington
Keyword(s):  
Teaching And Learning ◽  
Best Practice ◽  
Teaching Practice ◽  
Teaching Quality ◽  
Practice Research ◽  
Tertiary Sector ◽  
Theoretical Concepts ◽  
Emotional Labour ◽  
Emotional Factors ◽  
Educational Environments

Teaching and learning observations (henceforth ‘observations’) are used in educational environments worldwide to assess teaching quality and support professional development through reflexivity. Pressures from neo-liberalist, New Right politics encourage observations that are evaluative in nature, thereby over-emphasising quantitative strategies. Research suggests some observations are ineffectual because of emotional tensions between what is perceived as ‘authentic’ teaching and the inherent performativity required by managerialist policies ( Ball 2003 ). But as Scheff (2003) argues, conformity to social processes is not necessarily based on an individual's awareness of explicit rewards or sanctions resulting from judgements. Instead it can be based on invisible self-perceptions of the risk of shame. In turn, this discourages playfulness as these actions may be considered deviations from ‘best practice’. Hence observations can limit teacher effectiveness because they involve interpretations and judgements by an Other ( Price 2001 ). This article draws on narrative data from tertiary-sector staff in a UK research study using a multi-disciplinary interpretive framework ( Denzin 1989 ). Given the importance attributed to reflexivity in teaching practice, research in this area is sparse. Emotional factors within these contexts are often disregarded, perhaps because articulating feelings is considered weak or dangerous ( Lupton 1998 ). However, Bourdieu's theoretical concepts of professional habitus, field and capital bring deeper meaning to interpretations of teachers’ embodied emotional labour ( Colley 2006 a; Nias 1996 ; Reay 2004 ). The subtle nuance within the participants’ narratives illuminates the observer/observee dynamic within the classroom, providing examples of the complex, fluid nature of perceptions of performativity in observations; the inherent rewards and risks.

scholarly journals Variability in Preschool CLASS Scores and Children’s School Readiness

AERA Open ◽  
2021 ◽  
Vol 7 ◽  
pp. 233285842110389
Author(s):  
Jennifer K. Finders ◽  
Adassa Budrevich ◽  
Robert J. Duncan ◽  
David J. Purpura ◽  
James Elicker ◽  
...  
Keyword(s):  
School Readiness ◽  
Emotional Support ◽  
Instructional Support ◽  
Classroom Quality ◽  
Observational Period ◽  
High Stakes ◽  
Classroom Organization ◽  
Low Incomes ◽  
Classroom Assessment Scoring System ◽  
Preschool Class

The Classroom Assessment Scoring System (CLASS) is a widely administered measure of classroom quality that assesses teacher-child interactions in the domains of Emotional Support, Classroom Organization, and Instructional Support. We use data from an evaluation of state-funded prekindergarten provided to 684 children from families with low incomes (Mage = 57.56 months, 48% female) to examine the extent to which CLASS scores vary over the course of an observational period within a single day and investigate whether this variability is related to children’s school readiness at the end of the preschool year, holding constant two additional measures of quality. Teacher-child interactions in all three domains were moderately stable. Mean Classroom Organization was positively related to math, and variability in Classroom Organization was negatively related to literacy. Mean Instructional Support was negatively associated with language. Findings have implications for programs that utilize the CLASS to make high-stakes decision and inform professional development.

scholarly journals Novice Teachers’ Concerns, Early Professional Experiences and Development: Implications for Theory and Practice

2018 ◽  
Vol 9 (1) ◽  
pp. 100-114 ◽  
Author(s):  
Olena Zhukova
Keyword(s):  
Professional Development ◽  
Novice Teachers ◽  
Teaching And Learning ◽  
Teaching Practice ◽  
Teaching Quality ◽  
Theory And Practice ◽  
Future Research ◽  
Full Time ◽  
Quality Of Teaching

Abstract Quality teaching, being a key factor in shaping students’ academic and personal growth, has been at the centre of scientific debate for many years. Sustainable professional development of novice teachers has recently been recognized worldwide as one of the key areas for improving the quality of teaching and learning in schools. Given that the initial years on the job are generally characterised by novice teachers as the most challenging and intense in their career, the following questions typically arise: What can be done to sustain and facilitate teaching at the early developmental stages in teachers’ career? What are the contextual factors and the prerequisites leading to the quality of teaching and learning? The article presents the findings from a two-year longitudinal qualitative study aimed to contribute to the research base for understanding this crucial stage. More specifically, the purpose of this study was to provide deeper understanding and insights into key factors influencing and shaping novice teachers’ early professional development and learning, as well as their capacities to effectively adapt to their new roles and operate in complex and dynamically changing open-ended school environment. The research is framed as a cross-case analysis of 4 cases of novice teachers working in public secondary schools. The data were collected through multiple sources (i.e. semi-structured in-depth interviews, questionnaire, and focus groups) over a two-year period spanning the participants’ first and second full-time teaching years. Substantial differences in experiences and beliefs among the novice teachers, with varying levels of job satisfaction and professional support received, were identified in the study. The authors have also identified numerous patterns of novice teachers’ teaching practice closely associated with teachers’concerns and early professional experience interpretations, which might result in substantial fluctuation in teaching quality and teacher’s career paths. Implications for teacher education programs, mentoring, supervision, teachers’ professional development, and future research are discussed.

How Should Fifth-Grade Mathematics Teachers Start the School Year? Relations between Teacher–Student Interactions and Mathematics Instruction over One Year

2018 ◽  
Vol 120 (6) ◽  
pp. 1-36
Author(s):  
Holland W. Banse ◽  
Natalia A. Palacios ◽  
Timothy W. Curby ◽  
Sara E. Rimm-Kaufman
Keyword(s):  
Emotional Support ◽  
Structural Equation ◽  
Instructional Support ◽  
Equation Model ◽  
Mathematical Discourse ◽  
Fifth Grade ◽  
Observation Data ◽  
Classroom Organization ◽  
School Year ◽  
Teacher Student

Background Teaching is comprised of interconnected practices. Some practices are domain neutral (DN), or independent of a content area. Examples of DN practices include emotional and instructional support and classroom organization. Others are domain specific (DS), or content dependent. Within a mathematics context, examples of DS practices include mathematical discourse, tasks, and coherent lessons. Purpose Using extant fifth-grade teacher observation data, we investigate the following questions: (1) Do quality DN practices at the start of a fifth-grade school year relate to higher DS practices at the end of the year? (2) Do early, quality DS practices relate to later, higher use of DN practices? Specifically, we investigate relations between emotional support and mathematical discourse, instructional support and mathematical tasks, and classroom organization and mathematical coherence. Research Design We use an autoregressive, cross-lagged structural equation model with three time points from a single academic year. Findings/Results Results indicated that early levels of high emotional support and classroom organization were associated with later high levels of mathematical discourse and coherence, respectively. Early implementation of demanding tasks was associated with later, higher instructional support. Recommendations We discuss implications for professional development and practice. Specifically, we suggest that teachers and instructional coaches consider how DN and DS practices relate to each other in order to boost teachers’ effectiveness.

scholarly journals COPUS, PORTAAL, or DART? Classroom Observation Tool Comparison From the Instructor User’s Perspective

2021 ◽  
Vol 6 ◽  
Author(s):  
Mitra Asgari ◽  
Asha M. Miles ◽  
Maria Sol Lisboa ◽  
Mark A. Sarvary
Keyword(s):  
Active Learning ◽  
Teaching Practices ◽  
Teaching And Learning ◽  
Assessment Tool ◽  
Classroom Observation ◽  
Assessment Tools ◽  
Constructive Feedback ◽  
Time Investment ◽  
Observation Protocol ◽  
Available Resources

Classroom observation tools are used to evaluate teaching and learning activities, and to provide constructive feedback to instructors. To help instructors with selecting a suitable tool based on their needs and available resources, in this study, a group of observers assessed lectures of an introductory biology course using three, broadly cited classroom assessment tools in the STEM field: the Classroom Observation Protocol for Undergraduate STEM (COPUS); the Practical Observation Rubric to Assess Active Learning (PORTAAL); and the Decibel Analysis for Research in Teaching (DART). From a user’s perspective, we evaluated 1) the type and extent of information each tool provides, and 2) the time investment and difficulty of working with each tool. The assessment result of each tool was compared, with a list of expected outcomes generated by surveying a group of college instructors and with the result of a self-teaching assessment tool, Teaching Practices Inventory (TPI). Our findings conclude that each tool provided valuable assessment with a broad range of outcomes and time investment: PORTAAL offered the most detailed information on the quality of teaching practices and students’ engagement, but it demanded the greatest time investment. DART provided a basic estimation of active learning proportion with the least effort. The level of assessment outcome and the time investment when using COPUS was found to be less than PORTAAL, and more than DART. The TPI self-assessment outcome was found to be slightly optimistic regarding the proportion of active learning practices used in the studied course. This comparative study can help instructors in selecting a tool that suits their needs and available resources for a better assessment of their classroom teaching and learning.

scholarly journals Practical Dimension and Optimization Strategy of Improving the Teaching Quality of Political Theory Courses in Colleges and Universities

2021 ◽  
Vol 3 (3) ◽  
pp. 21
Author(s):  
Xiaojian Xu
Keyword(s):  
Political Theory ◽  
Goal Orientation ◽  
Teaching And Learning ◽  
Teaching Practice ◽  
Teaching Quality ◽  
Colleges And Universities ◽  
The Political ◽  
Optimization Strategy ◽  
Teaching Resources

It is the fundamental task of the political theory courses in colleges and universities to cultivate the builders and successors of the socialist cause. Because the teaching of political theory courses plays an important role in casting souls and educating people. Therefore, teachers should focus on enhancing the dissemination, theory and pertinence of ideological and political teaching in the process of carrying out political theory courses teaching practice, and make great efforts in the theory, content and methods of political theory courses teaching in order to continuously improve the teaching quality of political theory courses. Make the political theory courses truly recognized by the majority of young students. From the perspective of "teaching" and "learning", the improvement of political theory teaching quality in colleges and universities can be considered from three practical dimensions: curriculum cognition, goal orientation and teaching resources.

Sign in / Sign up

Export Citation Format

Share Document