Enhancing formative feedback in orthopaedic training: Development and implementation of a competency-based assessment framework

2019 ◽  
Author(s):  
Natalie Wagner ◽  
Anita Acai ◽  
Sydney A. McQueen ◽  
Com McCarthy ◽  
Andrew McGuire ◽  
...  

Objective: The purpose of this study was to develop, implement, and evaluate the effectiveness of an assessment framework aimed at improving formative feedback practices in a Canadian orthopaedic postgraduate training program. Methods: Tool development began in 2014 and took place in 4 phases, each building upon the previous and informing the next. The reliability, validity, and educational impact of the tools were assessed on an ongoing basis, and changes were made accordingly. Results: One hundred eighty-two tools were completed and analyzed during the study period. Quantitative results suggested moderate to excellent agreement between raters (intraclass correlation coefficient = 0.54-0.93), and an ability of the tools to discriminate between learners at different stages of training (p’s < 0.05). Qualitative data suggested that the tools improved both the quality and quantity of formative feedback given by assessors and had begun to foster a culture change around assessment in the program. Conclusions: The tool development, implementation, and evaluation processes detailed in this article can serve as a model for other training programs to consider as they move towards adopting competency-based approaches and refining current assessment practices.

2019 ◽  
Vol 76 (5) ◽  
pp. 1376-1401 ◽  
Author(s):  
Natalie Wagner ◽  
Anita Acai ◽  
Sydney A. McQueen ◽  
Colm McCarthy ◽  
Andrew McGuire ◽  
...  

Author(s):  
Bahar Memarian ◽  
Susan McCahan

Through a thematic analysis of open-ended survey responses, we explore the challenges assessors face during assessment (summative evaluation and formative feedback) of students’ work. The assessors were primed by asking them to mark solutions to closed-ended engineering problems typical in introductory Electrical and Civil engineering courses. The subsequent survey asked the assessors to reflect on their experience. The analysis of the thematic frequency count is presented and discussed in this paper. The data suggests that from the perspective of assessors, current assessment practices need improvement. In particular, it appears that summative evaluation is seen as the primary goal and feedback is given as time allows. However, the participants also identified insufficient time as a challenge, which may further diminish feedback


2018 ◽  
Vol 17 (2) ◽  
pp. 400-429
Author(s):  
Esther Martínez-Miguel ◽  
María del Carmen Solano Ruiz ◽  
Eva García-Carpintero Blas ◽  
César Manso Perea

Introducción: El enfoque de educación basada en competencias pretende reducir la brecha entre educación y empleo buscando lograr un aprendizaje profundo, significativo, para toda la vida, transferible a situaciones reales, complejas y cambiantes. Conceptualizar la evaluación a partir de este enfoque implica asumir su carácter multidimensional diseñando una evaluación para el aprendizaje y no sólo del aprendizaje, en la búsqueda de formas de evaluación capaces de mejorar la calidad del mismo. La conciencia del impacto de la evaluación en el aprendizaje obliga a plantear la evaluación como un proceso compartido que sea simultáneamente causa y efecto de los aprendizajes. En este contexto, el objetivo de este estudio es conocer la percepción de discentes y docentes en relación a las prácticas actuales de evaluación de competencias y su impacto en la calidad del aprendizaje. Metodología: Estudio descriptivo interpretativo. Análisis cualitativo de los datos recogidos mediante cuestionarios abiertos y grupos de discusión de discentes y docentes del Grado en Enfermería. Resultados: Ambos grupos consideran que las prácticas actuales de evaluación de competencias condicionan el aprendizaje, sin embargo, existen grandes diferencias en sus percepciones. Los docentes perciben este impacto como negativo y afirman que para los estudiantes la evaluación consiste sólo en superar asignaturas. Los estudiantes manifiestan que la evaluación les influye positivamente al orientar su aprendizaje y ofrecerles oportunidades de mejora. Conclusiones: Los docentes perciben dificultades para superar la orientación tradicional de la evaluación, mientras los estudiantes perciben su función más formativa y demandan para ella un feedback suficiente y de calidad. Introduction: Competency based education offers the promise of reducing the gap between education and employment and concerns in Higher Education have revolved around how to achieve deep and meaningful learning, a long life learning, so that learning transfer to real situations, complex and changing, would be possible. Conceptualizing assessment from competency based education approach requires assuming its multidimensional character and designing an assessment for learning and not only assessment of learning seeking to improve learning quality. Awareness of the assessment impact on learning requires raising evaluation as a shared process able to be simultaneously cause and effect of learning. In this context, the aim of this study is to determine learners and teachers perceptions about current practices of competence assessment and its impact on the quality of learning. Methodology: Interpretative descriptive study. Qualitative analysis of data collected through open questionnaires and discussion groups with Degree in Nursing learners and teachers. Results: Both teachers and learners believe that current assessment practices determine learning skills, but there are big differences in their perceptions. Teachers perceive negatively this impact and claim that for student’s evaluation is only overcoming subjects while students state that assessment influences them positively, guiding their learning and offering improvement opportunities. Conclusions: teachers perceive difficulties in overcoming evaluation`s traditional, while students perceive its most formative function and demand for it sufficient and quality feedback.


2016 ◽  
Vol 7 (2) ◽  
pp. 43-49
Author(s):  
John Hamilton

The requirement for commencing higher education students to apply principles of attribution in their early academic writing frequently creates frustration both for students and academic teaching staff. Teachers often provide information on the necessity of attribution, and considerable detail on the mechanics of how to reference, and express frustration at the failure of some students to demonstrate this in their writing. In turn, many students appear overwhelmed and confused by the expectations placed on them as early academic writers. This paper explores these expectations and questions current assessment practices, advocating a longer period of formative learning before students are required to competently and accurately apply attribution principles and referencing conventions in their writing. Using the threshold concept framework (Meyer & Land, 2005), it suggests viewing attribution as a ‘conceptual gateway’ through which students must pass in becoming academic writers, and explores some implications of this for teaching, learning and assessment.


Author(s):  
Karen E. Irving

Reliable just-in-time assessments are the foundation of informed teaching and learning. Modern electronic technologies assist in the formative assessment process by supporting classroom environments that allow students and teachers to assess learning and providing mechanisms to present information about student learning during instructional sequences. To implement formative assessment practices, students and teachers benefit from rich educational tasks that invite students to share information about their understanding of the lesson while the lesson is occurring in order to nurture productive learning by both teacher and student. Formative feedback is facilitated by technologies such as connected classrooms, videography, online formative quizzes, and manuscript multi-draft editing. Technology-assisted formative assessment represents a powerful option to promote improved classroom communications that support formative assessment practices for teachers in twenty-first century classrooms.


Author(s):  
Abatihun Alehegn Sewagegn ◽  
Boitumelo Molebogeng Diale

Authentic assessment plays a great role in enhancing students' learning and makes them competent in their study area. Studies indicate that assessment is authentic when the tasks have real-life value and students perform real-world tasks. Therefore, this chapter shows how lecturers practice authentic assessment to enhance students' learning in a higher education institution. To achieve this, the authors used a phenomenological qualitative research design. An interview was used to collect data. The result indicated that lecturers are highly dependent upon traditional assessment methods, which have no significant contribution to the competency of students. The practice of authentic assessment methods as a tool to enhance students' learning is limited. Therefore, the authors can conclude that enhancing students' learning using authentic assessment in their study areas is untenable if the lecturers continue to utilize their current assessment practices.


2014 ◽  
Vol 38 (1) ◽  
pp. 82-95
Author(s):  
Dallin George Young ◽  
Laura A. Dean ◽  
Douglas Franklin ◽  
William Kyle Tschepikow

Collegiate recreation professionals were surveyed to determine whether, how regularly, and by what means they were conducting assessment. This descriptive study explored current assessment practices; surveyed resources used in assessment, including specific attention to CAS materials; and reported outcomes of assessment activities. Results indicated that more than 90% of respondents were engaged in assessment, regardless of institution type. Professional literature, professional development activities, and assessment teams were the most frequently used resources; approximately 40% reported using CAS materials. Most frequently reported outcomes of assessment were generally related to student staffing. Respondents also indicated that mission statements and professional staffing changed less frequently as a result of assessment efforts. Implications for the practice of assessment in collegiate recreation programs are discussed.


1988 ◽  
Vol 8 (1) ◽  
pp. 38-51 ◽  
Author(s):  
Erika G. Gisel ◽  
Nancy A. Pollock

Occupational therapists in pediatric practice are often required to evaluate and treat children with eating problems. The lack of a standardized eating assessment has hindered therapists' ability to define normal oral-motor development, identify unequivocally those children who will benefit from intervention, refine treatment procedures using information gained through accurate assessment, and monitor progress in clinical and research settings. The purposes of this review are to (a) outline the scope of eating problems in children with oral-motor impairments, (b) establish the need for a quantitative eating assessment, (c) review the assessments currently available, and (d) suggest directions for future development.


2020 ◽  
Vol 14 ◽  
pp. 112-136
Author(s):  
Elizabeth Bond ◽  
◽  
Geoff Woolcott ◽  
Christos Markopoulos ◽  
◽  
...  

Formative assessment is a crucial aspect of teaching and learning in the classroom, but there is evidence that there has been a lack of effective implementation of formative assessment in practice. In response, this article outlines the design and development of a formative assessment framework that can be implemented as a consistent whole-school approach to embedding practice that is owned and developed by teachers. The approach outlined in the framework, therefore, is designed to integrate formative assessment practices within a school system context, providing advice and support to school leaders and teachers. The framework in practice should act to enable teachers and students to develop new understandings and perspectives about each other and the nature of teaching and learning, as well as ways to implement new practices of teaching and learning supported by reflective modes of active participation.


Sign in / Sign up

Export Citation Format

Share Document