Evaluation for Transformational Change: Learning from Practice

The COVID-19 crisis has challenged the evaluation profession by altering the framework within which it operates. Evaluators must embrace new realities and respond to changes while not altering their principles, norms, and standards.A review of how evaluation networks and offices have responded to changing demands showed lack of recognition for the long-term implications to the profession. Commissioners and users of evaluation now have new priorities, and nontraditional actors have entered the traditional evaluation space, offering similar expertise and meeting the demands of evaluation commissioners and users. The extensive development challenges posed by COVID-19 require a comprehensive response capacity from evaluation if it is to be transformative as a profession.This chapter draws on national and international case studies, examining the concept of transformation from a contextual perspective and noting the relativism in the concept. It draws links between aspects, suggesting that this period is an opportunity for evaluators to learn from practice around transformation, and suggests that flexibility provides an opportunity to remain relevant and advance transformational goals.

Escape Room vs. Traditional Assessment in Physiotherapy Students’ Anxiety, Stress and Gaming Experience: A Comparative Study

Escape Rooms can serve multiple academic and educational purposes and can be used as part of the evaluation of a learning program. The aim of this study was to analyze the levels of anxiety and stress perceived in the evaluation using the Escape Room compared to the traditional evaluation, as well as to analyze the gaming experience. Methods: A comparative study was carried out in students of the Degree in Physiotherapy, with a total of 56 participants who underwent 2 evaluation processes. The variables analyzed were the State—Trait Anxiety Inventory, the Perceived Stress Questionnaire, and the Gaming Experience Scale. A comparative analysis was performed between the groups using the Mann Whitney U test and Student’s T test. Results: The levels of state-anxiety and trait-anxiety were higher in the traditional assessment group. Although no differences were found in the qualification obtained by the students, statistically significant differences were found between the two evaluation systems in terms of the overload factor, the energy factor, and the fear-anxiety factor of the perceived stress questionnaire. Conclusions: The Escape Room can be considered as an alternative to the traditional evaluation in Physiotherapy Degree students due to its lower levels of anxiety and perceived stress.

A Study to Assess Perception of Nursing Students about the Effectiveness of Objective Structured Clinical Examination (OSCE) during Perineal Care Procedure in the selected College of Metropolitan City

Aim: 1. To conduct OSCE 2. To assess the perception of nursing students about OSCE 3. To compare the perception of nursing students between traditional evaluation (TE) and Objective Structured Clinical Examination (OSCE). Material and methods: The research approach and design were Qualitative Descriptive. The subjects were 30 students of 4th year Basic BSc Nursing. OSCE conducted under 4 stations namely Hygiene, Execution, Interaction, and Feedback. Data was collected using Demographic data profile; Clinical checklist for hand washing, perineal care SOP; related viva and opinionnaire. Data were analyzed using descriptive and inferential statistics. Results: Hygiene- 16.69% (5) had excellent, 66.6% (19) had Very good, 19.98% (6) had Good score & none of them had an Average or poor score in hand washing. Execution- 73.26% (22) had excellent, 16% (5) had Very good, 9.99% (3) had Good score & none of them had an Average or poor score in vital signs assessment. Interaction- 56.61% (17) had excellent, 43.29% (13) had Very good score &none of them had a Good, Average or poor score in viva. Feedback- 10 Opinionnaire on personal perception about OSCE administered to participants. 100% (30) of them had positively responded. Conclusion: OSCE proved to be an excellent method of clinical evaluation than traditional evaluation.

Antônio José, uma tragédia fora de hora? / Antônio José, a tragedy out of time?

Resumo: O objetivo deste artigo é, primeiro, mostrar que a tradicional avaliação da tragédia Antônio José (i. e., que ela peca pelo gênero conservador e pela forma versificada), exaustivamente repetida por inúmeros críticos e historiadores da literatura brasileira ao longo do século XX, não se confirma na prática, pois tragédias continuam existindo ao lado de dramas e melodramas até a segunda metade do século XIX nos dois lados do Atlântico, assim como composições em verso ao lado de outras em prosa. Em seguida, argumenta-se que Antônio José possui, apesar de se proclamar tragédia, inúmeras características ligadas à cena moderna e se insere perfeitamente no projeto romântico-eclético difundido por Gonçalves de Magalhães e outros entusiastas do nosso primeiro romantismo.Palavras-chave: romantismo; ecletismo; drama romântico; história literária.Abstract: The aim of this article is, firstly, to show that the traditional evaluation of the tragedy Antônio José (i.e., that it sins by its conservative genre and versified form), exhaustively repeated by countless critics and historians of Brazilian literature throughout the 20th century, is not confirmed in practice, because tragedies continue to exist alongside dramas and melodramas until the second half of the 19th century on both sides of the Atlantic, as well as verse compositions alongside others in prose. Then, it is argued that Antônio José possesses, despite proclaiming itself a tragedy, numerous characteristics linked to the modern drama and fits perfectly into the romantic-eclectic project spread by Gonçalves de Magalhães and other enthusiasts of our first romanticism.Keywords: romanticism; eclectism; romantic drama; literary history.

Research on Educational Evaluation, Promote the Development of Teachers and Students

Evaluation is a cognitive activity. Educational evaluation is to judge students’ learning process and results, which are always conducted by course teachers. The traditional evaluation model often follows the single and mechanical standards, and the teachers will evaluate the learning results within the same class or the same grade. In this way, the evaluators basically have no connection with the students, hence the assessment results are more of subjective consciousness. The assessment that emphasizes the results while overlooks the process made students lost their sense of identity, which will easily upset the students. Multiple evaluations will be more effective, because teachers, students, and parents are all the participants, which contribute to the multi-subject, multi-dimension, and diversified methods, so as to better motivate the students. With the implementation of multiple evaluations, teachers will no longer only focused on the students’ achievement but more on the overall improvement of students’ morality, intelligence, physique, and aesthetics. It is conducive to changing teachers’ education concepts and methods, making it easier for teachers and students to get closer to each other which is good for the common development.

Quantifying errors of multiple gridded soil moisture products in Sweden using triple collocation analysis and traditional evaluation method with ICOS data

<p>Soil moisture is an Essential Climate Variable (ECV) that plays an important role in land surface-atmosphere interactions. Accurate monitoring of soil moisture is essential for many studies in water, energy and carbon cycles. However, soil moisture is characterized with high spatial and temporal variability, making conventional point-based in-situ measurements difficult to sufficiently capture these variabilities given the often lack of dense in-situ network for most regions. Considerable efforts have been made to explore satellite remote sensing, hydrological and land surface models in estimating and mapping soil moisture, leading to increasing availability of different gridded soil moisture products at various spatial and temporal resolutions. The accuracy of an individual product varies between regions and needs to be evaluated in order to guide the selection of the most suitable products for certain applications. Such evaluation will also benefit product development and improvements. The most common (traditional) evaluation method is to calculate error metrics of the evaluated products with in-situ measurements as ground truth. The triple collocation (TC) analysis has been widely used and demonstrated powerful in evaluation of various products for different geophysical variables when ground truth is not available.</p><p>The Integrated Carbon Observation System (ICOS) is a research infrastructure with aim to quantify the greenhouse gas balance of Europe and adjacent regions. A standardized network of more than 140 research stations in 13 member states has been established and is operated by ICOS to provide direct measurements of climate relevant variables. The ICOS Carbon Portal offers a 'one-stop shop' freely for all ICOS data products at https://www.icos-cp.eu/observations/carbon-portal. This study evaluates for the first time a large number of different satellite-based and reanalysis surface soil moisture products at varying spatial and temporal resolutions using ICOS measurements from 2015 over Sweden. Evaluated products include ESA CCI, ASCAT, SMAP, SMOS, Sentinel-1 derived, ERA5 and GLDAS products. In order to quantify spatial patterns of errors of each individual product, TC analysis is applied to different combinations of gridded products for spatial evaluation across entire Sweden. The performance of products in different seasons and years is evaluated. The similarity and difference among different products for the drought period in the year 2018 is particularly assessed. This study is expected to improve our understanding of the applicability and limitations of various gridded soil moisture products in the Nordic region.</p>