Re-framing accountability and learning through evaluation: Insights from the Italian higher education evaluation system

Evaluation ◽  
2020 ◽  
Vol 26 (2) ◽  
pp. 147-165
Author(s):  
Rosaria Lumino ◽  
Dora Gambardella

Although the relation between accountability and learning is a key issue in the field of evaluation, the existing conceptualizations include significant gaps and shortcoming. This article seeks to bridge some of the identified gaps, overcoming the dichotomy between learning and accountability and the overemphasis on accountability, and offering a more nuanced account of various forms of positive and negative learning. We propose a theory-informed reconceptualization of both accountability and learning in order to develop an interpretative framework that recognizes their plurality and brings them together through evaluation. To make visible the analytical potential of our reconceptualization, we present the Italian higher education evaluation system as a source of illustrative examples. Our analysis confirms that accountability and learning are inextricably interconnected and that multiple forms of learning can be envisaged by taking into account the mutual relationship among organizational arrangements, evaluative practices and cultural codes. We argue that such kind of analysis allows to remove the taken-for-granted aspects of evaluation practices, challenging the often-implicit assumptions about their virtues as well as their weaknesses in order to see what evaluation actually does in a particular situation.

2016 ◽  
Vol 20 (6) ◽  
pp. 733-752 ◽  
Author(s):  
Sheizi Calheira de Freitas

Abstract The Brazilian program of higher education evaluation, broadly known as the National Exam of Students' Performance (ENADE), represents a governmental effort to gather information on undergraduate educational quality. As a product of that evaluation, reports are made available to each program evaluated. Our present research addresses the impact of ENADE evaluation report utilization on multiple higher education accounting programs' performance in their subsequent evaluation. Based upon theoretical support from literature about evaluation use, a web-based survey was developed and provided across the country to the coordinators of accounting programs. From a response rate of 62% of the study target population and using multiple regressions, we found that there was a positive correlation between usage of the ENADE evaluation report and the performance of undergraduate accounting programs in their subsequent evaluation. Based upon the reviewed literature and, in accordance with these research results, it is possible to infer that the use of evaluation reports derived from the higher education evaluation system promoted by the Brazilian government can influence the decisions of educational institutions and promote improvement.


Author(s):  
Giuseppe Anthony Nascimento de Lima ◽  
Thalles Henrique Do Nascimento Araújo ◽  
Luciano Ferreira de Azevedo ◽  
Francisco Fernandes de Araújo Neto

<p>The legislation that establishes the National Higher Education Evaluation System (SINAES) states that the institutional self-evaluation process in Brazilian Higher Education Institutions (BHEI) must be made periodically and compulsorily. However, the legislation, regulamentation and technical notes do not have a toolset (evaluative instrumentation, quality and quantitative metrics, diagnostic criteria, etc.) for conception, application and data analysis in self-evaluative processes. Among the various techniques and instruments used by many BHEI, this research tried to collect the most productive and efficient ones which were compatible with SINAES so as to obtain a metamodel able to guide the assembling and management of computerized internal institutional evaluations, in which software interface prototyping techniques were employed for its validation.</p>


2021 ◽  
Vol 13 (9A) ◽  

The Digital dependence in this study is not a dependency on the Internet in traditional contexts. The digital dependence of higher education evaluation has the following manifestations: The widespread penetration of "digit" exists everywhere in higher education evaluation; “Digit” takes up the priority within the coordinate system of higher education evaluation; Irrational "digit" becomes disciplinary force by alienation in higher education evaluation. Its roots in the fact that it derives from the long-term restriction by the evaluation views on rationalism under the control of technological rationality, the promotion of simplifying perception of the higher education field, and the resource black hole and benefit inducement that "digit" can be manifested. Therefore, the key to eliminate the digital dependence in higher education evaluation and breaking the utilitarian thinking should include the following three aspects: returning the meaning of digital criterion in higher education evaluation to be genuine, clarifying the reasonable boundaries of the digital application in the evaluation of higher education, and optimizing the structure of the higher education evaluation system.


Sign in / Sign up

Export Citation Format

Share Document