scholarly journals Assessing research performance in UK universities using the case of the economics and econometrics unit of assessment in the 1992–2014 research evaluation exercises

2017 ◽  
pp. rvw021 ◽  
Author(s):  
James Johnston ◽  
Alan Reeves
Keyword(s):  
Research Evaluation ◽  
Research Performance

Evaluation for Arts-Based Research Performance: Audience Perceptions of Rising from the Ashes

2021 ◽  
Author(s):  
Michael Viega
Keyword(s):  
Music Therapy ◽  
Rating Scale ◽  
Social Issues ◽  
Research Evaluation ◽  
Research Performance ◽  
Music Performance ◽  
Social Significance ◽  
Arts Based Research ◽  
The Social ◽  
Insight Into

Abstract The purpose of the study is to understand how audiences evaluated an arts-based research performance called Rising from the Ashes. Audience evaluation promises egalitarian and pluralistic perspectives that may assist artist-as-researchers with gaining new insight into out of performative arts-based research results. Rising from the Ashes was performed several times between 2015 and 2019. Evaluations were provided to six different audiences and consisted of rating-scale and open-ended questions based on general criteria for judging arts-based research: incisiveness, concision, generativity, social significance, evocation and illumination, and coherence. Descriptive rating scores and thematic analysis of open-ended questions aided in the artist-as-researcher’s understanding of how audiences responded to the performances. Descriptive scores showed that audiences strongly agreed that the performance was concise, incisive, and evocative and illuminating. The performance was less likely to support audiences’ understanding of the social issues addressed in the study, which implied decreased generativity and social significance. Open-ended questions enhanced and supported rating-scale responses as well as revealed specific elements of the performance that addressed its coherence. The results deepened the artists-as-researcher’s understanding of potential strengths and limitations of Rising from the Ashes based on the audience evaluations. Implications for arts-based research evaluation in music therapy, particularly related to music performance, are discussed.

Development of Evaluation System for Iranian Health Research Networks: Challenges and Lessons Learned

2020 ◽  
Author(s):  
Shirin DJALALINIA ◽  
Mohammad Bagher TALEI ◽  
Abbas NAJJARI ◽  
Mohammad Reza BAGHERI ◽  
Shahin AKHONDZADEH ◽  
...  
Keyword(s):  
Health Research ◽  
Evaluation System ◽  
Large Scale ◽  
Research Evaluation ◽  
Scientific Evidence ◽  
Research Performance ◽  
Research Impact ◽  
Lessons Learned ◽  
Evaluation Framework ◽  
Research Networks

Background: Health research networks (HRNs) are critical components of large-scale systems of production and validation of scientific evidence. As evaluation of research systems is a reliable process to measure efficiency and effectiveness of their activities, we aimed to report the processes of development of evaluation indicators’ for Iranian health research networks and the results of conducted assessment. Methods: In 2017, for the first time, aim to develop the evaluation framework for national HRNs, following the qualitative approach to assess the quality of research we designed the peer review method as one of the most important tools. This qualitative method was conducted according to experts’ views in specific fields. Key policy makers and stakeholders collaboratively developed a number of criteria for evaluation of research performance of Iranian HRNs. Following the review of conducted studies, benefitting from published guide line, these indicators were defined under 4 main axes of governance and leadership; infrastructures; research products and research impact. Results: Based on requirements of developed protocol for evaluation of HRNs in Iran, 18 HRNs completed the processes of evaluation. Results show a progressive need for more attention to precise planning of HRNs for achieving to goals. Another point to consider is the attention to documenting processes. The observational system for researches for detection of latest research priority was the most important issues that need to be more addressed by all of networks. Conclusion: Research evaluation of Iranian HRNs more over creating of constructive positive competition provide an overview of the shortcomings and research challenges could be used for better planning and promotion of the health research system.

scholarly journals Introducing and testing an advanced quantitative methodological approach for the evaluation of research centers: a case study on sustainability science

2019 ◽  
Vol 29 (2) ◽  
pp. 135-149 ◽  
Author(s):  
Omar Kassab ◽  
Rüdiger Mutz ◽  
Hans-Dieter Daniel
Keyword(s):  
Sustainability Science ◽  
Research Evaluation ◽  
Methodological Approach ◽  
Research Performance ◽  
Three Dimensions ◽  
Research Center ◽  
Research Centers ◽  
Evaluation Approach ◽  
Ex Post ◽  
Global University

Abstract With the growing complexity of societal and scientific problems, research centers have emerged to facilitate the conduct of research beyond disciplinary and institutional boundaries. While they have become firmly established in the global university landscape, research centers raise some critical questions for research evaluation. Existing evaluation approaches designed to assess universities, departments, projects, or individual researchers fail to capture some of the core characteristics of research centers and their participants, including the diversity of the involved researchers, at what point in time they join and leave the research center, or the intensity of their participation. In addressing these aspects, this article introduces an advanced approach for the ex post evaluation of research centers. It builds on a quasi-experimental within-group design, bibliometric analyses, and multilevel statistics to assess average and individual causal effects of research center affiliation on participants along three dimensions of research performance. The evaluation approach is tested with archival data from a center in the field of sustainability science. Against a widely held belief, we find that participation in research centers entails no disadvantages for researchers as far as their research performance is concerned. However, individual trajectories varied strongly.

scholarly journals Prestige and Independence-Controlled Publication Performance of Researchers at 14 Hungarian Research Institutions between 2014 and 2018 : A Data Paper

KOME ◽  
2021 ◽  
Vol Online first ◽  
Author(s):  
János Tóth ◽  
Márton Demeter
Keyword(s):  
Research Evaluation ◽  
Research Output ◽  
Research Performance ◽  
Structured Data ◽  
Research Institutions ◽  
Scientific Excellence ◽  
Global Competitiveness ◽  
Evaluation Policies ◽  
New Research ◽  
Research Performance Evaluation

This data article describes a dataset showing the five-year performance of 471 researchers from 14 Hungarian research institutions, with a total of 3219 observations. Each observation represent items produced between the 1st January 2014 and the 31th December 2018 by a researcher employed in the sampled research institutions from one of six research output types. Due to a prestige and independence-controlled categorization of research output, and the scarcity of easily accessible, well-structured data curated for research performance evaluation, this dataset can play an important role in new research evaluation policies at Hungarian research institutions aiming to enhance global competitiveness by fostering scientific excellence and innovation.

Research performance evaluation: the experience of an independent medical research institute

2012 ◽  
Vol 36 (2) ◽  
pp. 218 ◽  
Author(s):  
Catherine C. Schapper ◽  
Terence Dwyer ◽  
Geoffrey W. Tregear ◽  
MaryAnne Aitken ◽  
Moira A. Clay
Keyword(s):  
Public Health ◽  
Performance Evaluation ◽  
Research Funding ◽  
Research Evaluation ◽  
Research Performance ◽  
Evaluation Methodology ◽  
Strategic Goals ◽  
The Impact ◽  
Research Performance Evaluation ◽  
Research Institute

Background. Evaluation of the social and economic outcomes of health research funding is an area of intense interest and debate. Typically, approaches have sought to assess the impact of research funding by medical charities or regional government bodies. Independent research institutes have a similar need for accountability in investment decisions but have different objectives and funding, thus the existing approaches are not appropriate. Methods. An evaluation methodology using eight indicators was developed to assess research performance across three broad categories: knowledge creation; inputs to research; and commercial, clinical and public health outcomes. The evaluation approach was designed to provide a balanced assessment across laboratory, clinical and public health research. Results and discussion. With a diverse research agenda supported by a large number of researchers, the Research Performance Evaluation process at the Murdoch Childrens Research Institute has, by necessity, been iterative and responsive to the needs of the Institute and its staff. Since its inception 5 years ago, data collection systems have been refined, the methodology has been adjusted to capture appropriate data, staff awareness and participation has increased, and issues regarding the methodology and scoring have been resolved. Conclusions. The Research Performance Evaluation methodology described here provides a fair and transparent means of disbursing internal funding. It is also a powerful tool for evaluating the Institute’s progress towards achieving its strategic goals, and is therefore a key driver for research excellence. What is known about the topic? Increasingly, research funders are seeking to evaluate the impact and outcomes of research spending in order to inform policy decisions and guide research funding expenditure. However, in most instances, research evaluation activities are not undertaken by the organisation conducting the actual research and may not meet their practical needs. What does this paper add? The paper outlines a research performance evaluation methodology specifically tailored to the needs of the medical research institute conducting the research being evaluated, as a way of evaluating research performance to drive strategic goals and disburse internal funds. What are the implications for practitioners? This paper provides a clear approach to internal research evaluation using a process that meets the needs of the organisation actually conducting the research, and provides institutional data for strategic planning activities.

Social-Scientific Research Competency

2019 ◽  
Vol 35 (5) ◽  
pp. 737-750 ◽  
Author(s):  
Christopher Gess ◽  
Christoph Geiger ◽  
Matthias Ziegler
Keyword(s):  
Higher Education ◽  
Test Scores ◽  
Research Performance ◽  
Scientific Research ◽  
Research Education ◽  
Crystallized Intelligence ◽  
Research Competency ◽  
Social Scientific Research ◽  
Social Scientific ◽  
Education Courses

Abstract. Although the development of research competency is an important goal of higher education in social sciences, instruments to measure this outcome often depend on the students’ self-ratings. To provide empirical evidence for the utility of a newly developed instrument for the objective measurement of social-scientific research competency, two validation studies across two independent samples were conducted. Study 1 ( n = 675) provided evidence for unidimensionality, expected differences in test scores between differently advanced groups of students as well as incremental validities over and above self-perceived research self-efficacy. In Study 2 ( n = 82) it was demonstrated that the competency measured indeed is social-scientific and relations to facets of fluid and crystallized intelligence were analyzed. Overall, the results indicate that the test scores reflected a trainable, social-scientific, knowledge-related construct relevant to research performance. These are promising results for the application of the instrument in the evaluation of research education courses in higher education.

Work Engagement and Research Output Among Female and Male Scientists

2016 ◽  
Vol 15 (2) ◽  
pp. 55-65 ◽  
Author(s):  
Lonneke Dubbelt ◽  
Sonja Rispens ◽  
Evangelia Demerouti
Keyword(s):  
Work Engagement ◽  
Research Output ◽  
Research Performance ◽  
Daily Work ◽  
Time Control ◽  
Science Technology ◽  
And Performance ◽  
And Mathematics ◽  
Number Of Publications ◽  
The Relationship

Abstract. Women have a minority position within science, technology, engineering, and mathematics and, consequently, are likely to face more adversities at work. This diary study takes a look at a facilitating factor for women’s research performance within academia: daily work engagement. We examined the moderating effect of gender on the relationship between two behaviors (i.e., daily networking and time control) and daily work engagement, as well as its effect on the relationship between daily work engagement and performance measures (i.e., number of publications). Results suggest that daily networking and time control cultivate men’s work engagement, but daily work engagement is beneficial for the number of publications of women. The findings highlight the importance of work engagement in facilitating the performance of women in minority positions.

Measuring academic research performance through audit at the expense of trust: Exploring the 21st Century University

2011 ◽  
Vol 1 (1) ◽  
pp. 49-59 ◽  
Author(s):  
Chris Holligan ◽  
Ibrahim Sirkeci
Keyword(s):  
Research Performance ◽  
Academic Research ◽  
Reputation Management ◽  
Intellectual Life ◽  
Budget Cuts ◽  
University Culture ◽  
The Public ◽  
Audit Culture ◽  
Management Quality ◽  
Fiscal Austerity

British universities are experiencing a climate of fiscal austerity including severe budget cuts coupled with intensifying competition for markets have seen the emergence of audit culture which afflicts the public sector in general. This entails the risk to the integrity of university culture disappearing. This paper seeks to explore the interconnections between developing trends in universities which cause processes likely to undermine the objectivity and independence of research. We question that universities’ alignment with the capitalist business sector and the dominant market economy culture. Despite arguably positive aspects, there is a danger that universities may be dominated by hegemonic sectional interest rather than narratives of openness and democratically oriented critique. We also argue that audit culture embedded in reputation management, quality control and ranking hierarchies may necessarily promote deception while diminishing a collegiate culture of trust and pursuit of truth which is replaced by destructive impersonal accountability procedures. Such transitions inevitably contain insidious implications for the nature of the academy and undermine the values of academic-intellectual life.

Sign in / Sign up

Export Citation Format

Share Document