scholarly journals Methodical Toolkit for Analytical Evaluation of Performance

Author(s):  
Myroslava Kulynych ◽  
◽  
Larisa Lyashko ◽  
2020 ◽  
pp. 025576142093644
Author(s):  
Marcos Álvarez-Díaz ◽  
Luis Magín Muñiz-Bascón ◽  
Antonio Soria-Alemany ◽  
Alberto Veintimilla-Bonet ◽  
Rubén Fernández-Alonso

Evaluation of music performance in competitive contexts often produces discrepancies between the expert judges. These discrepancies can be reduced by using appropriate rubrics that minimise the differences between judges. The objective of this study was the design and validation of an analytical evaluation rubric, which would allow the most objective evaluation possible of a musical solo performance in a regulated official competition. A panel of three experts created an analytical rubric made up of five review criteria and three scoring levels, together with their respective indicators. To validate the rubric, two independent panels of judges used it to score a sample of recordings. An examination was made of the dimensionality, sources of error, inter-rater reliability and internal consistency of the scores coming from the experts. The essential unidimensionality of the rubric was confirmed. No differential effects between raters were found, nor were significant differences seen in each rater’s internal consistency. The use of a rubric as tool for evaluating music performance in a competitive context has positive effects, improving reliability and objectivity of the results, both in terms of intra-rater consistency and agreement between raters.


2018 ◽  
Vol 8 (2) ◽  
pp. 100-111 ◽  
Author(s):  
Maik Friedrich ◽  
Christoph Möhlenbrink

Abstract. Owing to the different approaches for remote tower operation, a standardized set of indicators is needed to evaluate the technical implementations at a task performance level. One of the most influential factors for air traffic control is weather. This article describes the influence of weather metrics on remote tower operations and how to validate them against each other. Weather metrics are essential to the evaluation of different remote controller working positions. Therefore, weather metrics were identified as part of a validation at the Erfurt-Weimar Airport. Air traffic control officers observed weather events at the tower control working position and the remote control working position. The eight participating air traffic control officers answered time-synchronized questionnaires at both workplaces. The questionnaires addressed operationally relevant weather events in the aerodrome. The validation experiment targeted the air traffic control officer’s ability to categorize and judge the same weather event at different workplaces. The results show the potential of standardized indicators for the evaluation of performance and the importance of weather metrics in relation to other evaluation metrics.


1989 ◽  
Vol 34 (4) ◽  
pp. 413-413
Author(s):  
No authorship indicated

Author(s):  
Nguyen Phi Long ◽  
Hiroyuki Daido ◽  
Yukihiro Matsunaga ◽  
Tomonori Yamada ◽  
Akihiro Nishimura ◽  
...  

Sign in / Sign up

Export Citation Format

Share Document