The FEMTI guidelines for contextual MT evaluation: principles and resources

A large number of evaluation metrics exist for machine translation (MT) systems, but depending on the intended context of use of such a system, not all metrics are equally relevant. Based on the ISO/IEC 9126 and 14598 standards for software evaluation, the Framework for the Evaluation of Machine Translation in ISLE (FEMTI) provides guidelines for the selection of quality characteristics to be evaluated depending on the expected task, users, and input characteristics of an MT system. This approach to contextual evaluation was implemented as a web-based application which helps its users design evaluation plans. In addition, FEMTI offers experts in evaluation the possibility to enter and share their knowledge using a dedicated web-based tool, tested in several evaluation exercises.

The heptachordal basis of hexachordal theory: on the semiotics of musical notation in the Middle Ages

ABSTRACTBy all appearances, the advent of a full-fledged hexachordal system in the late thirteenth century marked the culmination of a radical reconceptualisation of diatonic space that had begun over two centuries earlier with Guido of Arezzo's introduction of the syllables ut re mi fa sol la as an aid to sight-singing. An early witness of the new diatonic configuration is Johannes de Garlandia's Introductio musicae planae (c.1275), which presents the three proprietates per b quadro, per natura and per b molle as a fundamental articulation of the gamut that is necessary for conveying the intervallic distances between the diatonic pitches.A contextual evaluation of the theory of the proprietates, however, indicates that the hexachordal parsing of the gamut was not meant to establish the major sixth as the regulative paradigm of diatonic space (i.e. as a normative scale), but was rather in line with the earlier understanding of the ut-la syllables as an optional aid for singing. The development of hexachordal theory was in fact an implicit confirmation of the heptachordal structure of the gamut that had been in place since around the year 1000 (and arguably earlier), when the cycle of seven A–G letters was first used to label the constituent pitches of the octave.