Chapter 4. Eye tracking as a measure of cognitive effort for post-editing of machine translation

Author(s):  
Joss Moorkens
2020 ◽  
Vol 13 (2) ◽  
pp. 271-285
Author(s):  
Ramunė Kasperavičienė ◽  
Jurgita Motiejūnienė ◽  
Irena Patašienė

Despite fast development of machine translation, the output quality is less than acceptable in certain language pairs. The aim of this paper is to determine the types of errors in machine translation output that cause comprehension problems to potential readers. The study is based on a reading task experiment using eye tracking and a retrospective survey as a complementary method to add more value to the research as eye tracking as a method is considered to be problematic and challenging (O’BRIEN, 2009; ALVES et al., 2009). The cognitive evaluation approach is used in an eye tracking experiment to determine the complexity of the errors in the English–Lithuanian language pair from easiest to hardest as seen by the readers of a machine-translated text. The tested parameters – gaze time and fixation count – demonstrate that a different amount of cognitive effort is required to process different types of errors in machine-translated texts. The current work aims at contributing to other research in the Translation Studies field by providing the analysis of error assessment of machine translation output.


2019 ◽  
Vol 126 (3) ◽  
pp. 499-514 ◽  
Author(s):  
Felippe da S. L. Cardoso ◽  
Sixto González-Víllora ◽  
José Guilherme ◽  
Israel Teoldo

The present study aimed to investigate whether the form and amount of declarative tactical knowledge (DTK) and procedural tactical knowledge (PTK) influence cognitive effort during soccer performance among young players. We assessed 36 male players from a Brazilian first-division soccer club; participants averaged 14.89 ( SD = 1.42) years of age. We evaluated DTK from video simulation tests and PTK through the System of Tactical Assessment in Soccer. We assessed cognitive effort by measures of pupil diameter using Mobile Eye Tracking-XG while players viewed soccer video scenes and made game-related play decisions. After the assessment of tactical knowledge, we categorized the sample according to players’ tactical knowledge into participants with higher and lower PTK and higher and lower DTK. Subsequently, we examined the both PTK and DTK groups on cognitive effort. Our results suggest that tactical knowledge influences cognitive effort in that players with higher PTK and DTK displayed less cognitive effort during soccer performance tasks. In conclusion, we observed that PTK and DTK influenced the cognitive effort younger soccer players expended while viewing soccer scenes and making soccer performance decisions.


Target ◽  
2013 ◽  
Vol 25 (2) ◽  
pp. 180-227 ◽  
Author(s):  
Haidee Kruger

The tension between domesticating and foreignising translation strategies is particularly strongly felt in the translation of children’s literature, and has been a key issue in many studies of such literature. However, despite the pervasiveness of the concepts, there is little existing empirical research investigating how child (and adult) readers of translated children’s books process and respond to for eignised elements in translation. This means that scholars’ arguments in favour of either domestication or foreignisation in the translation of children’s literature are often based on intuition and personal experience, with no substantial empirical basis. This article presents the findings of an experiment undertaken to investigate Afrikaans child and adult readers’ processing of and responses to potentially linguistically and culturally foreign textual elements in translated children’s picturebooks, against the background of postcolonial/neocolonial cultural and linguistic hybridity in South Africa. The paper reports the results relating to two of the research questions informing the study: Does the use of foreignised elements in translated children’s picturebooks have any significant effect on the cognitive effort involved in reading for child and adult readers? Is the comprehension of child and adult readers affected by the use of for eignised elements in translated children’s picturebooks? A reading study utilising eye-tracking was conducted, involving both child and adult participants reading manipulated domesticated and foreignised versions of pages from two picturebooks translated from English to Afrikaans. To answer research question (1), data obtained by means of eye-tracking were analysed for dwell time, fixation count, first fixation duration and glances count for areas of interest (AOIs) reflecting domesticating or foreignising translation strategies. In order to answer question (2), short structured questionnaires or interviews with participants were used, focusing on the degree of comprehension of the two texts. Overall, the findings of the experiment demonstrate that while there are perceptible effects on processing and comprehension associated with the use of foreignising strategies, these effects are not straightforward or uniform, with notable differences not only for different AOIs, but also for child and adult readers.


2020 ◽  
Author(s):  
Zezhong Lv ◽  
Qing Xu ◽  
Klaus Schoeffmann ◽  
Simon Parkinson

AbstractVisual scanning plays an important role in sampling visual information from the surrounding environments for a lot of everyday sensorimotor tasks, such as walking and car driving. In this paper, we consider the problem of visual scanning mechanism underpinning sensorimotor tasks in 3D dynamic environments. We exploit the use of eye tracking data as a behaviometric, for indicating the visuo-motor behavioral measures in the context of virtual driving. A new metric of visual scanning efficiency (VSE), which is defined as a mathematical divergence between a fixation distribution and a distribution of optical flows induced by fixations, is proposed by making use of a widely-known information theoretic tool, namely the square root of Jensen-Shannon divergence. Based on the proposed efficiency metric, a cognitive effort measure (CEM) is developed by using the concept of quantity of information. Psychophysical eye tracking studies, in virtual reality based driving, are conducted to reveal that the new metric of visual scanning efficiency can be employed very well as a proxy evaluation for driving performance. In addition, the effectiveness of the proposed cognitive effort measure is demonstrated by a strong correlation between this measure and pupil size change. These results suggest that the exploitation of eye tracking data provides an effective behaviometric for sensorimotor activity.


2021 ◽  
Vol 0 (0) ◽  
Author(s):  
Jolanta Korycka-Skorupa ◽  
Izabela Gołębiowska

Abstract Multivariate mapping is a technique in which multivariate data are encoded into a single map. A variety of design solutions for multivariate mapping refers to the number of phenomena mapped, the map type, and the visual variables applied. Unlike other authors who have mainly evaluated bivariate maps, in our empirical study we compared three solutions when mapping four variables: two types of multivariate maps (intrinsic and extrinsic) and a simple univariate alternative (serving as a baseline). We analysed usability performance metrics (answer time, answer accuracy, subjective rating of task difficulty) and eye-tracking data. The results suggested that experts used all the tested maps with similar results for answer time and accuracy, even when using four-variable intrinsic maps, which is considered to be a challenging solution. However, eye-tracking data provided more nuances in relation to the difference in cognitive effort evoked by the tested maps across task types.


2016 ◽  
Vol 9 (5) ◽  
Author(s):  
Irma Puškarević ◽  
Uroš Nedeljković ◽  
Vladimir Dimovski ◽  
Klementina Možina

The use of rhetorical figures has become a widely–accepted method for capturing attention and positively increasing cognitive effort in print advertisements. So far research studies mostly analyzed the effect of rhetorical figures in the written as well as pictorial elements of an ad. However, there have been few studies addressing the effect of rhetorical figuration in the specific area of typeface design. This study analyzes the effects of typeface figuration (i.e., regular vs. irregular stylization of the form) on attention and attitude of the viewers. The study also looks at how the effect of typeface figuration changes in relation to the type of a product (hedonistic vs. utilitarian) being advertised. Through the use of a 2 × 2 experimental design, the study measures data using a combination of eye tracking (an objective method) and attitude scaling (a subjective method). 65 volunteers participated in the study. The eye tracking results show that using rhetorical figures in typeface mainly affects attention of the viewers. We have also determined that they influence their attitude. Additionally, the study shows that a typeface and a type of products are correlated; it shows that the hedonistic type of products can benefit more from the figuration. In conclusion, our study builds on and expands the current understanding of the use of rhetorical figures by proving that there is a correlation between the use of rhetorical figures in typeface and viewers' attention, depending on the type of product being advertised.


Babel ◽  
2020 ◽  
Vol 66 (6) ◽  
pp. 999-1024
Author(s):  
Wenchao Su ◽  
Defeng Li

Abstract The exploration of processing patterns is a major topic within the behavioural-cognitive approach to translation and interpreting studies, but existing studies have mainly focused on processing patterns in written translation while largely overlooking other important modes of interlingual transfer, for example sight translation. To fill this gap, the present study investigated processing patterns in rehearsed sight translation from English into Chinese (L1) and vice versa (L2) using eye-tracking technology and examined how translation directions influenced processing patterns in sight translation. It was found that (1) translation students spent more time but invested less cognitive effort in reading the source text in the preparatory reading than the actual sight translation; (2) the coordination time between comprehension and production in sight translation was similar to that with simultaneous interpreting; (3) the processing patterns in each translation direction also showed distinctive differences in both preparatory reading and reading-speech coordination. This was the first study to investigate processing patterns in sight translation that involved two linguistically distinct languages, i.e., English and Chinese, in both L1 and L2 translation and it is hoped that the findings will generate further research along this line.


2017 ◽  
Vol 43 (2) ◽  
pp. 451-459 ◽  
Author(s):  
Ivandré Paraboni ◽  
Alex Gwo Jen Lan ◽  
Matheus Mendes de Sant'Ana ◽  
Flávio Luiz Coutinho

Studies in referring expression generation (REG) have shown different effects of referential overspecification on the resolution of certain descriptions. To further investigate effects of this kind, this article reports two eye-tracking experiments that measure the time required to recognize target objects based on different kinds of information. Results suggest that referential overspecification may be either helpful or detrimental to identification depending on the kind of information that is actually overspecified, an insight that may be useful for the design of more informed hearer-oriented REG algorithms.


Sign in / Sign up

Export Citation Format

Share Document