Object identification difficulty can be predicted based on disfluencies and eye-movements in connected speech

2020 ◽  
Author(s):  
Aurélie Pistono ◽  
Robert Hartsuiker
Keyword(s):  
Eye Movements ◽  
Eye Tracking ◽  
Picture Naming ◽  
Object Identification ◽  
Connected Speech ◽  
Visual Identification ◽  
Multivariate Pattern ◽  
Visual Blurring ◽  
Selection Of ◽  
Lexical Concept

To reveal the underlying cause of disfluency, several authors use a network task, where participants describe the route taken by a marker through visually presented networks of objects. To be able to disentangle disfluency related to word preparation from other factors, we combined this task with eye-tracking. We asked whether delays in the earliest stages of picture naming elicit disfluency. We therefore used visual blurring which hinders visual identification of the items and thereby slows down selection of a lexical concept. This manipulation did not lead to more disfluency on average and viewing times decreased with blurred pictures. However, multivariate pattern analyses revealed that a classifier could predict, from the pattern of disfluency, whether each participant was about to name blurred or control pictures. Impeding the conceptual generation of a message therefore affected the pattern of disfluencies of each participant individually, but this pattern was not consistent from one participant to another.

scholarly journals Eye-movements can help disentangle mechanisms underlying disfluency

2020 ◽  
Author(s):  
Aurélie Pistono ◽  
Robert Hartsuiker
Keyword(s):  
Eye Movements ◽  
Eye Tracking ◽  
Eye Movement ◽  
Lexical Selection ◽  
Self Monitoring ◽  
Speech Encoding ◽  
Movement Data ◽  
Multivariate Pattern

To reveal the underlying cause of disfluency, several authors related the pattern of disfluencies to difficulties at specific levels of production, using a Network Task. However, disfluencies are arguably multifactorial. To disentangle disfluency related to word preparation from other factors, we combined this task with eye-tracking. We manipulated lexical and grammatical selection difficulty. In Experiment 1, lines connecting the pictures varied in length. Experiment 2 only used short lines. In both experiments, lexical selection difficulty promoted self- corrections and pauses and longer viewing times. Multivariate pattern analyses (MVPA) demonstrated that lexical selection difficulty is predictable from disfluency and eye-movement data patterns. In Experiment 1, participants spent less time gazing at pictures preceded by long lines, while producing more pauses. This suggests they used a strategy to inspect other areas than the upcoming picture. We conclude that eye-tracking is informative about mechanisms underlying disfluency related to speech encoding, self-monitoring, and stalling strategies.

Eye movements in sports research and practice: Immersive technologies as optimal environments for the study of gaze behaviour

2020 ◽  
Author(s):  
David Harris ◽  
Mark Wilson ◽  
Tim Holmes ◽  
Toby de Burgh ◽  
Samuel James Vine
Keyword(s):  
Virtual Reality ◽  
Eye Movements ◽  
Eye Tracking ◽  
Visual Information ◽  
Successful Performance ◽  
Experimental Control ◽  
Research And Practice ◽  
Gaze Behaviour ◽  
Immersive Technologies

Head-mounted eye tracking has been fundamental for developing an understanding of sporting expertise, as the way in which performers sample visual information from the environment is a major determinant of successful performance. There is, however, a long running tension between the desire to study realistic, in-situ gaze behaviour and the difficulties of acquiring accurate ocular measurements in dynamic and fast-moving sporting tasks. Here, we describe how immersive technologies, such as virtual reality, offer an increasingly compelling approach for conducting eye movement research in sport. The possibility of studying gaze behaviour in representative and realistic environments, but with high levels of experimental control, could enable significant strides forward for eye tracking in sport and improve understanding of how eye movements underpin sporting skills. By providing a rationale for virtual reality as an optimal environment for eye tracking research, as well as outlining practical considerations related to hardware, software and data analysis, we hope to guide researchers and practitioners in the use of this approach.

scholarly journals Neurogastronomy as a Tool for Evaluating Emotions and Visual Preferences of Selected Food Served in Different Ways

Foods ◽  
2021 ◽  
Vol 10 (2) ◽  
pp. 354
Author(s):  
Jakub Berčík ◽  
Johana Paluchová ◽  
Katarína Neomániová
Keyword(s):  
Eye Movements ◽  
Air Quality ◽  
Eye Tracking ◽  
Facial Expressions ◽  
Visual Design ◽  
Personal Interview ◽  
Visual Preferences ◽  
New Perspective ◽  
Corporate Resources ◽  
Face Reading

The appearance of food provides certain expectations regarding the harmonization of taste, delicacy, and overall quality, which subsequently affects not only the intake itself but also many other features of the behavior of customers of catering facilities. The main goal of this article is to find out what effect the visual design of food (waffles) prepared from the same ingredients and served in three different ways—a stone plate, street food style, and a white classic plate—has on the consumer’s preferences. In addition to the classic tablet assistance personal interview (TAPI) tools, biometric methods such as eye tracking and face reading were used in order to obtain unconscious feedback. During testing, air quality in the room by means of the Extech device and the influence of the visual design of food on the perception of its smell were checked. At the end of the paper, we point out the importance of using classical feedback collection techniques (TAPI) and their extension in measuring subconscious reactions based on monitoring the eye movements and facial expressions of the respondents, which provides a whole new perspective on the perception of visual design and serving food as well as more effective targeting and use of corporate resources.

scholarly journals A Fast and Effective System for Analysis of Optokinetic Waveforms with a Low-Cost Eye Tracking Device

Healthcare ◽  
2020 ◽  
Vol 9 (1) ◽  
pp. 10
Author(s):  
Chong-Bin Tsai ◽  
Wei-Yu Hung ◽  
Wei-Yen Hsu
Keyword(s):  
Eye Movements ◽  
Eye Tracking ◽  
Eye Movement ◽  
Low Cost ◽  
Saccadic Eye Movements ◽  
Slow Phase ◽  
Eye Tracker ◽  
Effective System ◽  
Tracking Device ◽  
Traditional Approaches

Optokinetic nystagmus (OKN) is an involuntary eye movement induced by motion of a large proportion of the visual field. It consists of a “slow phase (SP)” with eye movements in the same direction as the movement of the pattern and a “fast phase (FP)” with saccadic eye movements in the opposite direction. Study of OKN can reveal valuable information in ophthalmology, neurology and psychology. However, the current commercially available high-resolution and research-grade eye tracker is usually expensive. Methods & Results: We developed a novel fast and effective system combined with a low-cost eye tracking device to accurately quantitatively measure OKN eye movement. Conclusions: The experimental results indicate that the proposed method achieves fast and promising results in comparisons with several traditional approaches.

Effects of aging and noncanonical form presentation on idiom processing: Evidence from eye tracking

2020 ◽  
pp. 1-27
Author(s):  
Katja I. Haeuser ◽  
Shari Baum ◽  
Debra Titone
Keyword(s):  
Older Adults ◽  
Eye Movements ◽  
Eye Tracking ◽  
Healthy Aging ◽  
Idiom Comprehension ◽  
First Pass ◽  
Effects Of Aging ◽  
Open Question ◽  
Idiom Processing ◽  
Noncanonical Form

Abstract Comprehending idioms (e.g., bite the bullet) requires that people appreciate their figurative meanings while suppressing literal interpretations of the phrase. While much is known about idioms, an open question is how healthy aging and noncanonical form presentation affect idiom comprehension when the task is to read sentences silently for comprehension. Here, younger and older adults read sentences containing idioms or literal phrases, while we monitored their eye movements. Idioms were presented in a canonical or a noncanonical form (e.g., bite the iron bullet). To assess whether people integrate figurative or literal interpretations of idioms, a disambiguating region that was figuratively or literally biased followed the idiom in each sentence. During early stages of reading, older adults showed facilitation for canonical idioms, suggesting a greater sensitivity to stored idiomatic forms. During later stages of reading, older adults showed slower reading times when canonical idioms were biased toward their literal interpretation, suggesting they were more likely to interpret idioms figuratively on the first pass. In contrast, noncanonical form presentation slowed comprehension of figurative meanings comparably in younger and older participants. We conclude that idioms may be more strongly entrenched in older adults, and that noncanonical form presentation slows comprehension of figurative meanings.

scholarly journals Impaired Inhibitory Control of Saccadic Eye Movements in Cervical Dystonia: An Eye‐Tracking Study

2021 ◽  
Author(s):  
Federico Carbone ◽  
Philipp Ellmerer ◽  
Marcel Ritter ◽  
Sabine Spielberger ◽  
Philipp Mahlknecht ◽  
...  
Keyword(s):  
Eye Movements ◽  
Eye Tracking ◽  
Inhibitory Control ◽  
Cervical Dystonia ◽  
Saccadic Eye Movements

Influence of cognitive style on information processing and selection of yogurt labels: Insights from an eye-tracking study

2015 ◽  
Vol 74 ◽  
pp. 1-9 ◽  
Author(s):  
Franco Mawad ◽  
Marcela Trías ◽  
Ana Giménez ◽  
Alejandro Maiche ◽  
Gastón Ares
Keyword(s):  
Information Processing ◽  
Eye Tracking ◽  
Cognitive Style ◽  
Selection Of

The Eyes Chico, They Never Lie – Using Eye-Tracking to Examine Faking on the Conditional Reasoning Test for Aggression

2021 ◽  
Vol 20 (2) ◽  
pp. 84-96
Author(s):  
Mitja Ružojčić ◽  
Zvonimir Galić ◽  
Antun Palanović ◽  
Maja Parmač Kovačić ◽  
Andreja Bubić
Keyword(s):  
Eye Movements ◽  
Eye Tracking ◽  
Personnel Selection ◽  
Test Scores ◽  
Conditional Reasoning ◽  
Reasoning Test ◽  
Test Study ◽  
True Purpose ◽  
Response Alternatives

Abstract. To better understand the process of responding to the Conditional Reasoning Test for Aggression (CRT-A) and its implication for the test's use in personnel selection, we conducted two lab studies in which we compared test scores and eye movements of participants responding honestly and faking the test. Study 1 results showed that, although participants might try to respond differently to the CRT-A while faking, it remains an indirect and unfakeable measure as long as the test's purpose is undisclosed. Study 2 showed that revealing the true purpose of the CRT-A diminishes the test's indirect nature so the test becomes fakeable, solving it requires less attention and participants direct their eyes more to response alternatives congruent with the presentational demands.

Why subtitle speed matters: Evidence from word skipping and rereading

2021 ◽  
pp. 1-26
Author(s):  
Jan-Louis Kruger ◽  
Natalia Wisniewska ◽  
Sixin Liao
Keyword(s):  
Eye Movements ◽  
Eye Tracking ◽  
Eye Movement ◽  
Lexical Processing ◽  
Situation Model ◽  
Linguistic Processing ◽  
Reading Behavior ◽  
New Findings ◽  
Word Skipping

Abstract High subtitle speed undoubtedly impacts the viewer experience. However, little is known about how fast subtitles might impact the reading of individual words. This article presents new findings on the effect of subtitle speed on viewers’ reading behavior using word-based eye-tracking measures with specific attention to word skipping and rereading. In multimodal reading situations such as reading subtitles in video, rereading allows people to correct for oculomotor error or comprehension failure during linguistic processing or integrate words with elements of the image to build a situation model of the video. However, the opportunity to reread words, to read the majority of the words in the subtitle and to read subtitles to completion, is likely to be compromised when subtitles are too fast. Participants watched videos with subtitles at 12, 20, and 28 characters per second (cps) while their eye movements were recorded. It was found that comprehension declined as speed increased. Eye movement records also showed that faster subtitles resulted in more incomplete reading of subtitles. Furthermore, increased speed also caused fewer words to be reread following both horizontal eye movements (likely resulting in reduced lexical processing) and vertical eye movements (which would likely reduce higher-level comprehension and integration).

scholarly journals Selection of visual information for lightness judgements by eye movements

2013 ◽  
Vol 368 (1628) ◽  
pp. 20130056 ◽  
Author(s):  
Matteo Toscani ◽  
Matteo Valsecchi ◽  
Karl R. Gegenfurtner
Keyword(s):  
Eye Movements ◽  
Visual System ◽  
Visual Information ◽  
Selection Process ◽  
Sampling Strategy ◽  
Selection Strategy ◽  
Eye Fixations ◽  
Target Layer ◽  
Highly Correlated ◽  
Selection Of

When judging the lightness of objects, the visual system has to take into account many factors such as shading, scene geometry, occlusions or transparency. The problem then is to estimate global lightness based on a number of local samples that differ in luminance. Here, we show that eye fixations play a prominent role in this selection process. We explored a special case of transparency for which the visual system separates surface reflectance from interfering conditions to generate a layered image representation. Eye movements were recorded while the observers matched the lightness of the layered stimulus. We found that observers did focus their fixations on the target layer, and this sampling strategy affected their lightness perception. The effect of image segmentation on perceived lightness was highly correlated with the fixation strategy and was strongly affected when we manipulated it using a gaze-contingent display. Finally, we disrupted the segmentation process showing that it causally drives the selection strategy. Selection through eye fixations can so serve as a simple heuristic to estimate the target reflectance.

Sign in / Sign up

Export Citation Format

Share Document