An embodied semantic processing effect on eye gaze during sentence reading

2012 ◽  
Vol 4 (2) ◽  
pp. 99-114 ◽  
Author(s):  
Catherine I. Phillips ◽  
Christopher R. Sears ◽  
Penny M. Pexman
Keyword(s):  
Semantic Processing ◽  
Eye Gaze ◽  
Reading Processes ◽  
Object Interaction ◽  
Sentence Reading ◽  
Fixation Durations ◽  
Manual Responses ◽  
Total Fixation ◽  
Gaze Behaviour ◽  
Motor Information

AbstractThe present research examines the effects of body-object interaction (BOI) on eye gaze behaviour in a reading task. BOI measures perceptions of the ease with which a human body can physically interact with a word's referent. A set of high BOI words (e.g. cat) and a set of low BOI words (e.g. sun) were selected, matched on imageability and concreteness (as well as other lexical and semantic variables). Facilitatory BOI effects were observed: gaze durations and total fixation durations were shorter for high BOI words, and participants made fewer regressions to high BOI words. The results provide evidence of a BOI effect on non-manual responses and in a situation that taps normal reading processes. We discuss how the results (a) suggest that stored motor information (as measured by BOI ratings) is relevant to lexical semantics, and (b) are consistent with an embodied view of cognition (Wilson 2002).

Embodied semantic processing: The body-object interaction effect in a non-manual task

2011 ◽  
Vol 3 (1) ◽  
pp. 1-14 ◽  
Author(s):  
Michele Wellsby ◽  
Paul D. Siakaluk ◽  
William J. Owen ◽  
Penny M. Pexman
Keyword(s):  
Semantic Processing ◽  
The Body ◽  
Button Press ◽  
Categorization Task ◽  
Semantic System ◽  
Semantic Categorization ◽  
Verbal Responses ◽  
Lexical Semantic ◽  
Object Interaction ◽  
Motor Information

AbstractBody-object interaction (BOI) measures people's perceptions of the ease with which a human body can physically interact with a word's referent. Facilitatory BOI effects, involving faster responses for high BOI words, have been reported in a number of visual word recognition tasks using button press responses. Since BOI effects have only been observed in button-press tasks, it is possible that the effects may be due to priming by high BOI words of the motor system, rather than activation of stored motor information in the lexical semantic system. If this hypothesis is correct, BOI effects should not be observed in tasks using verbal responses. We tested this hypothesis in three versions of a go/no-go semantic categorization task: one version required button press responses, whereas the other two versions required verbal responses. Contrary to the motor priming hypothesis, we observed facilitatory BOI effects in all three versions of the semantic categorization task. These results support the inference that stored motor information is indeed an important component of the lexical semantic system.

scholarly journals The Effect of an Adaptive Simulated Inner Voice on User’s Eye-gaze Behaviour, Ownership Perception and Plausibility Judgement in Virtual Reality

2021 ◽  
Author(s):  
Ding Ding ◽  
Mark A Neerincx ◽  
Willem-Paul Brinkman
Keyword(s):  
Eye Gaze ◽  
Gaze Shift ◽  
Eye Fixation ◽  
Weak Support ◽  
Head Mounted Display ◽  
Inner Voice ◽  
Gaze Behaviour ◽  
Within Subjects ◽  
Potential Strategy ◽  
Tracking Technology

Abstract Virtual cognitions (VCs) are a stream of simulated thoughts people hear while emerged in a virtual environment, e.g. by hearing a simulated inner voice presented as a voice over. They can enhance people’s self-efficacy and knowledge about, for example, social interactions as previous studies have shown. Ownership and plausibility of these VCs are regarded as important for their effect, and enhancing both might, therefore, be beneficial. A potential strategy for achieving this is the synchronization of the VCs with people’s eye fixation using eye-tracking technology embedded in a head-mounted display. Hence, this paper tests this idea in the context of a pre-therapy for spider and snake phobia to examine the ability to guide people’s eye fixation. An experiment with 24 participants was conducted using a within-subjects design. Each participant was exposed to two conditions: one where the VCs were adapted to eye gaze of the participant and the other where they were not adapted, i.e. the control condition. The findings of a Bayesian analysis suggest that credibly more ownership was reported and more eye-gaze shift behaviour was observed in the eye-gaze-adapted condition than in the control condition. Compared to the alternative of no or negative mediation, the findings also give some more credibility to the hypothesis that ownership, at least partly, positively mediates the effect eye-gaze-adapted VCs have on eye-gaze shift behaviour. Only weak support was found for plausibility as a mediator. These findings help improve insight into how VCs affect people.

scholarly journals Localization of Syntactic and Semantic Brain Responses using Magnetoencephalography

2007 ◽  
Vol 19 (7) ◽  
pp. 1193-1205 ◽  
Author(s):  
Elisabet Service ◽  
Päivi Helenius ◽  
Sini Maury ◽  
Riitta Salmelin
Keyword(s):  
Temporal Lobe ◽  
Semantic Processing ◽  
Sentence Comprehension ◽  
Right Hemisphere ◽  
Temporal Cortex ◽  
Word Class ◽  
Sentence Reading ◽  
Word Onset ◽  
Semantic Errors ◽  
The Right

Electrophysiological methods have been used to study the temporal sequence of syntactic and semantic processing during sentence comprehension. Two responses associated with syntactic violations are the left anterior negativity (LAN) and the P600. A response to semantic violation is the N400. Although the sources of the N400 response have been identified in the left (and right) temporal lobe, the neural signatures of the LAN and P600 have not been revealed. The present study used magnetoencephalography to localize sources of syntactic and semantic activation in Finnish sentence reading. Participants were presented with sentences that ended in normally inf lected nouns, nouns in an unacceptable case, verbs instead of nouns, or nouns that were correctly inflected but made no sense in the context. Around 400 msec, semantically anomalous last words evoked strong activation in the left superior temporal lobe with significant activation also for word class errors (N400). Weaker activation was seen for the semantic errors in the right hemisphere. Later, 600-800 msec after word onset, the strongest activation was seen to word class and morphosyntactic errors (P600). Activation was significantly weaker to semantically anomalous and correct words. The P600 syntactic activation was localized to bilateral sources in the temporal lobe, posterior to the N400 sources. The results suggest that the same general region of the superior temporal cortex gives rise to both LAN and N400 with bilateral reactivity to semantic manipulation and a left hemisphere effect to syntactic manipulation. The bilateral P600 response was sensitive to syntactic but not semantic factors.

scholarly journals The effects of temporal pressure on obstacle negotiation and gaze behaviour in young adults with simulated vision loss

2019 ◽  
Vol 9 (1) ◽  
Author(s):  
Tjerk Zult ◽  
Jonathan Allsop ◽  
Matthew A. Timmis ◽  
Shahina Pardhan
Keyword(s):  
Vision Loss ◽  
Time Pressure ◽  
Normal Vision ◽  
Movement Kinematics ◽  
Blurred Vision ◽  
Constant Frequency ◽  
Everyday Activities ◽  
Fixation Durations ◽  
Gaze Behaviour ◽  
Temporal Pressure

Abstract Individuals with vision loss adapt their locomotion and gaze behaviour to safely negotiate objects in temporally unconstrained situations. However, everyday activities are often performed under time-pressure. We investigated the effects of blur on anxiety, movement kinematics and gaze behaviour during the negotiation of a floor-based obstacle under three amounts of pressure: 1) no-pressure; 2) tonal-pressure: an intermittent tone was played at a constant frequency; 3) tonal + time pressure: the intermittent tone increased in frequency and participants had to walk 20% faster to reach the end of the lab. Irrespective of the amount of pressure, the blurred vs. normal vision group reported 32% more anxiety, lifted the lead foot 43% higher and 10% slower over the obstacle, and looked 6% longer and 6% more frequently ahead of the obstacle. In the tonal + time pressure vs. no-pressure condition, both groups were more anxious, showed adaptations in movement kinematics related to walking faster, and adopted a ‘checking strategy’ by shortening their fixation durations at the obstacle. These results show that irrespective of temporal pressure, the blurred vision group remained more cautious as to how the lead foot negotiated the obstacle, in order to reduce the chance of tripping during crossing.

scholarly journals The neural correlates of the body-object interaction effect in semantic processing

2012 ◽  
Vol 6 ◽  
Author(s):  
Ian S. Hargreaves ◽  
Gemma A. Leonard ◽  
Penny M. Pexman ◽  
Daniel J. Pittman ◽  
Paul D. Siakaluk ◽  
...  
Keyword(s):  
Interaction Effect ◽  
Semantic Processing ◽  
Neural Correlates ◽  
The Body ◽  
Object Interaction

scholarly journals Impaired semantic processing during sentence reading in children with dyslexia: Combined fMRI and ERP evidence

NeuroImage ◽  
2008 ◽  
Vol 41 (1) ◽  
pp. 153-168 ◽  
Author(s):  
E SCHULZ ◽  
U MAURER ◽  
S VANDERMARK ◽  
K BUCHER ◽  
S BREM ◽  
...  
Keyword(s):  
Semantic Processing ◽  
Sentence Reading

scholarly journals Attention allocation on mobile app interfaces when human interacts with them

2021 ◽  
Author(s):  
Li Zhu ◽  
Gaochao Cui ◽  
Yan Li ◽  
Jianhai Zhang ◽  
Wanzeng Kong ◽  
...  
Keyword(s):  
Fixation Duration ◽  
Mobile Apps ◽  
Mobile App ◽  
Attention Allocation ◽  
Eye Tracker ◽  
Fixation Durations ◽  
Total Fixation ◽  
Significant Difference ◽  
Bottom Left ◽  
Left Region

AbstractWith the popularity of smartphones and the pervasion of mobile apps, people spend more and more time to interact with a diversity of apps on their smartphones, especially for young population. This raises a question: how people allocate attention to interfaces of apps during using them. To address this question, we, in this study, designed an experiment with two sessions (i.e., Session1: browsing original interfaces; Session 2: browsing interfaces after removal of colors and background) integrating with an eyetracking system. Attention fixation durations were recorded by an eye-tracker while participants browsed app interfaces. The whole screen of smartphone was divided into four even regions to explore fixation durations. The results revealed that participants gave significantly longer total fixation duration on the bottom left region compared to other regions in the session (1) Longer total fixation duration on the bottom was preserved, but there is no significant difference between left side and right side in the session2. Similar to the finding of total fixation duration, first fixation duration is also predominantly paid on the bottom area of the interface. Moreover, the skill in the use of mobile phone was quantified by assessing familiarity and accuracy of phone operation and was investigated in the association with the fixation durations. We found that first fixation duration of the bottom left region is significantly negatively correlated with the smartphone operation level in the session 1, but there is no significant correlation between them in the session (2) According to the results of ratio exploration, the ratio of the first fixation duration to the total fixation duration is not significantly different between areas of interest for both sessions. The findings of this study provide insights into the attention allocation during browsing app interfaces and are of implications on the design of app interfaces and advertisements as layout can be optimized according to the attention allocation to maximally deliver information.

scholarly journals Where did I come from? Where am I going? Functional influences on visual search fixation duration

2017 ◽  
Vol 10 (1) ◽  
Author(s):  
Harold H. Greene ◽  
James M. Brown
Keyword(s):  
Visual Search ◽  
Real Time ◽  
Fixation Duration ◽  
Search Behavior ◽  
Real Time Simulation ◽  
Fixation Durations ◽  
Total Fixation ◽  
Time Simulation ◽  
Saccade Direction

Real time simulation of visual search behavior can occur only if the control of fixation durations is sufficiently understood.  Visual search studies have typically confounded pre- and post-saccadic influences on fixation duration.  In the present study, pre- and post-saccadic influences on fixation durations were compared by considering saccade direction. Novel use of a gaze-contingent moving obstructer paradigm also addressed relative contributions of both influences to total fixation duration.   As a function of saccade direction, pre-saccadic fixation durations exhibited a different pattern from post-saccadic fixation durations.  Post-saccadic fixations were also more strongly influenced by peripheral obstruction than pre-saccadic fixation durations. This suggests that post-saccadic influences may contribute more to fixation durations than pre-saccadic influences. Together, the results demonstrate that it is insufficient to model the control of visual search fixation durations without consideration of pre- and post-saccadic influences. 

scholarly journals Optimizing Fixation Filters for Eye-Tracking on Small Screens

2021 ◽  
Vol 15 ◽  
Author(s):  
Julia Trabulsi ◽  
Kian Norouzi ◽  
Seidi Suurmets ◽  
Mike Storm ◽  
Thomas Zoëga Ramsøy
Keyword(s):  
Social Media ◽  
Eye Tracking ◽  
Eye Gaze ◽  
Methodological Approach ◽  
Detection Algorithm ◽  
Validity And Reliability ◽  
Consumer Responses ◽  
Detection Algorithms ◽  
Total Fixation ◽  
Fixation Detection

The study of consumer responses to advertising has recently expanded to include the use of eye-tracking to track the gaze of consumers. The calibration and validation of eye-gaze have typically been measured on large screens in static, controlled settings. However, little is known about how precise gaze localizations and eye fixations are on smaller screens, such as smartphones, and in moving feed-based conditions, such as those found on social media websites. We tested the precision of eye-tracking fixation detection algorithms relative to raw gaze mapping in natural scrolling conditions. Our results demonstrate that default fixation detection algorithms normally employed by hardware providers exhibit suboptimal performance on mobile phones. In this paper, we provide a detailed account of how different parameters in eye-tracking software can affect the validity and reliability of critical metrics, such as Percent Seen and Total Fixation Duration. We provide recommendations for producing improved eye-tracking metrics for content on small screens, such as smartphones, and vertically moving environments, such as a social media feed. The adjustments to the fixation detection algorithm we propose improves the accuracy of Percent Seen by 19% compared to a leading eye-tracking provider’s default fixation filter settings. The methodological approach provided in this paper could additionally serve as a framework for assessing the validity of applied neuroscience methods and metrics beyond mobile eye-tracking.

Sign in / Sign up

Export Citation Format

Share Document