Predictive real-time perceptual compression based on eye-gaze-position analysis

Author(s):  
Oleg V. Komogortsev ◽  
Javed I. Khan
2020 ◽  
Author(s):  
Woochul Choi ◽  
Hyeonsu Lee ◽  
Se-Bum Paik

AbstractBistable perception is characterized by periodic alternation between two different perceptual interpretations, the mechanism of which is poorly understood. Herein, we show that perceptual decisions in bistable perception are strongly correlated with slow rhythmic eye motion, the frequency of which varies across individuals. From eye gaze trajectory measurements during three types of bistable tasks, we found that each subject’s gaze position oscillates slowly(less than 1Hz), and that this frequency matches that of bistable perceptual alternation. Notably, the motion of the eye apparently moves in opposite directions before two opposite perceptual decisions, and this enables the prediction of the timing and direction of perceptual alternation from eye motion. We also found that the correlation between eye movement and a perceptual decision is maintained during variations of the alternation frequency by the intentional switching or retaining of perceived states. This result suggests that periodic bistable perception is phase-locked with rhythmic eye motion.


2021 ◽  
Author(s):  
Rachel Anna Ryskin ◽  
Miguel Angel Salinas ◽  
Steven T. Piantadosi ◽  
Edward Gibson

Speakers and listeners are thought to routinely make sophisticated inferences, in real time, about their conversation partner’s knowledge state and communicative intentions. However, these inferences have only been studied in industrialized cultures. Communicative expectations may be language-dependent, as are many phonological, syntactic, and semantic aspects of language. We study pragmatic inference in communication in the Tsimane’, an indigenous people of the Bolivian Amazon, who have little contact with industrialization or formal education. Using a referential communication task and eye-tracking, we probe how Tsimane' speakers use and understand referential expressions (e.g., ``Hand me the cup.'') across contexts. We manipulated aspects of the visual display to elicit contrastive inferences, including whether the referent was unique or part of a set as well as whether members of the same set differed in size or color. Strikingly, in all cases, patterns of behavior and eye-gaze of Tsimane' and English speakers were qualitatively identical, suggesting that real-time inference may be a core feature of human communication that is shared across cultures rather than a product of life in an industrialized society.


NeuroImage ◽  
2020 ◽  
Vol 216 ◽  
pp. 116617 ◽  
Author(s):  
Hyun-Chul Kim ◽  
Sangsoo Jin ◽  
Sungman Jo ◽  
Jong-Hwan Lee

2019 ◽  
Vol 11 (7) ◽  
pp. 143
Author(s):  
Tanaka ◽  
Takenouchi ◽  
Ogawa ◽  
Yoshikawa ◽  
Nishio ◽  
...  

In semi-autonomous robot conferencing, not only the operator controls the robot, but the robot itself also moves autonomously. Thus, it can modify the operator’s movement (e.g., adding social behaviors). However, the sense of agency, that is, the degree of feeling that the movement of the robot is the operator’s own movement, would decrease if the operator is conscious of the discrepancy between the teleoperation and autonomous behavior. In this study, we developed an interface to control the robot head by using an eye tracker. When the robot autonomously moves its eye-gaze position, the interface guides the operator’s eye movement towards this autonomous movement. The experiment showed that our interface can maintain the sense of agency, because it provided the illusion that the autonomous behavior of a robot is directed by the operator’s eye movement. This study reports the conditions of how to provide this illusion in semi-autonomous robot conferencing.


Sign in / Sign up

Export Citation Format

Share Document