Attention-Aware Robotic Laparoscope Based on Fuzzy Interpretation of Eye-Gaze Patterns

2015 ◽  
Vol 9 (4) ◽  
Author(s):  
Songpo Li ◽  
Xiaoli Zhang ◽  
Fernando J. Kim ◽  
Rodrigo Donalisio da Silva ◽  
Diedra Gustafson ◽  
...  
Keyword(s):  
Fuzzy Logic ◽  
Eye Movements ◽  
Visual Attention ◽  
Cognitive Load ◽  
Medical Practice ◽  
Eye Gaze ◽  
Experimental Results ◽  
Robot Interaction ◽  
Gaze Patterns ◽  
Modern Medical Practice

Laparoscopic robots have been widely adopted in modern medical practice. However, explicitly interacting with these robots may increase the physical and cognitive load on the surgeon. An attention-aware robotic laparoscope system has been developed to free the surgeon from the technical limitations of visualization through the laparoscope. This system can implicitly recognize the surgeon's visual attention by interpreting the surgeon's natural eye movements using fuzzy logic and then automatically steer the laparoscope to focus on that viewing target. Experimental results show that this system can make the surgeon–robot interaction more effective, intuitive, and has the potential to make the execution of the surgery smoother and faster.

scholarly journals GazeEMD: Detecting Visual Intention in Gaze-Based Human-Robot Interaction

Robotics ◽  
2021 ◽  
Vol 10 (2) ◽  
pp. 68
Author(s):  
Lei Shi ◽  
Cosmin Copot ◽  
Steve Vanlanduit
Keyword(s):  
Cognitive Load ◽  
Real World ◽  
Robotic Manipulator ◽  
Similarity Score ◽  
Human Robot Interaction ◽  
Experimental Results ◽  
The Other ◽  
Robot Interaction ◽  
Run Length ◽  
The Real

In gaze-based Human-Robot Interaction (HRI), it is important to determine human visual intention for interacting with robots. One typical HRI interaction scenario is that a human selects an object by gaze and a robotic manipulator will pick up the object. In this work, we propose an approach, GazeEMD, that can be used to detect whether a human is looking at an object for HRI application. We use Earth Mover’s Distance (EMD) to measure the similarity between the hypothetical gazes at objects and the actual gazes. Then, the similarity score is used to determine if the human visual intention is on the object. We compare our approach with a fixation-based method and HitScan with a run length in the scenario of selecting daily objects by gaze. Our experimental results indicate that the GazeEMD approach has higher accuracy and is more robust to noises than the other approaches. Hence, the users can lessen cognitive load by using our approach in the real-world HRI scenario.

The Mechanism of Relaxation by Viewing a Japanese Garden: A Pilot Study

2020 ◽  
Vol 13 (4) ◽  
pp. 31-43
Author(s):  
Seiko Goto ◽  
Yuki Morota ◽  
Congcong Liu ◽  
Minkai Sun ◽  
Bertram Emil Shi ◽  
...  
Keyword(s):  
Heart Rate ◽  
Eye Movements ◽  
Eye Gaze ◽  
Prior Experience ◽  
Physiological Responses ◽  
Psychological Responses ◽  
Heart Rate Monitor ◽  
Gaze Patterns ◽  
Japanese Garden

Aim: To explore people’s visual attention and psychological and physiological responses to viewing a Japanese garden (an asymmetrically designed garden) and an herb garden (a symmetrically designed garden). Background: There are few studies of eye movements when observing different style gardens, and how they are connected to the interpretation of the space, and physiological and psychological responses. Method: Thirty subjects were recruited and their physiological and psychological responses to viewing the garden types were assessed using a heart-rate monitor and questionnaire. Eye movements while viewing projected slide images of the gardens were tracking using an eye-tracking monitor. Results: A significant decrease in heart rate was observed when subjects were viewing the Japanese garden as opposed to viewing the herb garden. Mood was significantly improved in both gardens, but eye-gaze patterns differed. The Japanese garden elicited far more comments about expectations for the coming season; unlike the herb garden, it also induced memories of viewing other landscapes. Conclusion: The physiological and psychological responses to viewing gardens differs based on the quality of landscape design and the prior experience of viewers.

scholarly journals Eye gaze patterns reflect how young fraction learners approach numerical comparisons

2020 ◽  
Vol 6 (1) ◽  
pp. 83-107
Author(s):  
Alison T. Miller Singley ◽  
Jeffrey Lynn Crawford ◽  
Silvia A. Bunge
Keyword(s):  
Academic Achievement ◽  
Eye Movements ◽  
Problem Solving ◽  
Eye Tracking ◽  
Conceptual Development ◽  
Eye Gaze ◽  
Proficiency Levels ◽  
Gaze Patterns ◽  
Different Levels ◽  
Fraction Comparison

Learning fractions is notoriously difficult, yet critically important to mathematical and general academic achievement. Eye-tracking studies are beginning to characterize the strategies that adults use when comparing fractions, but we know relatively little about the strategies used by children. We used eye-tracking to analyze how novice children and mathematically-proficient adults approached a well-studied fraction comparison paradigm. Specifically, eye-tracking can provide insights into the nature of differences: whether they are quantitative—reflecting differences in efficiency—or qualitative—reflecting a fundamentally different approach. We found that children who had acquired the basic fraction rules made more eye movements than did either adults or less proficient children, suggesting a thorough but inefficient problem solving approach. Additionally, correct responses were associated with normative gaze patterns, regardless of age or proficiency levels. However, children paid more attention to irrelevant numerical relationships on conditions that were conceptually difficult. An exploratory analysis points to the possibility that children on the verge of making a conceptual leap attend to the relevant relationships even when they respond incorrectly. These findings indicate the potential of eye-tracking methodology to better characterize the behavior associated with different levels of fraction proficiency, as well as to provide insights for educators regarding how to best support novices at different levels of conceptual development.

scholarly journals Assessing expertise using eye tracking in a Virtual Reality flight simulation

2022 ◽  
Author(s):  
David Harris ◽  
Tom Arthur ◽  
Toby de Burgh ◽  
Mike Duxbury ◽  
Ross Lockett-Kirk ◽  
...  
Keyword(s):  
Virtual Reality ◽  
Eye Movements ◽  
Eye Tracking ◽  
Real World ◽  
Eye Gaze ◽  
Cost Effective ◽  
Flight Simulation ◽  
Training Tool ◽  
Gaze Patterns ◽  
Scaling Analyses

Objective: The aim of this work was to examine the fidelity and validity of an aviation simulation using eye tracking. Background: Commercial head-mounted virtual reality (VR) systems offer a convenient and cost-effective alternative to existing aviation simulation (e.g., for refresher exercises). We performed pre-implementation testing of a novel aviation simulation, designed for head-mounted VR, to determine its fidelity and validity as a training device. Method: Eighteen airline pilots, with varying levels of flight experience, completed a sequence of training ‘flows’. Self-reported measures of presence and workload and users’ perceptions of fidelity were taken. Pilots’ eye movements and performance were recorded to determine whether more experienced pilots showed distinct performance and eye gaze profiles in the simulation, as they would in the real-world. Results: Real-world expertise correlated with eye gaze patterns characterised by fewer, but longer, fixations and a scan path that was more structured and less random. Multidimensional scaling analyses also indicated differential clustering of strategies in more versus less experienced pilots. Subjective ratings of performance, however, showed little relationship with real-world expertise or eye movements. Conclusion: We adopted an evidence-based approach to assessing the fidelity and validity of a VR flight training tool. Pilot reports indicated the simulation was realistic and potentially useful for training, while direct measurement of eye movements was useful for establishing construct validity and psychological fidelity of the simulation.

Robot-to-human feedback and automatic object grasping using an RGB-D camera–projector system

Robotica ◽  
2017 ◽  
Vol 36 (2) ◽  
pp. 241-260 ◽  
Author(s):  
Jinglin Shen ◽  
Nicholas Gans
Keyword(s):  
Visual Attention ◽  
Visual Servoing ◽  
Robot Manipulator ◽  
Human Robot Interaction ◽  
Experimental Results ◽  
Robotic Arm ◽  
Depth Information ◽  
Robot Interaction ◽  
Attention Model ◽  
Robot Grasping

SUMMARYThis paper presents a novel system for human–robot interaction in object-grasping applications. Consisting of an RGB-D camera, a projector and a robot manipulator, the proposed system provides intuitive information to the human by analyzing the scene, detecting graspable objects and directly projecting numbers or symbols in front of objects. Objects are detected using a visual attention model that incorporates color, shape and depth information. The positions and orientations of the projected numbers are based on the shapes, positions and orientations of the corresponding objects. Users select a grasping target by indicating the corresponding number. Projected arrows are then created on the fly to guide a robotic arm to grasp the selected object using visual servoing and deliver the object to the human user. Experimental results are presented to demonstrate how the system is used in robot grasping tasks.

scholarly journals Eye Movements in Response to Pain-Related Feelings in the Presence of Low and High Cognitive Loads

2020 ◽  
Vol 10 (5) ◽  
pp. 92
Author(s):  
Ramtin Zargari Marandi ◽  
Camilla Ann Fjelsted ◽  
Iris Hrustanovic ◽  
Rikke Dan Olesen ◽  
Parisa Gazerani
Keyword(s):  
Eye Movements ◽  
Cognitive Load ◽  
Eye Movement ◽  
Cognitive Processing ◽  
Pain Perception ◽  
Cognitive Task ◽  
Load Level ◽  
Task Load ◽  
Pupillary Responses ◽  
Movement Characteristics

The affective dimension of pain contributes to pain perception. Cognitive load may influence pain-related feelings. Eye tracking has proven useful for detecting cognitive load effects objectively by using relevant eye movement characteristics. In this study, we investigated whether eye movement characteristics differ in response to pain-related feelings in the presence of low and high cognitive loads. A set of validated, control, and pain-related sounds were applied to provoke pain-related feelings. Twelve healthy young participants (six females) performed a cognitive task at two load levels, once with the control and once with pain-related sounds in a randomized order. During the tasks, eye movements and task performance were recorded. Afterwards, the participants were asked to fill out questionnaires on their pain perception in response to the applied cognitive loads. Our findings indicate that an increased cognitive load was associated with a decreased saccade peak velocity, saccade frequency, and fixation frequency, as well as an increased fixation duration and pupil dilation range. Among the oculometrics, pain-related feelings were reflected only in the pupillary responses to a low cognitive load. The performance and perceived cognitive load decreased and increased, respectively, with the task load level and were not influenced by the pain-related sounds. Pain-related feelings were lower when performing the task compared with when no task was being performed in an independent group of participants. This might be due to the cognitive engagement during the task. This study demonstrated that cognitive processing could moderate the feelings associated with pain perception.

scholarly journals Examination of Driver Visual and Cognitive Responses to Billboard Elicited Passive Distraction Using Eye-Fixation Related Potential

Sensors ◽  
2021 ◽  
Vol 21 (4) ◽  
pp. 1471
Author(s):  
Yongxiang Wang ◽  
William Clifford ◽  
Charles Markham ◽  
Catherine Deegan
Keyword(s):  
Visual Information ◽  
Driving Simulator ◽  
Tracking System ◽  
Eye Gaze ◽  
Driver Distraction ◽  
Experimental Results ◽  
Human Information Processing ◽  
Cognitive Responses ◽  
Information Processing Model ◽  
Eye Fixation

Distractions external to a vehicle contribute to visual attention diversion that may cause traffic accidents. As a low-cost and efficient advertising solution, billboards are widely installed on side of the road, especially the motorway. However, the effect of billboards on driver distraction, eye gaze, and cognition has not been fully investigated. This study utilises a customised driving simulator and synchronised electroencephalography (EEG) and eye tracking system to investigate the cognitive processes relating to the processing of driver visual information. A distinction is made between eye gaze fixations relating to stimuli that assist driving and others that may be a source of distraction. The study compares the driver’s cognitive responses to fixations on billboards with fixations on the vehicle dashboard. The measured eye-fixation related potential (EFRP) shows that the P1 components are similar; however, the subsequent N1 and P2 components differ. In addition, an EEG motor response is observed when the driver makes an adjustment of driving speed when prompted by speed limit signs. The experimental results demonstrate that the proposed measurement system is a valid tool in assessing driver cognition and suggests the cognitive level of engagement to the billboard is likely to be a precursor to driver distraction. The experimental results are compared with the human information processing model found in the literature.

Sign in / Sign up

Export Citation Format

Share Document