scholarly journals Evaluating Different Display Techniques for Communicating Search Strategy Training in a Collaborative Virtual Aircraft Inspection Environment

Author(s):  
P. Mehta ◽  
S. Sadasivan ◽  
J. S. Greenstein ◽  
A. K. Gramopadhye ◽  
A. T. Duchowski

Aircraft inspection is vital to assure safe and reliable air transportation. Search strategy training has been recognized to be effective in improving an inspector's performance in a visual inspection task. Improving the search performance of novice inspectors can be expedited by providing cognitive feedfoward information about the search strategy adopted by an expert inspector. In a collaborative virtual aircraft inspection environment using eye tracking equipment, novice inspectors can observe in real time the point of regard (POR) data of an expert inspector performing an inspection task. This research evaluates the effectiveness of three display techniques —‘dot’, ‘ray casting’ and ‘decaying trace’ – for representing, the gaze slaved visual deictic reference (VDR) of the expert inspector during search strategy training in an aircraft inspection task. Increase in performance of the novices performing an inspection task after training show the ‘decaying trace’ as the most effective form for representing the expert's VDR.

Author(s):  
George M. Nickles ◽  
Valerie Sacrez ◽  
Anand K. Gramopadhye

Previous research in inspection has shown that a systematic search strategy is more effective than a random search strategy in looking for defects. Moreover, past studies have shown that training can improve search strategy. The purpose of this study was to determine if a job aid could be used to train inspectors to adopt a systematic search strategy and thereby improve their search performance. The study used a computer simulated inspection task and a job aid, which included a cursor that traced a systematic search pattern over the inspection surface represented by the screen. An experiment was designed wherein sixteen subjects were randomly assigned to two groups, those who received practice and instructions on the use of a systematic search strategy and those who received training on the job aid. The results are analyzed and reported


Sensors ◽  
2021 ◽  
Vol 21 (18) ◽  
pp. 6135
Author(s):  
Jonas Aust ◽  
Antonija Mitrovic ◽  
Dirk Pons

Background—The visual inspection of aircraft parts such as engine blades is crucial to ensure safe aircraft operation. There is a need to understand the reliability of such inspections and the factors that affect the results. In this study, the factor ‘cleanliness’ was analysed among other factors. Method—Fifty industry practitioners of three expertise levels inspected 24 images of parts with a variety of defects in clean and dirty conditions, resulting in a total of N = 1200 observations. The data were analysed statistically to evaluate the relationships between cleanliness and inspection performance. Eye tracking was applied to understand the search strategies of different levels of expertise for various part conditions. Results—The results show an inspection accuracy of 86.8% and 66.8% for clean and dirty blades, respectively. The statistical analysis showed that cleanliness and defect type influenced the inspection accuracy, while expertise was surprisingly not a significant factor. In contrast, inspection time was affected by expertise along with other factors, including cleanliness, defect type and visual acuity. Eye tracking revealed that inspectors (experts) apply a more structured and systematic search with less fixations and revisits compared to other groups. Conclusions—Cleaning prior to inspection leads to better results. Eye tracking revealed that inspectors used an underlying search strategy characterised by edge detection and differentiation between surface deposits and other types of damage, which contributed to better performance.


2003 ◽  
Author(s):  
Rahul R. Desai ◽  
Anand K. Gramopadhye ◽  
Brian J. Melloy ◽  
Andrew Duchowski

Author(s):  
Piercarlo Dondi ◽  
Marco Porta ◽  
Angelo Donvito ◽  
Giovanni Volpe

AbstractInteractive and immersive technologies can significantly enhance the fruition of museums and exhibits. Several studies have proved that multimedia installations can attract visitors, presenting cultural and scientific information in an appealing way. In this article, we present our workflow for achieving a gaze-based interaction with artwork imagery. We designed both a tool for creating interactive “gaze-aware” images and an eye tracking application conceived to interact with those images with the gaze. Users can display different pictures, perform pan and zoom operations, and search for regions of interest with associated multimedia content (text, image, audio, or video). Besides being an assistive technology for motor impaired people (like most gaze-based interaction applications), our solution can also be a valid alternative to the common touch screen panels present in museums, in accordance with the new safety guidelines imposed by the COVID-19 pandemic. Experiments carried out with a panel of volunteer testers have shown that the tool is usable, effective, and easy to learn.


2017 ◽  
Vol 17 (3) ◽  
pp. 257-266 ◽  
Author(s):  
Azam Majooni ◽  
Mona Masood ◽  
Amir Akhavan

The basic premise of this research is investigating the effect of layout on the comprehension and cognitive load of the viewers in the information graphics. The term ‘Layout’ refers to the arrangement and organization of the visual and textual elements in a graphical design. The experiment conducted in this study is designed based on two stories and each one of these stories is presented with two different layouts. During the experiment, eye-tracking devices are applied to collect the gaze data including the eye movement data and pupil diameter fluctuation. In the research on the modification of the layouts, contents of each story are narrated using identical visual and textual elements. The analysis of eye-tracking data provides quantitative evidence concerning the change of layout in each story and its effect on the comprehension of participants and variation of their cognitive load. In conclusion, it can be claimed that the comprehension from the zigzag form of the layout was higher with a less imposed cognitive load.


Author(s):  
Anand K. Gramopadhye ◽  
Colin G. Drury ◽  
Joseph Sharit

Research on civil aircraft inspection and maintenance has shown the potential for employing human factor interventions in improving performance. A series of training experiments was developed to understand the effects of different training interventions in the visual inspection domain. This paper reports on preliminary results obtained in applying a combined active and progressive part training scheme in improving the decision making performance for a visual inspection task. The task was a computer simulated airframe visual inspection task.


2018 ◽  
Vol 11 (2) ◽  
Author(s):  
Sarah Vandemoortele ◽  
Kurt Feyaerts ◽  
Mark Reybrouck ◽  
Geert De Bièvre ◽  
Geert Brône ◽  
...  

Few investigations into the nonverbal communication in ensemble playing have focused on gaze behaviour up to now. In this study, the gaze behaviour of musicians playing in trios was recorded using the recently developed technique of mobile eye-tracking. Four trios (clarinet, violin, piano) were recorded while rehearsing and while playing several runs through the same musical fragment. The current article reports on an initial exploration of the data in which we describe how often gazing at the partner occurred. On the one hand, we aim to identify possible contrasting cases. On the other, we look for tendencies across the run-throughs. We discuss the quantified gaze behaviour in relation to the existing literature and the current research design.


2021 ◽  
pp. 1-19
Author(s):  
Jairo Perez-Osorio ◽  
Abdulaziz Abubshait ◽  
Agnieszka Wykowska

Abstract Understanding others' nonverbal behavior is essential for social interaction, as it allows, among others, to infer mental states. Although gaze communication, a well-established nonverbal social behavior, has shown its importance in inferring others' mental states, not much is known about the effects of irrelevant gaze signals on cognitive conflict markers during collaborative settings. Here, participants completed a categorization task where they categorized objects based on their color while observing images of a robot. On each trial, participants observed the robot iCub grasping an object from a table and offering it to them to simulate a handover. Once the robot “moved” the object forward, participants were asked to categorize the object according to its color. Before participants were allowed to respond, the robot made a lateral head/gaze shift. The gaze shifts were either congruent or incongruent with the object's color. We expected that incongruent head cues would induce more errors (Study 1), would be associated with more curvature in eye-tracking trajectories (Study 2), and induce larger amplitude in electrophysiological markers of cognitive conflict (Study 3). Results of the three studies show more oculomotor interference as measured in error rates (Study 1), larger curvatures eye-tracking trajectories (Study 2), and higher amplitudes of the N2 ERP of the EEG signals as well as higher event-related spectral perturbation amplitudes (Study 3) for incongruent trials compared with congruent trials. Our findings reveal that behavioral, ocular, and electrophysiological markers can index the influence of irrelevant signals during goal-oriented tasks.


Author(s):  
Hanna Jochmann-Mannak ◽  
Leo Lentz ◽  
Theo Huibers ◽  
Ted Sanders

This chapter presents an experiment with 158 children, aged 10 to 12, in which search performance and attitudes towards an informational Website are investigated. The same Website was designed in 3 different types of interface design varying in playfulness of navigation structure and in playfulness of visual design. The type of interface design did not have an effect on children’s search performance, but it did influence children’s feelings of emotional valence and their evaluation of “goodness.” Children felt most positive about the Website with a classical navigation structure and playful aesthetics. They found the playful image map Website least good. More importantly, children’s search performance was much more effective and efficient when using the search engine than when browsing the menu. Furthermore, this chapter explores the challenge of measuring affective responses towards digital interfaces with children by presenting an elaborate evaluation of different methods.


Author(s):  
Jorge Bacca-Acosta ◽  
Julian Tejada ◽  
Carlos Ospino-Ibañez

Learning how to give and follow directions in English is one of the key topics in regular English as a Foreign Language (EFL) courses. However, this topic is commonly taught in the classroom with pencil and paper exercises. In this chapter, a scaffolded virtual reality (VR) environment for learning the topic of following directions in English is introduced. An eye tracking study was conducted to determine how students perceive the scaffolds for completing the learning task, and an evaluation of acceptance and usability was conducted to identify the students' perceptions. The results show that scaffolds in the form of text and images are both effective for increasing the students' learning performance. The gaze frequency is higher for the textual scaffold, but the duration of gaze fixations is lower for the scaffolds in the form of images. The acceptance and usability of the VR environment were found to be positive.


Sign in / Sign up

Export Citation Format

Share Document