Crosschecking through verbal reports under spatial disorientation scenarios: Evidence from eye tracking metrics

2021 ◽  
Vol 86 ◽  
pp. 103202
Author(s):  
Yohan Kang ◽  
May Jorella Lazaro ◽  
Sungho Kim
2021 ◽  
pp. 181
Author(s):  
Eduardo Santos Junqueira Rodrigues ◽  
Cátia Luzia Oliveira Silva ◽  
Andrei Bosco Bezerra Torres ◽  
Elisângela Nogueira Teixeira

O artigo apresenta os resultados do mapeamento da interação de 30 alunos universitários ao utilizarem três distintas interfaces de fórum virtuais para estudar. A pesquisa utilizou o método do rastreamento ocular e entrevistas semi-estruturadas para documentar e analisar o processo de navegação dos alunos ao participarem e publicarem comentários nos fóruns. A análise dos dados indicou que interfaces de fórum virtual com design mais tradicional, intuitivo e minimalista, e com menor e mais racional disposição de elementos imagéticos, beneficia o aluno em situações de aprendizagem. Esse tipo de interface evita a frustração, perda de tempo e de foco na tarefa, permitindo o uso efetivo da atenção e memória do aluno na compreensão de conteúdos e resolução de problemas. Movimentos oculares indesejáveis dos alunos indicaram desorientação espacial e sobrecarga cognitiva causada por elementos clicáveis da interface dos fóruns, que foram prejudiciais à navegação dos alunos e, por isso, devem ser evitados, podendo levá-los a abandonar o fórum. Elementos imagéticos acessórios presentes na interface não interferiram negativamente com a tarefa dos alunos, pois foram ignorados por eles durante a navegação nos fóruns, como comprovado pela ausência de fixação ocular. O uso de um fórum de um ambiente virtual de aprendizagem (AVA) padrão tradicional não indicou vantagens para a navegação e realização de atividades quando comparado, pelos alunos, a um fórum generalista de design intuitivo, consistente e minimalista.Palavras-chave: Aprendizagem on-line; Navegação; Fórum virtual; Rastreamento ocular.Analysis, through the eye tracking technique, of virtual forum interfaces features that raise on-line learningAbstractThe article presents the results of mapped interaction of 30 university students using three different digital forum interfaces to study. The research utilized the eye tracking method and semi-structured interviews to document and analyze the students' browsing process as they participated in and published on the forums. Data analysis indicated that virtual forum interfaces with a more traditional, intuitive and minimalist design, and with a smaller and more rational array of imaging elements, benefit the student in learning situations. This type of interface avoids frustration, wasted time, and it increases focus on the task, allowing effective use of student attention and memory in understanding content and problem solving. Undesirable eye movements of the students indicated spatial disorientation and cognitive overload caused by clickable elements of the forum interface, which were detrimental to student navigation and therefore should be avoided and may lead them to leave the forum. Imaging elements accessories present in the interface did not interfere negatively with the students' task, as they were ignored by them during navigation in the forums, as evidenced by the absence of ocular fixation. The use of a traditional standard learning management system (LMS) forum did not indicate advantages for browsing and performing activities when compared to an intuitive, consistent and minimalist generalist designed forum.Keywords: Online learning; Navigation; Virtual fórum; Eye tracking.Análisis, a través de la técnica de rastreo ocular, de interfaces de foro virtual que favorece el aprendizaje on-lineResumenEl artículo presenta los resultados de la interacción mapeada de 30 estudiantes universitarios que utilizan tres interfaces de foros digitales diferentes para estudiar. La investigación utilizó el método de seguimiento ocular y entrevistas semiestructuradas para documentar y analizar el proceso de navegación de los estudiantes a medida que participaban y publicaban en los foros. El análisis de los datos indicó que los foros virtuales interactúan con un diseño más tradicional, intuitivo y minimalista, y con una gama más pequeña y más racional de elementos de imagen, beneficiando al estudiante en situaciones de aprendizaje. Este tipo de interfaz evita la frustración, el tiempo perdido y aumenta el enfoque en la tarea, permitiendo el uso efectivo de la atención y la memoria del alumno para comprender el contenido y la resolución de problemas. Los movimientos oculares indeseables de los estudiantes indicaron desorientación espacial y sobrecarga cognitiva causada por elementos seleccionables de la interfaz del foro, que fueron perjudiciales para la navegación del estudiante y, por lo tanto, deben evitarse y pueden llevarlos a abandonar el foro. Los accesorios de elementos de imagen presentes en la interfaz no interfirieron negativamente con la tarea de los estudiantes, ya que fueron ignorados por ellos durante la navegación en los foros, como lo demuestra la ausencia de fijación ocular. El uso de un foro de anbiente virtual de aprendziagen estándar tradicional no indicaba ventajas para navegar y realizar actividades en comparación con un foro diseñado por un general intuitivo, coherente y minimalista. Palabras clave: Aprender en línea; Navegación; Foro virtual; Registro visual.


Author(s):  
Yohan Kang ◽  
Myung Hwan Yun ◽  
Sungho Kim

Spatial disorientation (SD) can adversely affect a pilot’s flight mission and cause critical flight accidents. To ensure a pilot’s flight safety, it is important to understand the impact of SD on a pilot’s flight performance and mental stress levels, and it is necessary to verify the effectiveness of using verbal reports (VR) for pilots to overcome SD without the aid of aeronautical systems. Therefore, the purpose of this study is to analyze the difference in pilot performance and mental stress levels by VR executions and SD types. In this study, simulated flight experiments were performed on thirty Air Force fighter pilots (fifteen VR and fifteen non-VR) using a SD simulator with an Electrocardiography (ECG) measurement sensor attached. The experimental data was analyzed with using two flight performance scales (instructor evaluation scores and self-evaluation scores) and two mental stress scales (heart rate variability (HRV) measures and subjective stress scores) by two VR executions (VR and non-VR) and six SD types (Somatogravic Illusion, Coriolis, Leans, False Horizon, Graveyard Spin, and Black Hole Illusion). The result of the experiment, in terms of flight performance, showed a significant difference in instructor evaluation scores for VR execution, and in both instructor evaluation scores and self-evaluation scores for SD types. On the other hand, in terms of mental stress, there was a significant difference in both high frequency (HF) of HRV measures and subjective stress scores for VR execution, and in subjective stress scores for SD types. The results of this study can help pilots understand SD situations and overcome SD by executing VR.


2021 ◽  
Author(s):  
Susanny Cristini Vercellino Tassini ◽  
Mariana Cardoso Melo ◽  
Claudia Berlim de Mello ◽  
Orlando Francisco Amodeo Bueno

Central coherence theory proposes that a specific perceptual-cognitive process that limits the ability to derive overall meaning from details underlies the central disturbance in autism spectrum disorder (ASD). In a social context, it may interfere with the ability of individuals with ASD to understand interactions between people by recognizing emotional clues or attributing a particular mental state, and to play a role in the social difficulties associated with ASD. A sample of 28 adults diagnosed with ASD Level 1 and 25 controls were submitted to a cartoon-like task with the instruction to describe social scenes and a Navon letter task. Both quantitative measures and qualitative (thematic content analysis) procedures were used to assess performance. Heatmap and fixation preferences according to the stimuli quadrants were used to investigate eye-tracking patterns. A tendency to local processing, independently of the stimuli type, in the ASD participants was seen. In social scenes, quadrants with components such as characters' faces were neglected, resulting in a loss of implicit content related to interactions, as evidenced by verbal reports. A significantly longer reaction times and response durations in ASD. The findings corroborate the idea that weak central coherence may be part of the cognitive phenotype in ASD.


2020 ◽  
Vol 91 (12) ◽  
pp. 948-955
Author(s):  
Yohan Kang ◽  
Myung Hwan Yun ◽  
Sungho Kim

BACKGROUND: Circumstances in flight can adversely affect a pilots spatial abilities and lead to spatial disorientation (SD), increasing the potential for fatal accidents. To systematically understand the impact of SD, it is important to quantitatively and qualitatively analyze pilots flight performance and mental stress, and to verify the effectiveness of verbal reports (VR) in enabling pilots to deal with an SD situation. This study investigated the effects of VR execution and type of SD on flight performance and mental stress.METHODS: SD simulation experiments were conducted on 30 Air Force fighter pilots (15 in the VR group and 15 in the non-VR group) with electrocardiography (ECG) sensors attached. The pilots gave their VRs by immediately verbalizing their attention to instrument information and six potentially disorientating scenarios were implemented in each flight phase. Flight performance was analyzed using instructor evaluation and self-evaluation scores, and mental stress was measured using heart rate variability (HRV) and perceived distress score.RESULTS: In maintaining flight performance, the VR group, respectively, had 8% and 10% higher scores for altitude and speed than the non-VR group. The self-evaluation scores were lowest for Coriolis, while Graveyard Spin was scored lowest in the instructor evaluations. Regarding mental stress, the VR group tended to have higher HFs and lower LF/HF ratios among HRV measures than the non-VR group, and an 11% lower perceived distress score. The highest perceived distress score was for Coriolis.DISCUSSION: We suggest that pilots can be assisted to understand and overcome SD situations through VR.Kang Y, Yun MH, Kim S. Verbal reports influence on pilot flight performance and mental stress under spatial disorientation. Aerosp Med Hum Perform. 2020; 91(12):948955.


Author(s):  
Mariya Pachman ◽  
Amaël Arguel ◽  
Lori Lockyer ◽  
Gregor Kennedy ◽  
Jason Lodge

Research on incidence of and changes in confusion during complex learning and problem-solving calls for advanced methods of confusion detection in digital learning environments (DLEs). In this study we attempt to address this issue by investigating the use of multiple measures, including psychophysiological indicators and self-ratings, to detect confusion in DLEs. Participants were subjected to two intrinsically confusing insight problems in the form of visual digital puzzles. They were asked to solve problems while their eye trajectories were recorded and these data were triangulated with self-ratings of confusion and cued retrospective verbal reports. All participants had a significant increase in fixations on relevant (i.e., related to the solution) and not-relevant areas at an early stage of the problem-solving process. However, only fixations on not-relevant areas were positively correlated with confusion ratings. Moreover, participants who significantly solved the problem differed in their fixations duration on relevant and not-relevant areas from non-solvers. The importance of early detection of confusion and the affordances of emerging technologies for this purpose are discussed.


2020 ◽  
Vol 63 (7) ◽  
pp. 2245-2254 ◽  
Author(s):  
Jianrong Wang ◽  
Yumeng Zhu ◽  
Yu Chen ◽  
Abdilbar Mamat ◽  
Mei Yu ◽  
...  

Purpose The primary purpose of this study was to explore the audiovisual speech perception strategies.80.23.47 adopted by normal-hearing and deaf people in processing familiar and unfamiliar languages. Our primary hypothesis was that they would adopt different perception strategies due to different sensory experiences at an early age, limitations of the physical device, and the developmental gap of language, and others. Method Thirty normal-hearing adults and 33 prelingually deaf adults participated in the study. They were asked to perform judgment and listening tasks while watching videos of a Uygur–Mandarin bilingual speaker in a familiar language (Standard Chinese) or an unfamiliar language (Modern Uygur) while their eye movements were recorded by eye-tracking technology. Results Task had a slight influence on the distribution of selective attention, whereas subject and language had significant influences. To be specific, the normal-hearing and the d10eaf participants mainly gazed at the speaker's eyes and mouth, respectively, in the experiment; moreover, while the normal-hearing participants had to stare longer at the speaker's mouth when they confronted with the unfamiliar language Modern Uygur, the deaf participant did not change their attention allocation pattern when perceiving the two languages. Conclusions Normal-hearing and deaf adults adopt different audiovisual speech perception strategies: Normal-hearing adults mainly look at the eyes, and deaf adults mainly look at the mouth. Additionally, language and task can also modulate the speech perception strategy.


2011 ◽  
Vol 70 (1) ◽  
pp. 35-39 ◽  
Author(s):  
Muriel Fanget ◽  
Catherine Thevenot ◽  
Caroline Castel ◽  
Michel Fayol

In this study, we used a paradigm recently developed ( Thevenot, Fanget, & Fayol, 2007 ) to determine whether 10-year-old children solve simple addition problems by retrieval of the answer from long-term memory or by calculation procedures. Our paradigm is unique in that it does not rely on reaction times or verbal reports, which are known to potentially bias the results, especially in children. Rather, it takes advantage of the fact that calculation procedures degrade the memory traces of the operands, so that it is more difficult to recognize them when they have been involved in the solution of an addition problem by calculation rather than by retrieval. The present study sharpens the current conclusions in the literature and shows that, when the sum of addition problems is up to 10, children mainly use retrieval, but when it is greater than 10, they mainly use calculation procedures.


Author(s):  
Pirita Pyykkönen ◽  
Juhani Järvikivi

A visual world eye-tracking study investigated the activation and persistence of implicit causality information in spoken language comprehension. We showed that people infer the implicit causality of verbs as soon as they encounter such verbs in discourse, as is predicted by proponents of the immediate focusing account ( Greene & McKoon, 1995 ; Koornneef & Van Berkum, 2006 ; Van Berkum, Koornneef, Otten, & Nieuwland, 2007 ). Interestingly, we observed activation of implicit causality information even before people encountered the causal conjunction. However, while implicit causality information was persistent as the discourse unfolded, it did not have a privileged role as a focusing cue immediately at the ambiguous pronoun when people were resolving its antecedent. Instead, our study indicated that implicit causality does not affect all referents to the same extent, rather it interacts with other cues in the discourse, especially when one of the referents is already prominently in focus.


Sign in / Sign up

Export Citation Format

Share Document