Using Saccadic Intrusions to Quantify Mental Workload

This paper describes two methodological innovations in the study of adaptive training. The first is the use of a yoked design to insure that the average level of task difficulty for fixed-difficulty subjects is the same as the average level of difficulty reached by adaptive subjects. The second is the demonstration of the feasibility of using a secondary (subsidiary, non-loading) task to furnish the adaptive criterion for changing the difficulty level of the primary task. The results of two experiments are reported. Both experiments demonstrate the feasibility and utility of yoked design and adaptation on secondary task performance in adaptive training.

Download Full-text

Workload assessment for mental arithmetic tasks using the task-evoked pupillary response

10.7287/peerj.preprints.1105v2 ◽

2015 ◽

Author(s):

Gerhard Marquart ◽

Joost de Winter

Keyword(s):

Mental Arithmetic ◽

Pupil Diameter ◽

Mental Workload ◽

Self Report ◽

Blink Rate ◽

Eye Tracker ◽

Practical Applications ◽

The Mean ◽

Nasa Tlx ◽

Diameter Change

Pupillometry is a promising method for assessing mental workload and could be helpful in the optimization of systems that involve human-computer interaction. The present study focuses on replicating the studies by Ahern (1978) and Klingner (2010), which found that for three levels of difficulty of mental multiplications, the more difficult multiplications yielded larger dilations of the pupil. Using a remote eye tracker, our research expands upon these two previous studies by statistically testing for each 1.5 s interval of the calculation period (1) the mean absolute pupil diameter (MPD), (2) the mean pupil diameter change (MPDC) with respect to the pupil diameter during the pre-stimulus accommodation period, and (3) the mean pupil diameter change rate (MPDCR). An additional novelty of our research is that we compared the pupil diameter measure with a self-report measure of workload, the NASA Task Load Index (NASA-TLX), and with the mean blink rate (MBR). The results showed that the findings of Ahern and Klingner were replicated, and that the MPD and MPDC discriminated just as well between the lowest and highest difficulty levels as did the NASA-TLX. The MBR, on the other hand, did not interpretably differentiate between the difficulty levels. Moderate to strong correlations were found between the MPDC and the proportion of incorrect responses, indicating that the MPDC was higher for participants with a poorer performance. For practical applications, validity could be improved by combining pupillometry with other physiological techniques.

Download Full-text

On the Cost of Detection Response Task Performance on Cognitive Load

Human Factors The Journal of the Human Factors and Ergonomics Society ◽

10.1177/0018720820931628 ◽

2020 ◽

pp. 001872082093162 ◽

Cited By ~ 1

Author(s):

Francesco N. Biondi ◽

Balakumar Balasingam ◽

Prathamesh Ayare

Keyword(s):

Cognitive Load ◽

Task Performance ◽

Pupil Diameter ◽

Mental Workload ◽

Measuring System ◽

Cognitive Resources ◽

Task Load ◽

Detection Response ◽

Response Task ◽

The Cost

Objective This study investigates the cost of detection response task performance on cognitive load. Background Measuring system operator’s cognitive load is a foremost challenge in human factors and ergonomics. The detection response task is a standardized measure of cognitive load. It is hypothesized that, given its simple reaction time structure, it has no cost on cognitive load. We set out to test this hypothesis by utilizing pupil diameter as an alternative metric of cognitive load. Method Twenty-eight volunteers completed one of four experimental tasks with increasing levels of cognitive demand (control, 0-back, 1-back, and 2-back) with or without concurrent DRT performance. Pupil diameter was selected as nonintrusive metric of cognitive load. Self-reported workload was also recorded. Results A significant main effect of DRT presence was found for pupil diameter and self-reported workload. Larger pupil diameter was found when the n-back task was performed concurrently with the DRT, compared to no-DRT conditions. Consistent results were found for mental workload ratings and n-back performance. Conclusion Results indicate that DRT performance produced an added cost on cognitive load. The magnitude of the change in pupil diameter was comparable to that observed when transitioning from a condition of low task load to one where the 2-back was performed. The significant increase in cognitive load accompanying DRT performance was also reflected in higher self-reported workload. Application DRT is a valuable tool to measure operator’s cognitive load. However, these results advise caution when discounting it as cost-free metric with no added burden on operator’s cognitive resources.

Download Full-text

Instantaneous Measures of Mental Workload: An Initial Investigation

Proceedings of the Human Factors Society Annual Meeting ◽

10.1177/154193128402800104 ◽

1984 ◽

Vol 28 (1) ◽

pp. 6-10 ◽

Cited By ~ 3

Author(s):

Jonathan F. Antin ◽

Walter W. Wierwille

Keyword(s):

Task Performance ◽

Short Term Memory ◽

Mental Workload ◽

Time Estimation ◽

Primary Task ◽

Great Promise ◽

Short Term ◽

Storage And Retrieval ◽

Subjective Opinion ◽

Computer Tasks

Many researchers have implicitly or explicitly averaged measures of mental workload over a given run or period of time. This process tends to mask specific features (e.g. peaks) of interest in the flow of instantaneous mental workload (IMWL). A study was conducted in which thirty subjects performed computer tasks which quantifiably varied in difficulty during a run. These tasks emphasized perceptual, mediational, psychomotor, and storage and retrieval from short-term memory processes. Data were gathered on the following candidate measures of momentary load: instantaneous primary task performance, instantaneous Michon tapping and time estimation secondary task performance, instantaneous pulse and respiration rates, and two types of online subjective opinion. Data were short-term averaged and used to develop regression models to evaluate the ability of the measures to track IMWL. Primary task performance (response time for functional subtasks) and both forms of online subjective opinion measures showed great promise as measures of IMWL.

Download Full-text

Workload assessment for mental arithmetic tasks using the task-evoked pupillary response

10.7287/peerj.preprints.1105 ◽

2015 ◽

Author(s):

Gerhard Marquart ◽

Joost de Winter

Keyword(s):

Mental Arithmetic ◽

Pupil Diameter ◽

Mental Workload ◽

Self Report ◽

Blink Rate ◽

Eye Tracker ◽

Practical Applications ◽

The Mean ◽

Nasa Tlx ◽

Diameter Change

Pupillometry is a promising method for assessing mental workload and could be helpful in the optimization of systems that involve human-computer interaction. The present study focuses on replicating the studies by Ahern (1978) and Klingner (2010), which found that for three levels of difficulty of mental multiplications, the more difficult multiplications yielded larger dilations of the pupil. Using a remote eye tracker, our research expands upon these two previous studies by statistically testing for each 1.5 s interval of the calculation period (1) the mean absolute pupil diameter (MPD), (2) the mean pupil diameter change (MPDC) with respect to the pupil diameter during the pre-stimulus accommodation period, and (3) the mean pupil diameter change rate (MPDCR). An additional novelty of our research is that we compared the pupil diameter measure with a self-report measure of workload, the NASA Task Load Index (NASA-TLX), and with the mean blink rate (MBR). The results showed that the findings of Ahern and Klingner were replicated, and that the MPD and MPDC discriminated just as well between the lowest and highest difficulty levels as did the NASA-TLX. The MBR, on the other hand, did not interpretably differentiate between the difficulty levels. Moderate to strong correlations were found between the MPDC and the proportion of incorrect responses, indicating that the MPDC was higher for participants with a poorer performance. For practical applications, validity could be improved by combining pupillometry with other physiological techniques.

Download Full-text

Mental Workload and the Display of Abstraction Hierarchy Information

Proceedings of the Human Factors and Ergonomics Society Annual Meeting ◽

10.1177/154193120204600304 ◽

2002 ◽

Vol 46 (3) ◽

pp. 235-239 ◽

Cited By ~ 2

Author(s):

Catherine M. Burns ◽

Laura K. Thompson ◽

Antonio Rodriguez

Keyword(s):

Preliminary Data ◽

Pupil Diameter ◽

Mental Workload ◽

Tracking Data ◽

Eye Tracker ◽

Time Condition ◽

Multiple Levels ◽

The One ◽

Speed And Accuracy ◽

Over Time

In designing large ecological displays, designers are faced with the question of how to display multiple levels of abstract information. Previous research has shown that people may perform better, in terms of diagnosis speed and accuracy, if multiple levels of information are presented in an integrated format (Burns, 2000). We repeated the study of Burns (2000) which looks at providing abstract information in three formats - one level at a time, windowed and integrated. We collected eye tracking data at intervals throughout the experiment. Our eye-tracker was able to collect pupil diameter measures and changes. Results showed no notable difference in pupil diameter measures between the integrated condition and the one level at a time condition, but notably higher increases in pupil diameter when abstract information was in separate windows. Furthermore, pupil diameters increased over time in the windowed condition, suggesting that workload with this display may have been increasing. These preliminary data suggest that separating levels of abstract information may increase the mental workload of operators.

Download Full-text

The Assessment of Workload: Dual Task Methodology

Proceedings of the Human Factors Society Annual Meeting ◽

10.1177/154193128302700311 ◽

1983 ◽

Vol 27 (3) ◽

pp. 229-233 ◽

Cited By ~ 5

Author(s):

Arthur D. Fisk ◽

William L. Derrick ◽

Walter Schneider

Keyword(s):

Task Performance ◽

Dual Task ◽

Secondary Task ◽

Task Difficulty ◽

Primary Task ◽

Operator Workload

The present paper outlines three major assumptions often implicitly assumed in dual task experiments conducted to assess operator workload. These assumptions are shown to be incorrect. Three criteria which should be met in dual task experiments that draw inferences from secondary task decrements are discussed. An experiment, meeting the proposed criteria, was conducted which demonstrated that when the criteria are met secondary task performance can be predictive of primary task difficulty. However, the data also indicate that a simple assessment of effort alone will not predict total task performance.

Download Full-text

Workload assessment for mental arithmetic tasks using the task-evoked pupillary response

10.7287/peerj.preprints.1105v1 ◽

2015 ◽

Author(s):

Gerhard Marquart ◽

Joost de Winter

Keyword(s):

Mental Arithmetic ◽

Pupil Diameter ◽

Mental Workload ◽

Pupillary Response ◽

Self Report ◽

Blink Rate ◽

Eye Tracker ◽

Strong Correlations ◽

Practical Applications ◽

Diameter Change

Pupillometry is a promising method for assessing mental workload and could be helpful in the optimization of systems that involve human-computer interaction. The present study focuses on replicating the pupil diameter study by Ahern (1978) for mental multiplications of varying difficulty, using an automatic remote eye tracker. Our results showed that the findings of Ahern were replicated and that the mean pupil diameter and mean pupil diameter change (MPDC) discriminated just as well between the three difficulty levels as did a self-report questionnaire of mental workload (NASA-TLX). A higher mean blink rate was observed during the multiplication period for the highest level of difficulty in comparison with the other two levels. Moderate to strong correlations were found between the MPDC and the proportion of incorrect responses, indicating that the MPDC was higher for participants with a lower performance. For practical applications, validity could be improved by combining pupillometry with other physiological techniques.

Download Full-text

Effects of Performance and Task Duration on Mental Workload during Working Memory Task

Photonics ◽

10.3390/photonics6030094 ◽

2019 ◽

Vol 6 (3) ◽

pp. 94 ◽

Cited By ~ 4

Author(s):

Kosar Khaksari ◽

Emma Condy ◽

John Millerhagen ◽

Afrouz Anderson ◽

Hadis Dashtestani ◽

...

Keyword(s):

Working Memory ◽

Learning Process ◽

Task Difficulty ◽

Mental Workload ◽

Memory Task ◽

Behavioral Data ◽

Significant Difference ◽

The Difference ◽

Different Levels ◽

Back Task

N-back is a working memory (WM) task to study mental workload on the prefrontal cortex (PFC). We assume that the subject’s performance and changes in mental workload over time depends on the length of the experiment. The performance of the participant can change positively due to the participant’s learning process or negatively because of objective mental fatigue and/or sleepiness. In this pilot study, we examined the PFC activation of 23 healthy subjects while they performed an N-back task with two different levels of task difficulty (2-, and 3-back). The hemodynamic responses were analyzed along with the behavioral data (correct answers). A comparison was done between the hemodynamic activation and behavioral data between the two different task levels and between the beginning and end of the 3-back task. Our results show that there is a significant difference between the two task levels, which is due to the difference in task complication. In addition, a significant difference was seen between the beginning and end of the 3-back task in both behavioral data and hemodynamics due to the subject’s learning process throughout the experiment.

Download Full-text