Central and Peripheral Cues to Difficulty in a Dynamic Task

Author(s):  
Lisa Vangsness ◽  
Michael E. Young

Background Subjective workload assessments (e.g., NASA-TLX, SWAT, WP) rely upon judgments of difficulty (JODs) and workload to determine how challenging it is for an operator to complete a task. While it is likely that subjective workload assessments are an aggregate product of many cues to difficulty, including internal feelings of effort, that become available during task completion (Cordes, 1993; Kahneman, 2000), moment-to-moment judgments may evolve as additional external cues become available. That is, JODs are likely based to some degree upon internal (privileged) cues and integral task characteristics (central cues), but are also influenced by peripheral cues that serve as a proxy for task difficulty. These dynamic and multifaceted cues affect the choice to initiate tasks (e.g., Mitchell, 2017), comply with safety procedures (e.g., Sigurdsson, Taylor, & Wirth, 2013), and allocate resources (e.g, Kurzban, Duckworth, Kable, & Meyers, 2013), among other things. Identifying common cues that inform JODs contributes to workload theory and defines avenues for workload intervention. Method We developed a 40-minute videogame task that could be used as a laboratory to test people’s sensitivity to two peripheral cues that are present during many tasks: performance-based feedback and time-on-task. These cues became available as participants completed videogame sessions that were identical in instructions and objective, but differed in the source of their difficulty. Specifically, participants were assigned to one of five conditions in which enemy behavior changed along a continuum with respect to: how quickly enemies moved, how much damage enemies dealt to players, how many shots it took to eliminate an enemy character, how quickly enemies appeared in the level, and how close players could be to enemy characters before being chased. These random changes in task speed, feedback, physical effort, timing, and coordination occurred at the beginning of every level (i.e., block of trials). Participants’ JODs were collected at the beginning of each level and every subsequent three minutes by asking them to indicate whether the task was easier or harder than before. Performance-based feedback Participants began each level with 100 hit points of health and received visual and auditory feedback when they came in contact with an enemy character. Crucially, enemy attacks caused participants to lose hit points; when health dropped below 0, the character died and participants had to wait 30 s before resuming the game from a random location within the game space. Self-reported JODs Participants’ JODs were collected at the beginning of each level and every subsequent three minutes by asking them to indicate whether the task was easier or harder than before (Böckenholt, 2004). The task was paused 3s before and after the pop-up window appeared to reduce the performance costs associated with task interruption (Altmann & Trafton, 2007).

Author(s):  
Lisa Vangsness ◽  
Michael Young

Objective: We used this experiment to determine the degree to which cues to difficulty are used to make judgments of difficulty (JODs). Background: Traditional approaches involve seeking to standardize the information people used to evaluate subjective workload; however, it is likely that conscious and unconscious cues underlie peoples’ JODs. Method: We designed a video game task that tested the degree to which time-on-task, performance-based feedback, and central cues to difficulty informed JODs. These relationships were modeled along five continuous dimensions of difficulty. Results: Central cues most strongly contributed to JODs; judgments were supplemented by peripheral cues (performance-based feedback and time-on-task) even though these cues were not always valid. In addition, participants became more likely to rate the task as “easier” over time. Conclusion: Although central cues are strong predictors of task difficulty, people confuse task difficulty (central cues), effort allocation and skill (performance-based feedback), and proxy cues to difficulty (time) when making JODs. Application: Identifying the functional relationships between cues to difficulty and JODs will provide valuable insight regarding the information that people use to evaluate tasks and to make decisions.


Author(s):  
Maryam Attef ◽  
Mireille Cloutier ◽  
Meredith Gillespie ◽  
Chantal Trudel ◽  
Kym Boycott

This quality improvement study focused on developing an understanding of factors influencing the ability of prenatal genetics counsellors (GCs) to efficiently see patients during the COVID-19 pandemic and strategies to improve their workflow using techniques from human factors and design. The demand for Prenatal Genetics Clinics is rising which has increased pressure on GCs to become more efficient. Genetics counsellors can improve access to their services by reducing the time spent on the tasks performed before and after a genetic counselling encounter, thereby increasing the number of patients they see. We were limited to certain methods to understand the differences in workflow before and during the COVID-19 pandemic. This study involved a literature review, archival analysis of workflow studies conducted before the pandemic, stakeholder meetings and mapping, a brainstorming session, as well as documenting time-on-task in a diary and naturalistic observation sessions. A task analysis was developed to identify factors influencing efficiency related to the design of the space, processes and the use of artefacts. Virtual and on-site workflows show that GCs spend at least half of their time on tasks before and/or after the patient’s appointment. Looking at potential inefficiencies or bottlenecks in workflow formed the development of a strategic plan for improving GC workflows at the prenatal Genetics Clinic. Improvements suggested through this analysis were constrained to support the current number of healthcare providers working within the existing space configuration.


2021 ◽  
Vol 13 (2) ◽  
pp. 654
Author(s):  
Meng-Han Tsai ◽  
Hao-Yung Chan ◽  
Yi-Lin Chan ◽  
Heng-Kuang Shen ◽  
Pei-Yi Lin ◽  
...  

This study developed a chatbot to improve the efficiency of government activation of mine safety procedures during natural disasters. Taiwan has a comprehensive governmental system dedicated to responding to frequent natural disasters, and the Bureau of Mines has instituted clear procedures to ensure the delivery of disaster alarms and damage reports. However, the labor- and time-consumption procedures are inefficient. In this study, we propose a system framework for disaster-related information retrieval and immediate notifications to support the execution of mine safety procedures. The framework utilizes instant messaging (IM) applications as the user interface to look up information and send messages to announce the occurrence of disaster events. We evaluated the efficiency of the procedures before and after adopting the system and achieved a time-cost reduction of 55.8 min among three types of disaster events. The study has proven the feasibility of adopting novel techniques for decision-making and assures the improvement of the efficiency and effectiveness of the procedure activation.


2020 ◽  
Vol 58 (8) ◽  
pp. 1494-1514
Author(s):  
Zsófia Vörös ◽  
Dániel Kehl ◽  
Jean-François Rouet

To be able to solve complex information problems in a digital environment is a key 21st century skill. Technology users usually expect to achieve their goals in a fast and accurate way. However, the actual relationship between time-on-task and task outcome is currently not well understood. We analyzed data from a large-scale international study in which representative samples of adults had to solve more or less complex problems using standard computer applications. Our results indicate that different task characteristics influence the relationship between problem-solving performance and time-on-task in specific ways. Spending more time on a task is more likely to compensate an average problem solver when task complexity can be attributed to intrinsic task and technology drivers than when complexity stems from the cognitive/metacognitive activities belonging to information problem-solving processes per se, especially acquiring and evaluating information. Thus, the interpretation of time-on-task should take the source of difficulty into consideration. Implications for personal and professional development are discussed.


2019 ◽  
Vol 131 (1) ◽  
pp. 36-45 ◽  
Author(s):  
Nan Lin ◽  
Ruquan Han ◽  
Xuan Hui ◽  
Kaiying Zhang ◽  
Adrian W. Gelb

Abstract Editor’s Perspective What We Already Know about This Topic What This Article Tells Us That Is New Background Midazolam has been found to exacerbate or unmask limb motor dysfunction in patients with brain tumors. This study aimed to determine whether the exacerbated upper limb motor-sensory deficits are mediated through benzodiazepine sites by demonstrating reversibility by flumazenil in patients with gliomas in eloquent areas. Methods This was an interventional, parallel assignment, nonrandomized trial. Study subjects were admitted in the operating room. Patients with supratentorial eloquent area gliomas and volunteers of similar age without neurologic disease were sedated with midazolam, but still responsive and cooperative. Motor and sensory functions for upper extremities were evaluated by the Nine-Hole Peg Test before and after midazolam, as well as after flumazenil reversal. Results Thirty-two cases were included: 15 in the glioma group and 17 in the control group. The total dose of midazolam and flumazenil were comparable between the groups. In the glioma group, the times to task completion after midazolam in the contralateral hand (P = 0.001) and ipsilateral hand (P = 0.002) were 26.5 (95% CI, 11.3 to 41.7) and 13.7 (95% CI, 5.0 to 22.4) seconds slower than baseline, respectively. After flumazenil reversal, the contralateral hand (P = 0.99) and ipsilateral hand (P = 0.187) performed 1.2 (95% CI, −3.3 to 5.8) and 1.5 (95% CI, −0.5 to 3.5) seconds slower than baseline, respectively. In the control group, the dominant (P < 0.001) and nondominant hand (P = 0.006) were 2.9 (95% CI, 1.4 to 4.3) and 1.7 (95% CI, 0.5 to 2.9) seconds slower than baseline, respectively. After flumazenil, the dominant hand (P = 0.99) and nondominant hand (P = 0.019) performed 0.2 (95% CI, −0.7 to 1.0) and 1.3 (95% CI, −0.2 to 2.4) seconds faster than baseline, respectively. Conclusions In patients with eloquent area gliomas, mild sedation with midazolam induced motor coordination deficits in upper limbs. This deficit was almost completely reversed by the benzodiazepine antagonist flumazenil, suggesting that this is a reversible abnormality linked to occupation of the receptor by midazolam.


2020 ◽  
Vol 31 (3) ◽  
pp. 306-315 ◽  
Author(s):  
Lisa Vangsness ◽  
Michael E. Young

Standard approaches for identifying task-completion strategies, such as precrastination and procrastination, reduce behavior to single markers that oversimplify the process of task completion. To illustrate this point, we consider three task-completion strategies and introduce a new method to identify their use. This approach was tested using an archival data set (N = 8,655) of the available electronic records of research participation at Kansas State University. The approach outperformed standard diagnostic approaches and yielded an interesting finding: Several strategies were associated with negative outcomes. Specifically, both procrastinators and precrastinators struggled to finish tasks on time. Together, these findings underscore the importance of using holistic approaches to determine the relationship among task characteristics, individual differences, and task completion.


1999 ◽  
Vol 20 (3) ◽  
pp. 170-183 ◽  
Author(s):  
Joseph F. Kovaleski ◽  
Edward E. Gickling ◽  
Henry Morrow ◽  
Paul R. Swank

In 1990, the Commonwealth of Pennsylvania implemented a statewide instructional support team (IST) process to provide prereferral assessment and intervention for at-risk students in 500 school districts. The current study examined the academic performance of students affected by this process as contrasted with other at-risk students who did not have access to it. The dependent measures were academic learning time (time on task, task completion, and task comprehension). The results indicated that students supported by ISTs had greater levels of academic performance only when their schools implemented the IST process to a high degree. Low IST implementation produced no differences in academic performance in schools that had not implemented IST. The importance of implementing a promising program according to critical design features is discussed.


Author(s):  
Anthony J. Aretz ◽  
Chris Johannsen ◽  
Keith Ober

A correlational design was used to regress NASA TLX subjective workload ratings onto several potential independent variables (i.e., the number of concurrent tasks, task combination, task resource demands, and flight experience) to determine task characteristics that influence pilot subjective workload ratings. A part task simulator was used to present up to six concurrent tasks, in different combinations, to 27 cadets at the USAF Academy. The results indicated the number of concurrent tasks had the largest impact on subjective workload ratings. In terms of multiple resource theory, spatial, verbal, and visual demands (in that order) contributed the most variance. The implication for theoreticians and designers is that the number of concurrent tasks, mental resource demands, and time constraints seem to be key contributors to subjective workload ratings.


2013 ◽  
Vol 5 (3) ◽  
pp. 427-432
Author(s):  
Kathlyn E. Fletcher ◽  
Alexis M. Visotcky ◽  
Jason M. Slagle ◽  
Sergey Tarima ◽  
Jeff Whittle ◽  
...  

Abstract Background Workload has traditionally been measured by using surrogates, such as number of patients admitted or census, but these may not fully represent the complex concept of workload. Objective We measured self-reported subjective workload of interns and explored the relationship between subjective workload and possible predictors of it. Methods Trained research assistants observed internal medicine interns on call on a general medicine service. Approximately once an hour, the research assistants recorded the self-reported subjective workload of the interns by using Borg's Self-Perceived Exertion Scale, a 6 to 20 scale, and also recorded their own perceptions of the intern's workload. Research assistants continuously recorded the tasks performed by the interns. Interns were surveyed before and after the observation to obtain demographic and census data. Results Our sample included 25 interns, with a mean age of 28.6 years (SD, 2.4 years). Mean self-reported subjective workload was 12.0 (SD, 2.4). Mean self-reported subjective workload was significantly correlated with intern age (r  =  0.49, P < .05), but not with team or intern census, number of admissions, or number of patients cross-covered. Self-reported subjective workload in the period after sign-out was significantly higher than in the period before and during sign-out (P < .001). Conclusions Self-reported subjective workload was not associated with traditional measures of workload. However, receiving sign-out and assuming the care of cross-coverage patients may be related to higher subjective workload in interns. Given the patient safety implications of workload, it is important that the medical education community have tools to evaluate workload and identify contributors to it.


Sign in / Sign up

Export Citation Format

Share Document