Workload, Error Detection, and Experienced Stress in a Simulated Pharmacy Verification Task

2002 ◽  
Vol 95 (1) ◽  
pp. 27-46 ◽  
Author(s):  
Sean Reilley ◽  
Anthony F. Grasha ◽  
John Schafer

The relationships among workload, stress, and performance efficiency are topics of applied interest and theoretical importance to researchers concerned with human performance. Such interest extends to a variety of occupational areas including inpatient, outpatient, and community pharmacies. In that context, these relationships have become a consumer health issue given concerns that workload contributes to job stress and a significant decline in dispensing accuracy. In the present study, 102 trained college-aged individuals evaluated simulated pharmacy prescriptions for errors under conditions of either low workload (72 orders over 120 min. on task) or high workload (120 orders over 120 min. on task) in a high-fidelity simulated pharmacy environment. Overall, cumulative and detection theory indices of error detection were compatible with estimates from pharmacy field studies. When rates of sensitivity and specificity for detection were examined, substantial variations in the identification of errors (sensitivity) and difficulties with detection of data-entry mistakes were observed in the high workload condition, but only modest effects emerged for the low workload condition. Although increases in objective workload were associated with modest declines in detection accuracy, objective workload did nor significantly affect negative mood (Mood Adjective Checklist) or perceived workload (NASA-Task Load Index) as expected.

2017 ◽  
Vol 5 (1) ◽  
pp. 148-159 ◽  
Author(s):  
Louisa D. Raisbeck ◽  
Jed A. Diekfuss

Performance benefits exist for an external focus of attention compared with an internal focus of attention for performance and learning (Wulf, 2013). It is unknown, however, if varying the number of verbal cues affects learning and performance. Focus of attention and the number of verbal cues were manipulated during a simulated handgun-shooting task. For the internal focus conditions, participants were told to focus on their hand, arm, and wrist, whereas the external focus instructions were to focus on the gun, gun barrel, and gun stock. To manipulate the number of verbal cues, participants received instruction to focus on a single verbal cue or multiple verbal cues. Shooting performance was assessed at baseline, acquisition, and at two separate retention phases (immediate, delayed) that included transfer tests. Participants completed the NASA—Task Load Index to assess workload following all trials. Participants who received one verbal cue performed significantly better during immediate retention than those who received three verbal cues. Participants who used external focus of attention instructions had higher performance and reported less workload at delayed retention compared to those who used internal focus instructions. This research provides further support for the benefits of an external focus and highlights the importance of minimizing the number of verbal cues.


2016 ◽  
Vol 23 (6) ◽  
pp. 1113-1120 ◽  
Author(s):  
Lukasz M Mazur ◽  
Prithima R Mosaly ◽  
Carlton Moore ◽  
Elizabeth Comitz ◽  
Fei Yu ◽  
...  

Abstract Objective To assess the relationship between (1) task demands and workload, (2) task demands and performance, and (3) workload and performance, all during physician-computer interactions in a simulated environment. Methods Two experiments were performed in 2 different electronic medical record (EMR) environments: WebCIS ( n = 12) and Epic ( n = 17). Each participant was instructed to complete a set of prespecified tasks on 3 routine clinical EMR-based scenarios: urinary tract infection (UTI), pneumonia (PN), and heart failure (HF). Task demands were quantified using behavioral responses (click and time analysis). At the end of each scenario, subjective workload was measured using the NASA-Task-Load Index (NASA-TLX). Physiological workload was measured using pupillary dilation and electroencephalography (EEG) data collected throughout the scenarios. Performance was quantified based on the maximum severity of omission errors. Results Data analysis indicated that the PN and HF scenarios were significantly more demanding than the UTI scenario for participants using WebCIS ( P < .01), and that the PN scenario was significantly more demanding than the UTI and HF scenarios for participants using Epic ( P < .01). In both experiments, the regression analysis indicated a significant relationship only between task demands and performance ( P < .01). Discussion Results suggest that task demands as experienced by participants are related to participants' performance. Future work may support the notion that task demands could be used as a quality metric that is likely representative of performance, and perhaps patient outcomes. Conclusion The present study is a reasonable next step in a systematic assessment of how task demands and workload are related to performance in EMR-evolving environments.


2012 ◽  
Vol 30 (34_suppl) ◽  
pp. 245-245
Author(s):  
Lukasz M. Mazur ◽  
Prithima Mosaly ◽  
Ellen Jones ◽  
Lesley Hoyle ◽  
Bhishamjit S. Chera ◽  
...  

245 Background: Workload is a hypothetical construct representing the overall human cost incurred during a task. Across disciplines, the NASA Task Load Index (TLX) has been used as a subjective measure of workload. It quantifies six dimensions of work (mental, physical, and temporal demands, frustration, effort, and performance) on a scale of 1-100 scale, with scores >55 (i.e. overworked) associated with lesser performance. We herein quantify differences in physician workload for planning a relatively “simple” (palliative 2 field opposed lateral brain) versus relatively “complex” (curative 4 field pancreas) case. Further, we explore the association between workload and performance to define TLX levels where performance could be expected to decline. Methods: Nine physicians planned two cases, each case involving three tasks (i.e., task 1 - review written patient medical records; task 2 - review diagnostic images and design of treatment fields; and task 3 - review and approval of the treatment plan). After completing each case, TLX scores of each case/task was collected. Differences in workload between cases/tasks were assessed via ANOVA. The association between workload and performance (assessed using time-to-task completion and self-assessments) was assessed via Pearson’s correlation test. Results: 54 TLX workload and performance assessments were obtained. Workloads for the simple brain case/tasks averaged 41-48, versus 62-69 for the complex pancreas case/tasks (p<0.001 via ANOVA). There were no differences between tasks for the individual cases (p>0.1). There was a correlation between TLX scores and time-to-complete (r=0.54, p<0.001), and with physician self-assessments (r=-0.74, p<0.001). There was a trend towards reduced performance with TLX scores > 55. Conclusions: Physician workload levels are markedly lower for “simple” versus “complex” cases, indicating that TLX is a reliable tool to quantify workload. Performance appears to decline at TLX levels > 55, which is consistent with findings from other industries. Thus, we propose workload assessment (via TLX) to be considered as an independent quality measure to assess the quality assurance (QA) of processes used to deliver radiation therapy.


2001 ◽  
Vol 92 (1) ◽  
pp. 53-71 ◽  
Author(s):  
Anthony F. Grasha ◽  
Kraig Schell

Participants filled 42 orders on a task designed to simulate components of filling prescriptions. Task factors included objective workload of 70- versus 80-min. to complete the task and perceptions of workload dimensions using the NASA Task Load Index. The proportion and pattern of data-entry, counting, and product-selection errors were compatible with those found in pharmacy field-sites. Significant other relationship stress, field-dependence, and an 80-min. workpace predicted data-entry errors. Mistakes in product selection were associated with low GPA, high social stress, the NASA Task Load Index dimension of less concern with performing well, and a 70-min. workpace. Relationship of data to corresponding information in the pharmacy literarure and to assumptions of a cognitive-systems performance model was discussed.


2016 ◽  
Vol 14 (4) ◽  
pp. 289 ◽  
Author(s):  
Erik G. Prytz, PhD ◽  
Jonas Rybing, MSc ◽  
Carl-Oscar Jonson, PhD

Objective: This study reports on an initial test using a validated workload measurement method, the NASA Task Load Index (TLX), as an indicator of joint emergency exercise effectiveness. Prior research on emergency exercises indicates that exercises must be challenging, ie, result in high workload, to be effective. However, this is often problematic with some participants being underloaded and some overloaded. The NASA TLX was used to test for differences in workload between commanders and subordinates and among three different emergency response organizations during a joint emergency exercise.Design: Questionnaire-based evaluation with professional emergency responders.Setting: The study was performed in conjunction with a large-scale interorganizational joint emergency exercise in Sweden.Participants: A total of 20 participants from the rescue services, 12 from the emergency medical services, and 12 from the police participated in the study (N = 44). Ten participants had a command-level role during the exercise and the remaining 34 were subordinates.Main Outcome Measure(s): The main outcome measures were the workload subscales of the NASA TLX: mental demands, physical demands, temporal demands, performance, effort, and frustration. Results: The results showed that the organizations experienced different levels of workload, that the commanders experienced a higher workload than the subordinates, and that two out of three organizations fell below the twenty-fifth percentile of average workload scores compiled from 237 prior studies.Conclusions: The results support the notion that the NASA TLX could be a useful complementary tool to evaluate exercise designs and outcomes. This should be further explored and verified in additional studies.


Ergonomics ◽  
2013 ◽  
Vol 56 (5) ◽  
pp. 752-763 ◽  
Author(s):  
Marc Mouzé-Amady ◽  
Eric Raufaste ◽  
Henri Prade ◽  
Jean-Pierre Meyer

Author(s):  
A. V. Sokolov ◽  
D. A. Isakov

Block symmetric ciphers are one of the most important components of modern information security systems. At the same time, in addition to the structure of the applied block symmetric cipher, the cryptographic strength and performance of the information protection system is largely determined by the applied encryption mode. In addition to high performance and high-quality destruction of block statistics, modern encryption modes should also protect encrypted information from occurred or intentionally introduced errors. In this paper, we have developed an encryption mode with blocks skipping and using a pseudo-random key sequence generator, which allows checking the integrity of encrypted information with accurate detection of the place where an error was introduced. In this case, the error detection accuracy is determined by the adjustable parameter of the macroblock size and can be set depending on the level of importance of the protected information. The developed encryption mode is characterized by the following key advantages: reducing the number of required encryption operations by half, while providing a high level of cryptographic quality; more effective destruction of macroblock statistics due to the use of an additional generator of pseudo-random key sequences, the impossibility of propagation of the occurred (intentionally introduced) error outside the macroblock, as well as higher values of the number of protection levels due to the possibility of classifying the initial states of the applied generators of pseudo-random key sequences. As proposed in this paper, the mode of authenticated encryption with blocks skipping can be recommended for use on mobile platforms that are demanding both in terms of the quality and reliability of the protected information and are limited in terms of computing and power resources.


2017 ◽  
Vol 13 (2) ◽  
pp. 81
Author(s):  
Nur Azemil

Development of manufacturing and service institutions can not be separated from the role of human resources. Human resources have an important role in fulfilling vision and mission. University of A is one of the private educational institutions in East Java to achieve the goal must be managed properly that can be utilized optimally, this can be done by analyzing workload and performance or optimizing the number of employees. The purpose this research is measure workload and effect the employee’s performance. Measurement of workload is using National Aeronautics and Space Administration-Task Load Index (NASA-TLX) method, NASA-TLX method is rating multidimentional subjective mental workload  that divides<em> </em>the workload based on the average load of 6 dimensions, and the measurement of performance is using questionnaire with 5 scales by likert scale. The results showed that employees who have Medium workload is 8%, High workload is 84% and Very high workload is 8%. The result of the questionnaire showed the category of employee’s performance, simply performance is 24% and satisfactory performance is 76%. From the statistical test by using <em>Chi Square</em> method, it is known that the value = 5,9915 and = 2,2225, the result shows <strong> &lt; </strong> , then  is accepted and  is rejected. Thus, there is influence between the workload of employees and the employees’s performance.


Author(s):  
Dina Kanaan ◽  
Nadine Marie Moacdieh

Objective To use eye tracking to understand the effects of interruptions in different workload conditions as part of a monitoring and change detection task. Background Interruptions are detrimental to performance in complex, multitasking domains. There is a need for better display design techniques that help users overcome interruptions regardless of their workload level. This requires understanding a user’s attentional state immediately after an interruption in order to determine what type of display adjustments are most suitable. Method An emergency dispatching simulator was developed with a visual primary task and auditory interruptive task. Two levels of workload were induced by varying the number of emergency vehicles to monitor for changes and the rate of changes to monitor. Eye tracking, performance, and subjective measures (NASA-Task Load Index) were collected and analyzed for 41 participants. Results As expected, high workload interacted with interruptions to further degrade primary task performance and alter participants’ attention allocation immediately after the interruption. Participants in the high workload condition had more narrowed, slower scan patterns immediately after the interruption as compared to before the interruption, as evidenced by lower scanpath length per second and mean saccade amplitude. However, this change was not observed in low workload. Conclusion High workload modulates the effects of interruptions on performance and eye movements. Users in the high workload condition struggle to quickly scan the display in the seconds following an interruption. Application The results can provide insight into the type of display adjustments needed right after an interruption in a high-workload environment.


2003 ◽  
Vol 97 (1) ◽  
pp. 151-174 ◽  
Author(s):  
Sean Reilley ◽  
Anthony F. Grasha ◽  
Gerald Matthews ◽  
John Schafer

The relationships between attentional variables and information-processing demands of pharmacy dispensing tasks that contribute to difficulties in cognitive performance are not well-known. In the present study, a psychological approach to medical dispensing errors, the cognitive-systems performance model of Grasha, was employed to evaluate the contributions of individual differences in attention and alterations in visual task information on simulated pharmacy-verification performance, perceived workload, and self-reported stress. 73 college-age volunteers completed a pretest battery containing psychological measures of automatic and controlled information processing, and one-week later spent 265 min. completing the end visual-inspection process for 200 simulated prescriptions, 27% of which contained artificially inserted errors. Evidence suggesting that both automatic and controlled processes underlie performance of a simulated pharmacy-verification task was obtained. Individual differences in controlled information processing were mildly predictive of detection accuracy, while contrary to expectations, automatic processing scores did not produce significant relationships. Detection associated with experimental alterations in font size (12-pt. vs 6-pt.) of critical prescription label information was partially in line with expectations from the cognitive-systems performance model, while additional visual enhancements via a magnification/illumination device yielded mixed results. Finally, reports of perceived workload (NASA Task Load Index) and specific patterns of self-reported stress (Dundee Stress State Questionnaire) were consistent with a three-tier behavioral framework offered recently by Matthews, Davies, Westerman, and Stammers for predicting behaviors along the automatic-controlled continuum.


Sign in / Sign up

Export Citation Format

Share Document