scholarly journals Validation of Trade-Off in Human–Automation Interaction: An Empirical Study of Contrasting Office Automation Effects on Task Performance and Workload

2020 ◽  
Vol 10 (4) ◽  
pp. 1288
Author(s):  
Byung Cheol Lee ◽  
Jangwoon Park ◽  
Heejin Jeong ◽  
Jaehyun Park

Automation aims to improve the task performance and the safety of human operators. The success of automation can be facilitated with well-designed human–automation interaction (HAI), which includes the consideration of a trade-off between the benefits of reliable automation and the cost of Failed automation. This study evaluated four different types of HAIs in order to validate the automation trade-off, and HAI types were configured by the levels and the statuses of office automation. The levels of automation were determined by information amount (i.e., Low and High), and the statues were decided by automation function (i.e., Routine and Failed). Task performance including task completion time and accuracy and subjective workload of participants were measured in the evaluation of the HAIs. Relatively better task performance (short task completion time and high accuracy) were presented in the High level in Routine automation, while no significant effects of automation level were reported in Failed automation. The subjective workload by the National Aeronautics and Space Administration (NASA) Task Load Index (TLX) showed higher workload in High and Failed automation than Low and Failed automation. The type of sub-functions and the task classification can be estimated as major causes of automation trade-off, and dissimilar results between empirical and subjective measures need to be considered in the design of effective HAI.

1989 ◽  
Vol 33 (3) ◽  
pp. 159-163 ◽  
Author(s):  
Brian C. Hayes ◽  
Ko Kurokawa ◽  
Walter W. Wierwille

This research was undertaken, in part, to determine the magnitudes of performance decrements associated with automotive instrument panel tasks as a function of driver age. Driver eye scanning and dwell time measures and task completion measures were collected while 24 drivers aged 18 to 72 performed a variety of instrument panel tasks as each drove an instrumented vehicle along preselected routes. The results indicated a monotonically increasing relationship between driver age and task completion time and the number of glances to the instrument panel. Mean glance dwell times, either to the roadway or the instrument, were not significantly different among the various age groups. The nature of these differences for the various task categories used in the present study was examined.


2009 ◽  
Vol 50 ◽  
Author(s):  
Beatričė Andziulienė ◽  
Žilvinas Jucys

In order to address ergonomic problems in the process of education, education relevant to the use of ergonomic work tools. The article includes educational process is widely used in a text editor usabilityresults of the study, of the performance experiment. Operating results of the experiment showed that MS Office Word 2007 usability respect ahead of MS Word 2003 and OpenOffice Writer 3.0 applications: task completion time for work in MS Word 2007 editor is 5 percent lower than the same task in MS Word 2003 and 8 percent lower then in Open Office Writer 3.0 editor; navigational errors in learning a task using MS Word 2007 and Word 2003 decreased by 9 times on average, while using OpenOffice Writer 3.0 approximately 3.5-times; task performance accuracy (formatting error) is the best on MS Word 2007, there’s no errors then task is learned. The fact that OpenOffice Writer is a free open source product, this is a relatively well-developed alternative to the commercial Microsoft Office Word.


2022 ◽  
Vol 6 (1) ◽  
pp. 6
Author(s):  
Jari Kangas ◽  
Sriram Kishore Kumar ◽  
Helena Mehtonen ◽  
Jorma Järnstedt ◽  
Roope Raisamo

Virtual reality devices are used for several application domains, such as medicine, entertainment, marketing and training. A handheld controller is the common interaction method for direct object manipulation in virtual reality environments. Using hands would be a straightforward way to directly manipulate objects in the virtual environment if hand-tracking technology were reliable enough. In recent comparison studies, hand-based systems compared unfavorably against the handheld controllers in task completion times and accuracy. In our controlled study, we compare these two interaction techniques with a new hybrid interaction technique which combines the controller tracking with hand gestures for a rigid object manipulation task. The results demonstrate that the hybrid interaction technique is the most preferred because it is intuitive, easy to use, fast, reliable and it provides haptic feedback resembling the real-world object grab. This suggests that there is a trade-off between naturalness, task accuracy and task completion time when using these direct manipulation interaction techniques, and participants prefer to use interaction techniques that provide a balance between these three factors.


Author(s):  
Heejin Jeong ◽  
Jangwoon Park ◽  
Jaehyun Park ◽  
Byung Cheol Lee

Automation is ubiquitous and indispensable in modern working environments. It is adopted and used in not only advanced industrial- and technology-oriented operations, but also ordinary home or office computational functions. In general, automated systems aim to improve overall work efficiency and productivity of labor-intensive tasks by decreasing the risk of errors, and cognitive and physical workloads. The systems offer the support for diverse decision-making processes as well. However, the benefits of automation are not consistently achieved and depend on the types and features of automation (Onnasch, Wickens, Li, & Manzey, 2014; Parasuraman, Sheridan, & Wickens, 2000). Possible negative side effects have been reported. Sometimes, automation may lead to multi-tasking environments, which allows operators to be distractive with several tasks. It ultimately prolongs task completion time and causes to neglect monitoring and follow-up steps of the pre-processing tasks (Endsley, 1996). Furthermore, the operators who excessively depend on automation are easily deteriorated in skill acquisition, which is necessary for the emergency or manual operations. Thus, inconsistent performance in automation is a major issue in successful adoption and trust in automation (Jeong, Park, Park, & Lee, 2017). This paper presents an experimental study that investigates the main features and causes of the inconsistency in task performance in different types of automation. Automated proofreading tasks were used in this study, which is one of the most common types of automation we experience in daily life. Based on the similar algorithm of the auto-correct function in Microsoft Word, a custom-built program of five proofreading tasks, including one non-automated and four automated proofreading tasks, were developed using Visual Studio 2015 C#. In the non-automated task used as a reference for individual difference, participants were asked to manually find a typographical error in a sentence. In the automated tasks, auto-correcting functions are provided in two levels (i.e., low and high) of automation and two statuses (i.e., routine and failure of automation). The type of automation is defined as the combinations of a status and a level. Participants identified typographical errors by only an underlined word at the low-level automation, whereas an underlined word with a possible substituting word was given at the high-level. Additionally, in the routine automation status, a correct substituting word is provided. On the other hand, a grammatically incorrect word is given in the failed automation status. Nineteen participants (11 females and 8 males; age mean = 33.8, standard deviation = 19.1) took part in this study. Results of statistical analyses show a clear advantage in high-routine automation, in terms of both task completion time and accuracy. While task performances of high & routine automation types are quite obvious in both task completion time and accuracy, those in the failed automation types are mixed and indistinguishable. Different levels and statues of failed automation do not much influence task performance. Moreover, task completion time and mental demand are strongly correlated, and the accuracy rate and perceived trust show a strong positive correlation. The approaches and outcomes of the current study can provide some insights into the human-automation interaction systems that support human performance and safety, such as in-vehicle warning systems and automated vehicle controls.


2021 ◽  
pp. 101395
Author(s):  
Om-Kolsoom Shahryari ◽  
Hossein Pedram ◽  
Vahid Khajehvand ◽  
Mehdi Dehghan TakhtFooladi

2020 ◽  
Vol 103 (4) ◽  
pp. 003685042096288
Author(s):  
Mingyin Jiang ◽  
Dongjie Sun ◽  
Qiang Li ◽  
Daoxiong Wang

Poor usability designed of ventilator user interface can easily lead to human error. In this study, we evaluated the usability design of ventilator maintenance user interface and identified problems related to the usability of user interface that could easily cause human error. Sixteen respiratory therapists participated in this usability study. The usability of the ventilator maintenance user interface was evaluated by participants’ task performance (task completion time, task error rate), physiological workload (eye-fixation duration) and perceived workload (NASA-TLX), and user experience (questionnaire). For task performance, task completion time and task error rate showed significant differences. For task completion time, significant difference was found when conducting ventilator self-test ( p < 0.001), replace the breathing circuit ( p = 0.047), and check battery status ( p = 0.005). For task error rate, the three ventilators showed significant difference ( p = 0.012), and the Serov I showed a significantly higher task error rate than the Boaray 5000D ( p = 0.031). For workload, the Serov I was associated with higher physiological and perceived workloads than other ventilators ( p < 0.05). For user experience, the Boaray 5000D received better scores among the ventilators in terms of ease to maintain, friendly to maintain, and willingness to use ( p < 0.05, respectively). Our study adds available literature for usability evaluation of ventilator maintenance user interface. The results indicate that the maintenance user interface of the Boaray 5000D performed better than the other two tested ventilators. Moreover, the study results also proved that eye-fixation duration can be a reliable tool for evaluating the usability of ventilator user interface.


Processes ◽  
2021 ◽  
Vol 9 (12) ◽  
pp. 2148
Author(s):  
Zhefan Yu ◽  
Jianping Luo ◽  
Han Zhang ◽  
Eiji Onchi ◽  
Seung Hee Lee

This study aimed to identify the effects of different approaches to a motion control interface (MCI) in tele-operated crane handling tasks. In this study, due to the difficulty of applying the actual equipment to the experiment, we presented a prototype system of a tele-operated overhead handling (TOH) crane. Specifically, we investigated participants’ task performance including the accuracy of task completion during unloading, heart rate variation, workload, and the relationships between these factors when four motion control approaches were used: pointing (P), keyboard (K), orientation (O), hand-free gesture (HG). Experiments were conducted with two groups of participants: 21 university students and 11 crane operators used each of the four control methods. A task condition for handling iron blocks was tested. The efficacy of each motion control approach for task performance was evaluated by a within-subject experiment with a novice group. The expert group was used for comparing the task performance and satisfaction in the prototype system with the novices, evaluating whether the prototype system was reproducible for a real setting in the construction site. The results showed that the task completion time, the weight of physical demand, and the overall scores for workload were significantly impacted by the type of motion control: when HG was used, the task completion time increased. Particularly, using HG had the potential to increase the overall workload score, while physical laboriousness was also potentially increased by HG. Conversely, unloading accuracy, heart rate, and mental demand were not affected by motion control approaches. Generally, the expert group spent more time completing the tasks, but they performed better unloading accuracy than the novices in all methods. Ninety-one percent of the experts gave positive feedback on the reproducibility of the prototype system.


2020 ◽  
Author(s):  
Sara Di Bartolomeo ◽  
Aditeya Pandey ◽  
Aristotelis Sigiouan Leventidis ◽  
David Saffo ◽  
Uzma Haque Syeda ◽  
...  

Timelines are commonly represented on a horizontal line, which is not necessarily the most effective way to visualize temporal event sequences. However, few experiments have evaluated how timeline shape influences task performance. We present the design and results of a controlled experiment run on Amazon Mechanical Turk (n=192) in which we evaluate how timeline shape affects task completion time, correctness, and user preference. We tested 12 combinations of 4 shapes --- horizontal line, vertical line, circle, and spiral --- and 3 data types --- recurrent, non-recurrent, and mixed event sequences. We found good evidence that timeline shape meaningfully affects user task completion time but not correctness and that users have a strong shape preference. Building on our results, we present design guidelines for creating effective timeline visualizations based on user task and data types. A free copy of this paper, the evaluation stimuli and data, and code are available at https://osf.io/qr5yu/


Sign in / Sign up

Export Citation Format

Share Document