Agent Reasoning Transparency’s Effect on Operator Workload

Author(s):  
Julia L. Wright ◽  
Jessie Y.C. Chen ◽  
Michael J. Barnes ◽  
Peter A. Hancock

We examined how varying the transparency of agent reasoning affected operator workload in a route selection task, and how the differing measures of workload compared in assessing and understanding cognitive workload. Participants guided a three-vehicle convoy safely through a simulated environment of which they had a limited amount of information, while maintaining communication with command and monitoring their surroundings for threats. The intelligent route-planning agent assessed potential threats and suggested changes to the convoy route as needed. Each participant was assigned to one of three agent reasoning transparency conditions. Contrary to our hypothesis, NASA-TLX Global workload measures indicated that workload decreased slightly as access to agent reasoning increased. However, psychophysical measures of workload disagreed with NASA-TLX global results. Comparison of individual NASA-TLX workload factors with the psychophysical measures indicated that performance satisfaction was highest in the intermediary transparency condition, and the addition of ambiguous information in the highest transparency condition increased effort and resulted in increased complacent behavior. Recommendations for future workload analysis are offered.

Author(s):  
Julia L. Wright ◽  
Jessie Y.C. Chen ◽  
Michael J. Barnes ◽  
Peter A. Hancock

We examined how varying the transparency of agent reasoning affected complacent behavior, in the form of incorrect acceptances of an agent’s recommendations, in a route selection task. We were particularly interested in how participants’ eye movements might disambiguate whether the incorrect acceptances were due to complacency or incorrect information processing. Participants guided a threevehicle convoy safely through a simulated environment of which they had a limited amount of information, while maintaining communication with command and monitoring their surroundings for threats. The intelligent route-planning agent assessed potential threats and suggested changes to the convoy route as needed. Each participant was assigned to one of three agent reasoning transparency conditions. While access to agent reasoning did appear to reduce complacent behavior in one condition, performance in the other conditions indicated potential complacent behavior. An area of interest analysis, reviewed in conjunction with the performance data, indicated the reason behind the participants’ behavior was different between these two conditions. While in the non-transparent condition participants were likely engaging in complacent behavior, in the highly transparent condition it is more likely they were overwhelmed by the amount and/or type of information, resulting in difficulty assimilating the information to support their decision-making task.


2019 ◽  
Vol 1 ◽  
pp. 1-2
Author(s):  
Pyry Kettunen

<p><strong>Abstract.</strong> Different types of geospatial pictures, such as maps and aerial imagery, have varying potential to provide spatial knowledge for the viewers. Our earlier review has assessed different common types of geopictures with regard to their support for acquiring different types of spatial knowledge (Kettunen et al., 2012). The assessment was based on previous literature about geopicture experiments as well as analytical itemization of the information available on the pictures as a function of picture characteristics, namely vantage point, number of visible vertical features, and visual realism. In addition to the actual assessment, the review concluded that there is an important shortage of empirical evaluations on spatial knowledge acquisition from geopictures, which lag we are addressing with the experiment described here.</p><p>The aim of the experiment is to find out what kind of geospatial features, or landmarks (see Presson and Montello, 1988; Richter and Winter, 2014), people read from geopictures, does reading differ between pictures, and how does it differ. For the experimental task, we chose a common map activity of planning navigation for walking through an urban route. The stimuli are five different types of common geopictures with both aerial vertical and aerial oblique vantage points as well as with both abstract and photorealistic levels of visual realism (Figure 1). Five routes are to be planned in different areas of city of Helsinki so that a different geopicture type is shown for each route. The pictures are shown as corridors surrounding the shortest walking route.</p><p>The participants have been recruited from expert and non-expert social media groups and e-mail lists, being called to be over 18 years old. The background questionnaire has asked about their age, gender, possible visual disorders, and frequency of use for each type of map in the experiment.</p><p>The experimental design for measuring the effect of geopicture type was built randomized and between-participants so that each participant completes series of five pictures, each of different type, in randomized order, and from different geographical areas. Two rounds of five pictures are shown: first, to measure the actual selection of landmarks, and second, to investigate the level of recall of the selected landmarks later. The procedure of the experiment is the following (Figure 2): 1) Introduction, 2) Consent to participate, 3) Training trial of the landmark selection task (1 picture), 4) Testing trials of the landmark selection task (5 pictures), 5) Training trial of the selection recall task (1 picture), 6) Testing trials of the landmark selection task (5 pictures), 7) Background questionnaire, and 8) Thanks and feedback. The Start and End points of the routes are drawn on the pictures (Figure 1) and the participants are asked to plan the shortest route between the points along roads and paths, to point 3–7 features along the route in navigation route for being able to navigate the route, and to enter common names for the features after pointing each feature. Response times, pointed coordinates, and feature names are recorded in order to analyze the participants’ answers.</p><p>The presentation at the ICC2019 conference will introduce preliminary results of the conducted experiment, reflect them on the previous studies on maps and routing and discuss their implications on the design of map contents from the viewpoint of route planning. The results will build empirical foundation about differences in reading of geospatial picture types, and for selecting appropriate features to be drawn on maps.</p>


JOURNAL ASRO ◽  
2019 ◽  
Vol 10 (1) ◽  
pp. 34
Author(s):  
Ahmadi Ahmadi ◽  
Wahyu Endriyanto ◽  
Benny Sukandari ◽  
Agus Makhrowi

The workload is highly related to efficient and effective human resource utilization in an organization to achieve organizational objectives, vision, and mission. Various methods are used to optimize the number of personnel in an organization so that each task can be completed quickly and precisely. Accounting Institutions are inseparable from problems regarding the lack of workload with the number of personnel working on it. The change of the Policy gives an impact on the change of Job Description and List of Personnel Arrangements of the organization. To overcome these issues, workload measurement, analysis can be used to determine the optimal amount of personnel required in their working units. This study uses a mental workload measurement so called NASA-TLX and physical workload measurement According to the applicable workload regulation that is in accordance with the Administrative Direction of Workload Analysis. Both methods are then carried out to be compared to each other. The results showed that the physical workload is required in the completion of tasks in each work unit. In addition, the determination of the optimal number of personnel using physical workload or appropriate tasks per task position based Job Description is performed. As a result, it is known that there is an excessive workload in the Sub Service Budget Cost work units with personal shortcomings. On the other hand, there is an excessive personnel number in Administrative Work, Sub Department of Finance Administration and Sub Department Financial Control. The overall conclusion of this study is a need for personnel reduction in a List of Personnel Arrangements currently known as Accounting Institutions to be 39 personnel instead of the existing 48 personnel.  Keywords: Workload, NASA-TLX (Task Load Index), assignments Per Task title, Number of Optimal personnel


2018 ◽  
Vol 71 (5) ◽  
pp. 1045-1056 ◽  
Author(s):  
Tad T Brunyé ◽  
Shaina B Martis ◽  
Holly A Taylor

Planning routes from maps involves perceiving the symbolic environment, identifying alternate routes and applying explicit strategies and implicit heuristics to select an option. Two implicit heuristics have received considerable attention, the southern route preference and initial segment strategy. This study tested a prediction from decision-making theory that increasing cognitive load during route planning will increase reliance on these heuristics. In two experiments, participants planned routes while under conditions of minimal (0-back) or high (2-back) working memory load. In Experiment 1, we examined how memory load impacts the southern route heuristic. In Experiment 2, we examined how memory load impacts the initial segment heuristic. Results replicated earlier results demonstrating a southern route preference (Experiment 1) and initial segment strategy (Experiment 2) and further demonstrated that evidence for heuristic reliance is more likely under conditions of concurrent working memory load. Furthermore, the extent to which participants maintained efficient route selection latencies in the 2-back condition predicted the magnitude of this effect. Together, results demonstrate that working memory load increases the application of heuristics during spatial decision making, particularly when participants attempt to maintain quick decisions while managing concurrent task demands.


2021 ◽  
Vol 922 (1) ◽  
pp. 012074
Author(s):  
M Dhafir ◽  
M Idkham ◽  
Safrizal ◽  
A A Munawar ◽  
P Azrial

Abstract Recently, the work of climbing coconuts, especially in Aceh Province Indonesia still uses traditional methods, namely by climbing coconut trees directly. Traditional climbing is very high risk because it can fall which threatens the safety of life. Besides that, this job is also a heavy work category because it requires a lot of energy to do it. Therefore, the analysis of operator workload on climbing coconut trees using portable coconut climbing equipment is expected to be useful for developing tool designs and methods for climbing coconuts that are safer, more comfortable and more effective. The calculation of the operator’s workload is based on heart rate measurements, where three operators have their heart rate data taken during coconut tree climbing activities, either manually or using portable climbing tools. The workloads analyzed are qualitative and quantitative workloads. The results of the workload analysis indicate that climbing is traditionally classified as a “medium” job with an average IRHR value of 1.45, while using portable climbing equipment is classified as heavy work with an IRHR value of 1.54 The traditional climbing energy consumption rate is 3.29 kcal/hour.kg-ow (kilocalories per hour per operator’s weight), while using a portable climbing equipment is 3.82 kcal/hour.kg-ow. The high level of operator workload is largely determined by the operator’s habits in doing climbing as well as skills that must be trained in operating the tool. However, in terms of operator safety, the use of portable equipment has a higher level of security because there are footrests and handrails as well as seat belts.


2012 ◽  
Author(s):  
Qi Wang ◽  
Holly A. Taylor ◽  
Tad T. Brunye

1989 ◽  
Vol 33 (16) ◽  
pp. 1054-1058
Author(s):  
John P. Bulger ◽  
Susan G. Hill ◽  
Richard E. Christ

The Army developer community needs to be attuned to the need for addressing operator workload issues within the framework of the materiel acquisition process. Brief descriptions are given of: (a) the major acquisition approaches; (b) the Manpower and Personnel Integration (MANPRINT) program; and, (c) operator workload. The interrelationships between these three areas are considered. Workload is important because it affects the ability of the operator to perform required tasks; hence, system performance can be affected by workload. MANPRINT provides a framework for addressing operator workload issues and for formalizing workload analysis requirements.


Sign in / Sign up

Export Citation Format

Share Document