scholarly journals Comparison of Display Modality and Human-in-the-Loop Presence for On-Orbit Inspection of Spacecraft

2021 ◽  
pp. 001872082110427
Author(s):  
Hannah Weiss ◽  
Andrew Liu ◽  
Amos Byon ◽  
Jonathan Blossom ◽  
Leia Stirling
Keyword(s):  
Augmented Reality ◽  
Situation Awareness ◽  
Performance Enhancement ◽  
Detection Accuracy ◽  
Extravehicular Activity ◽  
Human In The Loop ◽  
Current Implementation ◽  
Inspection Tasks ◽  
The Impact ◽  
Inspection Task

Objective To investigate the impact of interface display modalities and human-in-the-loop presence on the awareness, workload, performance, and user strategies of humans interacting with teleoperated robotic systems while conducting inspection tasks onboard spacecraft. Background Due to recent advancements in robotic technology, free-flying teleoperated robot inspectors are a viable alternative to extravehicular activity inspection operations. Teleoperation depends on the user’s situation awareness; consequently, a key to successful operations is practical bi-directional communication between human and robot agents. Method Participants ( n = 19) performed telerobotic inspection of a virtual spacecraft during two degrees of temporal communication, a Synchronous Inspection task and an Asynchronous Inspection task. Participants executed the two tasks while using three distinct visual displays (2D, 3D, AR) and accompanying control systems. Results Anomaly detection performance was better during Synchronous Inspection than the Asynchronous Inspection of previously captured imagery. Users’ detection accuracy reduced when given interactive exocentric 3D viewpoints to accompany the egocentric robot view. The results provide evidence that 3D projections, either demonstrated on a 2D interface or augmented reality hologram, do not affect the mean clearance violation time (local guidance performance), even though the subjects perceived a benefit. Conclusion In the current implementation, the addition of augmented reality to a classical egocentric robot view for exterior inspection of spacecraft is unnecessary, as its margin of performance enhancement is limited in comparison. Application Results are presented to inform future human–robot interfaces to support crew autonomy for deep space missions.

Function-Specific Uncertainty Communication in Automated Driving

2019 ◽  
Vol 11 (2) ◽  
pp. 75-97
Author(s):  
Alexander Kunze ◽  
Stephen J. Summerskill ◽  
Russell Marshall ◽  
Ashleigh J. Filtness
Keyword(s):  
Augmented Reality ◽  
Situation Awareness ◽  
Driving Simulator ◽  
Automated Driving ◽  
Driving Experience ◽  
Visual Variables ◽  
Simulator Study ◽  
The Impact

Conveying the overall uncertainties of automated driving systems was shown to improve trust calibration and situation awareness, resulting in safer takeovers. However, the impact of presenting the uncertainties of multiple system functions has yet to be investigated. Further, existing research lacks recommendations for visualizing uncertainties in a driving context. The first study outlined in this publication investigated the implications of conveying function-specific uncertainties. The results of the driving simulator study indicate that the effects on takeover performance depends on driving experience, with less experienced drivers benefitting most. Interview responses revealed that workload increments are a major inhibitor of these benefits. Based on these findings, the second study explored the suitability of 11 visual variables for an augmented reality-based uncertainty display. The results show that particularly hue and animation-based variables are appropriate for conveying uncertainty changes. The findings inform the design of all displays that show content varying in urgency.

Function-Specific Uncertainty Communication in Automated Driving

2022 ◽  
pp. 1002-1026
Author(s):  
Alexander Kunze ◽  
Stephen J. Summerskill ◽  
Russell Marshall ◽  
Ashleigh J. Filtness
Keyword(s):  
Augmented Reality ◽  
Situation Awareness ◽  
Driving Simulator ◽  
Automated Driving ◽  
Driving Experience ◽  
Visual Variables ◽  
Simulator Study ◽  
The Impact

Conveying the overall uncertainties of automated driving systems was shown to improve trust calibration and situation awareness, resulting in safer takeovers. However, the impact of presenting the uncertainties of multiple system functions has yet to be investigated. Further, existing research lacks recommendations for visualizing uncertainties in a driving context. The first study outlined in this publication investigated the implications of conveying function-specific uncertainties. The results of the driving simulator study indicate that the effects on takeover performance depends on driving experience, with less experienced drivers benefitting most. Interview responses revealed that workload increments are a major inhibitor of these benefits. Based on these findings, the second study explored the suitability of 11 visual variables for an augmented reality-based uncertainty display. The results show that particularly hue and animation-based variables are appropriate for conveying uncertainty changes. The findings inform the design of all displays that show content varying in urgency.

Investigating the Impact of Human in-the-Loop Digital Twin in an Industrial Maintenance Context

2020 ◽  
Author(s):  
Ali Al-Yacoubb ◽  
Will Eaton ◽  
Melanie Zimmer ◽  
Achim Buerkle ◽  
Dedy Ariansyaha ◽  
...  
Keyword(s):  
Digital Twin ◽  
Human In The Loop ◽  
Industrial Maintenance ◽  
The Impact

Augmented Reality Procedure Assistance System for Operator Training and Simulation

2020 ◽  
Vol 64 (1) ◽  
pp. 1176-1180
Author(s):  
Eugene Hayden ◽  
Kang Wang ◽  
Chengjie Wu ◽  
Shi Cao
Keyword(s):  
Augmented Reality ◽  
Situation Awareness ◽  
Mental Workload ◽  
Field Of View ◽  
Task Completion ◽  
Operator Training ◽  
Head Mounted Display ◽  
Subject Design ◽  
Procedural Tasks ◽  
Speed Accuracy

This study explores the design, implementation, and evaluation of an Augmented Reality (AR) prototype that assists novice operators in performing procedural tasks in simulator environments. The prototype uses an optical see-through head-mounted display (OST HMD) in conjunction with a simulator display to supplement sequences of interactive visual and attention-guiding cues to the operator’s field of view. We used a 2x2 within-subject design to test two conditions: with/without AR-cues, each condition had a voice assistant and two procedural tasks (preflight and landing). An experiment examined twenty-six novice operators. The results demonstrated that augmented reality had benefits in terms of improved situation awareness and accuracy, however, it yielded longer task completion time by creating a speed-accuracy trade-off effect in favour of accuracy. No significant effect on mental workload is found. The results suggest that augmented reality systems have the potential to be used by a wider audience of operators.

Impact of UAS with Low Size, Weight, and Power Sensors on Air Traffic Controllers’ Performance and Acceptability Ratings

2020 ◽  
Vol 64 (1) ◽  
pp. 154-158
Author(s):  
Kim-Phuong L. Vu ◽  
Jonathan VanLuven ◽  
Timothy Diep ◽  
Vernol Battiste ◽  
Summer Brandt ◽  
...  
Keyword(s):  
Air Traffic ◽  
Unmanned Aircraft ◽  
Unmanned Aircraft Systems ◽  
Subjective Ratings ◽  
Detection Range ◽  
Human In The Loop ◽  
Air Traffic Controllers ◽  
Low Altitude ◽  
Sector Performance ◽  
The Impact

A human-in-the-loop simulation was conducted to evaluate the impact of Unmanned Aircraft Systems (UAS) with low size, weight, and power (SWaP) sensors operating in a busy, low-altitude sector. Use of low SWaP sensors allow for UAS to perform detect-and-avoid (DAA) maneuvers against non-transponding traffic in the sector. Depending upon the detection range of the low SWaP sensor, the UAS pilot may or may not have time to coordinate with air traffic controllers (ATCos) prior to performing the DAA maneuver. ATCo’s sector performance and subjective ratings of acceptability were obtained in four conditions that varied in UAS-ATCo coordination (all or none) prior to the DAA maneuver and workload (higher or lower). For performance, ATCos committed more losses of separation in high than low workload conditions. They also had to make more flight plan changes to manage the UAS when the UAS pilot did not coordinate DAA maneuvers compared to when they did coordinate the maneuvers prior to execution. Although the ATCos found the DAA procedures used by the UAS in the study to be acceptable, most preferred the UAS pilot to coordinate their DAA maneuvers with ATCos prior to executing them.

scholarly journals Augmented Reality and Machine Learning Incorporation Using YOLOv3 and ARKit

2021 ◽  
Vol 11 (13) ◽  
pp. 6006
Author(s):  
Huy Le ◽  
Minh Nguyen ◽  
Wei Qi Yan ◽  
Hoa Nguyen
Keyword(s):  
Machine Learning ◽  
Augmented Reality ◽  
Object Detection ◽  
Feature Detection ◽  
Detection Methods ◽  
Detection Accuracy ◽  
Data Annotation ◽  
Machine Learning Model ◽  
Potential Benefits ◽  
Feature Detection And Tracking

Augmented reality is one of the fastest growing fields, receiving increased funding for the last few years as people realise the potential benefits of rendering virtual information in the real world. Most of today’s augmented reality marker-based applications use local feature detection and tracking techniques. The disadvantage of applying these techniques is that the markers must be modified to match the unique classified algorithms or they suffer from low detection accuracy. Machine learning is an ideal solution to overcome the current drawbacks of image processing in augmented reality applications. However, traditional data annotation requires extensive time and labour, as it is usually done manually. This study incorporates machine learning to detect and track augmented reality marker targets in an application using deep neural networks. We firstly implement the auto-generated dataset tool, which is used for the machine learning dataset preparation. The final iOS prototype application incorporates object detection, object tracking and augmented reality. The machine learning model is trained to recognise the differences between targets using one of YOLO’s most well-known object detection methods. The final product makes use of a valuable toolkit for developing augmented reality applications called ARKit.

scholarly journals Multimodal Mixed Reality Impact on a Hand Guiding Task with a Holographic Cobot

2020 ◽  
Vol 4 (4) ◽  
pp. 78
Author(s):  
Andoni Rivera Pinto ◽  
Johan Kildal ◽  
Elena Lazkano
Keyword(s):  
Augmented Reality ◽  
Industrial Production ◽  
User Study ◽  
Haptic Feedback ◽  
Mixed Reality ◽  
Robot Arm ◽  
Pick And Place ◽  
Place Task ◽  
Guidance Technique ◽  
The Impact

In the context of industrial production, a worker that wants to program a robot using the hand-guidance technique needs that the robot is available to be programmed and not in operation. This means that production with that robot is stopped during that time. A way around this constraint is to perform the same manual guidance steps on a holographic representation of the digital twin of the robot, using augmented reality technologies. However, this presents the limitation of a lack of tangibility of the visual holograms that the user tries to grab. We present an interface in which some of the tangibility is provided through ultrasound-based mid-air haptics actuation. We report a user study that evaluates the impact that the presence of such haptic feedback may have on a pick-and-place task of the wrist of a holographic robot arm which we found to be beneficial.

scholarly journals The Impact of Interruptions on Feature Change Detection within Dynamic Scenes

2019 ◽  
Vol 63 (1) ◽  
pp. 1430-1434
Author(s):  
Kimberly N. Perry ◽  
Mark W. Scerbo
Keyword(s):  
Working Memory ◽  
Situation Awareness ◽  
Specific Information ◽  
Limited Information ◽  
Dynamic Scenes ◽  
Feature Change ◽  
Activation Level ◽  
Level 1 ◽  
Perceptual Changes ◽  
The Impact

The goal of the present study was to examine how interruptions occurring in dynamic scenes affect the ability to detect perceptual changes during level 1 situation awareness (SA). Undergraduates were asked to watch 24 brief videos (half with interruptions) including 8 with perceptual feature changes. All videos were unique and contained multiple dynamic objects. Three different sets of instructions regarding the changes were given to successive groups: no information, limited information, and feature specific information. Of the eight changes, half occurred during a visual interruption and half with no interruption. Results showed that participants detected few changes, but detections increased when given more information about the nature of the changes in the absence of interruptions. The findings suggest that interruptions may facilitate the decay of an objects’ activation level in working memory and that level 1 SA may be particularly fragile when the visual scene is interrupted.

The Impact Assessment of the Managed Motorway on M25 Junction 5 to 7

2011 ◽  
Vol 66-68 ◽  
pp. 692-696
Author(s):  
Sui Chao ◽  
Ling Tao Wu ◽  
Jian Yun Chen
Keyword(s):  
Impact Assessment ◽  
State Of The Art ◽  
Technical State ◽  
Current Implementation ◽  
The Impact

This study introduces the transport situation and polices of the highway agency for the M25. Then the current implementation of the Managed Motorway on M25 between junction 5 and junction 7 is reviewed, and some examples are given in this paper. Then a technical state-of-the-art of application is also reviewed. After that, the requirements for integration with complementary systems and polices are presented. Finally, this paper discusses the arguments for and against taking this application forward.

Sign in / Sign up

Export Citation Format

Share Document