scholarly journals Assessment of UAV operator workload in a reconfigurable multi-touch ground control station environment

2016 ◽  
Vol 4 (3) ◽  
pp. 203-216
Author(s):  
Jeffrey Haber ◽  
Joon Chung
Keyword(s):  
Mixed Reality ◽  
Human Mind ◽  
Ground Control ◽  
Task Load ◽  
Touch Gestures ◽  
Ground Control Station ◽  
Computer Based ◽  
Commercial Off The Shelf ◽  
The Impact ◽  
Operator Workload

Multi-touch computer inputs allow users to interact with a virtual environment through the use of gesture commands on a monitor instead of a mouse and keyboard. This style of input is easy for the human mind to adapt to because gestures directly reflect how one interacts with the natural environment. This paper presents and assesses a personal-computer-based unmanned aerial vehicle ground control station that utilizes multi-touch gesture inputs and system reconfigurability to enhance operator performance. The system was developed at Ryerson University’s Mixed-Reality Immersive Motion Simulation Laboratory using commercial-off-the-shelf Presagis software. The ground control station was then evaluated using NASA’s task load index to determine if the inclusion of multi-touch gestures and reconfigurability provided an improvement in operator workload over the more traditional style of mouse and keyboard inputs. To conduct this assessment, participants were tasked with flying a simulated aircraft through a specified number of waypoints, and had to utilize a payload controller within a predetermined area. The task load index results from these flight tests have initially shown that the developed touch-capable ground control station improved operator workload while reducing the impact of all six related human factors.

scholarly journals Enhancing the functional design of a multi-touch UAV ground control station.

2021 ◽  
Author(s):  
Jeffrey Haber
Keyword(s):  
Mixed Reality ◽  
Ground Control ◽  
High Fidelity ◽  
Functional Design ◽  
Motion Simulation ◽  
Touch Gestures ◽  
Ground Control Station ◽  
Aerial Vehicle ◽  
Key Features ◽  
Commercial Off The Shelf

This thesis presents a reconfigurable Ground Control Station designed for Unmanned Aerial Vehicle use, which utilizes multi-touch gesture inputs as well as the ability for the operator to personalize where the instruments they interact with are located on screen. The Ground Control Station that is presented was designed and developed in Ryerson University’s Mixed-Reality Immersive Motion Simulation Laboratory utilizing commercial off the shelf programs supplied by Presagis. Presagis’ VAPS XT 4.1 beta was used to design and develop the actual Ground Control Station’s User Interface due to its ability to create high quality interfaces for aircraft that harness multi-touch gestures. While FlightSIM 14 was used to simulate a high fidelity aircraft being controlled by the Ground Control Station. The final interface was comprised of six key features and 12 different instrument panels that could be manipulated by the operator to control a simulated aircraft throughout a virtual environment.

scholarly journals Enhancing the functional design of a multi-touch UAV ground control station.

2021 ◽  
Author(s):  
Jeffrey Haber
Keyword(s):  
Mixed Reality ◽  
Ground Control ◽  
High Fidelity ◽  
Functional Design ◽  
Motion Simulation ◽  
Touch Gestures ◽  
Ground Control Station ◽  
Aerial Vehicle ◽  
Key Features ◽  
Commercial Off The Shelf

This thesis presents a reconfigurable Ground Control Station designed for Unmanned Aerial Vehicle use, which utilizes multi-touch gesture inputs as well as the ability for the operator to personalize where the instruments they interact with are located on screen. The Ground Control Station that is presented was designed and developed in Ryerson University’s Mixed-Reality Immersive Motion Simulation Laboratory utilizing commercial off the shelf programs supplied by Presagis. Presagis’ VAPS XT 4.1 beta was used to design and develop the actual Ground Control Station’s User Interface due to its ability to create high quality interfaces for aircraft that harness multi-touch gestures. While FlightSIM 14 was used to simulate a high fidelity aircraft being controlled by the Ground Control Station. The final interface was comprised of six key features and 12 different instrument panels that could be manipulated by the operator to control a simulated aircraft throughout a virtual environment.

scholarly journals Design and evaluation of UAV ground control station by considering human factors standards and guidelines

2021 ◽  
Author(s):  
Taiwo Amida
Keyword(s):  
Human Factors ◽  
Human Error ◽  
Ground Control ◽  
Task Load ◽  
Ground Control Station ◽  
Programming Techniques ◽  
Aerial Vehicle ◽  
Standards And Guidelines ◽  
Commercial Off The Shelf ◽  
Nasa Task Load Index

The majority of Unmanned Aerial Vehicle (UAV) accidents can be directly related to human error. For this reason, standards and guidelines focusing on human factors have been published by various organizations such as Transport Canada, FAA, EASA, NASA and military agencies. The objective of this thesis is to present a methodology for designing a Ground Control Station (GCS) using available standards and guidelines for human factors. During the design process, a detailed analysis was performed using human factors methods to ensure all requirements were met; each phase of the design follows the guidelines presented in the compiled human factors standards and guidelines. The GCS interface was developed using advanced programming techniques and commercial off-the-shelf software. Moreover, an operator workload evaluation was carried out using NASA task load index for validation of design methodology. It was found that the applied methodology not only improved the pilot workload, but also ensured that all user and stakeholders’ requirements are met.

scholarly journals Design and evaluation of UAV ground control station by considering human factors standards and guidelines

2021 ◽  
Author(s):  
Taiwo Amida
Keyword(s):  
Human Factors ◽  
Human Error ◽  
Ground Control ◽  
Task Load ◽  
Ground Control Station ◽  
Programming Techniques ◽  
Aerial Vehicle ◽  
Standards And Guidelines ◽  
Commercial Off The Shelf ◽  
Nasa Task Load Index

The majority of Unmanned Aerial Vehicle (UAV) accidents can be directly related to human error. For this reason, standards and guidelines focusing on human factors have been published by various organizations such as Transport Canada, FAA, EASA, NASA and military agencies. The objective of this thesis is to present a methodology for designing a Ground Control Station (GCS) using available standards and guidelines for human factors. During the design process, a detailed analysis was performed using human factors methods to ensure all requirements were met; each phase of the design follows the guidelines presented in the compiled human factors standards and guidelines. The GCS interface was developed using advanced programming techniques and commercial off-the-shelf software. Moreover, an operator workload evaluation was carried out using NASA task load index for validation of design methodology. It was found that the applied methodology not only improved the pilot workload, but also ensured that all user and stakeholders’ requirements are met.

Developing Interpersonal and Counseling Skills Through Mixed-Reality Simulation in Communication Sciences and Disorders

2021 ◽  
pp. 1-13
Author(s):  
Twyla Perryman ◽  
Carlie Sandefur ◽  
Chelsea T. Morris
Keyword(s):  
Interpersonal Communication ◽  
Undergraduate Students ◽  
Mixed Reality ◽  
Clinical Skills ◽  
Statistical Significance ◽  
Counseling Skills ◽  
Clinical Simulation ◽  
Positive Attitudes ◽  
Computer Based ◽  
The Impact

Purpose Simulation is increasingly becoming a valuable tool for training and educating students in communication sciences and disorders (CSD). The purpose of this study is to examine the impact of a mixed-reality simulation on CSD students' perceptions of their ability to apply clinical and counseling skills. Additionally, this study sought to investigate the overall efficacy and acceptance of this type of clinical simulation experience for undergraduate CSD students. Method A total of 29 undergraduate students participated in a clinical simulation experience that used actor-controlled avatars in a mixed-reality simulation environment to practice collecting case history information and delivering diagnostic news to parents of a child client. All students completed pre- and postsimulation questionnaires that rated the impact of the clinical simulation experience on their confidence in demonstrating targeted clinical skills and their general attitudes about their participation. Additionally, five lead participants participated in follow-up interviews to gather data to best describe students' perceptions. Quantitative and qualitative data were recorded and analyzed. Results The majority of the students exhibited positive attitudes toward the mixed-reality clinical simulation experience and reported an increase in their perceived ability to apply several counseling skills (e.g., listening and selective feedback) following the session. Analysis showed that the perceived confidence levels on seven out of the 17 targeted skill items increased on the postevent questionnaire to a level of statistical significance and that the simulation experience was described as meaningful and supportive for increasing confidence. Conclusions Mixed-reality clinical simulation may be a useful tool for teaching interpersonal communication and counseling skills for students, including undergraduates, in CSD. Additionally, the use of mixed-reality technology in this study produced similar results seen with other clinical simulation methods such as standardized patients or computer-based simulations.

scholarly journals HoloGCS : Mixed Reality-based Ground Control Station for Unmanned Aerial Vehicle

2022 ◽  
Author(s):  
Daniar Estu Widiyanti ◽  
Krisma Asmoro ◽  
Soo Young Shin
Keyword(s):  
Video Streaming ◽  
Unmanned Aerial Vehicle ◽  
Mixed Reality ◽  
Field Of View ◽  
Ground Control ◽  
Complex Environment ◽  
Ground Control Station ◽  
Speech Control ◽  
Aerial Vehicle ◽  
Microsoft Hololens

Ground control station (GCS) is a system for controlling and monitoring unmanned aerial vehicle (UAV). In current GCS, the device used are considered as complex environment. This paper proposes a video streaming and speech command control for supporting mixed reality based UAV GCS using Microsoft HoloLens. Video streaming will inform the UAV view and transmit the raw video to the HoloLens, while the HoloLens steers the UAV based on the displayed UAV field of view (FoV). Using the HoloLens Mixed Reality Tool-Kit (MRTK) speech input, UAV speech control from the HoloLens was successfully implemented. Finally, experimental results based on video streaming and speech command calculation of the throughput, round-time trip, latency and speech accuracy tests are discussed to demonstrate the feasibility of the proposed scheme.

HoloGCS : Mixed Reality-based Ground Control Station for Unmanned Aerial Vehicle

2022 ◽  
Author(s):  
Daniar Estu Widiyanti ◽  
Krisma Asmoro ◽  
Soo Young Shin
Keyword(s):  
Video Streaming ◽  
Unmanned Aerial Vehicle ◽  
Mixed Reality ◽  
Field Of View ◽  
Ground Control ◽  
Complex Environment ◽  
Ground Control Station ◽  
Speech Control ◽  
Aerial Vehicle ◽  
Microsoft Hololens

Ground control station (GCS) is a system for controlling and monitoring unmanned aerial vehicle (UAV). In current GCS, the device used are considered as complex environment. This paper proposes a video streaming and speech command control for supporting mixed reality based UAV GCS using Microsoft HoloLens. Video streaming will inform the UAV view and transmit the raw video to the HoloLens, while the HoloLens steers the UAV based on the displayed UAV field of view (FoV). Using the HoloLens Mixed Reality Tool-Kit (MRTK) speech input, UAV speech control from the HoloLens was successfully implemented. Finally, experimental results based on video streaming and speech command calculation of the throughput, round-time trip, latency and speech accuracy tests are discussed to demonstrate the feasibility of the proposed scheme.

Evaluating the Impact of Automated Technology in Basic Military Training Using Computer-Based Surveys

1997 ◽  
Author(s):  
Walter G. Albert ◽  
Winston Bennett ◽  
Kenneth Pemberton ◽  
Charles Holt ◽  
Pat Waldroop
Keyword(s):  
Military Training ◽  
Automated Technology ◽  
Computer Based ◽  
The Impact

scholarly journals A Robot Operating System Framework for Secure UAV Communications

Sensors ◽  
2021 ◽  
Vol 21 (4) ◽  
pp. 1369
Author(s):  
Hyojun Lee ◽  
Jiyoung Yoon ◽  
Min-Seong Jang ◽  
Kyung-Joon Park
Keyword(s):  
Operating System ◽  
Unmanned Aerial Vehicles ◽  
Ground Control ◽  
Unmanned Aerial System ◽  
Security Framework ◽  
Security Vulnerabilities ◽  
Robot Operating System ◽  
Security Issues ◽  
Aerial Vehicles ◽  
Ground Control Station

To perform advanced operations with unmanned aerial vehicles (UAVs), it is crucial that components other than the existing ones such as flight controller, network devices, and ground control station (GCS) are also used. The inevitable addition of hardware and software to accomplish UAV operations may lead to security vulnerabilities through various vectors. Hence, we propose a security framework in this study to improve the security of an unmanned aerial system (UAS). The proposed framework operates in the robot operating system (ROS) and is designed to focus on several perspectives, such as overhead arising from additional security elements and security issues essential for flight missions. The UAS is operated in a nonnative and native ROS environment. The performance of the proposed framework in both environments is verified through experiments.

Sign in / Sign up

Export Citation Format

Share Document