HoloGCS : Mixed Reality-based Ground Control Station for Unmanned Aerial Vehicle

2022 ◽  
Author(s):  
Daniar Estu Widiyanti ◽  
Krisma Asmoro ◽  
Soo Young Shin
Keyword(s):  
Video Streaming ◽  
Unmanned Aerial Vehicle ◽  
Mixed Reality ◽  
Field Of View ◽  
Ground Control ◽  
Complex Environment ◽  
Ground Control Station ◽  
Speech Control ◽  
Aerial Vehicle ◽  
Microsoft Hololens

Ground control station (GCS) is a system for controlling and monitoring unmanned aerial vehicle (UAV). In current GCS, the device used are considered as complex environment. This paper proposes a video streaming and speech command control for supporting mixed reality based UAV GCS using Microsoft HoloLens. Video streaming will inform the UAV view and transmit the raw video to the HoloLens, while the HoloLens steers the UAV based on the displayed UAV field of view (FoV). Using the HoloLens Mixed Reality Tool-Kit (MRTK) speech input, UAV speech control from the HoloLens was successfully implemented. Finally, experimental results based on video streaming and speech command calculation of the throughput, round-time trip, latency and speech accuracy tests are discussed to demonstrate the feasibility of the proposed scheme.

scholarly journals HoloGCS : Mixed Reality-based Ground Control Station for Unmanned Aerial Vehicle

2022 ◽  
Author(s):  
Daniar Estu Widiyanti ◽  
Krisma Asmoro ◽  
Soo Young Shin
Keyword(s):  
Video Streaming ◽  
Unmanned Aerial Vehicle ◽  
Mixed Reality ◽  
Field Of View ◽  
Ground Control ◽  
Complex Environment ◽  
Ground Control Station ◽  
Speech Control ◽  
Aerial Vehicle ◽  
Microsoft Hololens

Ground control station (GCS) is a system for controlling and monitoring unmanned aerial vehicle (UAV). In current GCS, the device used are considered as complex environment. This paper proposes a video streaming and speech command control for supporting mixed reality based UAV GCS using Microsoft HoloLens. Video streaming will inform the UAV view and transmit the raw video to the HoloLens, while the HoloLens steers the UAV based on the displayed UAV field of view (FoV). Using the HoloLens Mixed Reality Tool-Kit (MRTK) speech input, UAV speech control from the HoloLens was successfully implemented. Finally, experimental results based on video streaming and speech command calculation of the throughput, round-time trip, latency and speech accuracy tests are discussed to demonstrate the feasibility of the proposed scheme.

scholarly journals Enhancing the functional design of a multi-touch UAV ground control station.

2021 ◽  
Author(s):  
Jeffrey Haber
Keyword(s):  
Mixed Reality ◽  
Ground Control ◽  
High Fidelity ◽  
Functional Design ◽  
Motion Simulation ◽  
Touch Gestures ◽  
Ground Control Station ◽  
Aerial Vehicle ◽  
Key Features ◽  
Commercial Off The Shelf

This thesis presents a reconfigurable Ground Control Station designed for Unmanned Aerial Vehicle use, which utilizes multi-touch gesture inputs as well as the ability for the operator to personalize where the instruments they interact with are located on screen. The Ground Control Station that is presented was designed and developed in Ryerson University’s Mixed-Reality Immersive Motion Simulation Laboratory utilizing commercial off the shelf programs supplied by Presagis. Presagis’ VAPS XT 4.1 beta was used to design and develop the actual Ground Control Station’s User Interface due to its ability to create high quality interfaces for aircraft that harness multi-touch gestures. While FlightSIM 14 was used to simulate a high fidelity aircraft being controlled by the Ground Control Station. The final interface was comprised of six key features and 12 different instrument panels that could be manipulated by the operator to control a simulated aircraft throughout a virtual environment.

MONITORING OF TRAFFIC USING UNMANNED AERIAL VEHICLE IN MALAYSIA LANDSCAPE PERSPECTIVE

2015 ◽  
Vol 76 (1) ◽  
Author(s):  
Azizul Abdullah ◽  
Elmi Abu Bakar ◽  
Muhammad Zaim Mohamed Pauzi
Keyword(s):  
Unmanned Aerial Vehicle ◽  
Ground Control ◽  
Limited Area ◽  
Traffic Flows ◽  
Highway Traffic ◽  
Traffic Condition ◽  
Starting Point ◽  
Ground Control Station ◽  
Aerial Vehicle ◽  
On The Road

Collecting information on traffic flows are important for provide high quality road system. At present, fixed camera is widely used for the monitoring system which covers limited area.  Therefore, the unmanned aerial vehicle (UAV) such as quadrotor is developed for monitoring traffic flow since the UAV is responsive mobile sensing system. This development of UAV platform is a starting point for developed a highway traffic and management system which is in future can be enhance by connected the system with graphical user interface (GUI) on ground control station that can defined types of vehicles and analyze level of congestion. At present, the system that developed only transmits a real time video to ground control station without any interpretation by software that detects types of vehicles and analyzes traffic condition. Through the surveillance and monitoring of traffic flows that done at Engineering Campus, Universiti Sains Malaysia, the system provides suitable information for authorities to analyse level of congestion happened on the road and provide alternative solution for users in order to avoid the traffic jam.  

scholarly journals Enhancing the functional design of a multi-touch UAV ground control station.

2021 ◽  
Author(s):  
Jeffrey Haber
Keyword(s):  
Mixed Reality ◽  
Ground Control ◽  
High Fidelity ◽  
Functional Design ◽  
Motion Simulation ◽  
Touch Gestures ◽  
Ground Control Station ◽  
Aerial Vehicle ◽  
Key Features ◽  
Commercial Off The Shelf

This thesis presents a reconfigurable Ground Control Station designed for Unmanned Aerial Vehicle use, which utilizes multi-touch gesture inputs as well as the ability for the operator to personalize where the instruments they interact with are located on screen. The Ground Control Station that is presented was designed and developed in Ryerson University’s Mixed-Reality Immersive Motion Simulation Laboratory utilizing commercial off the shelf programs supplied by Presagis. Presagis’ VAPS XT 4.1 beta was used to design and develop the actual Ground Control Station’s User Interface due to its ability to create high quality interfaces for aircraft that harness multi-touch gestures. While FlightSIM 14 was used to simulate a high fidelity aircraft being controlled by the Ground Control Station. The final interface was comprised of six key features and 12 different instrument panels that could be manipulated by the operator to control a simulated aircraft throughout a virtual environment.

Sign in / Sign up

Export Citation Format

Share Document