Three-dimensional image coordinate-based missing region of interest area detection and damage localization for bridge visual inspection using unmanned aerial vehicles

2020 ◽  
pp. 147592172091867
Author(s):  
Sungsik Yoon ◽  
Gi-Hun Gwon ◽  
Jin-Hwan Lee ◽  
Hyung-Jo Jung
Keyword(s):  
Unmanned Aerial Vehicles ◽  
Visual Inspection ◽  
Experimental Validation ◽  
Three Dimensional ◽  
Region Of Interest ◽  
Field Of View ◽  
Damage Localization ◽  
Distance Information ◽  
Dimensional Image ◽  
Aerial Vehicles

In this study, the three-phase missing region of interest area detection and damage localization methodology based on three-dimensional image coordinates was proposed. In Phase 1, the coordinate transformation is performed by the position and attitude information of the unmanned aerial vehicles and camera, and the coordinates of the center point of each acquired image are obtained with the distance information between the camera and the target surface. For Phase 2, the size of the field of view of every acquired image is calculated using the focal length and working distance of the camera. Finally, in Phase 3, the missing part of the region of interest area can be identified and any damage detected at the individual image level can also be localized on the whole inspection region using information about the sizes of the field of view in all images calculated in the previous phase. In order to demonstrate the proposed methodology, experimental validation was performed on the actual bridge pier and deck as well as the lab-scale concrete shear wall. In the tests, the missing area detection and damage localization results were compared with image stitching and human visual inspection results, respectively. Experimental validation results have shown that the proposed methodology identifies missing areas and damage locations within reasonable accuracy of 10 cm.

scholarly journals COMPARISON OF UAV LIDAR ODOMETRY OF ROTATING AND FIXED VELODYNE PLATFORMS

2020 ◽  
Vol XLIII-B1-2020 ◽  
pp. 527-534
Author(s):  
M. L. Tazir ◽  
N. Seube
Keyword(s):  
Unmanned Aerial Vehicles ◽  
Three Dimensional ◽  
High Accuracy ◽  
Field Of View ◽  
Direct Access ◽  
Refresh Rate ◽  
Additional Degree ◽  
Aerial Vehicles ◽  
3D Information ◽  
Axis Passing

Abstract. Three-dimensional LiDAR rangefinders are increasingly integrated into unmanned aerial vehicles (UAV), due to their direct access to 3D information, their high accuracy and high refresh rate, and their tendency to be lightweight and cheaper. However, all commercial LiDARs can only offer a limited vertical resolution. To cope with this problem, a solution can be to rotate the LiDAR on an axis passing through its center, adding an additional degree of freedom and allowing more overlap, which significantly enlarges the sensor scope and allows having a complete spherical field of view (FOV). In this paper, we explore this solution in detail for drone’s context, while making comparisons between the rotating and fixed configurations for a Multi-Layers LiDAR (MLL) of type Velodyne Puck Lite. We investigate its impact on the LiDAR Odometry (LO) process by comparing the resulting trajectories with the data of the two configurations, as well as, qualitative comparisons, of the resulting maps.

A method for autonomous collision-free navigation of a quadrotor UAV in unknown tunnel-like environments

Robotica ◽  
2021 ◽  
pp. 1-27
Author(s):  
Taha Elmokadem ◽  
Andrey V. Savkin
Keyword(s):  
Unmanned Aerial Vehicles ◽  
Autonomous Underwater Vehicles ◽  
Three Dimensional ◽  
Underwater Vehicles ◽  
Practical Implementation ◽  
Challenging Problem ◽  
Quadrotor Uav ◽  
Navigation Algorithm ◽  
Aerial Vehicles ◽  
Quadrotor Uavs

Abstract Unmanned aerial vehicles (UAVs) have become essential tools for exploring, mapping and inspection of unknown three-dimensional (3D) tunnel-like environments which is a very challenging problem. A computationally light navigation algorithm is developed in this paper for quadrotor UAVs to autonomously guide the vehicle through such environments. It uses sensors observations to safely guide the UAV along the tunnel axis while avoiding collisions with its walls. The approach is evaluated using several computer simulations with realistic sensing models and practical implementation with a quadrotor UAV. The proposed method is also applicable to other UAV types and autonomous underwater vehicles.

scholarly journals Learning-Based Autonomous UAV System for Electrical and Mechanical (E&M) Device Inspection

Sensors ◽  
2021 ◽  
Vol 21 (4) ◽  
pp. 1385
Author(s):  
Yurong Feng ◽  
Kwaiwa Tse ◽  
Shengyang Chen ◽  
Chih-Yung Wen ◽  
Boyang Li
Keyword(s):  
System Design ◽  
State Estimation ◽  
Unmanned Aerial Vehicles ◽  
Visual Inspection ◽  
Spatial Information ◽  
Free Flight ◽  
Object State ◽  
Aerial Vehicles ◽  
Inspection Tasks ◽  
Autonomous Inspection

The inspection of electrical and mechanical (E&M) devices using unmanned aerial vehicles (UAVs) has become an increasingly popular choice in the last decade due to their flexibility and mobility. UAVs have the potential to reduce human involvement in visual inspection tasks, which could increase efficiency and reduce risks. This paper presents a UAV system for autonomously performing E&M device inspection. The proposed system relies on learning-based detection for perception, multi-sensor fusion for localization, and path planning for fully autonomous inspection. The perception method utilizes semantic and spatial information generated by a 2-D object detector. The information is then fused with depth measurements for object state estimation. No prior knowledge about the location and category of the target device is needed. The system design is validated by flight experiments using a quadrotor platform. The result shows that the proposed UAV system enables the inspection mission autonomously and ensures a stable and collision-free flight.

scholarly journals Vision-Based Target Three-Dimensional Geolocation Using Unmanned Aerial Vehicles

2018 ◽  
Vol 65 (10) ◽  
pp. 8052-8061 ◽  
Author(s):  
Lele Zhang ◽  
Fang Deng ◽  
Jie Chen ◽  
Yingcai Bi ◽  
Swee King Phang ◽  
...  
Keyword(s):  
Unmanned Aerial Vehicles ◽  
Three Dimensional ◽  
Aerial Vehicles

A survey on stereo vision-based autonomous navigation for multi-rotor MUAVs

Robotica ◽  
2018 ◽  
Vol 36 (8) ◽  
pp. 1225-1243 ◽  
Author(s):  
Jose-Pablo Sanchez-Rodriguez ◽  
Alejandro Aceves-Lopez
Keyword(s):  
Unmanned Aerial Vehicles ◽  
Stereo Vision ◽  
Autonomous Navigation ◽  
Three Dimensional ◽  
Field Of View ◽  
Line Of Sight ◽  
Onboard Computer ◽  
Low Weight ◽  
Vision Based Navigation ◽  
Difficult Challenge

SUMMARYThis paper presents an overview of the most recent vision-based multi-rotor micro unmanned aerial vehicles (MUAVs) intended for autonomous navigation using a stereoscopic camera. Drone operation is difficult because pilots need the expertise to fly the drones. Pilots have a limited field of view, and unfortunate situations, such as loss of line of sight or collision with objects such as wires and branches, can happen. Autonomous navigation is an even more difficult challenge than remote control navigation because the drones must make decisions on their own in real time and simultaneously build maps of their surroundings if none is available. Moreover, MUAVs are limited in terms of useful payload capability and energy consumption. Therefore, a drone must be equipped with small sensors, and it must carry low weight. In addition, a drone requires a sufficiently powerful onboard computer so that it can understand its surroundings and navigate accordingly to achieve its goal safely. A stereoscopic camera is considered a suitable sensor because of its three-dimensional (3D) capabilities. Hence, a drone can perform vision-based navigation through object recognition and self-localise inside a map if one is available; otherwise, its autonomous navigation creates a simultaneous localisation and mapping problem.

Optimized artificial potential field algorithm to multi-unmanned aerial vehicle coordinated trajectory planning and collision avoidance in three-dimensional environment

2019 ◽  
Vol 233 (16) ◽  
pp. 6032-6043 ◽  
Author(s):  
Jun Tang ◽  
Jiayi Sun ◽  
Cong Lu ◽  
Songyang Lao
Keyword(s):  
Unmanned Aerial Vehicles ◽  
Collision Avoidance ◽  
Unmanned Aerial Vehicle ◽  
Trajectory Planning ◽  
Potential Field ◽  
Three Dimensional ◽  
Artificial Potential Field ◽  
Aerial Vehicles ◽  
Aerial Vehicle ◽  
Vehicle Trajectory

Multi-unmanned aerial vehicle trajectory planning is one of the most complex global optimum problems in multi-unmanned aerial vehicle coordinated control. Results of recent research works on trajectory planning reveal persisting theoretical and practical problems. To mitigate them, this paper proposes a novel optimized artificial potential field algorithm for multi-unmanned aerial vehicle operations in a three-dimensional dynamic space. For all purposes, this study considers the unmanned aerial vehicles and obstacles as spheres and cylinders with negative electricity, respectively, while the targets are considered spheres with positive electricity. However, the conventional artificial potential field algorithm is restricted to a single unmanned aerial vehicle trajectory planning in two-dimensional space and usually fails to ensure collision avoidance. To deal with this challenge, we propose a method with a distance factor and jump strategy to resolve common problems such as unreachable targets and ensure that the unmanned aerial vehicle does not collide into the obstacles. The method takes companion unmanned aerial vehicles as the dynamic obstacles to realize collaborative trajectory planning. Besides, the method solves jitter problems using the dynamic step adjustment method and climb strategy. It is validated in quantitative test simulation models and reasonable results are generated for a three-dimensional simulated urban environment.

Technology for the Visual Inspection of Aircraft Surfaces Using Programmable Unmanned Aerial Vehicles

2019 ◽  
Vol 58 (6) ◽  
pp. 960-968
Author(s):  
Yu. B. Blokhinov ◽  
V. A. Gorbachev ◽  
A. D. Nikitin ◽  
S. V. Skryabin
Keyword(s):  
Unmanned Aerial Vehicles ◽  
Visual Inspection ◽  
Aerial Vehicles
Sign in / Sign up

Export Citation Format

Share Document