Aerial Image Matching Based Relative Localization of a UAV in Urban Environments

Author(s):  
Tharindu S. Chathuranga ◽  
Rohan Munasinghe
Author(s):  
Z. Hussnain ◽  
S. Oude Elberink ◽  
G. Vosselman

<p><strong>Abstract.</strong> In this paper, a method is presented to improve the MLS platform’s trajectory for GNSS denied areas. The method comprises two major steps. The first step is based on a 2D image registration technique described in our previous publication. Internally, this registration technique first performs aerial to aerial image matching, this issues correspondences which enable to compute the 3D tie points by multiview triangulation. Similarly, it registers the rasterized Mobile Laser Scanning Point Cloud (MLSPC) patches with the multiple related aerial image patches. The later registration provides the correspondence between the aerial to aerial tie points and the MLSPC’s 3D points. In the second step, which is described in this paper, a procedure utilizes three kinds of observations to improve the MLS platform’s trajectory. The first type of observation is the set of 3D tie points computed automatically in the previous step (and are already available), the second type of observation is based on IMU readings and the third type of observation is soft-constraint over related pose parameters. In this situation, the 3D tie points are considered accurate and precise observations, since they provide both locally and globally strict constraints, whereas the IMU observations and soft-constraints only provide locally precise constraints. For 6DOF trajectory representation, first, the pose [R, t] parameters are converted to 6 B-spline functions over time. Then for the trajectory adjustment, the coefficients of B-splines are updated from the established observations. We tested our method on an MLS data set acquired at a test area in Rotterdam, and verified the trajectory improvement by evaluation with independently and manually measured GCPs. After the adjustment, the trajectory has achieved the accuracy of RMSE X<span class="thinspace"></span>=<span class="thinspace"></span>9<span class="thinspace"></span>cm, Y<span class="thinspace"></span>=<span class="thinspace"></span>14<span class="thinspace"></span>cm and Z<span class="thinspace"></span>=<span class="thinspace"></span>14<span class="thinspace"></span>cm. Analysing the error in the updated trajectory suggests that our procedure is effective at adjusting the 6DOF trajectory and to regenerate a reliable MLSPC product.</p>


2018 ◽  
Vol 10 (10) ◽  
pp. 1542 ◽  
Author(s):  
Livia Piermattei ◽  
Mauro Marty ◽  
Wilfried Karel ◽  
Camillo Ressl ◽  
Markus Hollaus ◽  
...  

This work focuses on the accuracy estimation of canopy height models (CHMs) derived from image matching of Pléiades stereo imagery over forested mountain areas. To determine the height above ground and hence canopy height in forest areas, we use normalised digital surface models (nDSMs), computed as the differences between external high-resolution digital terrain models (DTMs) and digital surface models (DSMs) from Pléiades image matching. With the overall goal of testing the operational feasibility of Pléiades images for forest monitoring over mountain areas, two questions guide this work whose answers can help in identifying the optimal acquisition planning to derive CHMs. Specifically, we want to assess (1) the benefit of using tri-stereo images instead of stereo pairs, and (2) the impact of different viewing angles and topography. To answer the first question, we acquired new Pléiades data over a study site in Canton Ticino (Switzerland), and we compare the accuracies of CHMs from Pléiades tri-stereo and from each stereo pair combination. We perform the investigation on different viewing angles over a study area near Ljubljana (Slovenia), where three stereo pairs were acquired at one-day offsets. We focus the analyses on open stable and on tree covered areas. To evaluate the accuracy of Pléiades CHMs, we use CHMs from aerial image matching and airborne laser scanning as reference for the Ticino and Ljubljana study areas, respectively. For the two study areas, the statistics of the nDSMs in stable areas show median values close to the expected value of zero. The smallest standard deviation based on the median of absolute differences (σMAD) was 0.80 m for the forward-backward image pair in Ticino and 0.29 m in Ljubljana for the stereo images with the smallest absolute across-track angle (−5.3°). The differences between the highest accuracy Pléiades CHMs and their reference CHMs show a median of 0.02 m in Ticino with a σMAD of 1.90 m and in Ljubljana a median of 0.32 m with a σMAD of 3.79 m. The discrepancies between these results are most likely attributed to differences in forest structure, particularly tree height, density, and forest gaps. Furthermore, it should be taken into account that temporal vegetational changes between the Pléiades and reference data acquisitions introduce additional, spurious CHM differences. Overall, for narrow forward–backward angle of convergence (12°) and based on the used software and workflow to generate the nDSMs from Pléiades images, the results show that the differences between tri-stereo and stereo matching are rather small in terms of accuracy and completeness of the CHM/nDSMs. Therefore, a small angle of convergence does not constitute a major limiting factor. More relevant is the impact of a large across-track angle (19°), which considerably reduces the quality of Pléiades CHMs/nDSMs.


2011 ◽  
Vol 268-270 ◽  
pp. 1376-1381
Author(s):  
De Jun Tang ◽  
Wei Shi Zhang ◽  
Lian Fu Li ◽  
Yan Si

The image matching technology is very important technology in computer vision. It is a wide range of application areas, such as aerial image analysis, industrial inspection, and stereo vision, medical, meteorological, and intelligent robots. The article introduces several important image matching technology, and some common fast image matching usage. Propose the image fast matching method basing on local information, mainly use template matching basing on local image features to achieve, by extraction of the selected feature points (including the obvious point, corner points, edge points, edge line, etc.) extracted, and through the calculation of similarity, and by using fast matching algorithm to achieve fast and accurate image matching requirements.


Author(s):  
Qi Shan ◽  
Changchang Wu ◽  
Brian Curless ◽  
Yasutaka Furukawa ◽  
Carlos Hernandez ◽  
...  
Keyword(s):  

2019 ◽  
Vol 117 ◽  
pp. 131-139 ◽  
Author(s):  
Suting Chen ◽  
Rui Feng ◽  
Yanyan Zhang ◽  
Chuang Zhang

Sign in / Sign up

Export Citation Format

Share Document