scholarly journals Improve Building Façades in Open Lidar Data Using Ground Imagery

2018 ◽  
Author(s):  
Shenman Zhang ◽  
Pengjie Tao
Keyword(s):  
Point Cloud ◽  
Open Data ◽  
Point Clouds ◽  
Lidar Data ◽  
Free Access ◽  
Registration Accuracy ◽  
Incomplete Coverage ◽  
Meta Information ◽  
Coherent Point Drift ◽  
Different Sources

Recent advances in open data initiatives allow us to free access to a vast amount of open LiDAR data in many cities. However, most of these open LiDAR data over cities are acquired by airborne scanning, where the points on façades are sparse or even completely missing due to the viewpoint and object occlusions in the urban environment. Integrating other sources of data, such as ground images, to complete the missing parts is an effective and practical solution. This paper presents an approach for improving open LiDAR data coverage on building façades by using point cloud generated from ground images. A coarse-to-fine strategy is proposed to fuse these two different sources of data. Firstly, the façade point cloud generated from terrestrial images is initially geolocated by matching the SFM camera positions to their GPS meta-information. Next, an improved Coherent Point Drift algorithm with normal consistency is proposed to accurately align building façades to open LiDAR data. The significance of the work resides in the use of 2D overlapping points on the outline of buildings instead of limited 3D overlap between the two point clouds and the achievement to a reliable and precise registration under possible incomplete coverage and ambiguous correspondence. Experiments show that the proposed approach can significantly improve the façades details of buildings in open LiDAR data and improving registration accuracy from up to 10 meters to less than half a meter compared to classic registration methods.

scholarly journals Improving Details of Building Façades in Open LiDAR Data Using Ground Images

2019 ◽  
Vol 11 (4) ◽  
pp. 420 ◽  
Author(s):  
Shenman Zhang ◽  
Pengjie Tao ◽  
Lei Wang ◽  
Yaolin Hou ◽  
Zhihua Hu
Keyword(s):  
Point Cloud ◽  
Open Data ◽  
Point Clouds ◽  
Lidar Data ◽  
Free Access ◽  
Registration Accuracy ◽  
Building Facades ◽  
Incomplete Coverage ◽  
Coherent Point Drift ◽  
Different Sources

Recent open data initiatives allow free access to a vast amount of light detection and ranging (LiDAR) data in many cities. However, most open LiDAR data of cities are acquired by airborne scanning, where points on building façades are sparse or even completely missing due to occlusions in the urban environment, leading to the absence of façade details. This paper presents an approach for improving the LiDAR data coverage on building façades by using point cloud generated from ground images. A coarse-to-fine strategy is proposed to fuse these two-point clouds of different sources with very limited overlaps. First, the façade point cloud generated from ground images is leveled by adjusting the facade normal to perpendicular to the upright direction. Then leveling façade point cloud is geolocated by alignment between images GPS data and their structure from motion (SfM) coordinates. Next, a modified coherent point drift algorithm with (surface) normal consistency is proposed to accurately align the façade point cloud to the LiDAR data. The significance of this work resides in the use of 2D overlapping points on the building outlines instead of the limited 3D overlap between the two-point clouds. This way we can still achieve reliable and precise registration under incomplete coverage and ambiguous correspondence. Experiments show that the proposed approach can significantly improve the façade details in open LiDAR data, and achieve 2 to 10 times higher registration accuracy, when compared to classic registration methods.

Registration and Fusion of UAV LiDAR System Sequence Images and Laser Point Clouds

2020 ◽  
Author(s):  
Jiayong Yu ◽  
Longchen Ma ◽  
Maoyi Tian, ◽  
Xiushan Lu
Keyword(s):  
Point Cloud ◽  
Image Data ◽  
Point Clouds ◽  
Optical Image ◽  
Point Cloud Data ◽  
Feature Points ◽  
Lidar System ◽  
Registration Accuracy ◽  
Cloud Data ◽  
Intensity Image

The unmanned aerial vehicle (UAV)-mounted mobile LiDAR system (ULS) is widely used for geomatics owing to its efficient data acquisition and convenient operation. However, due to limited carrying capacity of a UAV, sensors integrated in the ULS should be small and lightweight, which results in decrease in the density of the collected scanning points. This affects registration between image data and point cloud data. To address this issue, the authors propose a method for registering and fusing ULS sequence images and laser point clouds, wherein they convert the problem of registering point cloud data and image data into a problem of matching feature points between the two images. First, a point cloud is selected to produce an intensity image. Subsequently, the corresponding feature points of the intensity image and the optical image are matched, and exterior orientation parameters are solved using a collinear equation based on image position and orientation. Finally, the sequence images are fused with the laser point cloud, based on the Global Navigation Satellite System (GNSS) time index of the optical image, to generate a true color point cloud. The experimental results show the higher registration accuracy and fusion speed of the proposed method, thereby demonstrating its accuracy and effectiveness.

Registration and Fusion of UAV LiDAR System Sequence Images and Laser Point Clouds

2021 ◽  
Vol 65 (1) ◽  
pp. 10501-1-10501-9
Author(s):  
Jiayong Yu ◽  
Longchen Ma ◽  
Maoyi Tian ◽  
Xiushan Lu
Keyword(s):  
Point Cloud ◽  
Image Data ◽  
Point Clouds ◽  
Optical Image ◽  
Point Cloud Data ◽  
Feature Points ◽  
Lidar System ◽  
Registration Accuracy ◽  
Cloud Data ◽  
Intensity Image

Abstract The unmanned aerial vehicle (UAV)-mounted mobile LiDAR system (ULS) is widely used for geomatics owing to its efficient data acquisition and convenient operation. However, due to limited carrying capacity of a UAV, sensors integrated in the ULS should be small and lightweight, which results in decrease in the density of the collected scanning points. This affects registration between image data and point cloud data. To address this issue, the authors propose a method for registering and fusing ULS sequence images and laser point clouds, wherein they convert the problem of registering point cloud data and image data into a problem of matching feature points between the two images. First, a point cloud is selected to produce an intensity image. Subsequently, the corresponding feature points of the intensity image and the optical image are matched, and exterior orientation parameters are solved using a collinear equation based on image position and orientation. Finally, the sequence images are fused with the laser point cloud, based on the Global Navigation Satellite System (GNSS) time index of the optical image, to generate a true color point cloud. The experimental results show the higher registration accuracy and fusion speed of the proposed method, thereby demonstrating its accuracy and effectiveness.

scholarly journals Evaluating Thermal Attribute Mapping Strategies for Oblique Airborne Photogrammetric System AOS-Tx8

2019 ◽  
Vol 12 (1) ◽  
pp. 112 ◽  
Author(s):  
Dong Lin ◽  
Lutz Bannehr ◽  
Christoph Ulrich ◽  
Hans-Gerd Maas
Keyword(s):  
Point Cloud ◽  
Large Scale ◽  
Texture Mapping ◽  
Point Clouds ◽  
Registration Accuracy ◽  
Point Cloud Registration ◽  
Thermal Imagery ◽  
Processing Scheme ◽  
Data Registration ◽  
Thermal Cameras

Thermal imagery is widely used in various fields of remote sensing. In this study, a novel processing scheme is developed to process the data acquired by the oblique airborne photogrammetric system AOS-Tx8 consisting of four thermal cameras and four RGB cameras with the goal of large-scale area thermal attribute mapping. In order to merge 3D RGB data and 3D thermal data, registration is conducted in four steps: First, thermal and RGB point clouds are generated independently by applying structure from motion (SfM) photogrammetry to both the thermal and RGB imagery. Next, a coarse point cloud registration is performed by the support of georeferencing data (global positioning system, GPS). Subsequently, a fine point cloud registration is conducted by octree-based iterative closest point (ICP). Finally, three different texture mapping strategies are compared. Experimental results showed that the global image pose refinement outperforms the other two strategies at registration accuracy between thermal imagery and RGB point cloud. Potential building thermal leakages in large areas can be fast detected in the generated texture mapping results. Furthermore, a combination of the proposed workflow and the oblique airborne system allows for a detailed thermal analysis of building roofs and facades.

scholarly journals UAV and LiDAR Data in the Service of Bank Gully Erosion Measurement in Rambla de Algeciras Lakeshore

Water ◽  
2020 ◽  
Vol 12 (10) ◽  
pp. 2748
Author(s):  
Radouane Hout ◽  
Véronique Maleval ◽  
Gil Mahe ◽  
Eric Rouvellac ◽  
Rémi Crouzevialle ◽  
...  
Keyword(s):  
High Resolution ◽  
Point Clouds ◽  
Sediment Budget ◽  
Lidar Data ◽  
Different Types ◽  
The Subject ◽  
Geomorphological Changes ◽  
Uncertainty Models ◽  
Geological Formations ◽  
Different Sources

The Rambla de Algeciras lake in Murcia is a reservoir for drinking water and contributes to the reduction of flooding. With a semi-arid climate and a very friable nature of the geological formations at the lakeshore level, the emergence and development of bank gullies is favored and poses a problem of silting of the dam. A study was conducted on these lakeshores to estimate the sediment input from the bank gullies. In 2018, three gullies of different types were the subject of three UAV photography missions to model in high resolution their low topographic change, using the SfM-MVS photogrammetry method. The combination of two configurations of nadir and oblique photography allowed us to obtain a complete high-resolution modeling of complex bank gullies with overhangs, as it was the case in site 3. To study annual lakeshore variability and sediment dynamics we used LiDAR data from the PNOA project taken in 2009 and 2016. For a better error analysis of UAV photogrammetry data we compared spatially variable and uniform uncertainty models, while taking into account the different sources of error. For LiDAR data, on the other hand, we used a spatially uniform error model. Depending on the geomorphology of the gullies and the configuration of the data capture, we chose the most appropriate method to detect geomorphological changes on the surfaces of the bank gullies. At site 3 the gully topography is complex, so we performed a 3D distance calculation between point clouds using the M3C2 algorithm to estimate the sediment budget. On sites 1 and 2 we used the DoD technique to estimate the sediment budget as it was the case for the LiDAR data. The results of the LiDAR and UAV data reveal significant lakeshore erosion activity by bank gullies since the annual inflow from the banks is estimated at 39 T/ha/year.

scholarly journals Hue-assisted automatic registration of color point clouds

2014 ◽  
Vol 1 (4) ◽  
pp. 223-232 ◽  
Author(s):  
Hao Men ◽  
Kishore Pochiraju
Keyword(s):  
Point Cloud ◽  
Point Clouds ◽  
Local Geometry ◽  
Automatic Registration ◽  
Color Information ◽  
Registration Accuracy ◽  
Surface Color ◽  
Registration Algorithm ◽  
Sample Density ◽  
Occupancy Grids

Abstract This paper describes a variant of the extended Gaussian image based registration algorithm for point clouds with surface color information. The method correlates the distributions of surface normals for rotational alignment and grid occupancy for translational alignment with hue filters applied during the construction of surface normal histograms and occupancy grids. In this method, the size of the point cloud is reduced with a hue-based down sampling that is independent of the point sample density or local geometry. Experimental results show that use of the hue filters increases the registration speed and improves the registration accuracy. Coarse rigid transformations determined in this step enable fine alignment with dense, unfiltered point clouds or using Iterative Common Point (ICP) alignment techniques.

scholarly journals Automated Extraction of 3D Trees from Mobile LiDAR Point Clouds

2014 ◽  
Vol XL-5 ◽  
pp. 629-632 ◽  
Author(s):  
Y. Yu ◽  
J. Li ◽  
H. Guan ◽  
D. Zai ◽  
C. Wang
Keyword(s):  
Point Cloud ◽  
Euclidean Distance ◽  
Point Clouds ◽  
Shape Descriptor ◽  
Light Detection And Ranging ◽  
Lidar Data ◽  
Automated Extraction ◽  
Normalized Cut ◽  
Model Driven ◽  
Automated Algorithm

This paper presents an automated algorithm for extracting 3D trees directly from 3D mobile light detection and ranging (LiDAR) data. To reduce both computational and spatial complexities, ground points are first filtered out from a raw 3D point cloud via blockbased elevation filtering. Off-ground points are then grouped into clusters representing individual objects through Euclidean distance clustering and voxel-based normalized cut segmentation. Finally, a model-driven method is proposed to achieve the extraction of 3D trees based on a pairwise 3D shape descriptor. The proposed algorithm is tested using a set of mobile LiDAR point clouds acquired by a RIEGL VMX-450 system. The results demonstrate the feasibility and effectiveness of the proposed algorithm.

scholarly journals Pose Estimation of Non-Cooperative Space Targets Based on Cross-Source Point Cloud Fusion

2021 ◽  
Vol 13 (21) ◽  
pp. 4239
Author(s):  
Jie Li ◽  
Yiqi Zhuang ◽  
Qi Peng ◽  
Liang Zhao
Keyword(s):  
Pose Estimation ◽  
Measurement System ◽  
Point Cloud ◽  
Conformal Geometry ◽  
Unscented Kalman Filter ◽  
Estimation Error ◽  
Point Clouds ◽  
Fusion Algorithm ◽  
Registration Accuracy ◽  
Source Point

On-orbit space technology is used for tasks such as the relative navigation of non-cooperative targets, rendezvous and docking, on-orbit assembly, and space debris removal. In particular, the pose estimation of space non-cooperative targets is a prerequisite for studying these applications. The capabilities of a single sensor are limited, making it difficult to achieve high accuracy in the measurement range. Against this backdrop, a non-cooperative target pose measurement system fused with multi-source sensors was designed in this study. First, a cross-source point cloud fusion algorithm was developed. This algorithm uses the unified and simplified expression of geometric elements in conformal geometry algebra, breaks the traditional point-to-point correspondence, and constructs matching relationships between points and spheres. Next, for the fused point cloud, we proposed a plane clustering-method-based CGA to eliminate point cloud diffusion and then reconstruct the 3D contour model. Finally, we used a twistor along with the Clohessy–Wiltshire equation to obtain the posture and other motion parameters of the non-cooperative target through the unscented Kalman filter. In both the numerical simulations and the semi-physical experiments, the proposed measurement system met the requirements for non-cooperative target measurement accuracy, and the estimation error of the angle of the rotating spindle was 30% lower than that of other, previously studied methods. The proposed cross-source point cloud fusion algorithm can achieve high registration accuracy for point clouds with different densities and small overlap rates.

scholarly journals Optimization of the PointPillars network for 3D object detection in point clouds

2020 ◽  
Author(s):  
Joanna Stanisz ◽  
Konrad Lis ◽  
Tomasz Kryjak ◽  
Marek Gorgon
Keyword(s):  
Object Detection ◽  
Point Cloud ◽  
Main Part ◽  
Point Clouds ◽  
Lidar Data ◽  
Detection Accuracy ◽  
3D Object ◽  
Fold Reduction ◽  
Low Energy Consumption ◽  
3D Object Detection

In this paper we present our research on the optimisation of a deep neural network for 3D object detection in a point cloud. Techniques like quantisation and pruning available in the Brevitas and PyTorch tools were used. We performed the experiments for the PointPillars network, which offers a reasonable compromise between detection accuracy and calculation complexity. The aim of this work was to propose a variant of the network which we will ultimately implement in an FPGA device. This will allow for real-time LiDAR data processing with low energy consumption. The obtained results indicate that even a significant quantisation from 32-bit floating point to 2-bit integer in the main part of the algorithm, results in 5%-9% decrease of the detection accuracy, while allowing for almost a 16-fold reduction in size of the model.

scholarly journals INTEGRATING SMARTPHONE IMAGES AND AIRBORNE LIDAR DATA FOR COMPLETE URBAN BUILDING MODELLING

2016 ◽  
Vol XLI-B5 ◽  
pp. 741-747 ◽  
Author(s):  
Shenman Zhang ◽  
Jie Shan ◽  
Zhichao Zhang ◽  
Jixing Yan ◽  
Yaolin Hou
Keyword(s):  
Point Cloud ◽  
Point Clouds ◽  
Airborne Lidar ◽  
Image Point ◽  
Lidar Data ◽  
Building Model ◽  
Building Facades ◽  
Single Data ◽  
Airborne Lidar Data ◽  
Building Reconstruction

A complete building model reconstruction needs data collected from both air and ground. The former often has sparse coverage on building façades, while the latter usually is unable to observe the building rooftops. Attempting to solve the missing data issues in building reconstruction from single data source, we describe an approach for complete building reconstruction that integrates airborne LiDAR data and ground smartphone imagery. First, by taking advantages of GPS and digital compass information embedded in the image metadata of smartphones, we are able to find airborne LiDAR point clouds for the corresponding buildings in the images. In the next step, Structure-from-Motion and dense multi-view stereo algorithms are applied to generate building point cloud from multiple ground images. The third step extracts building outlines respectively from the LiDAR point cloud and the ground image point cloud. An automated correspondence between these two sets of building outlines allows us to achieve a precise registration and combination of the two point clouds, which ultimately results in a complete and full resolution building model. The developed approach overcomes the problem of sparse points on building façades in airborne LiDAR and the deficiency of rooftops in ground images such that the merits of both datasets are utilized.

Sign in / Sign up

Export Citation Format

Share Document