VALIDATION OF A UAV-DERIVED POINT CLOUD BY SEMANTIC CLASSIFICATION AND COMPARISON WITH TLS DATA

Abstract. Recent years showed a gradual transition from terrestrial to aerial survey thanks to the development of UAV and sensors for it. Many sectors benefited by this change among which geological one; drones are flexible, cost-efficient and can support outcrops surveying in many difficult situations such as inaccessible steep and high rock faces. The experiences acquired in terrestrial survey, with total stations, GNSS or terrestrial laser scanner (TLS), are not yet completely transferred to UAV acquisition. Hence, quality comparisons are still needed. The present paper is framed in this perspective aiming to evaluate the quality of the point clouds generated by an UAV in a geological context; data analysis was conducted comparing the UAV product with the homologous acquired with a TLS system. Exploiting modern semantic classification, based on eigenfeatures and support vector machine (SVM), the two point clouds were compared in terms of density and mutual distance. The UAV survey proves its usefulness in this situation with a uniform density distribution in the whole area and producing a point cloud with a quality comparable with the more traditional TLS systems.

Download Full-text

Fitting Terrestrial Laser Scanner Point Clouds with T-Splines: Local Refinement Strategy for Rigid Body Motion

Remote Sensing ◽

10.3390/rs13132494 ◽

2021 ◽

Vol 13 (13) ◽

pp. 2494

Author(s):

Gaël Kermarrec ◽

Niklas Schild ◽

Jan Hartmann

Keyword(s):

Point Cloud ◽

Goodness Of Fit ◽

Laser Scanner ◽

Point Clouds ◽

Statistical Testing ◽

Computational Time ◽

Terrestrial Laser Scanner ◽

Reference Surface ◽

Local Refinement ◽

Surface Approximation

T-splines have recently been introduced to represent objects of arbitrary shapes using a smaller number of control points than the conventional non-uniform rational B-splines (NURBS) or B-spline representatizons in computer-aided design, computer graphics and reverse engineering. They are flexible in representing complex surface shapes and economic in terms of parameters as they enable local refinement. This property is a great advantage when dense, scattered and noisy point clouds are approximated using least squares fitting, such as those from a terrestrial laser scanner (TLS). Unfortunately, when it comes to assessing the goodness of fit of the surface approximation with a real dataset, only a noisy point cloud can be approximated: (i) a low root mean squared error (RMSE) can be linked with an overfitting, i.e., a fitting of the noise, and should be correspondingly avoided, and (ii) a high RMSE is synonymous with a lack of details. To address the challenge of judging the approximation, the reference surface should be entirely known: this can be solved by printing a mathematically defined T-splines reference surface in three dimensions (3D) and modeling the artefacts induced by the 3D printing. Once scanned under different configurations, it is possible to assess the goodness of fit of the approximation for a noisy and potentially gappy point cloud and compare it with the traditional but less flexible NURBS. The advantages of T-splines local refinement open the door for further applications within a geodetic context such as rigorous statistical testing of deformation. Two different scans from a slightly deformed object were approximated; we found that more than 40% of the computational time could be saved without affecting the goodness of fit of the surface approximation by using the same mesh for the two epochs.

Download Full-text

Comparison of Depth Camera and Terrestrial Laser Scanner in Monitoring Structural Deflections

Sensors ◽

10.3390/s21010201 ◽

2020 ◽

Vol 21 (1) ◽

pp. 201

Author(s):

Michael Bekele Maru ◽

Donghwan Lee ◽

Kassahun Demissie Tola ◽

Seunghee Park

Keyword(s):

Optical Sensors ◽

Point Cloud ◽

Three Dimensional ◽

Laser Scanner ◽

Point Clouds ◽

Depth Camera ◽

Terrestrial Laser Scanner ◽

Cloud Data ◽

3D Point Clouds ◽

3D Information

Modeling a structure in the virtual world using three-dimensional (3D) information enhances our understanding, while also aiding in the visualization, of how a structure reacts to any disturbance. Generally, 3D point clouds are used for determining structural behavioral changes. Light detection and ranging (LiDAR) is one of the crucial ways by which a 3D point cloud dataset can be generated. Additionally, 3D cameras are commonly used to develop a point cloud containing many points on the external surface of an object around it. The main objective of this study was to compare the performance of optical sensors, namely a depth camera (DC) and terrestrial laser scanner (TLS) in estimating structural deflection. We also utilized bilateral filtering techniques, which are commonly used in image processing, on the point cloud data for enhancing their accuracy and increasing the application prospects of these sensors in structure health monitoring. The results from these sensors were validated by comparing them with the outputs from a linear variable differential transformer sensor, which was mounted on the beam during an indoor experiment. The results showed that the datasets obtained from both the sensors were acceptable for nominal deflections of 3 mm and above because the error range was less than ±10%. However, the result obtained from the TLS were better than those obtained from the DC.

Download Full-text

Classification of Point Clouds for Indoor Components Using Few Labeled Samples

Remote Sensing ◽

10.3390/rs12142181 ◽

2020 ◽

Vol 12 (14) ◽

pp. 2181

Author(s):

Hangbin Wu ◽

Huimin Yang ◽

Shengyu Huang ◽

Doudou Zeng ◽

Chun Liu ◽

...

Keyword(s):

Deep Learning ◽

Point Cloud ◽

Point Clouds ◽

Neighborhood Search ◽

Learning Methods ◽

Semantic Classification ◽

Cloud Classification ◽

Mixed Features ◽

Indoor Scenarios ◽

Point Cloud Classification

The existing deep learning methods for point cloud classification are trained using abundant labeled samples and used to test only a few samples. However, classification tasks are diverse, and not all tasks have enough labeled samples for training. In this paper, a novel point cloud classification method for indoor components using few labeled samples is proposed to solve the problem of the requirement for abundant labeled samples for training with deep learning classification methods. This method is composed of four parts: mixing samples, feature extraction, dimensionality reduction, and semantic classification. First, the few labeled point clouds are mixed with unlabeled point clouds. Next, the mixed high-dimensional features are extracted using a deep learning framework. Subsequently, a nonlinear manifold learning method is used to embed the mixed features into a low-dimensional space. Finally, the few labeled point clouds in each cluster are identified, and semantic labels are provided for unlabeled point clouds in the same cluster by a neighborhood search strategy. The validity and versatility of the proposed method were validated by different experiments and compared with three state-of-the-art deep learning methods. Our method uses fewer than 30 labeled point clouds to achieve an accuracy that is 1.89–19.67% greater than existing methods. More importantly, the experimental results suggest that this method is not only suitable for single-attribute indoor scenarios but also for comprehensive complex indoor scenarios.

Download Full-text

2D lidar to kinematic chain calibration using planar features of indoor scenes

Industrial Robot the international journal of robotics research and application ◽

10.1108/ir-09-2019-0201 ◽

2020 ◽

Vol 47 (5) ◽

pp. 647-655

Author(s):

Bernardo Lourenço ◽

Tiago Madeira ◽

Paulo Dias ◽

Vitor M. Ferreira Santos ◽

Miguel Oliveira

Keyword(s):

Point Cloud ◽

Laser Scanner ◽

Kinematic Chain ◽

Point Clouds ◽

Calibration Procedure ◽

High Angular Resolution ◽

Reconstruction Procedure ◽

Content Type ◽

Additional Degree ◽

Indoor Scenes

Purpose 2D laser rangefinders (LRFs) are commonly used sensors in the field of robotics, as they provide accurate range measurements with high angular resolution. These sensors can be coupled with mechanical units which, by granting an additional degree of freedom to the movement of the LRF, enable the 3D perception of a scene. To be successful, this reconstruction procedure requires to evaluate with high accuracy the extrinsic transformation between the LRF and the motorized system. Design/methodology/approach In this work, a calibration procedure is proposed to evaluate this transformation. The method does not require a predefined marker (commonly used despite its numerous disadvantages), as it uses planar features in the point acquired clouds. Findings Qualitative inspections show that the proposed method reduces artifacts significantly, which typically appear in point clouds because of inaccurate calibrations. Furthermore, quantitative results and comparisons with a high-resolution 3D scanner demonstrate that the calibrated point cloud represents the geometries present in the scene with much higher accuracy than with the un-calibrated point cloud. Practical implications The last key point of this work is the comparison of two laser scanners: the lemonbot (authors’) and a commercial FARO scanner. Despite being almost ten times cheaper, the laser scanner was able to achieve similar results in terms of geometric accuracy. Originality/value This work describes a novel calibration technique that is easy to implement and is able to achieve accurate results. One of its key features is the use of planes to calibrate the extrinsic transformation.

Download Full-text

Detection of Very Small Tree Plantations and Tree-Level Characterization Using Open-Access Remote-Sensing Databases

Remote Sensing ◽

10.3390/rs12142276 ◽

2020 ◽

Vol 12 (14) ◽

pp. 2276

Author(s):

Laura Alonso ◽

Juan Picos ◽

Guillermo Bastos ◽

Julia Armesto

Keyword(s):

Open Access ◽

Point Cloud ◽

Castanea Sativa ◽

Point Clouds ◽

Coefficient Of Determination ◽

National Database ◽

Tree Level ◽

Tree Plantations ◽

Support Vector ◽

Individual Trees

Highly fragmented land property hinders the planning and management of single species tree plantations. In such situations, acquiring information about the available resources is challenging. This study aims to propose a method to locate and characterize tree plantations in these cases. Galicia (Northwest of Spain) is an area where property is extremely divided into small parcels. European chestnut (Castanea sativa) plantations are an important source of income there; however, it is often difficult to obtain information about them due to their small size and scattered distribution. Therefore, we selected a Galician region with a high presence of chestnut plantations as a case study area in order to locate and characterize small plantations using open-access data. First, we detected the location of chestnut plantations applying a supervised classification for a combination of: Sentinel-2 images and the open-access low-density Light Detection and Ranging (LiDAR) point clouds, obtained from the untapped open-access LiDAR Spanish national database. Three classification algorithms were used: Random Forest (RF), Support Vector Machine (SVM), and XGBoost. We later characterized the plots at the tree-level using the LiDAR point-cloud. We detected individual trees and obtained their height applying a local maxima algorithm to a point-cloud-derived Canopy Height Model (CHM). We also calculated the crown surface of each tree by applying a method based on two-dimensional (2D) tree shape reconstruction and canopy segmentation to a projection of the LiDAR point cloud. Chestnut plantations were detected with an overall accuracy of 81.5%. Individual trees were identified with a detection rate of 96%. The coefficient of determination R2 value for tree height estimation was 0.83, while for the crown surface calculation it was 0.74. The accuracy achieved with these open-access databases makes the proposed procedure suitable for acquiring knowledge about the location and state of chestnut plantations as well as for monitoring their evolution.

Download Full-text

A Single Point-Based Multilevel Features Fusion and Pyramid Neighborhood Optimization Method for ALS Point Cloud Classification

Applied Sciences ◽

10.3390/app9050951 ◽

2019 ◽

Vol 9 (5) ◽

pp. 951 ◽

Cited By ~ 6

Author(s):

Yong Li ◽

Guofeng Tong ◽

Xiance Du ◽

Xiang Yang ◽

Jianjun Zhang ◽

...

Keyword(s):

Point Cloud ◽

Single Point ◽

Point Clouds ◽

Optimization Method ◽

Gaussian Kernel ◽

Support Vector ◽

Angle Distribution ◽

Features Fusion ◽

Cloud Classification ◽

Point Cloud Classification

3D point cloud classification has wide applications in the field of scene understanding. Point cloud classification based on points can more accurately segment the boundary region between adjacent objects. In this paper, a point cloud classification algorithm based on a single point multilevel features fusion and pyramid neighborhood optimization are proposed for a Airborne Laser Scanning (ALS) point cloud. First, the proposed algorithm determines the neighborhood region of each point, after which the features of each single point are extracted. For the characteristics of the ALS point cloud, two new feature descriptors are proposed, i.e., a normal angle distribution histogram and latitude sampling histogram. Following this, multilevel features of a single point are constructed by multi-resolution of the point cloud and multi-neighborhood spaces. Next, the features are trained by the Support Vector Machine based on a Gaussian kernel function, and the points are classified by the trained model. Finally, a classification results optimization method based on a multi-scale pyramid neighborhood constructed by a multi-resolution point cloud is used. In the experiment, the algorithm is tested by a public dataset. The experimental results show that the proposed algorithm can effectively classify large-scale ALS point clouds. Compared with the existing algorithms, the proposed algorithm has a better classification performance.

Download Full-text

Influence of ULS data acquisition characteristics on the achievable stem reconstruction accuracies

10.5194/egusphere-egu2020-7378 ◽

2020 ◽

Author(s):

Moritz Bruggisser ◽

Johannes Otepka ◽

Norbert Pfeifer ◽

Markus Hollaus

Keyword(s):

Point Cloud ◽

Laser Scanning ◽

Laser Scanner ◽

Point Clouds ◽

Stem Diameter ◽

Forest Monitoring ◽

Individual Tree ◽

Detection Rates ◽

Point Count ◽

Tree Stem

<p>Unmanned aerial vehicles-borne laser scanning (ULS) allows time-efficient acquisition of high-resolution point clouds on regional extents at moderate costs. The quality of ULS-point clouds facilitates the 3D modelling of individual tree stems, what opens new possibilities in the context of forest monitoring and management. In our study, we developed and tested an algorithm which allows for i) the autonomous detection of potential stem locations within the point clouds, ii) the estimation of the diameter at breast height (DBH) and iii) the reconstruction of the tree stem. In our experiments on point clouds from both, a RIEGL miniVUX-1DL and a VUX-1UAV, respectively, we could detect 91.0 % and 77.6 % of the stems within our study area automatically. The DBH could be modelled with biases of 3.1 cm and 1.1 cm, respectively, from the two point cloud sets with respective detection rates of 80.6 % and 61.2 % of the trees present in the field inventory. The lowest 12 m of the tree stem could be reconstructed with absolute stem diameter differences below 5 cm and 2 cm, respectively, compared to stem diameters from a point cloud from terrestrial laser scanning. The accuracy of larger tree stems thereby was higher in general than the accuracy for smaller trees. Furthermore, we recognized a small influence only of the completeness with which a stem is covered with points, as long as half of the stem circumference was captured. Likewise, the absolute point count did not impact the accuracy, but, in contrast, was critical to the completeness with which a scene could be reconstructed. The precision of the laser scanner, on the other hand, was a key factor for the accuracy of the stem diameter estimation.&#160;<br>The findings of this study are highly relevant for the flight planning and the sensor selection of future ULS acquisition missions in the context of forest inventories.</p>

Download Full-text

A comparison of multi-view 3D reconstruction of a rock wall using several cameras and a laser scanner

ISPRS - International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences ◽

10.5194/isprsarchives-xl-5-573-2014 ◽

2014 ◽

Vol XL-5 ◽

pp. 573-580 ◽

Cited By ~ 35

Author(s):

K. Thoeni ◽

A. Giacomini ◽

R. Murtagh ◽

E. Kniest

Keyword(s):

3D Reconstruction ◽

Point Cloud ◽

Laser Scanner ◽

Ground Truth ◽

Point Clouds ◽

Digital Cameras ◽

Rock Wall ◽

Geological Features ◽

Dense Point ◽

Sharp Edges

This work presents a comparative study between multi-view 3D reconstruction using various digital cameras and a terrestrial laser scanner (TLS). Five different digital cameras were used in order to estimate the limits related to the camera type and to establish the minimum camera requirements to obtain comparable results to the ones of the TLS. The cameras used for this study range from commercial grade to professional grade and included a GoPro Hero 1080 (5 Mp), iPhone 4S (8 Mp), Panasonic Lumix LX5 (9.5 Mp), Panasonic Lumix ZS20 (14.1 Mp) and Canon EOS 7D (18 Mp). The TLS used for this work was a FARO Focus 3D laser scanner with a range accuracy of ±2 mm. The study area is a small rock wall of about 6 m height and 20 m length. The wall is partly smooth with some evident geological features, such as non-persistent joints and sharp edges. Eight control points were placed on the wall and their coordinates were measured by using a total station. These coordinates were then used to georeference all models. A similar number of images was acquired from a distance of between approximately 5 to 10 m, depending on field of view of each camera. The commercial software package PhotoScan was used to process the images, georeference and scale the models, and to generate the dense point clouds. Finally, the open-source package CloudCompare was used to assess the accuracy of the multi-view results. Each point cloud obtained from a specific camera was compared to the point cloud obtained with the TLS. The latter is taken as ground truth. The result is a coloured point cloud for each camera showing the deviation in relation to the TLS data. The main goal of this study is to quantify the quality of the multi-view 3D reconstruction results obtained with various cameras as objectively as possible and to evaluate its applicability to geotechnical problems.

Download Full-text

Accurate Calibration of a Self-Developed Vehicle-Borne LiDAR Scanning System

Journal of Sensors ◽

10.1155/2021/8816063 ◽

2021 ◽

Vol 2021 ◽

pp. 1-18

Author(s):

Ming Guo ◽

Bingnan Yan ◽

Tengfei Zhou ◽

Deng Pan ◽

Guoli Wang

Keyword(s):

Point Cloud ◽

Laser Scanner ◽

Measurement Data ◽

Point Clouds ◽

Calibration Method ◽

Linear Interpolation ◽

Measurement Unit ◽

Scanning System ◽

High Precision Measurement ◽

Distance Ratio

To obtain high-precision measurement data using vehicle-borne light detection and ranging (LiDAR) scanning (VLS) systems, calibration is necessary before a data acquisition mission. Thus, a novel calibration method based on a homemade target ball is proposed to estimate the system mounting parameters, which refer to the rotational and translational offsets between the LiDAR sensor and inertial measurement unit (IMU) orientation and position. Firstly, the spherical point cloud is fitted into a sphere to extract the coordinates of the centre, and each scan line on the sphere is fitted into a section of the sphere to calculate the distance ratio from the centre to the nearest two sections, and the attitude and trajectory parameters of the centre are calculated by linear interpolation. Then, the real coordinates of the centre of the sphere are calculated by measuring the coordinates of the reflector directly above the target ball with the total station. Finally, three rotation parameters and three translation parameters are calculated by two least-squares adjustments. Comparisons of the point cloud before and after calibration and the calibrated point clouds with the point cloud obtained by the terrestrial laser scanner show that the accuracy significantly improved after calibration. The experiment indicates that the calibration method based on the homemade target ball can effectively improve the accuracy of the point cloud, which can promote VLS development and applications.

Download Full-text

POTENTIAL OF FULL WAVEFORM AIRBORNE LASER SCANNING DATA FOR URBAN AREA CLASSIFICATION – TRANSFER OF CLASSIFICATION APPROACHES BETWEEN MISSIONS

ISPRS - International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences ◽

10.5194/isprsarchives-xl-7-w3-1317-2015 ◽

2015 ◽

Vol XL-7/W3 ◽

pp. 1317-1323 ◽

Cited By ~ 3

Author(s):

G. Tran ◽

D. Nguyen ◽

M. Milenkovic ◽

N. Pfeifer

Keyword(s):

Point Cloud ◽

Laser Scanning ◽

Laser Scanner ◽

Point Clouds ◽

Surface Model ◽

Knowledge Based ◽

Full Waveform ◽

Airborne Laser ◽

Point Density ◽

Area Classification

Full-waveform (FWF) LiDAR (Light Detection and Ranging) systems have their advantage in recording the entire backscattered signal of each emitted laser pulse compared to conventional airborne discrete-return laser scanner systems. The FWF systems can provide point clouds which contain extra attributes like amplitude and echo width, etc. In this study, a FWF data collected in 2010 for Eisenstadt, a city in the eastern part of Austria was used to classify four main classes: buildings, trees, waterbody and ground by employing a decision tree. Point density, echo ratio, echo width, normalised digital surface model and point cloud roughness are the main inputs for classification. The accuracy of the final results, correctness and completeness measures, were assessed by comparison of the classified output to a knowledge-based labelling of the points. Completeness and correctness between 90% and 97% was reached, depending on the class. While such results and methods were presented before, we are investigating additionally the transferability of the classification method (features, thresholds …) to another urban FWF lidar point cloud. Our conclusions are that from the features used, only echo width requires new thresholds. A data-driven adaptation of thresholds is suggested.

Download Full-text