scholarly journals THE SEGMENTATION OF POINT CLOUDS WITH K-MEANS AND ANN (ARTIFICAL NEURAL NETWORK)

2017 ◽  
Vol XLII-1/W1 ◽  
pp. 595-598 ◽  
Author(s):  
R. A. Kuçak ◽  
E. Özdemir ◽  
S. Erol
Keyword(s):  
Neural Network ◽  
Urban Areas ◽  
Point Cloud ◽  
Laser Scanner ◽  
Digital Terrain Model ◽  
Point Clouds ◽  
Self Organizing Map ◽  
Terrestrial Lidar ◽  
The Road ◽  
Photogrammetric Method

Segmentation of point clouds is recently used in many Geomatics Engineering applications such as the building extraction in urban areas, Digital Terrain Model (DTM) generation and the road or urban furniture extraction. Segmentation is a process of dividing point clouds according to their special characteristic layers. The present paper discusses K-means and self-organizing map (SOM) which is a type of ANN (Artificial Neural Network) segmentation algorithm which treats the segmentation of point cloud. The point clouds which generate with photogrammetric method and Terrestrial Lidar System (TLS) were segmented according to surface normal, intensity and curvature. Thus, the results were evaluated.<br><br> LIDAR (Light Detection and Ranging) and Photogrammetry are commonly used to obtain point clouds in many remote sensing and geodesy applications. By photogrammetric method or LIDAR method, it is possible to obtain point cloud from terrestrial or airborne systems. In this study, the measurements were made with a Leica C10 laser scanner in LIDAR method. In photogrammetric method, the point cloud was obtained from photographs taken from the ground with a 13 MP non-metric camera.

scholarly journals TERRAIN EXTRACTION BY INTEGRATING TERRESTRIAL LASER SCANNER DATA AND SPECTRAL INFORMATION

2015 ◽  
Vol XL-2/W4 ◽  
pp. 45-51 ◽  
Author(s):  
C. L. Lau ◽  
S. Halim ◽  
M. Zulkepli ◽  
A. M. Azwan ◽  
W. L. Tang ◽  
...  
Keyword(s):  
Point Cloud ◽  
Laser Scanner ◽  
Digital Camera ◽  
Digital Terrain Model ◽  
Point Clouds ◽  
Spectral Information ◽  
Terrestrial Laser Scanner ◽  
Cloud Data ◽  
Terrain Model ◽  
Colour Image

The extraction of true terrain points from unstructured laser point cloud data is an important process in order to produce an accurate digital terrain model (DTM). However, most of these spatial filtering methods just utilizing the geometrical data to discriminate the terrain points from nonterrain points. The point cloud filtering method also can be improved by using the spectral information available with some scanners. Therefore, the objective of this study is to investigate the effectiveness of using the three-channel (red, green and blue) of the colour image captured from built-in digital camera which is available in some Terrestrial Laser Scanner (TLS) for terrain extraction. In this study, the data acquisition was conducted at a mini replica landscape in Universiti Teknologi Malaysia (UTM), Skudai campus using Leica ScanStation C10. The spectral information of the coloured point clouds from selected sample classes are extracted for spectral analysis. The coloured point clouds which within the corresponding preset spectral threshold are identified as that specific feature point from the dataset. This process of terrain extraction is done through using developed Matlab coding. Result demonstrates that a higher spectral resolution passive image is required in order to improve the output. This is because low quality of the colour images captured by the sensor contributes to the low separability in spectral reflectance. In conclusion, this study shows that, spectral information is capable to be used as a parameter for terrain extraction.

scholarly journals SEMANTIC LABELING AND REFINEMENT OF LIDAR POINT CLOUDS USING DEEP NEURAL NETWORK IN URBAN AREAS

2019 ◽  
Vol IV-2/W7 ◽  
pp. 63-70 ◽  
Author(s):  
R. Huang ◽  
Z. Ye ◽  
D. Hong ◽  
Y. Xu ◽  
U. Stilla
Keyword(s):  
Neural Network ◽  
Urban Areas ◽  
Point Cloud ◽  
Laser Scanning ◽  
Deep Neural Network ◽  
Dimensional Space ◽  
Point Clouds ◽  
Spatial Domain ◽  
Local Context ◽  
Semantic Labeling

<p><strong>Abstract.</strong> In this paper, we propose a framework for obtaining semantic labels of LiDAR point clouds and refining the classification results by combining a deep neural network with a graph-structured smoothing technique. In general, the goal of the semantic scene analysis is to assign a semantic label to each point in the point cloud. Although various related researches have been reported, due to the complexity of urban areas, the semantic labeling of point clouds in urban areas is still a challenging task. In this paper, we address the issues of how to effectively extract features from each point and its local surrounding and how to refine the initial soft labels by considering contextual information in the spatial domain. Specifically, we improve the effectiveness of classification of point cloud in two aspects. Firstly, instead of utilizing handcrafted features as input for classification and refinement, the local context of a point is embedded into deep dimensional space and classified via a deep neural network (PointNet++), and simultaneously soft labels are obtained as initial results for next refinement. Secondly, the initial label probability set is improved by taking the context both in the spatial domain into consideration by constructing a graph structure, and the final labels are optimized by a graph cuts algorithm. To evaluate the performance of our proposed framework, experiments are conducted on a mobile laser scanning (MLS) point cloud dataset. We demonstrate that our approach can achieve higher accuracy in comparison to several commonly-used state-of-the-art baselines. The overall accuracy of our proposed method on TUM dataset can reach 85.38% for labeling eight semantic classes.</p>

scholarly journals New Feature Classes for Acoustic Habitat Mapping—A Multibeam Echosounder Point Cloud Analysis for Mapping Submerged Aquatic Vegetation (SAV)

Geosciences ◽  
2019 ◽  
Vol 9 (5) ◽  
pp. 235 ◽  
Author(s):  
Philipp Held ◽  
Jens Schneider von Deimling
Keyword(s):  
Data Analysis ◽  
Prediction Accuracy ◽  
Point Cloud ◽  
Submerged Aquatic Vegetation ◽  
Aquatic Vegetation ◽  
Digital Terrain Model ◽  
Point Clouds ◽  
Habitat Mapping ◽  
Terrestrial Lidar ◽  
Multibeam Echosounder

A new method for multibeam echosounder (MBES) data analysis is presented with the aim of improving habitat mapping, especially when considering submerged aquatic vegetation (SAV). MBES data were acquired with 400 kHz in 1–8 m water depth with a spatial resolution in the decimeter scale. The survey area was known to be populated with the seagrass Zostera marina and the bathymetric soundings were highly influenced by this habitat. The depth values often coincide with the canopy of the seagrass. Instead of classifying the data with a digital terrain model and the given derivatives, we derive predictive features from the native point cloud of the MBES soundings in a similar way to terrestrial LiDAR data analysis. We calculated the eigenvalues to derive nine characteristic features, which include linearity, planarity, and sphericity. The features were calculated for each sounding within a cylindrical neighborhood of 0.5 m radius and holding 88 neighboring soundings, on average, during our survey. The occurrence of seagrass was ground-truthed by divers and aerial photography. A data model was constructed and we applied a random forest machine learning supervised classification to predict between the two cases of “seafloor” and “vegetation”. Prediction by linearity, planarity, and sphericity resulted in 88.5% prediction accuracy. After constructing the higher-order eigenvalue derivatives and having the nine features available, the model resulted in 96% prediction accuracy. This study outlines for the first time that valuable feature classes can be derived from MBES point clouds—an approach that could substantially improve bathymetric measurements and habitat mapping.

scholarly journals POINT-CLOUD COMPRESSION FOR VEHICLE-BASED MOBILE MAPPING SYSTEMS USING PORTABLE NETWORK GRAPHICS

2017 ◽  
Vol IV-2/W4 ◽  
pp. 99-106 ◽  
Author(s):  
K. Kohira ◽  
H. Masuda
Keyword(s):  
Urban Areas ◽  
Point Cloud ◽  
Laser Scanner ◽  
Point Clouds ◽  
Residential Areas ◽  
Compression Method ◽  
Mobile Mapping ◽  
Automatic Driving ◽  
Mobile Mapping Systems ◽  
Mapping Systems

A mobile mapping system is effective for capturing dense point-clouds of roads and roadside objects．Point-clouds of urban areas, residential areas, and arterial roads are useful for maintenance of infrastructure, map creation, and automatic driving. However, the data size of point-clouds measured in large areas is enormously large. A large storage capacity is required to store such point-clouds, and heavy loads will be taken on network if point-clouds are transferred through the network. Therefore, it is desirable to reduce data sizes of point-clouds without deterioration of quality. In this research, we propose a novel point-cloud compression method for vehicle-based mobile mapping systems. In our compression method, point-clouds are mapped onto 2D pixels using GPS time and the parameters of the laser scanner. Then, the images are encoded in the Portable Networking Graphics (PNG) format and compressed using the PNG algorithm. In our experiments, our method could efficiently compress point-clouds without deteriorating the quality.

scholarly journals Fitting Terrestrial Laser Scanner Point Clouds with T-Splines: Local Refinement Strategy for Rigid Body Motion

2021 ◽  
Vol 13 (13) ◽  
pp. 2494
Author(s):  
Gaël Kermarrec ◽  
Niklas Schild ◽  
Jan Hartmann
Keyword(s):  
Point Cloud ◽  
Goodness Of Fit ◽  
Laser Scanner ◽  
Point Clouds ◽  
Statistical Testing ◽  
Computational Time ◽  
Terrestrial Laser Scanner ◽  
Reference Surface ◽  
Local Refinement ◽  
Surface Approximation

T-splines have recently been introduced to represent objects of arbitrary shapes using a smaller number of control points than the conventional non-uniform rational B-splines (NURBS) or B-spline representatizons in computer-aided design, computer graphics and reverse engineering. They are flexible in representing complex surface shapes and economic in terms of parameters as they enable local refinement. This property is a great advantage when dense, scattered and noisy point clouds are approximated using least squares fitting, such as those from a terrestrial laser scanner (TLS). Unfortunately, when it comes to assessing the goodness of fit of the surface approximation with a real dataset, only a noisy point cloud can be approximated: (i) a low root mean squared error (RMSE) can be linked with an overfitting, i.e., a fitting of the noise, and should be correspondingly avoided, and (ii) a high RMSE is synonymous with a lack of details. To address the challenge of judging the approximation, the reference surface should be entirely known: this can be solved by printing a mathematically defined T-splines reference surface in three dimensions (3D) and modeling the artefacts induced by the 3D printing. Once scanned under different configurations, it is possible to assess the goodness of fit of the approximation for a noisy and potentially gappy point cloud and compare it with the traditional but less flexible NURBS. The advantages of T-splines local refinement open the door for further applications within a geodetic context such as rigorous statistical testing of deformation. Two different scans from a slightly deformed object were approximated; we found that more than 40% of the computational time could be saved without affecting the goodness of fit of the surface approximation by using the same mesh for the two epochs.

scholarly journals Comparison of Depth Camera and Terrestrial Laser Scanner in Monitoring Structural Deflections

Sensors ◽  
2020 ◽  
Vol 21 (1) ◽  
pp. 201
Author(s):  
Michael Bekele Maru ◽  
Donghwan Lee ◽  
Kassahun Demissie Tola ◽  
Seunghee Park
Keyword(s):  
Optical Sensors ◽  
Point Cloud ◽  
Three Dimensional ◽  
Laser Scanner ◽  
Point Clouds ◽  
Depth Camera ◽  
Terrestrial Laser Scanner ◽  
Cloud Data ◽  
3D Point Clouds ◽  
3D Information

Modeling a structure in the virtual world using three-dimensional (3D) information enhances our understanding, while also aiding in the visualization, of how a structure reacts to any disturbance. Generally, 3D point clouds are used for determining structural behavioral changes. Light detection and ranging (LiDAR) is one of the crucial ways by which a 3D point cloud dataset can be generated. Additionally, 3D cameras are commonly used to develop a point cloud containing many points on the external surface of an object around it. The main objective of this study was to compare the performance of optical sensors, namely a depth camera (DC) and terrestrial laser scanner (TLS) in estimating structural deflection. We also utilized bilateral filtering techniques, which are commonly used in image processing, on the point cloud data for enhancing their accuracy and increasing the application prospects of these sensors in structure health monitoring. The results from these sensors were validated by comparing them with the outputs from a linear variable differential transformer sensor, which was mounted on the beam during an indoor experiment. The results showed that the datasets obtained from both the sensors were acceptable for nominal deflections of 3 mm and above because the error range was less than ±10%. However, the result obtained from the TLS were better than those obtained from the DC.

Real-Time 3D object detection using improved convolutional neural network based on image-driven point cloud

2021 ◽  
Vol 14 ◽  
Author(s):  
Zhiyong Gao ◽  
Jianhong Xiang
Keyword(s):  
Neural Network ◽  
Object Detection ◽  
Convolutional Neural Network ◽  
Real Time ◽  
Point Cloud ◽  
Point Clouds ◽  
3D Point Cloud ◽  
3D Object ◽  
3D Object Detection ◽  
Instance Segmentation

Background: While detecting the object directly from the 3D point cloud, the natural 3D patterns and invariance of 3D data are often obscure. Objective: In this work, we aimed at studying the 3D object detection from discrete, disordered and sparse 3D point clouds. Methods: The CNN is composed of the frustum sequence module, 3D instance segmentation module S-NET, 3D point cloud transformation module T-NET, and 3D boundary box estimation module E-NET. The search space of the object is determined by the frustum sequence module. The instance segmentation of the point cloud is performed by the 3D instance segmentation module. The 3D coordinates of the object are confirmed by the transformation module and the 3D bounding box estimation module. Results: Evaluated on KITTI benchmark dataset, our method outperforms the state of the art by remarkable margins while having real-time capability. Conclusion: We achieve real-time 3D object detection by proposing an improved convolutional neural network (CNN) based on image-driven point clouds.

scholarly journals Segmentation and Multi-Scale Convolutional Neural Network-Based Classification of Airborne Laser Scanner Data

Sensors ◽  
2018 ◽  
Vol 18 (10) ◽  
pp. 3347 ◽  
Author(s):  
Zhishuang Yang ◽  
Bo Tan ◽  
Huikun Pei ◽  
Wanshou Jiang
Keyword(s):  
Neural Network ◽  
Convolutional Neural Network ◽  
Laser Scanning ◽  
Laser Scanner ◽  
Region Growing ◽  
Point Clouds ◽  
Classification Method ◽  
Multi Scale ◽  
Airborne Laser

The classification of point clouds is a basic task in airborne laser scanning (ALS) point cloud processing. It is quite a challenge when facing complex observed scenes and irregular point distributions. In order to reduce the computational burden of the point-based classification method and improve the classification accuracy, we present a segmentation and multi-scale convolutional neural network-based classification method. Firstly, a three-step region-growing segmentation method was proposed to reduce both under-segmentation and over-segmentation. Then, a feature image generation method was used to transform the 3D neighborhood features of a point into a 2D image. Finally, feature images were treated as the input of a multi-scale convolutional neural network for training and testing tasks. In order to obtain performance comparisons with existing approaches, we evaluated our framework using the International Society for Photogrammetry and Remote Sensing Working Groups II/4 (ISPRS WG II/4) 3D labeling benchmark tests. The experiment result, which achieved 84.9% overall accuracy and 69.2% of average F1 scores, has a satisfactory performance over all participating approaches analyzed.

Error Analysis of a Mobile Terrestrial LiDAR System

GEOMATICA ◽  
2014 ◽  
Vol 68 (3) ◽  
pp. 183-194 ◽  
Author(s):  
M. Leslar ◽  
B. Hu ◽  
J.G. Wang
Keyword(s):  
Point Cloud ◽  
Point Clouds ◽  
Sensitivity Study ◽  
Error Sources ◽  
Terrestrial Lidar ◽  
Lever Arm ◽  
Ideal Situation ◽  
Individual Variables ◽  
The Individual ◽  
Source Of Error

The understanding of the effects of error on Mobile Terrestrial LiDAR (MTL) point clouds has not increased with their popularity. In this study, comprehensive error analyses based on error propagation theory and global sensitivity study were carried out to quantitatively describe the effects of various error sources in a MTL system on the point cloud. Two scenarios were envisioned; the first using the uncertainties for measurement and calibration variables that are normally expected for MTL systems as they exist today, and the second using an ideal situation where measurement and calibration values have been well adjusted. It was found that the highest proportion of error in the point cloud can be attributed to the boresight and lever arm parameters for MTL systems calibrated using non-rigours methods. In particular, under a loosely controlled error condition, the LiDAR to INS Z lever arm and the LiDAR to INS roll angle contributed more error in the output point cloud than any other parameter, including the INS position. Under tightly controlled error conditions, the INS position became the dominant source of error in the point cloud. In addition, conditional variance analysis has shown that the majority of the error in a point cloud can be attributed to the individual variables. Errors caused by the interactions between the diverse variables are minimal and can be regarded as insignificant.

Sign in / Sign up

Export Citation Format

Share Document