scholarly journals A HADOOP-BASED ALGORITHM OF GENERATING DEM GRID FROM POINT CLOUD DATA

Author(s):  
X. Jian ◽  
X. Xiao ◽  
H. Chengfang ◽  
Z. Zhizhong ◽  
W. Zhaohui ◽  
...  

Airborne LiDAR technology has proven to be the most powerful tools to obtain high-density, high-accuracy and significantly detailed surface information of terrain and surface objects within a short time, and from which the Digital Elevation Model of high quality can be extracted. Point cloud data generated from the pre-processed data should be classified by segmentation algorithms, so as to differ the terrain points from disorganized points, then followed by a procedure of interpolating the selected points to turn points into DEM data. The whole procedure takes a long time and huge computing resource due to high-density, that is concentrated on by a number of researches. Hadoop is a distributed system infrastructure developed by the Apache Foundation, which contains a highly fault-tolerant distributed file system (HDFS) with high transmission rate and a parallel programming model (Map/Reduce). Such a framework is appropriate for DEM generation algorithms to improve efficiency. Point cloud data of Dongting Lake acquired by Riegl LMS-Q680i laser scanner was utilized as the original data to generate DEM by a Hadoop-based algorithms implemented in Linux, then followed by another traditional procedure programmed by C++ as the comparative experiment. Then the algorithm’s efficiency, coding complexity, and performance-cost ratio were discussed for the comparison. The results demonstrate that the algorithm's speed depends on size of point set and density of DEM grid, and the non-Hadoop implementation can achieve a high performance when memory is big enough, but the multiple Hadoop implementation can achieve a higher performance-cost ratio, while point set is of vast quantities on the other hand.

2019 ◽  
Vol 11 (23) ◽  
pp. 2737 ◽  
Author(s):  
Minsu Kim ◽  
Seonkyung Park ◽  
Jeffrey Danielson ◽  
Jeffrey Irwin ◽  
Gregory Stensaas ◽  
...  

The traditional practice to assess accuracy in lidar data involves calculating RMSEz (root mean square error of the vertical component). Accuracy assessment of lidar point clouds in full 3D (three dimension) is not routinely performed. The main challenge in assessing accuracy in full 3D is how to identify a conjugate point of a ground-surveyed checkpoint in the lidar point cloud with the smallest possible uncertainty value. Relatively coarse point-spacing in airborne lidar data makes it challenging to determine a conjugate point accurately. As a result, a substantial unwanted error is added to the inherent positional uncertainty of the lidar data. Unless we keep this additional error small enough, the 3D accuracy assessment result will not properly represent the inherent uncertainty. We call this added error “external uncertainty,” which is associated with conjugate point identification. This research developed a general external uncertainty model using three-plane intersections and accounts for several factors (sensor precision, feature dimension, and point density). This method can be used for lidar point cloud data from a wide range of sensor qualities, point densities, and sizes of the features of interest. The external uncertainty model was derived as a semi-analytical function that takes the number of points on a plane as an input. It is a normalized general function that can be scaled by smooth surface precision (SSP) of a lidar system. This general uncertainty model provides a quantitative guideline on the required conditions for the conjugate point based on the geometric features. Applications of the external uncertainty model were demonstrated using various lidar point cloud data from the U.S. Geological Survey (USGS) 3D Elevation Program (3DEP) library to determine the valid conditions for a conjugate point from three-plane modeling.


Author(s):  
Yaneev Golombek ◽  
Wesley E. Marshall

This study investigates the feasibility of extracting streetscape features from high-density United States Geological Survey (USGS) quality level 1 (QL1) light detection and ranging (LiDAR) and quantifying the features into three-dimensional (3D) volumetric pixel (voxel) zones. As the USGS embarks on a national LiDAR database with the goal of collecting LiDAR across the continuous U.S.A., the USGS primarily requires QL2 or QL1 as a collection standard. The authors’ previous study thoroughly investigated the limits of extracting streetscape features with QL2 data, which was primarily limited to buildings and street trees. Recent studies published by other researchers that utilize advanced digital mapping techniques for streetscape measuring acknowledge that most features outside of buildings and street trees are too small to detect. QL1 data, however, is four times denser than QL2 data. This study divides streetscapes into Thiessen proximal polygons, sets voxel parameters, classifies QL1 LiDAR point cloud data, and computes quantitative statistics where classified point cloud data intersects voxels within the streetscape polygons. It demonstrates how most other common streetscape features are detectable in a standard urban QL1 dataset. In addition to street trees and buildings, one can also legitimately extract and statistically quantify walls, fences, landscape vegetation, light posts, traffic lights, power poles, power lines, street signs, and miscellaneous street furniture. Furthermore, as these features are processed into their appropriate voxel height zones, this study introduces a new methodology for obtaining comprehensive tabular descriptive statistics describing how streetscape features are truly represented in 3D.


2015 ◽  
Vol 159 ◽  
pp. 374-380 ◽  
Author(s):  
Srikant Srinivasan ◽  
Kaustubh Kaluskar ◽  
Scott Broderick ◽  
Krishna Rajan

Author(s):  
Y. Wang ◽  
X. Hu

Urban viaducts are important infrastructures for the transportation system of a city. In this paper, an original method is proposed to automatically extract urban viaducts and reconstruct topology of the viaduct network just with airborne LiDAR point cloud data. It will greatly simplify the effort-taking procedure of viaducts extraction and reconstruction. In our method, the point cloud first is filtered to divide all the points into ground points and none-ground points. Region growth algorithm is adopted to find the viaduct points from the none-ground points by the features generated from its general prescriptive designation rules. Then, the viaduct points are projected into 2D images to extract the centerline of every viaduct and generate cubic functions to represent passages of viaducts by least square fitting, with which the topology of the viaduct network can be rebuilt by combining the height information. Finally, a topological graph of the viaducts network is produced. The full-automatic method can potentially benefit the application of urban navigation and city model reconstruction.


2021 ◽  
Vol 13 (20) ◽  
pp. 4031
Author(s):  
Ine Rosier ◽  
Jan Diels ◽  
Ben Somers ◽  
Jos Van Orshoven

Rural European landscapes are characterized by a variety of vegetated landscape elements. Although it is often not their main function, they have the potential to affect river discharge and the frequency, extent, depth and duration of floods downstream by creating both hydrological discontinuities and connections across the landscape. Information about the extent to which individual landscape elements and their spatial location affect peak river discharge and flood frequency and severity in agricultural catchments under specific meteorological conditions is limited. This knowledge gap can partly be explained by the lack of exhaustive inventories of the presence, geometry, and hydrological traits of vegetated landscape elements (vLEs), which in turn is due to the lack of appropriate techniques and source data to produce such inventories and keep them up to date. In this paper, a multi-step methodology is proposed to delineate and classify vLEs based on LiDAR point cloud data in three study areas in Flanders, Belgium. We classified the LiDAR point cloud data into the classes ‘vegetated landscape element point’ and ‘other’ using a Random Forest model with an accuracy classification score ranging between 0.92 and 0.97. The landscape element objects were further classified into the classes ‘tree object’ and ‘shrub object’ using a Logistic Regression model with an area-based accuracy ranging between 0.34 and 0.95.


2016 ◽  
Vol 45 (s1) ◽  
pp. 130006
Author(s):  
刘志青 Liu Zhiqing ◽  
李鹏程 Li Pengcheng ◽  
郭海涛 Guo Haitao ◽  
张保明 Zhang Baoming ◽  
陈小卫 Chen Xiaowei ◽  
...  

Sign in / Sign up

Export Citation Format

Share Document