Linked Dynamic Graph CNN: Learning through Point Cloud by Linking Hierarchical Features

Author(s):  
Kuangen Zhang ◽  
Ming Hao ◽  
Jing Wang ◽  
Xinxing Chen ◽  
Yuquan Leng ◽  
...  
2020 ◽  
Vol 12 (1) ◽  
pp. 178 ◽  
Author(s):  
Jinming Zhang ◽  
Xiangyun Hu ◽  
Hengming Dai ◽  
ShenRun Qu

It is difficult to extract a digital elevation model (DEM) from an airborne laser scanning (ALS) point cloud in a forest area because of the irregular and uneven distribution of ground and vegetation points. Machine learning, especially deep learning methods, has shown powerful feature extraction in accomplishing point cloud classification. However, most of the existing deep learning frameworks, such as PointNet, dynamic graph convolutional neural network (DGCNN), and SparseConvNet, cannot consider the particularity of ALS point clouds. For large-scene laser point clouds, the current data preprocessing methods are mostly based on random sampling, which is not suitable for DEM extraction tasks. In this study, we propose a novel data sampling algorithm for the data preparation of patch-based training and classification named T-Sampling. T-Sampling uses the set of the lowest points in a certain area as basic points with other points added to supplement it, which can guarantee the integrity of the terrain in the sampling area. In the learning part, we propose a new convolution model based on terrain named Tin-EdgeConv that fully considers the spatial relationship between ground and non-ground points when constructing a directed graph. We design a new network based on Tin-EdgeConv to extract local features and use PointNet architecture to extract global context information. Finally, we combine this information effectively with a designed attention fusion module. These aspects are important in achieving high classification accuracy. We evaluate the proposed method by using large-scale data from forest areas. Results show that our method is more accurate than existing algorithms.


2019 ◽  
Vol 13 (3) ◽  
pp. 99-106
Author(s):  
Hyeonho Jeong ◽  
Hyosung Hong ◽  
Gyuha Park ◽  
Mooncheol Won ◽  
Mingyu Kim ◽  
...  

Author(s):  
E. Widyaningrum ◽  
M. K. Fajari ◽  
R. C. Lindenbergh ◽  
M. Hahn

Abstract. Automation of 3D LiDAR point cloud processing is expected to increase the production rate of many applications including automatic map generation. Fast development on high-end hardware has boosted the expansion of deep learning research for 3D classification and segmentation. However, deep learning requires large amount of high quality training samples. The generation of training samples for accurate classification results, especially for airborne point cloud data, is still problematic. Moreover, which customized features should be used best for segmenting airborne point cloud data is still unclear. This paper proposes semi-automatic point cloud labelling and examines the potential of combining different tailor-made features for pointwise semantic segmentation of an airborne point cloud. We implement a Dynamic Graph CNN (DGCNN) approach to classify airborne point cloud data into four land cover classes: bare-land, trees, buildings and roads. The DGCNN architecture is chosen as this network relates two approaches, PointNet and graph CNNs, to exploit the geometric relationships between points. For experiments, we train an airborne point cloud and co-aligned orthophoto of the Surabaya city area of Indonesia to DGCNN using three different tailor-made feature combinations: points with RGB (Red, Green, Blue) color, points with original LiDAR features (Intensity, Return number, Number of returns) so-called IRN, and points with two spectral colors and Intensity (Red, Green, Intensity) so-called RGI. The overall accuracy of the testing area indicates that using RGB information gives the best segmentation results of 81.05% while IRN and RGI gives accuracy values of 76.13%, and 79.81%, respectively.


2021 ◽  
Vol 15 (3) ◽  
pp. 235-244
Author(s):  
Rui Guo ◽  
Yong Zhou ◽  
Jiaqi Zhao ◽  
Yiyun Man ◽  
Minjie Liu ◽  
...  

2020 ◽  
Vol 12 (6) ◽  
pp. 1005 ◽  
Author(s):  
Roberto Pierdicca ◽  
Marina Paolanti ◽  
Francesca Matrone ◽  
Massimo Martini ◽  
Christian Morbidoni ◽  
...  

In the Digital Cultural Heritage (DCH) domain, the semantic segmentation of 3D Point Clouds with Deep Learning (DL) techniques can help to recognize historical architectural elements, at an adequate level of detail, and thus speed up the process of modeling of historical buildings for developing BIM models from survey data, referred to as HBIM (Historical Building Information Modeling). In this paper, we propose a DL framework for Point Cloud segmentation, which employs an improved DGCNN (Dynamic Graph Convolutional Neural Network) by adding meaningful features such as normal and colour. The approach has been applied to a newly collected DCH Dataset which is publicy available: ArCH (Architectural Cultural Heritage) Dataset. This dataset comprises 11 labeled points clouds, derived from the union of several single scans or from the integration of the latter with photogrammetric surveys. The involved scenes are both indoor and outdoor, with churches, chapels, cloisters, porticoes and loggias covered by a variety of vaults and beared by many different types of columns. They belong to different historical periods and different styles, in order to make the dataset the least possible uniform and homogeneous (in the repetition of the architectural elements) and the results as general as possible. The experiments yield high accuracy, demonstrating the effectiveness and suitability of the proposed approach.


2020 ◽  
Author(s):  
Yiming Cui ◽  
Xin Liu ◽  
Hongmin Liu ◽  
Jiyong Zhang ◽  
Alina Zare ◽  
...  

2020 ◽  
Vol 3 (1) ◽  
pp. 21
Author(s):  
Xiuyun Lin ◽  
Yulin Gong ◽  
Yuan Sun ◽  
Jiawen Jiang ◽  
Yanli Zhang ◽  
...  

This study aims at searching for characteristic parameters of tree trunks to establish a volume model and dynamic analysis of volume based on terrestrial laser scanning (TLS). We collected three phases of data over 5 years from an artificial Liriodendron chinense forest. The upper diameters of the tree stump and tree height data were obtained by using the multi-station scanning method. A novel hierarchical TLS point cloud feature named the height cumulative percentage (Hz%) was designed. The shape of the upper tree trunk extracted by the point cloud was equivalent to that of the analytical tree with inflection points at 25% and 50% of the height, and the dynamic volume change of the model, which was established by hierarchical features, was highly related to the volume change of the actual point cloud extraction. The obtained results reflected the fact that the Hz% value provided by multi-station scanning was closely related to the characteristic stumpage parameters and could be used to invert the dynamic forest structure. The volume model established based on point cloud hierarchical parameters in this study could be used to monitor the dynamic changes of forest volume and to provide a new reference for applying TLS point clouds for the dynamic monitoring of forest resources.


2021 ◽  
Author(s):  
Xiaolong Lu ◽  
Baodi Liu ◽  
Weifeng Liu ◽  
Kai Zhang ◽  
Ye Li ◽  
...  

2020 ◽  
Vol 13 (1) ◽  
pp. 66
Author(s):  
Yifei Tian ◽  
Long Chen ◽  
Wei Song ◽  
Yunsick Sung ◽  
Sangchul Woo

3D (3-Dimensional) object recognition is a hot research topic that benefits environment perception, disease diagnosis, and the mobile robot industry. Point clouds collected by range sensors are a popular data structure to represent a 3D object model. This paper proposed a 3D object recognition method named Dynamic Graph Convolutional Broad Network (DGCB-Net) to realize feature extraction and 3D object recognition from the point cloud. DGCB-Net adopts edge convolutional layers constructed by weight-shared multiple-layer perceptrons (MLPs) to extract local features from the point cloud graph structure automatically. Features obtained from all edge convolutional layers are concatenated together to form a feature aggregation. Unlike stacking many layers in-depth, our DGCB-Net employs a broad architecture to extend point cloud feature aggregation flatly. The broad architecture is structured utilizing a flat combining architecture with multiple feature layers and enhancement layers. Both feature layers and enhancement layers concatenate together to further enrich the features’ information of the point cloud. All features work on the object recognition results thus that our DGCB-Net show better recognition performance than other 3D object recognition algorithms on ModelNet10/40 and our scanning point cloud dataset.


Sign in / Sign up

Export Citation Format

Share Document