scholarly journals POLE-LIKE STREET FURNITURE DECOMPOSTION IN MOBILE LASER SCANNING DATA

Author(s):  
F. Li ◽  
S. Oude Elberink ◽  
G. Vosselman

Automatic semantic interpretation of street furniture has become a popular topic in recent years. Current studies detect street furniture as connected components of points above the street level. Street furniture classification based on properties of such components suffers from large intra class variability of shapes and cannot deal with mixed classes like traffic signs attached to light poles. In this paper, we focus on the decomposition of point clouds of pole-like street furniture. A novel street furniture decomposition method is proposed, which consists of three steps: (i) acquirement of prior-knowledge, (ii) pole extraction, (iii) components separation. For the pole extraction, a novel global pole extraction approach is proposed to handle 3 different cases of street furniture. In the evaluation of results, which involves the decomposition of 27 different instances of street furniture, we demonstrate that our method decomposes mixed classes street furniture into poles and different components with respect to different functionalities.

Author(s):  
F. Li ◽  
S. Oude Elberink ◽  
G. Vosselman

Automatic semantic interpretation of street furniture has become a popular topic in recent years. Current studies detect street furniture as connected components of points above the street level. Street furniture classification based on properties of such components suffers from large intra class variability of shapes and cannot deal with mixed classes like traffic signs attached to light poles. In this paper, we focus on the decomposition of point clouds of pole-like street furniture. A novel street furniture decomposition method is proposed, which consists of three steps: (i) acquirement of prior-knowledge, (ii) pole extraction, (iii) components separation. For the pole extraction, a novel global pole extraction approach is proposed to handle 3 different cases of street furniture. In the evaluation of results, which involves the decomposition of 27 different instances of street furniture, we demonstrate that our method decomposes mixed classes street furniture into poles and different components with respect to different functionalities.


2021 ◽  
Vol 13 (11) ◽  
pp. 2135
Author(s):  
Jesús Balado ◽  
Pedro Arias ◽  
Henrique Lorenzo ◽  
Adrián Meijide-Rodríguez

Mobile Laser Scanning (MLS) systems have proven their usefulness in the rapid and accurate acquisition of the urban environment. From the generated point clouds, street furniture can be extracted and classified without manual intervention. However, this process of acquisition and classification is not error-free, caused mainly by disturbances. This paper analyses the effect of three disturbances (point density variation, ambient noise, and occlusions) on the classification of urban objects in point clouds. From point clouds acquired in real case studies, synthetic disturbances are generated and added. The point density reduction is generated by downsampling in a voxel-wise distribution. The ambient noise is generated as random points within the bounding box of the object, and the occlusion is generated by eliminating points contained in a sphere. Samples with disturbances are classified by a pre-trained Convolutional Neural Network (CNN). The results showed different behaviours for each disturbance: density reduction affected objects depending on the object shape and dimensions, ambient noise depending on the volume of the object, while occlusions depended on their size and location. Finally, the CNN was re-trained with a percentage of synthetic samples with disturbances. An improvement in the performance of 10–40% was reported except for occlusions with a radius larger than 1 m.


2019 ◽  
Vol 11 (12) ◽  
pp. 1453 ◽  
Author(s):  
Shanxin Zhang ◽  
Cheng Wang ◽  
Lili Lin ◽  
Chenglu Wen ◽  
Chenhui Yang ◽  
...  

Maintaining the high visual recognizability of traffic signs for traffic safety is a key matter for road network management. Mobile Laser Scanning (MLS) systems provide efficient way of 3D measurement over large-scale traffic environment. This paper presents a quantitative visual recognizability evaluation method for traffic signs in large-scale traffic environment based on traffic recognition theory and MLS 3D point clouds. We first propose the Visibility Evaluation Model (VEM) to quantitatively describe the visibility of traffic sign from any given viewpoint, then we proposed the concept of visual recognizability field and Traffic Sign Visual Recognizability Evaluation Model (TSVREM) to measure the visual recognizability of a traffic sign. Finally, we present an automatic TSVREM calculation algorithm for MLS 3D point clouds. Experimental results on real MLS 3D point clouds show that the proposed method is feasible and efficient.


Author(s):  
X. Roynard ◽  
J.-E. Deschaud ◽  
F. Goulette

Change detection is an important issue in city monitoring to analyse street furniture, road works, car parking, etc. For example, parking surveys are needed but are currently a laborious task involving sending operators in the streets to identify the changes in car locations. In this paper, we propose a method that performs a fast and robust segmentation and classification of urban point clouds, that can be used for change detection. We apply this method to detect the cars, as a particular object class, in order to perform parking surveys automatically. A recently proposed method already addresses the need for fast segmentation and classification of urban point clouds, using elevation images. The interest to work on images is that processing is much faster, proven and robust. However there may be a loss of information in complex 3D cases: for example when objects are one above the other, typically a car under a tree or a pedestrian under a balcony. In this paper we propose a method that retain the three-dimensional information while preserving fast computation times and improving segmentation and classification accuracy. It is based on fast region-growing using an octree, for the segmentation, and specific descriptors with Random-Forest for the classification. Experiments have been performed on large urban point clouds acquired by Mobile Laser Scanning. They show that the method is as fast as the state of the art, and that it gives more robust results in the complex 3D cases.


Author(s):  
Y. Li ◽  
B. Wu

<p><strong>Abstract.</strong> Ground objects can be regarded as a combination of structures of different geometries. Generally, the structural geometries can be grouped into linear, planar and scatter shapes. A good segmentation of objects into different structures can help to interpret the scanned scenes and provide essential clues for subsequent semantic interpretation. This is particularly true for the terrestrial static and mobile laser scanning data, where the geometric structures of objects are presented in detail due to the close scanning distances. In consideration of the large data volume and the large variation in point density of such point clouds, this paper presents a structural segmentation method of point clouds to efficiently decompose the ground objects into different structural components based on supervoxels of multiple sizes. First, supervoxels are generated with sizes adaptive to the point density with minimum occupied points and minimum size constraints. Then, the multi-size supervoxels are clustered into different components based on a structural labelling result obtained via Markov random field. Two datasets including terrestrial and mobile laser scanning point clouds were used to evaluate the performance of the proposed method. The results indicate that the proposed method can effectively and efficiently classify the point clouds into structurally meaningful segments with overall accuracies higher than 96%, even with largely varying point density.</p>


Author(s):  
S. Zhang ◽  
C. Wang ◽  
M. Cheng ◽  
J. Li

<p><strong>Abstract.</strong> Maintaining high visibility of traffic signs is very important for traffic safety. Manual inspection and removal of occlusion in front of traffic signs is one of the daily tasks of the traffic management department. This paper presents a method that can automatically detect the occlusion and continuously quantitative estimate the visibility of traffic sign cover all the road surface based on Mobile Laser Scanning (MLS) systems. The concept of traffic sign’s visibility field is proposed in this paper. One of important innovation of this paper is that we use retinal imaging area to evaluate the visibility of a traffic sign. And this makes our method is in line with human vision. To validate the reasonable and accuracy of our method, we use the 2D and 3D registration technology to observe the consistence of the occlusion ratio in point clouds with it in photo. Experiment of implementation on large scale traffic environments show that our method is feasible and efficient.</p>


Author(s):  
M. Kada ◽  
D. Kuramin

Abstract. In the practical and professional work of classifying airborne laser scanning (ALS) point clouds, there are nowadays numerous methods and software applications available that are able to separate the points into a few basic categories and do so with a known and consistent quality. Further refinement of the classes then requires either manual or semi-automatic work, or the use of supervised machine learning algorithms. In using supervised machine learning, e.g. Deep Learning neural networks, however, there is a significant chance that they will not maintain the approved quality of an existing classification. In this study, we therefore evaluate the application of two neural networks, PointNet++ and KPConv, and propose to integrate prior knowledge from a pre-existing classification in the form of height above ground and an encoding of the already available labels as additional per-point input features. Our experiments show that such an approach can improve the quality of the 3D classification results by 6% to 10% in mean intersection over union (mIoU) depending on the respective network, but it also cannot completely avoid the aforementioned problems.


Author(s):  
X. Roynard ◽  
J.-E. Deschaud ◽  
F. Goulette

Change detection is an important issue in city monitoring to analyse street furniture, road works, car parking, etc. For example, parking surveys are needed but are currently a laborious task involving sending operators in the streets to identify the changes in car locations. In this paper, we propose a method that performs a fast and robust segmentation and classification of urban point clouds, that can be used for change detection. We apply this method to detect the cars, as a particular object class, in order to perform parking surveys automatically. A recently proposed method already addresses the need for fast segmentation and classification of urban point clouds, using elevation images. The interest to work on images is that processing is much faster, proven and robust. However there may be a loss of information in complex 3D cases: for example when objects are one above the other, typically a car under a tree or a pedestrian under a balcony. In this paper we propose a method that retain the three-dimensional information while preserving fast computation times and improving segmentation and classification accuracy. It is based on fast region-growing using an octree, for the segmentation, and specific descriptors with Random-Forest for the classification. Experiments have been performed on large urban point clouds acquired by Mobile Laser Scanning. They show that the method is as fast as the state of the art, and that it gives more robust results in the complex 3D cases.


Author(s):  
M. Kölle ◽  
D. Laupheimer ◽  
V. Walter ◽  
N. Haala ◽  
U. Soergel

Abstract. Semantic interpretation of multi-modal datasets is of great importance in many domains of geospatial data analysis. However, when training models for automated semantic segmentation, labeled training data is required and in case of multi-modality for each representation form of the scene. To completely avoid the time-consuming and cost-intensive involvement of an expert in the annotation procedure, we propose an Active Learning (AL) pipeline where a Random Forest classifier selects a subset of points sufficient for training and where necessary labels are received from the crowd. In this AL loop, we aim on coupled semantic segmentation of an Airborne Laser Scanning (ALS) point cloud and the corresponding 3D textured mesh generated from LiDAR data and imagery in a hybrid manner. Within this work we pursue two main objectives: i) We evaluate the performance of the AL pipeline applied to an ultra-high resolution ALS point cloud and a derived textured mesh (both benchmark datasets are available at https://ifpwww.ifp.uni-stuttgart.de/benchmark/hessigheim/default.aspx). ii) We investigate the capabilities of the crowd regarding interpretation of 3D geodata and observed that the crowd performs about 3 percentage points better when labeling meshes compared to point clouds. We additionally demonstrate that labels received solely by the crowd can power a machine learning system only differing in Overall Accuracy by less than 2 percentage points for the point cloud and less than 3 percentage points for the mesh, compared to using the completely labeled training pool. For deriving this sparse training set, we ask the crowd to label 0.25 % of available training points, resulting in costs of 190 &amp;dollar;.


Author(s):  
J. Balado ◽  
M. Soilán ◽  
L. Díaz-Vilariño ◽  
P. van Oosterom

Abstract. Traffic signs are one of the most relevant road assets for driving, as the safety of drivers depends to a great extent on their correct location. In this paper two methods are compared for the segmentation of the sign and the pole supporting it. Both methods are based on the morphological opening to identify the sign points, the first one directly employs the mathematical morphology directly applied to point clouds and the second one through point cloud rasterization into images. The comparison was conducted on twenty real traffic signs acquired with Mobile Laser Scanning obtaining point clouds from environments with signposts, traffic lights and lampposts. The results showed a correct segmentation of the signs, obtaining a F-score of 0.81 by the point-based method and a 0.75 by 2D image method. In particular, the point-based mathematical morphology proved to be more accurate in the segmentation of traffic sings installed on traffic lights and lampposts, avoiding over detection shown by the 2D image method.


Sign in / Sign up

Export Citation Format

Share Document