scholarly journals Study on Real-Time Point Cloud Superimposition on Camera Image to Assist Environmental Three-Dimensional Laser Scanning

2021 ◽  
Vol 15 (3) ◽  
pp. 324-333
Author(s):  
Kenta Ohno ◽  
Hiroaki Date ◽  
Satoshi Kanai ◽  
◽  

Recently, three-dimensional (3D) laser scanning technology using terrestrial laser scanner (TLS) has been widely used in the fields of plant manufacturing, civil engineering and construction, and surveying. It is desirable for the operator to be able to immediately and intuitively confirm the scanned point cloud to reduce unscanned regions and acquire scanned point clouds of high quality. Therefore, in this study, we developed a method to superimpose the point cloud on the actual environment to assist environmental 3D laser measurements, allowing the operator to check the scanned point cloud or unscanned regions in real time using the camera image. The method included extracting the correspondences of the camera image and the image generated by point clouds by considering unscanned regions, estimating the camera position and attitude in the point cloud by sampling correspondence points, and superimposing the scanned point cloud and unscanned regions on the camera image. When the proposed method was applied to two types of environments, that is, a boiler room and university office, the estimated camera image had a mean position error of approximately 150 mm and mean attitude error of approximately 1°, while the scanned point cloud and unscanned regions were superimposed on the camera image on a tablet PC at a rate of approximately 1 fps.

Sensors ◽  
2020 ◽  
Vol 21 (1) ◽  
pp. 201
Author(s):  
Michael Bekele Maru ◽  
Donghwan Lee ◽  
Kassahun Demissie Tola ◽  
Seunghee Park

Modeling a structure in the virtual world using three-dimensional (3D) information enhances our understanding, while also aiding in the visualization, of how a structure reacts to any disturbance. Generally, 3D point clouds are used for determining structural behavioral changes. Light detection and ranging (LiDAR) is one of the crucial ways by which a 3D point cloud dataset can be generated. Additionally, 3D cameras are commonly used to develop a point cloud containing many points on the external surface of an object around it. The main objective of this study was to compare the performance of optical sensors, namely a depth camera (DC) and terrestrial laser scanner (TLS) in estimating structural deflection. We also utilized bilateral filtering techniques, which are commonly used in image processing, on the point cloud data for enhancing their accuracy and increasing the application prospects of these sensors in structure health monitoring. The results from these sensors were validated by comparing them with the outputs from a linear variable differential transformer sensor, which was mounted on the beam during an indoor experiment. The results showed that the datasets obtained from both the sensors were acceptable for nominal deflections of 3 mm and above because the error range was less than ±10%. However, the result obtained from the TLS were better than those obtained from the DC.


Author(s):  
Y. Hori ◽  
T. Ogawa

The implementation of laser scanning in the field of archaeology provides us with an entirely new dimension in research and surveying. It allows us to digitally recreate individual objects, or entire cities, using millions of three-dimensional points grouped together in what is referred to as "point clouds". In addition, the visualization of the point cloud data, which can be used in the final report by archaeologists and architects, should usually be produced as a JPG or TIFF file. Not only the visualization of point cloud data, but also re-examination of older data and new survey of the construction of Roman building applying remote-sensing technology for precise and detailed measurements afford new information that may lead to revising drawings of ancient buildings which had been adduced as evidence without any consideration of a degree of accuracy, and finally can provide new research of ancient buildings. We used laser scanners at fields because of its speed, comprehensive coverage, accuracy and flexibility of data manipulation. Therefore, we “skipped” many of post-processing and focused on the images created from the meta-data simply aligned using a tool which extended automatic feature-matching algorithm and a popular renderer that can provide graphic results.


2020 ◽  
Vol 12 (6) ◽  
pp. 942 ◽  
Author(s):  
Maria Rosaria De Blasiis ◽  
Alessandro Di Benedetto ◽  
Margherita Fiani

The surface conditions of road pavements, including the occurrence and severity of distresses present on the surface, are an important indicator of pavement performance. Periodic monitoring and condition assessment is an essential requirement for the safety of vehicles moving on that road and the wellbeing of people. The traditional characterization of the different types of distress often involves complex activities, sometimes inefficient and risky, as they interfere with road traffic. The mobile laser systems (MLS) are now widely used to acquire detailed information about the road surface in terms of a three-dimensional point cloud. Despite its increasing use, there are still no standards for the acquisition and processing of the data collected. The aim of our work was to develop a procedure for processing the data acquired by MLS, in order to identify the localized degradations that mostly affect safety. We have studied the data flow and implemented several processing algorithms to identify and quantify a few types of distresses, namely potholes and swells/shoves, starting from very dense point clouds. We have implemented data processing in four steps: (i) editing of the point cloud to extract only the points belonging to the road surface, (ii) determination of the road roughness as deviation in height of every single point of the cloud with respect to the modeled road surface, (iii) segmentation of the distress (iv) computation of the main geometric parameters of the distress in order to classify it by severity levels. The results obtained by the proposed methodology are promising. The procedures implemented have made it possible to correctly segmented and identify the types of distress to be analyzed, in accordance with the on-site inspections. The tests carried out have shown that the choice of the values of some parameters to give as input to the software is not trivial: the choice of some of them is based on considerations related to the nature of the data, for others, it derives from the distress to be segmented. Due to the different possible configurations of the various distresses it is better to choose these parameters according to the boundary conditions and not to impose default values. The test involved a 100-m long urban road segment, the surface of which was measured with an MLS installed on a vehicle that traveled the road at 10 km/h.


2020 ◽  
Author(s):  
Moritz Bruggisser ◽  
Johannes Otepka ◽  
Norbert Pfeifer ◽  
Markus Hollaus

<p>Unmanned aerial vehicles-borne laser scanning (ULS) allows time-efficient acquisition of high-resolution point clouds on regional extents at moderate costs. The quality of ULS-point clouds facilitates the 3D modelling of individual tree stems, what opens new possibilities in the context of forest monitoring and management. In our study, we developed and tested an algorithm which allows for i) the autonomous detection of potential stem locations within the point clouds, ii) the estimation of the diameter at breast height (DBH) and iii) the reconstruction of the tree stem. In our experiments on point clouds from both, a RIEGL miniVUX-1DL and a VUX-1UAV, respectively, we could detect 91.0 % and 77.6 % of the stems within our study area automatically. The DBH could be modelled with biases of 3.1 cm and 1.1 cm, respectively, from the two point cloud sets with respective detection rates of 80.6 % and 61.2 % of the trees present in the field inventory. The lowest 12 m of the tree stem could be reconstructed with absolute stem diameter differences below 5 cm and 2 cm, respectively, compared to stem diameters from a point cloud from terrestrial laser scanning. The accuracy of larger tree stems thereby was higher in general than the accuracy for smaller trees. Furthermore, we recognized a small influence only of the completeness with which a stem is covered with points, as long as half of the stem circumference was captured. Likewise, the absolute point count did not impact the accuracy, but, in contrast, was critical to the completeness with which a scene could be reconstructed. The precision of the laser scanner, on the other hand, was a key factor for the accuracy of the stem diameter estimation. <br>The findings of this study are highly relevant for the flight planning and the sensor selection of future ULS acquisition missions in the context of forest inventories.</p>


Author(s):  
G. Tran ◽  
D. Nguyen ◽  
M. Milenkovic ◽  
N. Pfeifer

Full-waveform (FWF) LiDAR (Light Detection and Ranging) systems have their advantage in recording the entire backscattered signal of each emitted laser pulse compared to conventional airborne discrete-return laser scanner systems. The FWF systems can provide point clouds which contain extra attributes like amplitude and echo width, etc. In this study, a FWF data collected in 2010 for Eisenstadt, a city in the eastern part of Austria was used to classify four main classes: buildings, trees, waterbody and ground by employing a decision tree. Point density, echo ratio, echo width, normalised digital surface model and point cloud roughness are the main inputs for classification. The accuracy of the final results, correctness and completeness measures, were assessed by comparison of the classified output to a knowledge-based labelling of the points. Completeness and correctness between 90% and 97% was reached, depending on the class. While such results and methods were presented before, we are investigating additionally the transferability of the classification method (features, thresholds …) to another urban FWF lidar point cloud. Our conclusions are that from the features used, only echo width requires new thresholds. A data-driven adaptation of thresholds is suggested.


Author(s):  
M. Nakagawa ◽  
M. Taguchi

Abstract. In this paper, we focus on the development of intelligent construction vehicles to improve the safety of workers in construction sites. Generally, global navigation satellite system positioning is utilized to obtain the position data of workers and construction vehicles. However, construction fields in urban areas have poor satellite positioning environments. Therefore, we have developed a 3D sensing unit mounted on a construction vehicle for worker position data acquisition. The unit mainly consists of a multilayer laser scanner. We propose a real-time object measurement, classification and tracking methodology with the multilayer laser scanner. We also propose a methodology to estimate and visualize object behaviors with a spatial model based on a space subdivision framework consisting of agents, activities, resources, and modifiers. We applied the space subdivision framework with a geofencing approach using real-time object classification and tracking results estimated from temporal point clouds. Our methodology was evaluated using temporal point clouds acquired from a construction vehicle in drilling works.


2020 ◽  
Vol 49 (2-3) ◽  
Author(s):  
Aliki Konsolaki ◽  
Emmanuel Vassilakis ◽  
Leonidas Gouliotis ◽  
Georgios Kontostavlos ◽  
Vassilis Giannopoulos

Remote sensing techniques and laser scanning technology have given us the opportunity to study indoor environments, such as caves, with their complex and unique morphology. In the presented case study, we used a handheld laser scanner for acquiring points with projected coordinate information (X, Y, Z) covering the entire show cave of Koutouki; including its hidden passages and dark corners. The point cloud covers the floor, the walls, and the roof of the cave, as well as the stalactites, stalagmites and the connected columns that constitute the decoration of the cave. The absolute and exact placement of the point cloud within a geographic reference frame gives us the opportunity for three-dimensional measurements and detailed visualization of the subsurface structures. Using open - source software, we managed to make a quantification analysis of the terrain and generated morphological and geometric features of the speleothems. We identified 55 columns by using digital terrain analysis and processed them statistically in order to correlate them to the frame of the cave development. The parameters that derived are the contours, each column height, the speleothem geometry and volume, as well as the volume of the open space cavity. We argue that by the demonstrated methodology, it is possible to identify with high accuracy and detail: the geomorphological features of a cave, an estimate of the speleogenesis, and the ability to monitor the evolution of a karstic system.Key words: cave, laser scanner, 3D representation, speleothems, SLAM.  


Author(s):  
V. E. Oniga ◽  
A. I. Breaban ◽  
E. I. Alexe ◽  
C. Văsii

Abstract. Indoor mapping and modelling is an important research subject with application in a wide range of domains including interior design, real estate, cultural heritage conservation and restoration. There are multiple sensors applicable for 3D indoor modelling, but the laser scanning technique is frequently used because of the acquisition time, detailed information and accuracy. In this paper, the efficiency of the Maptek I-Site 8820 terrestrial scanner, which is a long-range laser scanner and the accuracy of a HMLS point cloud acquired with a mobile scanner, namely GeoSlam Zeb Horizon were tested for indoor mapping. Aula Magna “Carmen Silva” of the “Gheorghe Asachi” Technical University of Iasi is studied in the current paper since the auditorium interior creates a distinct environment that combines complex geometric structures with architectural lighting and for preserving its great cultural value, the monument has a national historical significance. The registration process of the TLS point clouds was done using two methods: a semi-automatic one with artificial targets and a completely automatic one, based on Iterative Closest Point (ICP) algorithm. The resulted TLS point cloud was analysed in relation to the HMLS point cloud by computing the M3C2 (Multiscale Model to Model Cloud Comparison), obtaining a standard deviation of 2.1 cm and by investigating the Hausdorff distances from which resulted a standard deviation (σ) of 1.6 cm. Cross-sections have been extracted from the HMLS and TLS point clouds and after comparing the sections, 80% of the sigma values are less or equal to 1 cm. The results show high potential of using HMLS and also a long-range laser scanner for 3D modelling of complex scenes, the occlusion effect in the case of TLS being only 5% of the scanned area.


Author(s):  
A. Nurunnabi ◽  
F. N. Teferle ◽  
J. Li ◽  
R. C. Lindenbergh ◽  
A. Hunegnaw

Abstract. Ground surface extraction is one of the classic tasks in airborne laser scanning (ALS) point cloud processing that is used for three-dimensional (3D) city modelling, infrastructure health monitoring, and disaster management. Many methods have been developed over the last three decades. Recently, Deep Learning (DL) has become the most dominant technique for 3D point cloud classification. DL methods used for classification can be categorized into end-to-end and non end-to-end approaches. One of the main challenges of using supervised DL approaches is getting a sufficient amount of training data. The main advantage of using a supervised non end-to-end approach is that it requires less training data. This paper introduces a novel local feature-based non end-to-end DL algorithm that generates a binary classifier for ground point filtering. It studies feature relevance, and investigates three models that are different combinations of features. This method is free from the limitations of point clouds’ irregular data structure and varying data density, which is the biggest challenge for using the elegant convolutional neural network. The new algorithm does not require transforming data into regular 3D voxel grids or any rasterization. The performance of the new method has been demonstrated through two ALS datasets covering urban environments. The method successfully labels ground and non-ground points in the presence of steep slopes and height discontinuity in the terrain. Experiments in this paper show that the algorithm achieves around 97% in both F1-score and model accuracy for ground point labelling.


Author(s):  
Gülhan Benli

Since the 2000s, terrestrial laser scanning, as one of the methods used to document historical edifices in protected areas, has taken on greater importance because it mitigates the difficulties associated with working on large areas and saves time while also making it possible to better understand all the particularities of the area. Through this technology, comprehensive point data (point clouds) about the surface of an object can be generated in a highly accurate three-dimensional manner. Furthermore, with the proper software this three-dimensional point cloud data can be transformed into three-dimensional rendering/mapping/modeling and quantitative orthophotographs. In this chapter, the study will present the results of terrestrial laser scanning and surveying which was used to obtain three-dimensional point clouds through three-dimensional survey measurements and scans of silhouettes of streets in Fatih in Historic Peninsula in Istanbul, which were then transposed into survey images and drawings. The study will also cite examples of the facade mapping using terrestrial laser scanning data in Istanbul Historic Peninsula Project.


Sign in / Sign up

Export Citation Format

Share Document