scholarly journals Hybrid approach for alignment of a pre-processed three-dimensional point cloud, video, and CAD model using partial point cloud in retrofitting applications

2018 ◽  
Vol 14 (3) ◽  
pp. 155014771876645 ◽  
Author(s):  
Ashok Kumar Patil ◽  
G Ajay Kumar ◽  
Tae-Hyoung Kim ◽  
Young Ho Chai

Acquiring the three-dimensional point cloud data of a scene using a laser scanner and the alignment of the point cloud data within a real-time video environment view of a camera is a very new concept and is an efficient method for constructing, monitoring, and retrofitting complex engineering models in heavy industrial plants. This article presents a novel prototype framework for virtual retrofitting applications. The workflow includes an efficient 4-in-1 alignment, beginning with the coordination of pre-processed three-dimensional point cloud data using a partial point cloud from LiDAR and alignment of the pre-processed point cloud within the video scene using a frame-by-frame registering method. Finally, the proposed approach can be utilized in pre-retrofitting applications by pre-generated three-dimensional computer-aided design models virtually retrofitted with the help of a synchronized point cloud, and a video scene is efficiently visualized using a wearable virtual reality device. The prototype method is demonstrated in a real-world setting, using the partial point cloud from LiDAR, pre-processed point cloud data, and video from a two-dimensional camera.

Sensors ◽  
2019 ◽  
Vol 19 (18) ◽  
pp. 3908 ◽  
Author(s):  
Pavan Kumar B. N. ◽  
Ashok Kumar Patil ◽  
Chethana B. ◽  
Young Ho Chai

Acquisition of 3D point cloud data (PCD) using a laser scanner and aligning it with a video frame is a new approach that is efficient for retrofitting comprehensive objects in heavy pipeline industrial facilities. This work contributes a generic framework for interactive retrofitting in a virtual environment and an unmanned aerial vehicle (UAV)-based sensory setup design to acquire PCD. The framework adopts a 4-in-1 alignment using a point cloud registration algorithm for a pre-processed PCD alignment with the partial PCD, and frame-by-frame registration method for video alignment. This work also proposes a virtual interactive retrofitting framework that uses pre-defined 3D computer-aided design models (CAD) with a customized graphical user interface (GUI) and visualization of a 4-in-1 aligned video scene from a UAV camera in a desktop environment. Trials were carried out using the proposed framework in a real environment at a water treatment facility. A qualitative and quantitative study was conducted to evaluate the performance of the proposed generic framework from participants by adopting the appropriate questionnaire and retrofitting task-oriented experiment. Overall, it was found that the proposed framework could be a solution for interactive 3D CAD model retrofitting on a combination of UAV sensory setup-acquired PCD and real-time video from the camera in heavy industrial facilities.


2021 ◽  
Author(s):  
Chengxin Ju ◽  
Yuanyuan Zhao ◽  
Fengfeng Wu ◽  
Rui Li ◽  
Tianle Yang ◽  
...  

Abstract Background: Three-dimensional (3D) laser scanning technology could rapidly extract the surface geometric features of maize plants to achieve non-destructive monitoring of maize phenotypes. However, extracting the phenotypic parameters of maize plants based on laser point cloud data is challenging.Methods: In this paper, a rotational scanning method was used to collect the data of potted maize point cloud from different perspectives by using a laser scanner. Maize point cloud data were grid-reconstructed and aligned based on greedy projection triangulation algorithm and iterative closest point (ICP) algorithm, and the random sampling consistency algorithm was used to segment the stem and leaf point clouds of single maize plant to obtain the plant height and leaf parameters.Results: The results showed that the R2 between the predicted plant height and the measured plant height was above 0.95, and the R2 of the predicted leaf length, leaf width and leaf area were 0.938, 0878 and 0.956 respectively when compared with the measured values.Conclusions: The 3D reconstruction of maize plants using the laser scanner showed a good performance, and the phenotypic parameters obtained based on the reconstructed 3D model had high accuracy. The results were helpful to the practical application of plant 3D reconstruction and provided guidance for plant parameter acquisition and theoretical methods for intelligent agricultural research.


Author(s):  
Haozhi Chen ◽  
Tingli Liu ◽  
Guangxue Chen

The work aims to explore a microscopic observation system of paper surface and achieve high-precision stereoscopic observation with detail characterization of paper surface morphology. Based on the DT-400E precision program-controlled three-dimensional translation stage and KEYENCE LJV-7200 two-dimensional laser scanner, the hardware parts of our own system are developed to scan and transmit point cloud data of paper surface morphology to the computer. The corresponding system software will automatically process the point cloud data acquired from the laser scanner and generate the corresponding vivid 3D model and height histogram. This system scans and characterizes four different types of paper samples, allowing the human eye to visually distinguish the differences in surface morphology as well as automatically calculate the numerical differences in paper surface morphology parameters. The results of the applicability test show that the system is highly efficient in acquiring, observing, and evaluating the topography of the paper surface. The system can not only predict the paper surface quality of printed paper, but can also be extended to the evaluation of 3D printed surfaces.


Bauingenieur ◽  
2017 ◽  
Vol 92 (05) ◽  
pp. 191-199
Author(s):  
T. Rabczuk ◽  
C. Anitescu ◽  
C. L. Chan

Es wird ein Verfahren zur Diskretisierung aus Oberflächenrepräsentierung gewonnener zwei- und drei dimensionaler Modelle vorgeschlagen. Das Verfahren basiert auf einer hierarchischen Quad-Tree-(2D) oder Octree-(3D) Struktur, um die Oberflächendetails ohne signifikante Erhöhung der Anzahl innerer Elemente effizient darzustellen. Darüber hinaus kann die Oberflächengeometrie präzise in das Modell unter Verwendung kubischer (oder höherer Ordnung) Splines abgebildet werden. Das resultierende Modell verwendet dieselben Basisfunktionen (Bézier-Bernstein-Polynome), die in Computer Aided Design (CAD) Software verwendet werden. Die Methode erlaubt eine generelle Oberflächenrepresäntierung aus unterschiedlichen Datenquellen wie bspw. Bilddaten, Daten von 3D-Scannern und B-Rep-Modellen und minimiert Benutzerinterventionen zur Generierung und Vernetzung volumetrischer Modelle. Letztendlich wird das Verfahren zur Erstellung komplexer dreidimensionaler Modelle im Bauingenieurwesen angewendet.


2021 ◽  
Vol 2021 ◽  
pp. 1-9
Author(s):  
Kai Chen ◽  
Kai Zhan ◽  
Xiaocong Yang ◽  
Da Zhang

A three-dimensional (3D) laser scanner with characteristics such as acquiring huge point cloud data and noncontact measurement has revolutionized the surveying and mapping industry. Nonetheless, how to guarantee the 3D laser scanner precision remains the critical factor that determines the excellence of 3D laser scanners. Hence, this study proposes a 3D laser scanner error analysis and calibration-method-based D-H model, applies the D-H model method in the robot area to the 3D laser scanner coordinate for calculating the point cloud data and creatively derive the error model, comprehensively analyzes six external parameters and seven inner structure parameters that affect point cloud coordinator error, and designs two calibration platforms for inner structure parameters. To validate the proposed method, we used SOKKIA total station and BLSS-PE 3D laser scanner to attain the center coordinate of the testing target sphere and then evaluate the external parameters and modify the point coordinate. Based on modifying the point coordinate, comparing the point coordinate that considered the inner structure parameters with the point coordinate that did not consider the inner structure parameters, the experiment revealed that the BLSS-PE 3D laser scanner’s precision enhanced after considering the inner structure parameters, demonstrating that the error analysis and calibration method was correct and feasible.


Author(s):  
F. Sadeghi ◽  
H. Arefi ◽  
A. Fallah ◽  
M. Hahn

3D The three dimensional building modelling has been an interesting topic of research for decades and it seems that photogrammetry methods provide the only economic means to acquire truly 3D city data. According to the enormous developments of 3D building reconstruction with several applications such as navigation system, location based services and urban planning, the need to consider the semantic features (such as windows and doors) becomes more essential than ever, and therefore, a 3D model of buildings as block is not any more sufficient. To reconstruct the façade elements completely, we employed the high density point cloud data that obtained from the handheld laser scanner. The advantage of the handheld laser scanner with capability of direct acquisition of very dense 3D point clouds is that there is no need to derive three dimensional data from multi images using structure from motion techniques. This paper presents a grammar-based algorithm for façade reconstruction using handheld laser scanner data. The proposed method is a combination of bottom-up (data driven) and top-down (model driven) methods in which, at first the façade basic elements are extracted in a bottom-up way and then they are served as pre-knowledge for further processing to complete models especially in occluded and incomplete areas. The first step of data driven modelling is using the conditional RANSAC (RANdom SAmple Consensus) algorithm to detect façade plane in point cloud data and remove noisy objects like trees, pedestrians, traffic signs and poles. Then, the façade planes are divided into three depth layers to detect protrusion, indentation and wall points using density histogram. Due to an inappropriate reflection of laser beams from glasses, the windows appear like holes in point cloud data and therefore, can be distinguished and extracted easily from point cloud comparing to the other façade elements. Next step, is rasterizing the indentation layer that holds the windows and doors information. After rasterization process, the morphological operators are applied in order to remove small irrelevant objects. Next, the horizontal splitting lines are employed to determine floors and vertical splitting lines are employed to detect walls, windows, and doors. The windows, doors and walls elements which are named as terminals are clustered during classification process. Each terminal contains a special property as width. Among terminals, windows and doors are named the geometry tiles in definition of the vocabularies of grammar rules. Higher order structures that inferred by grouping the tiles resulted in the production rules. The rules with three dimensional modelled façade elements constitute formal grammar that is named façade grammar. This grammar holds all the information that is necessary to reconstruct façades in the style of the given building. Thus, it can be used to improve and complete façade reconstruction in areas with no or limited sensor data. Finally, a 3D reconstructed façade model is generated that the accuracy of its geometry size and geometry position depends on the density of the raw point cloud.


Sensors ◽  
2021 ◽  
Vol 21 (3) ◽  
pp. 884
Author(s):  
Chia-Ming Tsai ◽  
Yi-Horng Lai ◽  
Yung-Da Sun ◽  
Yu-Jen Chung ◽  
Jau-Woei Perng

Numerous sensors can obtain images or point cloud data on land, however, the rapid attenuation of electromagnetic signals and the lack of light in water have been observed to restrict sensing functions. This study expands the utilization of two- and three-dimensional detection technologies in underwater applications to detect abandoned tires. A three-dimensional acoustic sensor, the BV5000, is used in this study to collect underwater point cloud data. Some pre-processing steps are proposed to remove noise and the seabed from raw data. Point clouds are then processed to obtain two data types: a 2D image and a 3D point cloud. Deep learning methods with different dimensions are used to train the models. In the two-dimensional method, the point cloud is transferred into a bird’s eye view image. The Faster R-CNN and YOLOv3 network architectures are used to detect tires. Meanwhile, in the three-dimensional method, the point cloud associated with a tire is cut out from the raw data and is used as training data. The PointNet and PointConv network architectures are then used for tire classification. The results show that both approaches provide good accuracy.


Sign in / Sign up

Export Citation Format

Share Document