Study of RGB-D point cloud registration method guided by color information

Author(s):  
Yuhang Lin ◽  
Hang Liu ◽  
Qin Ye
Author(s):  
J. Shao ◽  
W. Zhang ◽  
Y. Zhu ◽  
A. Shen

Image has rich color information, and it can help to promote recognition and classification of point cloud. The registration is an important step in the application of image and point cloud. In order to give the rich texture and color information for LiDAR point cloud, the paper researched a fast registration method of point cloud and sequence images based on the ground-based LiDAR system. First, calculating transformation matrix of one of sequence images based on 2D image and LiDAR point cloud; second, using the relationships of position and attitude information among multi-angle sequence images to calculate all transformation matrixes in the horizontal direction; last, completing the registration of point cloud and sequence images based on the collinear condition of image point, projective center and LiDAR point. The experimental results show that the method is simple and fast, and the stitching error between adjacent images is litter; meanwhile, the overall registration accuracy is high, and the method can be used in engineering application.


Sensors ◽  
2021 ◽  
Vol 21 (17) ◽  
pp. 5778
Author(s):  
Baifan Chen ◽  
Hong Chen ◽  
Baojun Song ◽  
Grace Gong

Three-dimensional point cloud registration (PCReg) has a wide range of applications in computer vision, 3D reconstruction and medical fields. Although numerous advances have been achieved in the field of point cloud registration in recent years, large-scale rigid transformation is a problem that most algorithms still cannot effectively handle. To solve this problem, we propose a point cloud registration method based on learning and transform-invariant features (TIF-Reg). Our algorithm includes four modules, which are the transform-invariant feature extraction module, deep feature embedding module, corresponding point generation module and decoupled singular value decomposition (SVD) module. In the transform-invariant feature extraction module, we design TIF in SE(3) (which means the 3D rigid transformation space) which contains a triangular feature and local density feature for points. It fully exploits the transformation invariance of point clouds, making the algorithm highly robust to rigid transformation. The deep feature embedding module embeds TIF into a high-dimension space using a deep neural network, further improving the expression ability of features. The corresponding point cloud is generated using an attention mechanism in the corresponding point generation module, and the final transformation for registration is calculated in the decoupled SVD module. In an experiment, we first train and evaluate the TIF-Reg method on the ModelNet40 dataset. The results show that our method keeps the root mean squared error (RMSE) of rotation within 0.5∘ and the RMSE of translation error close to 0 m, even when the rotation is up to [−180∘, 180∘] or the translation is up to [−20 m, 20 m]. We also test the generalization of our method on the TUM3D dataset using the model trained on Modelnet40. The results show that our method’s errors are close to the experimental results on Modelnet40, which verifies the good generalization ability of our method. All experiments prove that the proposed method is superior to state-of-the-art PCReg algorithms in terms of accuracy and complexity.


2015 ◽  
Vol 35 (2) ◽  
pp. 0215002 ◽  
Author(s):  
伍梦琦 Wu Mengqi ◽  
李中伟 Li Zhongwei ◽  
钟凯 Zhong Kai ◽  
史玉升 Shi Yusheng

2014 ◽  
Vol 536-537 ◽  
pp. 131-135 ◽  
Author(s):  
Tian Fan Chen ◽  
Cheng Hui Gao ◽  
Bing Wei He

A method is presented to accurate face-mating point cloud registration after dealing with noise point. Point cloud registration is divided into two parts,firstly,coarse registration is applied for visual point cloud,then three local sufaces of overlap cloud region are selected to be mating calculated after denosing base on least squares fitting , at last accurate splicing parameters of translation and rotation are acquired by nonlinear least square .This algorithm is easy to deal with the denosing, has faster convergence speed and higher registration accuracy.Its feasibility is proved by samples.


Sign in / Sign up

Export Citation Format

Share Document