Image-Aided LiDAR Mapping Platform and Data Processing Strategy for Stockpile Volume Estimation

Stockpile quantity monitoring is vital for agencies and businesses to maintain inventory of bulk material such as salt, sand, aggregate, lime, and many other materials commonly used in agriculture, highways, and industrial applications. Traditional approaches for volumetric assessment of bulk material stockpiles, e.g., truckload counting, are inaccurate and prone to cumulative errors over long time. Modern aerial and terrestrial remote sensing platforms equipped with camera and/or light detection and ranging (LiDAR) units have been increasingly popular for conducting high-fidelity geometric measurements. Current use of these sensing technologies for stockpile volume estimation is impacted by environmental conditions such as lack of global navigation satellite system (GNSS) signals, poor lighting, and/or featureless surfaces. This study addresses these limitations through a new mapping platform denoted as Stockpile Monitoring and Reporting Technology (SMART), which is designed and integrated as a time-efficient, cost-effective stockpile monitoring solution. The novel mapping framework is realized through camera and LiDAR data-fusion that facilitates stockpile volume estimation in challenging environmental conditions. LiDAR point clouds are derived through a sequence of data collections from different scans. In order to handle the sparse nature of the collected data at a given scan, an automated image-aided LiDAR coarse registration technique is developed followed by a new segmentation approach to derive features, which are used for fine registration. The resulting 3D point cloud is subsequently used for accurate volume estimation. Field surveys were conducted on stockpiles of varying size and shape complexity. Independent assessment of stockpile volume using terrestrial laser scanners (TLS) shows that the developed framework had close to 1% relative error.

Deep Cascade Networks for Single 2D US Slice to 3D CT/MRI Image Registration

Background and Objective: Ultrasound (US) devices are often used in percutanous interventions. Due to their low image quality, the US image slices are aligned with pre-operative Computed Tomography/Magnetic Resonance Imaging (CT/MRI) images to enable better visibilities of anatomies during the intervention. This work aims at improving the deep learning one shot registration by using less loops through deep learning networks.Methods: We propose two cascade networks which aim at improving registration accuracy by less loops. The InitNet-Regression-LoopNet (IRL) network applies the plane regression method to detect the orientation of the predicted plane derived from the previous loop, then corrects input CT/MRI volume orientation and improves the prediction iteratively. The InitNet-LoopNet-MultiChannel (ILM) comprises two cascade networks, where an InitNet is trained with low resolution images toperform coarse registration. Then, a LoopNet wraps the high resolution images and result of the previous loop into a three channel input and trained to improve prediction accuracy in every loop. Results: We benchmark the two cascade networks on 1035 clinical images from 52 patients , yielding an improved registration accuracy with LoopNet. The IRL achieved an average angle error of 13.3° and an average distance error of 4.5 millimieter. It out-performs the ILM network with angle error 17.4° and distance error 4.9 millimeter and the InitNet with angle error 18.6° and distance error 4.9 millimeter. Our results show the efficiency of the proposed registration networks, which have the potential to improve the robustness and accuracy of intraoperative patient registration.

Point cloud and BIM model registration based on genetic algorithm and ICP algorithm

With the rapid development of the construction industry, BIM technology, and 3D laser scanning technology are being used more and more widely, and there are many applications of combining BIM technology with 3D laser scanning technology, such as quality inspection, progress inspection, or digital preservation of ancient buildings. Therefore, this paper proposes a 3D point cloud and BIM model registration scheme based on genetic algorithm and ICP algorithm, firstly, the point cloud data is pre-processed by statistical denoising method for denoising and downsampling, and the BIM model data is converted to format data; then the coarse registration is performed by genetic algorithm, and the accurate registration is performed by ICP algorithm based on KD-tree, and finally, we experimentally verify the feasibility of the algorithm in this paper, and compared with the ICP algorithm, the registration efficiency and accuracy of the algorithm in this paper are greatly improved.

Super Edge 4-Points Congruent Sets-Based Point Cloud Global Registration

With the acceleration in three-dimensional (3D) high-frame-rate sensing technologies, dense point clouds collected from multiple standpoints pose a great challenge for the accuracy and efficiency of registration. The combination of coarse registration and fine registration has been extensively promoted. Unlike the requirement of small movements between scan pairs in fine registration, coarse registration can match scans with arbitrary initial poses. The state-of-the-art coarse methods, Super 4-Points Congruent Sets algorithm based on the 4-Points Congruent Sets, improves the speed of registration to a linear order via smart indexing. However, the lack of reduction in the scale of original point clouds limits the application. Besides, the coplanarity of registration bases prevents further reduction of search space. This paper proposes a novel registration method called the Super Edge 4-Points Congruent Sets to address the above problems. The proposed algorithm follows a three-step procedure, including boundary segmentation, overlapping regions extraction, and bases selection. Firstly, an improved method based on vector angle is used to segment the original point clouds aiming to thin out the scale of the initial point clouds. Furthermore, overlapping regions extraction is executed to find out the overlapping regions on the contour. Finally, the proposed method selects registration bases conforming to the distance constraints from the candidate set without consideration about coplanarity. Experiments on various datasets with different characteristics have demonstrated that the average time complexity of the proposed algorithm is improved by 89.76%, and the accuracy is improved by 5 mm on average than the Super 4-Points Congruent Sets algorithm. More encouragingly, the experimental results show that the proposed algorithm can be applied to various restrictive cases, such as few overlapping regions and massive noise. Therefore, the algorithm proposed in this paper is a faster and more robust method than Super 4-Points Congruent Sets under the guarantee of the promised quality.

A Medical Image Registration Method Based on Progressive Images

Background. Medical image registration is an essential task for medical image analysis in various applications. In this work, we develop a coarse-to-fine medical image registration method based on progressive images and SURF algorithm (PI-SURF) for higher registration accuracy. Methods. As a first step, the reference image and the floating image are fused to generate multiple progressive images. Thereafter, the floating image and progressive image are registered to get the coarse registration result based on the SURF algorithm. For further improvement, the coarse registration result and the reference image are registered to perform fine image registration. The appropriate progressive image has been investigated by experiments. The mutual information (MI), normal mutual information (NMI), normalized correlation coefficient (NCC), and mean square difference (MSD) similarity metrics are used to demonstrate the potential of the PI-SURF method. Results. For the unimodal and multimodal registration, the PI-SURF method achieves the best results compared with the mutual information method, Demons method, Demons+B-spline method, and SURF method. The MI, NMI, and NCC of PI-SURF are improved by 15.5%, 1.31%, and 7.3%, respectively, while MSD decreased by 13.2% for the multimodal registration compared with the optimal result of the state-of-the-art methods. Conclusions. The extensive experiments show that the proposed PI-SURF method achieves higher quality of registration.

Pairwise Registration Algorithm for Large-Scale Planar Point Cloud Used in Flatness Measurement

In this paper, an optimized three-dimensional (3D) pairwise point cloud registration algorithm is proposed, which is used for flatness measurement based on a laser profilometer. The objective is to achieve a fast and accurate six-degrees-of-freedom (6-DoF) pose estimation of a large-scale planar point cloud to ensure that the flatness measurement is precise. To that end, the proposed algorithm extracts the boundary of the point cloud to obtain more effective feature descriptors of the keypoints. Then, it eliminates the invalid keypoints by neighborhood evaluation to obtain the initial matching point pairs. Thereafter, clustering combined with the geometric consistency constraints of correspondences is conducted to realize coarse registration. Finally, the iterative closest point (ICP) algorithm is used to complete fine registration based on the boundary point cloud. The experimental results demonstrate that the proposed algorithm is superior to the current algorithms in terms of boundary extraction and registration performance.