scholarly journals AN AUTOMATIC OPTICAL AND SAR IMAGE REGISTRATION METHOD USING ITERATIVE MULTI-LEVEL AND REFINEMENT MODEL

Author(s):  
C. Xu ◽  
H. G. Sui ◽  
D. R. Li ◽  
K. M. Sun ◽  
J. Y. Liu

Automatic image registration is a vital yet challenging task, particularly for multi-sensor remote sensing images. Given the diversity of the data, it is unlikely that a single registration algorithm or a single image feature will work satisfactorily for all applications. Focusing on this issue, the mainly contribution of this paper is to propose an automatic optical-to-SAR image registration method using –level and refinement model: Firstly, a multi-level strategy of coarse-to-fine registration is presented, the visual saliency features is used to acquire coarse registration, and then specific area and line features are used to refine the registration result, after that, sub-pixel matching is applied using KNN Graph. Secondly, an iterative strategy that involves adaptive parameter adjustment for re-extracting and re-matching features is presented. Considering the fact that almost all feature-based registration methods rely on feature extraction results, the iterative strategy improve the robustness of feature matching. And all parameters can be automatically and adaptively adjusted in the iterative procedure. Thirdly, a uniform level set segmentation model for optical and SAR images is presented to segment conjugate features, and Voronoi diagram is introduced into Spectral Point Matching (VSPM) to further enhance the matching accuracy between two sets of matching points. Experimental results show that the proposed method can effectively and robustly generate sufficient, reliable point pairs and provide accurate registration.

Author(s):  
C. Xu ◽  
H. G. Sui ◽  
D. R. Li ◽  
K. M. Sun ◽  
J. Y. Liu

Automatic image registration is a vital yet challenging task, particularly for multi-sensor remote sensing images. Given the diversity of the data, it is unlikely that a single registration algorithm or a single image feature will work satisfactorily for all applications. Focusing on this issue, the mainly contribution of this paper is to propose an automatic optical-to-SAR image registration method using –level and refinement model: Firstly, a multi-level strategy of coarse-to-fine registration is presented, the visual saliency features is used to acquire coarse registration, and then specific area and line features are used to refine the registration result, after that, sub-pixel matching is applied using KNN Graph. Secondly, an iterative strategy that involves adaptive parameter adjustment for re-extracting and re-matching features is presented. Considering the fact that almost all feature-based registration methods rely on feature extraction results, the iterative strategy improve the robustness of feature matching. And all parameters can be automatically and adaptively adjusted in the iterative procedure. Thirdly, a uniform level set segmentation model for optical and SAR images is presented to segment conjugate features, and Voronoi diagram is introduced into Spectral Point Matching (VSPM) to further enhance the matching accuracy between two sets of matching points. Experimental results show that the proposed method can effectively and robustly generate sufficient, reliable point pairs and provide accurate registration.


2018 ◽  
Vol 10 (11) ◽  
pp. 1837 ◽  
Author(s):  
Chu He ◽  
Peizhang Fang ◽  
Dehui Xiong ◽  
Wenwei Wang ◽  
Mingsheng Liao

Automatic image registration of optical-to-Synthetic aperture radar (SAR) images is difficult because of the inconsistency of radiometric and geometric properties between the optical image and the SAR image. The intensity-based methods may require many calculations and be ineffective when there are geometric distortions between these two images. The feature-based methods have high requirements on features, and there are certain challenges in feature extraction and matching. A new automatic optical-to-SAR image registration framework is proposed in this paper. First, modified holistically nested edge detection is employed to detect the main contours in both the optical and SAR images. Second, a mesh grid strategy is presented to perform a coarse-to-fine registration. The coarse registration calculates the feature matching and summarizes the preliminary results for the fine registration process. Finally, moving direct linear transformation is introduced to perform a homography warp to alleviate parallax. The experimental results show the effectiveness and accuracy of our proposed method.


2016 ◽  
Vol 13 (2) ◽  
pp. 242-246 ◽  
Author(s):  
Fuqiang Liu ◽  
Fukun Bi ◽  
Liang Chen ◽  
Hao Shi ◽  
Wei Liu

2011 ◽  
Vol 48-49 ◽  
pp. 48-51
Author(s):  
Lu Jing Yang ◽  
Wei Hao ◽  
Chong Lun Li

Image registration is a very fundamental and important part in many multi-sensor image based applications. Phase correlation-based image registration method is widely concerned for its small computation amount, strong anti-interference property. However, it can only solve the image registration problem with translational motion. Hence, we proposed a modified phase correlation registration method in the paper. We analyzed the principle of registration, gave the flow chart, and applied the method to the SAR image registration problems with scaling, rotation and translation transformation. Simulation results show that the method can accurately estimate the translation parameters, zoom scale and rotation angle of registrating image relative to the reference image.


2019 ◽  
Vol 11 (15) ◽  
pp. 1833 ◽  
Author(s):  
Han Yang ◽  
Xiaorun Li ◽  
Liaoying Zhao ◽  
Shuhan Chen

Automatic image registration has been wildly used in remote sensing applications. However, the feature-based registration method is sometimes inaccurate and unstable for images with large scale difference, grayscale and texture differences. In this manuscript, a coarse-to-fine registration scheme is proposed, which combines the advantage of feature-based registration and phase correlation-based registration. The scheme consists of four steps. First, feature-based registration method is adopted for coarse registration. A geometrical outlier removal method is applied to improve the accuracy of coarse registration, which uses geometric similarities of inliers. Then, the sensed image is modified through the coarse registration result under affine deformation model. After that, the modified sensed image is registered to the reference image by extended phase correlation. Lastly, the final registration results are calculated by the fusion of the coarse registration and the fine registration. High universality of feature-based registration and high accuracy of extended phase correlation-based registration are both preserved in the proposed method. Experimental results of several different remote sensing images, which come from several published image registration papers, demonstrate the high robustness and accuracy of the proposed method. The evaluation contains root mean square error (RMSE), Laplace mean square error (LMSE) and red–green image registration results.


2007 ◽  
Vol 19 (06) ◽  
pp. 359-374 ◽  
Author(s):  
Yih-Chih Chiou ◽  
Chern-Sheng Lin ◽  
Cheng-Yu Lin

Mammogram registration is a critical step in automatic detection of breast cancer. Much research has been devoted to registering mammograms using either feature-matching or similarity measure. However, a few studies have been done on combining these two methods. In this research, a hybrid mammogram registration method for the early detection of breast cancer is developed by combining feature-based and intensity-based image registration techniques. Besides, internal and external features were used simultaneously during the registration to obtain a global spatial transformation. The experimental results indicates that the similarity between the two mammograms increases significantly after a proper registration using the proposed TPS-registration procedures.


2011 ◽  
Vol 65 ◽  
pp. 514-517
Author(s):  
Rui Niu ◽  
Xiao Tao Tang ◽  
Yu Wang

Interferometric Synthetic Aperture Radar is a kind of technology to acquire the DEM information on the surface of the earth. It is concerned and researched by all over the world. Complex image registration of high precision is the key step in InSAR data processing, its results directly influence on the quantity of interferometric phase , even to the DEM precision.This paper introduces the complex image registration plans which is used the correlative coefficient method to make the coarse registration, and is used the correlative coefficient interpolation method to make the high precise registration.The experiments with spaceborne and aeroplane InSAR data prove that this method is with feasibility, high efficiency and practicability.


2019 ◽  
Vol 9 (17) ◽  
pp. 3598 ◽  
Author(s):  
Erhu Zhang ◽  
Yajun Chen ◽  
Min Gao ◽  
Jinghong Duan ◽  
Cuining Jing

In the printing industry, defect detection is of crucial importance for ensuring the quality of printed matter. However, rarely has research been conducted for web offset printing. In this paper, we propose an automatic defect detection method for web offset printing, which consists of determining first row of captured images, image registration and defect detection. Determining the first row of captured images is a particular problem of web offset printing, which has not been studied before. To solve this problem, a fast computational algorithm based on image projection is given, which can convert 2D image searching into 1D feature matching. For image registration, a shape context descriptor is constructed by considering the shape concave-convex feature, which can effectively reduce the dimension of features compared with the traditional image registration method. To tolerate the position difference and brightness deviation between the detected image and the reference image, a modified image subtraction is proposed for defect detection. The experimental results demonstrate the effectiveness of the proposed method.


Sign in / Sign up

Export Citation Format

Share Document