Automatic image registration method for high resolution remote sensing images based on feature points

Author(s):  
Wan-Zhen Zhou ◽  
Xiao-Yang Li ◽  
Zhi Gao
2021 ◽  
Vol 13 (17) ◽  
pp. 3425
Author(s):  
Xin Zhao ◽  
Hui Li ◽  
Ping Wang ◽  
Linhai Jing

Accurate registration for multisource high-resolution remote sensing images is an essential step for various remote sensing applications. Due to the complexity of the feature and texture information of high-resolution remote sensing images, especially for images covering earthquake disasters, feature-based image registration methods need a more helpful feature descriptor to improve the accuracy. However, traditional image registration methods that only use local features at low levels have difficulty representing the features of the matching points. To improve the accuracy of matching features for multisource high-resolution remote sensing images, an image registration method based on a deep residual network (ResNet) and scale-invariant feature transform (SIFT) was proposed. It used the fusion of SIFT features and ResNet features on the basis of the traditional algorithm to achieve image registration. The proposed method consists of two parts: model construction and training and image registration using a combination of SIFT and ResNet34 features. First, a registration sample set constructed from high-resolution satellite remote sensing images was used to fine-tune the network to obtain the ResNet model. Then, for the image to be registered, the Shi_Tomas algorithm and the combination of SIFT and ResNet features were used for feature extraction to complete the image registration. Considering the difference in image sizes and scenes, five pairs of images were used to conduct experiments to verify the effectiveness of the method in different practical applications. The experimental results showed that the proposed method can achieve higher accuracies and more tie points than traditional feature-based methods.


2015 ◽  
Vol 12 (1) ◽  
pp. 289-306 ◽  
Author(s):  
Chao Wang ◽  
Aiye Shi ◽  
Xin Wang ◽  
Fengchen Huang ◽  
Hui Liu

When traditional multi-scale analysis tools are applied to high resolution remote sensing image registration, difficulties and limitations are common in selection of directional sub-bands and distribution optimization of control point pairs etc. Aiming at this issue, a novel registration method based on JSEG and NMI is proposed in this paper. It is the method that incorporates the multi-scale segmentation method (JSEG) into image registration for the first time and proposes an adaptive feature point extraction method on the basis of blocking strategy. Then, NMI is adopted to obtain a set of control point pairs. Finally, the image registration is realized by virtue of Delaunay triangle local transform mapping functions. In accordance with experiments on high resolution remote sensing images collected by different sensors, it is found that the method can not only extract feature points accurately but also ensure reasonable distribution of control point pairs. Meanwhile, compared with traditional multi-scale tools-based methods, the method has relatively high accuracy and robustness.


Sensors ◽  
2020 ◽  
Vol 20 (8) ◽  
pp. 2286 ◽  
Author(s):  
Xin Zhao ◽  
Hui Li ◽  
Ping Wang ◽  
Linhai Jing

For earthquake disaster assessment using remote sensing (RS), multisource image registration is an important step. However, severe earthquakes will increase the deformation between the remote sensing images acquired before and after the earthquakes on different platforms. Traditional image registration methods can hardly meet the requirements of accuracy and efficiency of image registration of post-earthquake RS images used for disaster assessment. Therefore, an improved image registration method was proposed for the registration of multisource high-resolution remote sensing images. The proposed method used the combination of the Shi_Tomasi corner detection algorithm and scale-invariant feature transform (SIFT) to detect tie points from image patches obtained by an image partition strategy considering geographic information constraints. Then, the random sample consensus (RANSAC) and greedy algorithms were employed to remove outliers and redundant matched tie points. Additionally, a pre-earthquake RS image database was constructed using pre-earthquake high-resolution RS images and used as the references for image registration. The performance of the proposed method was evaluated using three image pairs covering regions affected by severe earthquakes. It was shown that the proposed method provided higher accuracy, less running time, and more tie points with a more even distribution than the classic SIFT method and the SIFT method using the same image partitioning strategy.


2020 ◽  
Vol 12 (18) ◽  
pp. 2937
Author(s):  
Song Cui ◽  
Miaozhong Xu ◽  
Ailong Ma ◽  
Yanfei Zhong

The nonlinear radiation distortions (NRD) among multimodal remote sensing images bring enormous challenges to image registration. The traditional feature-based registration methods commonly use the image intensity or gradient information to detect and describe the features that are sensitive to NRD. However, the nonlinear mapping of the corresponding features of the multimodal images often results in failure of the feature matching, as well as the image registration. In this paper, a modality-free multimodal remote sensing image registration method (SRIFT) is proposed for the registration of multimodal remote sensing images, which is invariant to scale, radiation, and rotation. In SRIFT, the nonlinear diffusion scale (NDS) space is first established to construct a multi-scale space. A local orientation and scale phase congruency (LOSPC) algorithm are then used so that the features of the images with NRD are mapped to establish a one-to-one correspondence, to obtain sufficiently stable key points. In the feature description stage, a rotation-invariant coordinate (RIC) system is adopted to build a descriptor, without requiring estimation of the main direction. The experiments undertaken in this study included one set of simulated data experiments and nine groups of experiments with different types of real multimodal remote sensing images with rotation and scale differences (including synthetic aperture radar (SAR)/optical, digital surface model (DSM)/optical, light detection and ranging (LiDAR) intensity/optical, near-infrared (NIR)/optical, short-wave infrared (SWIR)/optical, classification/optical, and map/optical image pairs), to test the proposed algorithm from both quantitative and qualitative aspects. The experimental results showed that the proposed method has strong robustness to NRD, being invariant to scale, radiation, and rotation, and the achieved registration precision was better than that of the state-of-the-art methods.


2012 ◽  
Vol 452-453 ◽  
pp. 950-953
Author(s):  
Yong Mei Zhang ◽  
Li Ma

Aiming at the registration of multi-sensor remote sensing images, a fast and effective image registration algorithm method is presented. In this algorithm, using SIFT to extract feature points, remove mismatching points through Delaunay triangulation, and introduce distance calculation into the determination of homologous control point pairs. The effect of image registration algorithm is evaluated by subjective and objective method. Experiment results show the proposed algorithm can accurately register multi-spectral and panchromatic images with some shift, rotation angles and back-ground noises, and it can inrease the speed and precision of registration.


2016 ◽  
Vol 16 (5) ◽  
pp. 34-49 ◽  
Author(s):  
Fenghua Huang ◽  
Zhengyuan Mao ◽  
Wenzao Shi

Abstract While SIFT (Scale Invariant Feature Transform) features are used to match High-Resolution (HR) remote sensing urban images captured at different phases with large scale and view variations, feature points are few and the matching accuracy is low. Although replacing SIFT with fully affine invariant features ASIFT (Affine-SIFT) can increase the number of feature points, it results in matching inefficiency and a non-uniform distribution of matched feature point pairs. To address these problems, this paper proposes the novel matching method ICA-ASIFT, which matches HR remote sensing urban images captured at different phases by using an Independent Component Analysis algorithm (ICA) and ASIFT features jointly. First, all possible affine deformations are modeled for the image transform, extracting ASIFT features of remote sensing images captured at different times. The ICA algorithm reduces the dimensionality of ASIFT features and improves matching efficiency of subsequent ASIFT feature point pairs. Next, coarse matching is performed on ASIFT feature point pairs through the algorithms of Nearest Vector Angle Ratio (NVAR), Direction Difference Analysis (DDA) and RANdom SAmple Consensus (RANSAC), eliminating apparent mismatches. Then, fine matching is performed on rough matched point pairs using a Neighborhoodbased Feature Graph Matching algorithm (NFGM) to obtain final ASIFT matching point pairs of remote sensing images. Finally, final matching point pairs are used to compute the affine transform matrix. Matching HR remote sensing images captured at different phases is achieved through affine transform. Experiments are used to compare the performance of ICA-ASFIT and three other algorithms (i.e., Harris- SIFT, PCA-SIFT, TD-ASIFT) on HR remote sensing images captured at different times in different regions. Experimental results show that the proposed ICA-ASFIT algorithm effectively matches HR remote sensing urban images and outperforms other algorithms in terms of matching accuracy and efficiency.


Author(s):  
Kun Yang ◽  
Anning Pan ◽  
Yang Yang ◽  
Su Zhang ◽  
Sim Heng Ong ◽  
...  

Remote sensing image registration plays an important role in military and civilian fields, such as natural disaster damage assessment, military damage assessment and ground targets identification, etc. However, due to the ground relief variations and imaging viewpoint changes, non-rigid geometric distortion occurs between remote sensing images with different viewpoint, which further increases the difficulty of remote sensing image registration. To address the problem, we propose a multi-viewpoint remote sensing image registration method which contains the following contributions. (i) A multiple features based finite mixture model is constructed for dealing with different types of image features. (ii) Three features are combined and substituted into the mixture model to form a feature complementation, i.e., the Euclidean distance and shape context are used to measure the similarity of geometric structure, and the SIFT (scale-invariant feature transform) distance which is endowed with the intensity information is used to measure the scale space extrema. (iii) To prevent the ill-posed problem, a geometric constraint term is introduced into the L2E-based energy function for better behaving the non-rigid transformation. We evaluated the performances of the proposed method by three series of remote sensing images obtained from the unmanned aerial vehicle (UAV) and Google Earth, and compared with five state-of-the-art methods where our method shows the best alignments in most cases.


Sign in / Sign up

Export Citation Format

Share Document