Joint image registration and fusion method with a gradient strength regularization

2015 ◽  
Vol 24 (3) ◽  
pp. 033018 ◽  
Author(s):  
Huang Lidong ◽  
Zhao Wei ◽  
Wang Jun
2021 ◽  
Vol 13 (22) ◽  
pp. 4720
Author(s):  
Lina Yi ◽  
Jing M. Chen ◽  
Guifeng Zhang ◽  
Xiao Xu ◽  
Xing Ming ◽  
...  

This paper proposes a systematic image mosaicking methodology to produce hyperspectral image for environment monitoring using an emerging UAV-based push-broom hyperspectral imager. The suitability of alternative methods in each step is assessed by experiments of an urban scape, a river course and a forest study area. First, the hyperspectral image strips were acquired by sequentially stitching the UAV images acquired by push-broom scanning along each flight line. Next, direct geo-referencing was applied to each image strip to get initial geo-rectified result. Then, with ground control points, the curved surface spline function was used to transform the initial geo-rectified image strips to improve their geometrical accuracy. To further remove the displacement between pairs of image strips, an improved phase correlation (IPC) and a SIFT and RANSAC-based method (SR) were used in image registration. Finally, the weighted average and the best stitching image fusion method were used to remove the spectral differences between image strips and get the seamless mosaic. Experiment results showed that as the GCPs‘ number increases, the mosaicked image‘s geometrical accuracy increases. In image registration, there exists obvious edge information that can be accurately extracted from the urban scape and river course area; comparative results can be achieved by the IPC method with less time cost. However, for the ground objects with complex texture like forest, the edges extracted from the image is prone to be inaccurate and result in the failure of the IPC method, and only the SR method can get a good result. In image fusion, the best stitching fusion method can get seamless results for all three study areas. Whereas, the weighted average fusion method was only useful in eliminating the stitching line for the river course and forest areas but failed for the urban scape area due to the spectral heterogeneity of different ground objects. For different environment monitoring applications, the proposed methodology provides a practical solution to seamlessly mosaic UAV-based push-broom hyperspectral images with high geometrical accuracy and spectral fidelity.


2019 ◽  
Vol 79 (47-48) ◽  
pp. 34795-34812
Author(s):  
Jun Wu ◽  
Xingxing Ren ◽  
Zhitao Xiao ◽  
Fang Zhang ◽  
Lei Geng ◽  
...  

2018 ◽  
Vol 2018 ◽  
pp. 1-9
Author(s):  
Jianhui Zhao ◽  
Hongbo Gao ◽  
Xinyu Zhang ◽  
Yinglin Zhang ◽  
Yuchao Liu

In order to improve the visual effect of the around view monitor (AVM), we propose a novel ring fusion method to reduce the brightness difference among fisheye images and achieve a smooth transition around stitching seam. Firstly, an integrated corner detection is proposed to automatically detect corner points for image registration. Then, we use equalization processing to reduce the brightness among images. And we match the color of images according to the ring fusion method. Finally, we use distance weight to blend images around stitching seam. Through this algorithm, we have made a Matlab toolbox for image blending. 100% of the required corner is accurately and fully automatically detected. The transition around the stitching seam is very smooth, with no obvious stitching trace.


Endoscopy ◽  
2012 ◽  
Vol 44 (10) ◽  
Author(s):  
H Córdova ◽  
R San José Estépar ◽  
A Rodríguez-D'Jesús ◽  
G Martínez-Pallí ◽  
P Arguis ◽  
...  

2019 ◽  
Vol 2019 (7) ◽  
pp. 465-1-465-7
Author(s):  
Sjors van Riel ◽  
Dennis van de Wouw ◽  
Peter de With

Author(s):  
Sindhu Madhuri G. ◽  
Indira Gandhi M P

Image is a basic and fundamental data source for the digital image processing. This image data source is required to be processed into information or intelligence and further to knowledge levels where it is required to understand and migrate into knowledge economy systems. Image registration is one of such key and most important process already identified in the digital image processing domain. Image registration is a process of bringing the reference image and sensed image into a common co-ordinate system, and application of complex transformation techniques for necessary comparison of reference with sensed images obtained from different - views, times, spaces, etc., in order to extract the valuable information and intelligence embedded in them. Due to the complexity of overall image registration process, it is difficult to suggest a single transformation technique even for a specific application. In addition, it is highly impossible to suggest one single transformation technique for comparison of various sensed images with a reference image during the image registration process. This research gap calls for the development of new image registration techniques for the application of more than one transformation technique during the image registration process for the necessary comparisons with reference image & sensed images, those are obtained from the available heterogeneous sources or sensors, based on the requirement. In addition, it is a basic need to attempt for the measurement of effectiveness of the image registration process also. Therefore, a research framework is developed for image registration process and attempted for the measurement of its effectiveness also. This new research area is a novel idea, and is expected to emerge as a provision for the knowledge computations with creative thinking through the embedded intelligence extraction during the complex image registration process.


Sign in / Sign up

Export Citation Format

Share Document