Combining Feature Correspondence with Parametric Chamfer Alignment: Hybrid Two-Stage Registration for Ultra-Widefield Retinal Images

Author(s):  
Li Ding ◽  
Tony Kang ◽  
Ajay E. Kuriyan ◽  
Rajeev S. Ramchandran ◽  
Charles C. Wykoff ◽  
...  

<div>We propose a novel hybrid framework for registering retinal images in the presence of extreme geometric distortions that are commonly encountered in ultra-widefield (UWF) fluorescein angiography. Our approach consists of two stages: a feature-based global registration and a vessel-based local refinement. For the global registration, we introduce a modified RANSAC algorithm that jointly identifies robust matches between feature keypoints in reference and target images and estimates a polynomial geometric transformation consistent with the identified correspondences. Our RANSAC modification particularly improves feature point matching and the registration in peripheral regions that are most severely impacted by the geometric distortions. The second local refinement stage is formulated in our framework as a parametric chamfer alignment for vessel maps obtained using a deep neural network. Because the complete vessel maps contribute to the chamfer alignment, this approach not only improves registration accuracy but also aligns with clinical practice, where vessels are typically a key focus of examinations. We validate the effectiveness of the proposed framework on a new UWF fluorescein angiography (FA) dataset and on the existing narrow-field FIRE (fundus image registration) dataset and demonstrate that it significantly outperforms prior retinal image registration methods. The proposed approach enhances the utility of large sets of longitudinal UWF images by enabling: (a) automatic computation of vessel change metrics and (b) standardized and co-registered examination that can better highlight changes of clinical interest to physicians.</div>

2021 ◽  
Author(s):  
Li Ding ◽  
Tony Kang ◽  
Ajay E. Kuriyan ◽  
Rajeev S. Ramchandran ◽  
Charles C. Wykoff ◽  
...  

<div>We propose a novel hybrid framework for registering retinal images in the presence of extreme geometric distortions that are commonly encountered in ultra-widefield (UWF) fluorescein angiography. Our approach consists of two stages: a feature-based global registration and a vessel-based local refinement. For the global registration, we introduce a modified RANSAC algorithm that jointly identifies robust matches between feature keypoints in reference and target images and estimates a polynomial geometric transformation consistent with the identified correspondences. Our RANSAC modification particularly improves feature point matching and the registration in peripheral regions that are most severely impacted by the geometric distortions. The second local refinement stage is formulated in our framework as a parametric chamfer alignment for vessel maps obtained using a deep neural network. Because the complete vessel maps contribute to the chamfer alignment, this approach not only improves registration accuracy but also aligns with clinical practice, where vessels are typically a key focus of examinations. We validate the effectiveness of the proposed framework on a new UWF fluorescein angiography (FA) dataset and on the existing narrow-field FIRE (fundus image registration) dataset and demonstrate that it significantly outperforms prior retinal image registration methods. The proposed approach enhances the utility of large sets of longitudinal UWF images by enabling: (a) automatic computation of vessel change metrics and (b) standardized and co-registered examination that can better highlight changes of clinical interest to physicians.</div>


Sensors ◽  
2019 ◽  
Vol 19 (14) ◽  
pp. 3117
Author(s):  
Xue Wan ◽  
Chenhui Wang ◽  
Shengyang Li

Phase correlation is one of the widely used image registration method in medical image processing and remote sensing. One of the main limitations of the phase correlation-based registration method is that it can only cope with Euclidean transformations, such as translation, rotation and scale, which constrain its application in wider fields, such as multi-view image matching, image-based navigation, etc. In this paper, we extended the phase correlation to perspective transformation by the combination of particle swarm optimization. Inspired by optic lens alignment based on interference, we propose to use the quality of PC fringes as the similarity, and then the aim of registration is to search for the optimized geometric transformation operator, which obtain the maximize value of PC-based similarity function through particle swarm optimization approach. The proposed method is validated by image registration experiments using simulated terrain shading, texture and natural landscape images containing different challenges, including illumination variation, lack of texture, motion blur, occlusion and geometric distortions. Further, image-based navigation experiments are carried out to demonstrate that the proposed method is able to correctly recover the trajectory of camera using multimodal target and reference image. Even under great radiometric and geometric distortions, the proposed method is able to achieve 0.1 sub-pixel matching accuracy on average while other methods fail to find the correspondence.


Author(s):  
J. P. Jhan ◽  
J. Y. Rau

<p><strong>Abstract.</strong> Due to the raw images of multi-lens multispectral (MS) camera has significant misregistration errors, performing image registration for band co-registration is necessary. Image matching is an essential step for image registration, which obtains conjugate features on the overlapped areas, and use them to estimate the coefficients of a transformation model for correcting the geometrical errors. However, due to the none-linear intensity of spectral response, performing feature-based image matching (such as SURF) can only obtain only a few conjugate features on cross-band MS images. Different to SURF that extracts local extremum in a multi-scale space and utilizes a threshold to determine a feature, we proposed a normalized SURF (N-SURF) that extracts features on single scale, calculates the cumulative distribution function (CDF) of features, and obtains consistent features from the CDF. In this study, two datasets acquired from Tetracam MiniMCA-12 and Micasense RedEdge Altum are used for evaluating the matching performance of N-SURF. Results show that N-SURF can extract approximately 2&amp;ndash;3 times number of features, match more points, and have more efficient than original SURF. On the other hand, with the successful of MS image matching, we can therefor use the conjugates to compute the coefficients of a geometric transformation model. In this study, three transformation models are used to compare the difference on MS band co-registration, i.e. affine, projective, and extended projective. Results show that extended projective model is better than the others as it can compensate the difference of lens distortion and viewpoint, and has co-registration accuracy of 0.3&amp;ndash;0.6 pixels.</p>


2021 ◽  
Author(s):  
Guillaume Cazoulat ◽  
Brian M Anderson ◽  
Molly M McCulloch ◽  
Bastien Rigaud ◽  
Eugene J Koay ◽  
...  

2004 ◽  
Vol 43 (04) ◽  
pp. 367-370 ◽  
Author(s):  
U. Morgenstern ◽  
R. Steinmeier ◽  
F. Uhlemann

Summary Objective: The registration of medical volume data sets plays an important role when different images or modalities are used during computer-assisted surgical procedures. Nevertheless, it is often questionable how robust and accurate the underlying algorithms really are. Therefore, the goal is to foster the establishment of methods for an objective evaluation. Method: To reliably calculate the accuracy of registration algorithms, a reference transformation must be known. Due to the unknown perfect registration for real clinical data, the simulation of realistic data and successive affine transformations are employed. The simulation is based on models of the respective imaging modality where the dominant physical effects are taken into account. This gives the user full control over all simulation and transformation parameters. Finally, suitable quality measures are applied which allow a systematic evaluation of image registration accuracy by comparing the known theoretical result and the transformation calculated by the algorithm under investigation. Results: During the development of a new registration algorithm, the presented method proved to be a very valuable tool for optimization and evaluation of registration accuracy, since it allows objective numerical comparison of the calculated results. Conclusions: The presented method can be used during the development of algorithms for optimization and for quantitative comparison of different registration schemes. The respective software tool can automatically generate and transform simulated but realistic data. Employing suitable numerical quality measures, an objective evaluation of registration results can be easily obtained. Still, the validity of the relatively simple models has to be verified to draw reliable conclusions with respect to real data.


2020 ◽  
Vol 47 (7) ◽  
pp. 3023-3031
Author(s):  
Hisamichi Takagi ◽  
Noriyuki Kadoya ◽  
Tomohiro Kajikawa ◽  
Shohei Tanaka ◽  
Yoshiki Takayama ◽  
...  

2017 ◽  
Vol 42 ◽  
pp. 108-111 ◽  
Author(s):  
Hideharu Miura ◽  
Shuichi Ozawa ◽  
Minoru Nakao ◽  
Kengo Furukawa ◽  
Yoshiko Doi ◽  
...  

Sign in / Sign up

Export Citation Format

Share Document