HYBRID REGISTRATION OF CORRESPONDING MAMMOGRAM IMAGES FOR AUTOMATIC DETECTION OF BREAST CANCER

2007 ◽  
Vol 19 (06) ◽  
pp. 359-374 ◽  
Author(s):  
Yih-Chih Chiou ◽  
Chern-Sheng Lin ◽  
Cheng-Yu Lin
Keyword(s):  
Breast Cancer ◽  
Image Registration ◽  
Early Detection ◽  
Feature Matching ◽  
Automatic Detection ◽  
Spatial Transformation ◽  
Registration Method ◽  
Feature Based ◽  
Mammogram Images ◽  
Hybrid Registration

Mammogram registration is a critical step in automatic detection of breast cancer. Much research has been devoted to registering mammograms using either feature-matching or similarity measure. However, a few studies have been done on combining these two methods. In this research, a hybrid mammogram registration method for the early detection of breast cancer is developed by combining feature-based and intensity-based image registration techniques. Besides, internal and external features were used simultaneously during the registration to obtain a global spatial transformation. The experimental results indicates that the similarity between the two mammograms increases significantly after a proper registration using the proposed TPS-registration procedures.

scholarly journals An Image Registration Method Using Deep Residual Network Features for Multisource High-Resolution Remote Sensing Images

2021 ◽  
Vol 13 (17) ◽  
pp. 3425
Author(s):  
Xin Zhao ◽  
Hui Li ◽  
Ping Wang ◽  
Linhai Jing
Keyword(s):  
Remote Sensing ◽  
High Resolution ◽  
Image Registration ◽  
Feature Descriptor ◽  
Remote Sensing Images ◽  
Residual Network ◽  
Scale Invariant ◽  
Registration Method ◽  
Sensing Applications ◽  
Feature Based

Accurate registration for multisource high-resolution remote sensing images is an essential step for various remote sensing applications. Due to the complexity of the feature and texture information of high-resolution remote sensing images, especially for images covering earthquake disasters, feature-based image registration methods need a more helpful feature descriptor to improve the accuracy. However, traditional image registration methods that only use local features at low levels have difficulty representing the features of the matching points. To improve the accuracy of matching features for multisource high-resolution remote sensing images, an image registration method based on a deep residual network (ResNet) and scale-invariant feature transform (SIFT) was proposed. It used the fusion of SIFT features and ResNet features on the basis of the traditional algorithm to achieve image registration. The proposed method consists of two parts: model construction and training and image registration using a combination of SIFT and ResNet34 features. First, a registration sample set constructed from high-resolution satellite remote sensing images was used to fine-tune the network to obtain the ResNet model. Then, for the image to be registered, the Shi_Tomas algorithm and the combination of SIFT and ResNet features were used for feature extraction to complete the image registration. Considering the difference in image sizes and scenes, five pairs of images were used to conduct experiments to verify the effectiveness of the method in different practical applications. The experimental results showed that the proposed method can achieve higher accuracies and more tie points than traditional feature-based methods.

scholarly journals A Novel Coarse-to-Fine Scheme for Remote Sensing Image Registration Based on SIFT and Phase Correlation

2019 ◽  
Vol 11 (15) ◽  
pp. 1833 ◽  
Author(s):  
Han Yang ◽  
Xiaorun Li ◽  
Liaoying Zhao ◽  
Shuhan Chen
Keyword(s):  
Remote Sensing ◽  
Image Registration ◽  
Phase Correlation ◽  
Mean Square ◽  
Extended Phase ◽  
Registration Method ◽  
Coarse Registration ◽  
Feature Based ◽  
Coarse To Fine ◽  
Fine Registration

Automatic image registration has been wildly used in remote sensing applications. However, the feature-based registration method is sometimes inaccurate and unstable for images with large scale difference, grayscale and texture differences. In this manuscript, a coarse-to-fine registration scheme is proposed, which combines the advantage of feature-based registration and phase correlation-based registration. The scheme consists of four steps. First, feature-based registration method is adopted for coarse registration. A geometrical outlier removal method is applied to improve the accuracy of coarse registration, which uses geometric similarities of inliers. Then, the sensed image is modified through the coarse registration result under affine deformation model. After that, the modified sensed image is registered to the reference image by extended phase correlation. Lastly, the final registration results are calculated by the fusion of the coarse registration and the fine registration. High universality of feature-based registration and high accuracy of extended phase correlation-based registration are both preserved in the proposed method. Experimental results of several different remote sensing images, which come from several published image registration papers, demonstrate the high robustness and accuracy of the proposed method. The evaluation contains root mean square error (RMSE), Laplace mean square error (LMSE) and red–green image registration results.

scholarly journals AN AUTOMATIC OPTICAL AND SAR IMAGE REGISTRATION METHOD USING ITERATIVE MULTI-LEVEL AND REFINEMENT MODEL

2016 ◽  
Vol XLI-B7 ◽  
pp. 593-600
Author(s):  
C. Xu ◽  
H. G. Sui ◽  
D. R. Li ◽  
K. M. Sun ◽  
J. Y. Liu
Keyword(s):  
Image Registration ◽  
Feature Matching ◽  
Visual Saliency ◽  
Specific Area ◽  
Image Feature ◽  
Sar Image ◽  
Registration Method ◽  
Adaptive Parameter ◽  
Coarse Registration ◽  
Multi Level

Automatic image registration is a vital yet challenging task, particularly for multi-sensor remote sensing images. Given the diversity of the data, it is unlikely that a single registration algorithm or a single image feature will work satisfactorily for all applications. Focusing on this issue, the mainly contribution of this paper is to propose an automatic optical-to-SAR image registration method using –level and refinement model: Firstly, a multi-level strategy of coarse-to-fine registration is presented, the visual saliency features is used to acquire coarse registration, and then specific area and line features are used to refine the registration result, after that, sub-pixel matching is applied using KNN Graph. Secondly, an iterative strategy that involves adaptive parameter adjustment for re-extracting and re-matching features is presented. Considering the fact that almost all feature-based registration methods rely on feature extraction results, the iterative strategy improve the robustness of feature matching. And all parameters can be automatically and adaptively adjusted in the iterative procedure. Thirdly, a uniform level set segmentation model for optical and SAR images is presented to segment conjugate features, and Voronoi diagram is introduced into Spectral Point Matching (VSPM) to further enhance the matching accuracy between two sets of matching points. Experimental results show that the proposed method can effectively and robustly generate sufficient, reliable point pairs and provide accurate registration.

scholarly journals Automatic Defect Detection for Web Offset Printing Based on Machine Vision

2019 ◽  
Vol 9 (17) ◽  
pp. 3598 ◽  
Author(s):  
Erhu Zhang ◽  
Yajun Chen ◽  
Min Gao ◽  
Jinghong Duan ◽  
Cuining Jing
Keyword(s):  
Image Registration ◽  
Defect Detection ◽  
Feature Matching ◽  
Reference Image ◽  
Printing Industry ◽  
Offset Printing ◽  
Shape Context ◽  
Image Subtraction ◽  
Registration Method

In the printing industry, defect detection is of crucial importance for ensuring the quality of printed matter. However, rarely has research been conducted for web offset printing. In this paper, we propose an automatic defect detection method for web offset printing, which consists of determining first row of captured images, image registration and defect detection. Determining the first row of captured images is a particular problem of web offset printing, which has not been studied before. To solve this problem, a fast computational algorithm based on image projection is given, which can convert 2D image searching into 1D feature matching. For image registration, a shape context descriptor is constructed by considering the shape concave-convex feature, which can effectively reduce the dimension of features compared with the traditional image registration method. To tolerate the position difference and brightness deviation between the detected image and the reference image, a modified image subtraction is proposed for defect detection. The experimental results demonstrate the effectiveness of the proposed method.

scholarly journals Modality-Free Feature Detector and Descriptor for Multimodal Remote Sensing Image Registration

2020 ◽  
Vol 12 (18) ◽  
pp. 2937
Author(s):  
Song Cui ◽  
Miaozhong Xu ◽  
Ailong Ma ◽  
Yanfei Zhong
Keyword(s):  
Remote Sensing ◽  
Image Registration ◽  
Near Infrared ◽  
Feature Matching ◽  
Simulated Data ◽  
Remote Sensing Image ◽  
Surface Model ◽  
Phase Congruency ◽  
Remote Sensing Images ◽  
Registration Method

The nonlinear radiation distortions (NRD) among multimodal remote sensing images bring enormous challenges to image registration. The traditional feature-based registration methods commonly use the image intensity or gradient information to detect and describe the features that are sensitive to NRD. However, the nonlinear mapping of the corresponding features of the multimodal images often results in failure of the feature matching, as well as the image registration. In this paper, a modality-free multimodal remote sensing image registration method (SRIFT) is proposed for the registration of multimodal remote sensing images, which is invariant to scale, radiation, and rotation. In SRIFT, the nonlinear diffusion scale (NDS) space is first established to construct a multi-scale space. A local orientation and scale phase congruency (LOSPC) algorithm are then used so that the features of the images with NRD are mapped to establish a one-to-one correspondence, to obtain sufficiently stable key points. In the feature description stage, a rotation-invariant coordinate (RIC) system is adopted to build a descriptor, without requiring estimation of the main direction. The experiments undertaken in this study included one set of simulated data experiments and nine groups of experiments with different types of real multimodal remote sensing images with rotation and scale differences (including synthetic aperture radar (SAR)/optical, digital surface model (DSM)/optical, light detection and ranging (LiDAR) intensity/optical, near-infrared (NIR)/optical, short-wave infrared (SWIR)/optical, classification/optical, and map/optical image pairs), to test the proposed algorithm from both quantitative and qualitative aspects. The experimental results showed that the proposed method has strong robustness to NRD, being invariant to scale, radiation, and rotation, and the achieved registration precision was better than that of the state-of-the-art methods.

scholarly journals Feedback Unilateral Grid-Based Clustering Feature Matching for Remote Sensing Image Registration

2019 ◽  
Vol 11 (12) ◽  
pp. 1418
Author(s):  
Zhaohui Zheng ◽  
Hong Zheng ◽  
Yong Ma ◽  
Fan Fan ◽  
Jianping Ju ◽  
...  
Keyword(s):  
Remote Sensing ◽  
Image Registration ◽  
Image Matching ◽  
Feature Matching ◽  
Remote Sensing Image ◽  
Registration Accuracy ◽  
Computation Efficiency ◽  
Feature Based ◽  
Local Grid ◽  
Grid Based

In feature-based image matching, implementing a fast and ultra-robust feature matching technique is a challenging task. To solve the problems that the traditional feature matching algorithm suffers from, such as long running time and low registration accuracy, an algorithm called feedback unilateral grid-based clustering (FUGC) is presented which is able to improve computation efficiency, accuracy and robustness of feature-based image matching while applying it to remote sensing image registration. First, the image is divided by using unilateral grids and then fast coarse screening of the initial matching feature points through local grid clustering is performed to eliminate a great deal of mismatches in milliseconds. To ensure that true matches are not erroneously screened, a local linear transformation is designed to take feedback verification further, thereby performing fine screening between true matching points deleted erroneously and undeleted false positives in and around this area. This strategy can not only extract high-accuracy matching from coarse baseline matching with low accuracy, but also preserves the true matching points to the greatest extent. The experimental results demonstrate the strong robustness of the FUGC algorithm on various real-world remote sensing images. The FUGC algorithm outperforms current state-of-the-art methods and meets the real-time requirement.

scholarly journals Statistics Based Neural Networks Method for Industrial Image Inspection

2021 ◽  
Author(s):  
Yi Zhu
Keyword(s):  
Neural Networks ◽  
Image Registration ◽  
The Other ◽  
Inspection System ◽  
Tolerance Zone ◽  
Registration Method ◽  
Image Inspection ◽  
Feature Based ◽  
Two Indices ◽  
Defect Simulation

Automated industrial image inspection system has attracted a great deal of interest in recent years. In this thesis, a new method is presented by combining a statistics method with a neural networks method, which could reduce the interference of machine dynamics and improve the inspection accuracy. Different from the pixel-based or feature-based methods, the proposed method is based on two indices of an image, which are the variances of the rows and columns of the image. For image inspection, first neural networks are trained using these two indices from a set of good images in order to establish a tolerance zone. Then, the two indices of each inspection image are computed through trained neural networks and compared with the tolerance zone. A defective item is detected if either index falls out of the tolerance zone. The other contributions, such as two-point based image registration method and defect simulation algorithms, also help to improve the performance of inspection. Experimental results demonstrate that the proposed approach has a better performance in comparison with traditional statistics approach.

Image Registration Techniques and Frameworks

2017 ◽  
pp. 102-114 ◽  
Author(s):  
Sayan Chakraborty ◽  
Prasenjit Kumar Patra ◽  
Prasenjit Maji ◽  
Amira S. Ashour ◽  
Nilanjan Dey
Keyword(s):  
Image Registration ◽  
Affine Transformation ◽  
Feature Detection ◽  
Feature Matching ◽  
Mapping Function ◽  
Intermediate Step ◽  
B Splines ◽  
Function Design ◽  
Feature Based ◽  
Step Over

Image registration allude to transforming one image with reference to another (geometrically alignment of reference and sensed images) i.e. the process of overlaying images of the same scene, seized by assorted sensors, from different viewpoints at variant time. Virtually all large image evaluating or mining systems require image registration, as an intermediate step. Over the years, a broad range of techniques has been flourished for various types of data and problems. These approaches are classified according to their nature mainly as area-based and feature-based and on four basic tread of image registration procedure namely feature detection, feature matching, mapping function design, and image transformation and resampling. The current chapter highlights the cogitation effect of four different registration techniques, namely Affine transformation based registration, Rigid transformation based registration, B-splines registration, and Demons registration. It provides a comparative study among all of these registration techniques as well as different frameworks involved in registration process.

Sign in / Sign up

Export Citation Format

Share Document