scholarly journals Semantic segmentation guided feature point classification and seam fusion for image stitching

2021 ◽  
Vol 15 ◽  
pp. 174830262110653
Author(s):  
Huafeng Huang ◽  
Fei Chen ◽  
Hang Cheng ◽  
Liyao Li ◽  
Meiqing Wang
Keyword(s):  
Semantic Segmentation ◽  
Classification Problem ◽  
Feature Point ◽  
Image Feature ◽  
Image Stitching ◽  
Feature Points ◽  
Target Image ◽  
Distance Transformation ◽  
Cutting Algorithm

Image stitching can be employed to stitch images taken from different times, perspectives, or devices into a panorama with a wider view. However, the imaging specification of images to be stitched is strict. If the imaging specification is not satisfied, artefacts caused by inaccurate alignment and unnatural distortion will occur. Semantic segmentation can solve the classification problem at the pixel level; however, image stitching significantly depends on the accuracy of feature points. Therefore, this paper proposes an image stitching algorithm based on semantic segmentation to guide feature point classification and seam fusion. First, the images are recognized by a cascade semantic segmentation network, and the image feature points are classified. Thereafter, the corresponding homography transformations are calculated using different class feature points, and the best homography mapping for the entire target image is selected. Finally, a seam-cutting algorithm based on semantic segmentation is used to compute the seam, and a feathering Poisson fusion with distance transformation is used to eliminate artefacts and light differences. Experiments show that the algorithm can generate transitional natural and perceptual stitching results even under the influence of perspective and light differences.

A Fast Underwater Image Stitching Algorithm with Adaptive Adjustment of Attitude Angle

2021 ◽  
Author(s):  
Lizhou Jiang ◽  
Zhijie Tang ◽  
Zhihang Luo ◽  
Chi Wang
Keyword(s):  
Feature Point ◽  
Reference Image ◽  
Image Stitching ◽  
Panoramic Image ◽  
Feature Points ◽  
Image Capture ◽  
Matching Process ◽  
Underwater Image ◽  
Adaptive Adjustment ◽  
The Impact

In underwater image acquisition process, due to the impact of water currents and other disturbances, the movement posture of the underwater machine will be unstable, which could lead to unusual problems such as twisting of underwater image capture. These factors will increase the error rate of feature point matching and lead to the failure of panoramic image mosaic. In this regard, we propose a new, highly applicable underwater image stitching algorithm. Firstly, the posture angle adjustment link is added to the underwater image processing, and the angle deflection problem of the underwater image is effectively improved by using the posture angle information. Secondly, the feature points of underwater images are extracted based on the accelerated robust feature (SURF) algorithm. Then, the reference image is matched with the feature points of the image to be registered, and effective feature point pairs are obtained by screening. Finally, the images are stitched based on OpenCV to obtain a good panoramic image. Afterexperimental analysis and comparison, our method can increase the number of matching feature point pairs between images. In addition, the Euclidean distance is significantly shortened during the matching process, which further makes the matching of feature points more accurate. Our method satisfactorily overcomes the adverse effects of actual underwater operations and has a better application prospect.

Equi-affine differential invariants for invariant feature point detection

2019 ◽  
Vol 31 (2) ◽  
pp. 277-296
Author(s):  
STANLEY L. TUZNIK ◽  
PETER J. OLVER ◽  
ALLEN TANNENBAUM
Keyword(s):  
Feature Point ◽  
Image Feature ◽  
Differential Invariants ◽  
Feature Points ◽  
Affine Invariant ◽  
Moving Frames ◽  
Feature Detectors ◽  
Point Detection ◽  
Point Detector ◽  
Method Of Moving Frames

Image feature points are detected as pixels which locally maximise a detector function, two commonly used examples of which are the (Euclidean) image gradient and the Harris–Stephens corner detector. A major limitation of these feature detectors is that they are only Euclidean-invariant. In this work, we demonstrate the application of a 2D equi-affine-invariant image feature point detector based on differential invariants as derived through the equivariant method of moving frames. The fundamental equi-affine differential invariants for 3D image volumes are also computed.

scholarly journals Flexible point cloud matching method based on three-dimensional image feature points

2018 ◽  
Vol 10 (9) ◽  
pp. 168781401879503
Author(s):  
Haihua Cui ◽  
Wenhe Liao ◽  
Xiaosheng Cheng ◽  
Ning Dai ◽  
Changye Guo
Keyword(s):  
Point Cloud ◽  
Three Dimensional ◽  
Point Clouds ◽  
Feature Point ◽  
Image Feature ◽  
Surface Measurement ◽  
Surface Model ◽  
Feature Points ◽  
Matching Method ◽  
Dimensional Image

Flexible and robust point cloud matching is important for three-dimensional surface measurement. This article proposes a new matching method based on three-dimensional image feature points. First, an intrinsic shape signature algorithm is used to detect the key shape feature points, using a weighted three-dimensional occupational histogram of the data points within the angular space, which is a view-independent representation of the three-dimensional shape. Then, the point feature histogram is used to represent the underlying surface model properties at a point whose computation is based on the combination of certain geometrical relations between the point’s nearest k-neighbors. The two-view point clouds are robustly matched using the proposed double neighborhood constraint of minimizing the sum of the Euclidean distances between the local neighbors of the point and feature point. The proposed optimization method is immune to noise, reduces the search range for matching points, and improves the correct feature point matching rate for a weak surface texture. The matching accuracy and stability of the proposed method are verified using experiments. This method can be used for a flat surface with weak features and in other applications. The method has a larger application range than the traditional methods.

The Feature Extraction and Matching Algorithm Based on the Fire Video Image Orientation

2013 ◽  
Vol 380-384 ◽  
pp. 3986-3989
Author(s):  
Ying Lu ◽  
Hui Qin Wang ◽  
Fei Xu ◽  
Wei Guang Liu
Keyword(s):  
Scale Space ◽  
Video Image ◽  
Feature Point ◽  
Image Feature ◽  
Feature Points ◽  
Scale Invariant ◽  
Match Rate ◽  
Harris Corner ◽  
Computationally Intensive ◽  
Fire Flame

Because the SIFT (scale invariant feature transform) algorithm can not accurately locate the flame shape features and computationally intensive, this article proposed a stereo video image fire flame matching method which is a combination of Harris corner and SIFT algorithm. Firstly, the algorithm extracts image feature points using Harris operator in Gaussian scale space and defines the main directions for each feature point, and then calculates the 32-dimensional feature vectors of each feature point descriptor and the Euclidean distance to match two images. Experimental results of image matching demonstrate that the new algorithm improves the significance of the shape of the extracted feature points and keep a better match rate of 96%. At the same time the time complexity is reduced by 27.8%. This algorithm has a certain practicality.

scholarly journals Panoramic image mosaic method based on image segmentation and Improved SIFT algorithm

2021 ◽  
Vol 2113 (1) ◽  
pp. 012066
Author(s):  
Lei Zhuang ◽  
Jiyan Yu ◽  
Yang Song
Keyword(s):  
Image Segmentation ◽  
Feature Point ◽  
Image Feature ◽  
Feature Descriptor ◽  
Image Mosaic ◽  
Panoramic Image ◽  
Feature Points ◽  
Sift Algorithm ◽  
Original Algorithm ◽  
Image Pairs

Abstract Aiming at the problem of large amount of calculation in extracting image feature points in panoramic image mosaic by SIFT algorithm, a panoramic image mosaic algorithm based on image segmentation and Improved SIFT is proposed in this paper. The algorithm fully considers the characteristics of panoramic image stitching. Firstly, the stitched image is divided into blocks, and the maximum overlapping block of image pairs is extracted by using mutual information. The SIFT key points are extracted by SIFT algorithm, and the dog is filtered before the spatial extreme value detection of SIFT algorithm to eliminate the feature points with small intensity value; When establishing the feature descriptor, the 128 dimension of the original algorithm is reduced to 64 dimensions to reduce the amount of calculation. In the feature point registration process, the feature descriptor is reduced to 32 dimensions, the feature point pairs are roughly extracted by the optimal node first BBF algorithm, and the feature point pairs are registered and screened by RANSAC; Finally, the image transformation matrix is obtained to realize panoramic image mosaic. The experimental results show that the proposed algorithm not only ensures the panoramic mosaic effect, but also extracts the feature points in 11% of the time of the traditional SIFT algorithm, and the feature point registration speed is 27.17% of the traditional SIFT algorithm.

scholarly journals Application of Image Mosaic Technology in Tai Chi Animation Creation

2022 ◽  
Vol 2022 ◽  
pp. 1-9
Author(s):  
Yajun Pang
Keyword(s):  
Tai Chi ◽  
High Efficiency ◽  
Scale Space ◽  
Point Of View ◽  
Image Feature ◽  
Image Stitching ◽  
Image Mosaic ◽  
Feature Points ◽  
Image Splicing ◽  
Cylindrical Projection

Panorama can reflect the image seen at any angle of view at a certain point of view. How to improve the quality of panorama stitching and use it as a data foundation in the “smart tourism” system has become a research hotspot in recent years. Image stitching means to use the overlapping area between the images to be stitched for registration and fusion to generate a new image with a wider viewing angle. This article takes the production of “Tai Chi” animation as an example to apply image stitching technology to the production of realistic 3D model textures to simplify the production of animation textures. A handheld camera is used to collect images in a certain overlapping area. After cylindrical projection, the Harris algorithm based on scale space is adopted to detect image feature points, the two-way normalized cross-correlation algorithm matches the feature points, and the algorithm to extract the threshold T iteratively removes mismatches. The transformation parameter model is quickly estimated through the improved RANSAC algorithm, and the spliced image is projected and transformed. The Szeliski grayscale fusion method directly calculates the grayscale average of the matching points to fuse the image, and finally, the best stitching method is used to eliminate the ghosting at the image mosaic. Data experiments based on Matlab show that the proposed image splicing technology has the advantages of high efficiency and clear spliced images and a more satisfactory panoramic image visual effect can be achieved.

Image Feature Matching Based on SIFT Algorithm

2014 ◽  
Vol 644-650 ◽  
pp. 4157-4161
Author(s):  
Xin Zhang ◽  
Ya Sheng Zhang ◽  
Hong Yao
Keyword(s):  
Image Matching ◽  
Feature Matching ◽  
Quadratic Function ◽  
Scale Space ◽  
Feature Point ◽  
Image Feature ◽  
Three Dimension ◽  
Feature Points ◽  
Gradient Distribution ◽  
Sift Feature

In the process of image matching, it is involved such as image rotation, scale zooming, brightness change and other problems. In order to improve the precision of image matching, image matching algorithm based on SIFT feature point is proposed. First, the method of generating scale space is introduced. Then, the scale and position of feature points are determined through three dimension quadratic function and feature vectors are determined through gradient distribution characteristic of neighborhood pixels of feature points. Finally, feature matching is completed based on the Euclidean distance. The experiment result indicates that using SIFT feature point can achieve image matching effectively.

scholarly journals FSD-BRIEF: A Distorted BRIEF Descriptor for Fisheye Image Based on Spherical Perspective Model

Sensors ◽  
2021 ◽  
Vol 21 (5) ◽  
pp. 1839
Author(s):  
Yutong Zhang ◽  
Jianmei Song ◽  
Yan Ding ◽  
Yating Yuan ◽  
Hua-Liang Wei
Keyword(s):  
Feature Matching ◽  
Field Of View ◽  
Image Feature ◽  
Feature Points ◽  
Matching Process ◽  
Feature Descriptors ◽  
Coordinate Mapping ◽  
Matching Performance ◽  
Perspective Model ◽  
Attitude Matrix

Fisheye images with a far larger Field of View (FOV) have severe radial distortion, with the result that the associated image feature matching process cannot achieve the best performance if the traditional feature descriptors are used. To address this challenge, this paper reports a novel distorted Binary Robust Independent Elementary Feature (BRIEF) descriptor for fisheye images based on a spherical perspective model. Firstly, the 3D gray centroid of feature points is designed, and the position and direction of the feature points on the spherical image are described by a constructed feature point attitude matrix. Then, based on the attitude matrix of feature points, the coordinate mapping relationship between the BRIEF descriptor template and the fisheye image is established to realize the computation associated with the distorted BRIEF descriptor. Four experiments are provided to test and verify the invariance and matching performance of the proposed descriptor for a fisheye image. The experimental results show that the proposed descriptor works well for distortion invariance and can significantly improve the matching performance in fisheye images.

scholarly journals Automatic measurement of traditional Chinese costume from its silhouette through Fuzzy c-means clustering method

2020 ◽  
Vol 15 ◽  
pp. 155892502097832
Author(s):  
Jiaqin Zhang ◽  
Jingan Wang ◽  
Le Xing ◽  
Hui’e Liang
Keyword(s):  
Industrial Application ◽  
Clustering Algorithm ◽  
Color Space ◽  
Automatic Measurement ◽  
Feature Point ◽  
Feature Points ◽  
Point Location ◽  
Fuzzy C Means ◽  
Fuzzy C Means Clustering ◽  
Environmental Robustness

As the precious cultural heritage of the Chinese nation, traditional costumes are in urgent need of scientific research and protection. In particular, there are scanty studies on costume silhouettes, due to the reasons of the need for cultural relic protection, and the strong subjectivity of manual measurement, which limit the accuracy of quantitative research. This paper presents an automatic measurement method for traditional Chinese costume dimensions based on fuzzy C-means clustering and silhouette feature point location. The method is consisted of six steps: (1) costume image acquisition; (2) costume image preprocessing; (3) color space transformation; (4) object clustering segmentation; (5) costume silhouette feature point location; and (6) costume measurement. First, the relative total variation model was used to obtain the environmental robustness and costume color adaptability. Second, the FCM clustering algorithm was used to implement image segmentation to extract the outer silhouette of the costume. Finally, automatic measurement of costume silhouette was achieved by locating its feature points. The experimental results demonstrated that the proposed method could effectively segment the outer silhouette of a costume image and locate the feature points of the silhouette. The measurement accuracy could meet the requirements of industrial application, thus providing the dual value of costume culture research and industrial application.

scholarly journals 3D Mesh Pre-processing Method Based on Feature Point Classification and Anisotropic Vertex Denoising Considering Scene Structure Characteristics

2021 ◽  
Vol 13 (11) ◽  
pp. 2145
Author(s):  
Yawen Liu ◽  
Bingxuan Guo ◽  
Xiongwu Xiao ◽  
Wei Qiu
Keyword(s):  
Real Data ◽  
Geometric Constraints ◽  
Feature Point ◽  
Feature Points ◽  
Denoising Method ◽  
3D Mesh ◽  
Mesh Denoising ◽  
Scene Structure ◽  
Sharp Edges ◽  
Update Strategy

3D mesh denoising plays an important role in 3D model pre-processing and repair. A fundamental challenge in the mesh denoising process is to accurately extract features from the noise and to preserve and restore the scene structure features of the model. In this paper, we propose a novel feature-preserving mesh denoising method, which was based on robust guidance normal estimation, accurate feature point extraction and an anisotropic vertex denoising strategy. The methodology of the proposed approach is as follows: (1) The dual weight function that takes into account the angle characteristics is used to estimate the guidance normals of the surface, which improved the reliability of the joint bilateral filtering algorithm and avoids losing the corner structures; (2) The filtered facet normal is used to classify the feature points based on the normal voting tensor (NVT) method, which raised the accuracy and integrity of feature classification for the noisy model; (3) The anisotropic vertex update strategy is used in triangular mesh denoising: updating the non-feature points with isotropic neighborhood normals, which effectively suppressed the sharp edges from being smoothed; updating the feature points based on local geometric constraints, which preserved and restored the features while avoided sharp pseudo features. The detailed quantitative and qualitative analyses conducted on synthetic and real data show that our method can remove the noise of various mesh models and retain or restore the edge and corner features of the model without generating pseudo features.

Sign in / Sign up

Export Citation Format

Share Document