A Heterogeneous Feature-based Image Alignment Method

Author(s):  
Cen Rao ◽  
Yanlin Guo ◽  
H. Sawhney ◽  
R. Kumar
Sensors ◽  
2019 ◽  
Vol 19 (23) ◽  
pp. 5310
Author(s):  
Lai Kang ◽  
Yingmei Wei ◽  
Jie Jiang ◽  
Yuxiang Xie

Cylindrical panorama stitching is able to generate high resolution images of a scene with a wide field-of-view (FOV), making it a useful scene representation for applications like environmental sensing and robot localization. Traditional image stitching methods based on hand-crafted features are effective for constructing a cylindrical panorama from a sequence of images in the case when there are sufficient reliable features in the scene. However, these methods are unable to handle low-texture environments where no reliable feature correspondence can be established. This paper proposes a novel two-step image alignment method based on deep learning and iterative optimization to address the above issue. In particular, a light-weight end-to-end trainable convolutional neural network (CNN) architecture called ShiftNet is proposed to estimate the initial shifts between images, which is further optimized in a sub-pixel refinement procedure based on a specified camera motion model. Extensive experiments on a synthetic dataset, rendered photo-realistic images, and real images were carried out to evaluate the performance of our proposed method. Both qualitative and quantitative experimental results demonstrate that cylindrical panorama stitching based on our proposed image alignment method leads to significant improvements over traditional feature based methods and recent deep learning based methods for challenging low-texture environments.


2021 ◽  
Author(s):  
Guoqiang Peng ◽  
Zhuo Zhang ◽  
Tian Zhang ◽  
Zhiyao Song ◽  
Arif Masrur

Abstract Urban pluvial flash floods have become a matter of widespread concern, as they severely impact people’s lives in urban areas. Hydrological and hydraulic models have been widely used for urban flood management and urban planning. Traditionally, to reduce the complexity of urban flood modelling and simulations, simplification or generalization methods have been used; for example, some models focus on the simulation of overland water flow, and some models focus on the simulation of the water flow in sewer systems. However, the water flow of urban floods includes both overland flow and sewer system flow. The overland flow processes are impacted by many different geographical features in what is an extremely spatially heterogeneous environment. Therefore, this article is based on two widely used models (SWMM and ANUGA) that are coupled to develop a bi-directional method of simulating water flow processes in urban areas. The open source overland flow model uses the unstructured triangular as the spatial discretization scheme. The unstructured triangular-based hydraulic model can be better used to capture the spatial heterogeneity of the urban surfaces. So, the unstructured triangular-based model is an essential condition for heterogeneous feature-based urban flood simulation. The experiments indicate that the proposed coupled model in this article can accurately depict surface waterlogged areas and that the heterogeneous feature-based urban flood model can be used to determine different types of urban flow processes.


Sensors ◽  
2022 ◽  
Vol 22 (2) ◽  
pp. 453
Author(s):  
Kyosuke Suzuki ◽  
Tomoki Inoue ◽  
Takayuki Nagata ◽  
Miku Kasai ◽  
Taku Nonomura ◽  
...  

We propose a markerless image alignment method for pressure-sensitive paint measurement data replacing the time-consuming conventional alignment method in which the black markers are placed on the model and are detected manually. In the proposed method, feature points are detected by a boundary detection method, in which the PSP boundary is detected using the Moore-Neighbor tracing algorithm. The performance of the proposed method is compared with the conventional method based on black markers, the difference of Gaussian (DoG) detector, and the Hessian corner detector. The results by the proposed method and the DoG detector are equivalent to each other. On the other hand, the performances of the image alignment using the black marker and the Hessian corner detector are slightly worse compared with the DoG and the proposed method. The computational cost of the proposed method is half of that of the DoG method. The proposed method is a promising for the image alignment in the PSP application in the viewpoint of the alignment precision and computational cost.


Sign in / Sign up

Export Citation Format

Share Document