Adaptive aggregation stereo matching algorithm based on edge preservation

Belief propagation (BP) algorithm still exists some shortages, such as inaccurate edge preservation and ambiguous detail information in the foreground, while self-adapting dissimilarity measure (SDM) also exists some shortages, such as ill textureless and occluded information in the background. To address these problems, we present a novel stereo matching algorithm fusing BP and SDM with an excellent background and foreground information. Lots of experiments show that BP and SDM can complement each other. BP algorithm can hold the better background information due to message propagation inference, whereas SDM can possess the better foreground information due to detail treatment. Therefore, a piecewise function is proposed, which can combine BP algorithm in an excellent background information and SDM in the foreground information, and greatly improve the disparity effect as a whole. We also expect that this work can attract more attention on combination of local methods and global methods, due to its simplicity, efficiency, and accuracy. Experimental results show that the proposed method can keep the superior performance and hold better background and foreground on the Middlebury datasets, compared to BP and SDM.

Download Full-text

Towards an Embedded Stereo Matching Algorithm Based on Multiple Correlation Windows

Proceedings of the 13th International Conference on Distributed Smart Cameras ◽

10.1145/3349801.3357128 ◽

2019 ◽

Author(s):

M. A. Palacios-Ramos ◽

H. D. Vázquez-Delgado ◽

Abiel Aguilar-González ◽

M. Pérez-Patricio

Keyword(s):

Stereo Matching ◽

Multiple Correlation ◽

Matching Algorithm

Download Full-text

Matching Large Baseline Oblique Stereo Images Using an End-to-End Convolutional Neural Network

Remote Sensing ◽

10.3390/rs13020274 ◽

2021 ◽

Vol 13 (2) ◽

pp. 274

Author(s):

Guobiao Yao ◽

Alper Yilmaz ◽

Li Zhang ◽

Fei Meng ◽

Haibin Ai ◽

...

Keyword(s):

Neural Network ◽

Deep Learning ◽

Convolutional Neural Network ◽

Stereo Matching ◽

Least Square ◽

Affine Invariant ◽

Stereo Images ◽

Distance Ratio ◽

Matching Algorithm ◽

End To End

The available stereo matching algorithms produce large number of false positive matches or only produce a few true-positives across oblique stereo images with large baseline. This undesired result happens due to the complex perspective deformation and radiometric distortion across the images. To address this problem, we propose a novel affine invariant feature matching algorithm with subpixel accuracy based on an end-to-end convolutional neural network (CNN). In our method, we adopt and modify a Hessian affine network, which we refer to as IHesAffNet, to obtain affine invariant Hessian regions using deep learning framework. To improve the correlation between corresponding features, we introduce an empirical weighted loss function (EWLF) based on the negative samples using K nearest neighbors, and then generate deep learning-based descriptors with high discrimination that is realized with our multiple hard network structure (MTHardNets). Following this step, the conjugate features are produced by using the Euclidean distance ratio as the matching metric, and the accuracy of matches are optimized through the deep learning transform based least square matching (DLT-LSM). Finally, experiments on Large baseline oblique stereo images acquired by ground close-range and unmanned aerial vehicle (UAV) verify the effectiveness of the proposed approach, and comprehensive comparisons demonstrate that our matching algorithm outperforms the state-of-art methods in terms of accuracy, distribution and correct ratio. The main contributions of this article are: (i) our proposed MTHardNets can generate high quality descriptors; and (ii) the IHesAffNet can produce substantial affine invariant corresponding features with reliable transform parameters.

Download Full-text