scholarly journals 3D Stereo Reconstruction of SEM Images

2018 ◽  
Vol 12 (12) ◽  
pp. 57
Author(s):  
J. C. Henao-Londoño ◽  
J. C. Riaño-Rojas ◽  
J. B. Gómez-Mendoza ◽  
E. Restrepo-Parra
Keyword(s):  
Dynamic Programming ◽  
Stereo Matching ◽  
Materials Science ◽  
Parameters Estimation ◽  
Pixel Size ◽  
Disparity Map ◽  
Sem Images ◽  
Stereo Reconstruction ◽  
Global Matching ◽  
Reconstructed Surface

In this work is proposed a new fully automated methodology using computer vision and dynamic programming to obtain a 3D reconstruction model of surfaces using scanning electron microscope (SEM) images based on stereovision. The horizontal stereo matching step is done with a robust and efficient algorithm based on semi-global matching. The cost function used in this study is very simple since the brightness and contrast change of corresponding pixels is negligible for the small tilt involved in stereo SEM. It is used a sum of absolute differences (SAD) over a variable pixel size window. Since it relies on dynamic programming, the matching algorithm uses an occlusion parameter which penalizes large depth discontinuities and, in practice, smooths the disparity map and the corresponding reconstructed surface. This step yields a disparity map, i.e. the differences between the horizontal coordinates of the matching points in the stereo images. The horizontal disparity map is finally converted into heights according to the SEM acquisition parameters: tilt angle, image magnification and pixel size. A validation test was first performed using as reference a microscopic grid with manufacturer specifications. Finally, with the 3D model are proposed some applications in materials science as roughness parameters estimation and wear measurements.

Image Stereo Matching Based on Multi-Scale Plane Set

2013 ◽  
Vol 709 ◽  
pp. 527-533 ◽  
Author(s):  
Xin Hui Jiang ◽  
Shao Jun Yu ◽  
Xing Jiang
Keyword(s):  
Dynamic Programming ◽  
Stereo Matching ◽  
Structural Model ◽  
Dynamic Programming Algorithm ◽  
Programming Method ◽  
Programming Algorithm ◽  
Dynamic Programming Method ◽  
Disparity Map ◽  
Matching Method ◽  
Multi Scale

The disparity map of dynamic programming method is poor. To overcome it, a stereo matching method based on multi-scale plane set is proposed in this paper. This method converts the structural model into the plane set. Define the key plane. Then the key planes are in a high-scale. The other planes are in the low scale. Stereo matching the multi-scale plane set using dynamic programming method. The experimental results show that: this method can solve the dynamic programming algorithm`s problem that disparity map has low matching accuracy and a lot of stripes error.

scholarly journals HYBRID-BASED DENSE STEREO MATCHING

2016 ◽  
Vol XLI-B3 ◽  
pp. 495-501 ◽  
Author(s):  
T. Y. Chuang ◽  
H. W. Ting ◽  
J. J. Jaw
Keyword(s):  
Stereo Matching ◽  
Penalty Parameter ◽  
Disparity Map ◽  
Cost Aggregation ◽  
Satisfactory Performance ◽  
Dense Stereo Matching ◽  
Illumination Changes ◽  
Global Matching ◽  
Disparity Maps ◽  
Image Edges

Stereo matching generating accurate and dense disparity maps is an indispensable technique for 3D exploitation of imagery in the fields of Computer vision and Photogrammetry. Although numerous solutions and advances have been proposed in the literature, occlusions, disparity discontinuities, sparse texture, image distortion, and illumination changes still lead to problematic issues and await better treatment. In this paper, a hybrid-based method based on semi-global matching is presented to tackle the challenges on dense stereo matching. To ease the sensitiveness of SGM cost aggregation towards penalty parameters, a formal way to provide proper penalty estimates is proposed. To this end, the study manipulates a shape-adaptive cross-based matching with an edge constraint to generate an initial disparity map for penalty estimation. Image edges, indicating the potential locations of occlusions as well as disparity discontinuities, are approved by the edge drawing algorithm to ensure the local support regions not to cover significant disparity changes. Besides, an additional penalty parameter 𝑃𝑒 is imposed onto the energy function of SGM cost aggregation to specifically handle edge pixels. Furthermore, the final disparities of edge pixels are found by weighting both values derived from the SGM cost aggregation and the U-SURF matching, providing more reliable estimates at disparity discontinuity areas. Evaluations on Middlebury stereo benchmarks demonstrate satisfactory performance and reveal the potency of the hybrid-based dense stereo matching method.

scholarly journals HYBRID-BASED DENSE STEREO MATCHING

2016 ◽  
Vol XLI-B3 ◽  
pp. 495-501
Author(s):  
T. Y. Chuang ◽  
H. W. Ting ◽  
J. J. Jaw
Keyword(s):  
Stereo Matching ◽  
Penalty Parameter ◽  
Disparity Map ◽  
Cost Aggregation ◽  
Satisfactory Performance ◽  
Dense Stereo Matching ◽  
Illumination Changes ◽  
Global Matching ◽  
Disparity Maps ◽  
Image Edges

Stereo matching generating accurate and dense disparity maps is an indispensable technique for 3D exploitation of imagery in the fields of Computer vision and Photogrammetry. Although numerous solutions and advances have been proposed in the literature, occlusions, disparity discontinuities, sparse texture, image distortion, and illumination changes still lead to problematic issues and await better treatment. In this paper, a hybrid-based method based on semi-global matching is presented to tackle the challenges on dense stereo matching. To ease the sensitiveness of SGM cost aggregation towards penalty parameters, a formal way to provide proper penalty estimates is proposed. To this end, the study manipulates a shape-adaptive cross-based matching with an edge constraint to generate an initial disparity map for penalty estimation. Image edges, indicating the potential locations of occlusions as well as disparity discontinuities, are approved by the edge drawing algorithm to ensure the local support regions not to cover significant disparity changes. Besides, an additional penalty parameter 𝑃𝑒 is imposed onto the energy function of SGM cost aggregation to specifically handle edge pixels. Furthermore, the final disparities of edge pixels are found by weighting both values derived from the SGM cost aggregation and the U-SURF matching, providing more reliable estimates at disparity discontinuity areas. Evaluations on Middlebury stereo benchmarks demonstrate satisfactory performance and reveal the potency of the hybrid-based dense stereo matching method.

scholarly journals AMBIGUITY CONCEPT IN STEREO MATCHING PIPELINE

2021 ◽  
Vol XLIII-B2-2021 ◽  
pp. 383-390
Author(s):  
E. Sarrazin ◽  
M. Cournet ◽  
L. Dumas ◽  
V. Defonte ◽  
Q. Fardet ◽  
...  
Keyword(s):  
Stereo Matching ◽  
Performance Estimation ◽  
Cost Curve ◽  
Disparity Map ◽  
Integral Measure ◽  
Global Matching ◽  
Good Potential ◽  
The Cost ◽  
The Impact

Abstract. In a 3D reconstruction pipeline, stereo matching step aims at computing a disparity map representing the depth between image pair. The evaluation of the disparity map can be done through the estimation of a confidence metric. In this article, we propose a new confidence metric, named ambiguity integral metric, to assess the quality of the produced disparity map. This metric is derived from the concept of ambiguity, which characterizes the property of the cost curve profile. It aims to quantify the difficulty in identifying the correct disparity to select. The quality of ambiguity integral metric is evaluated through the ROC curve methodology and compared with other confidence measures. In regards to other measures, the ambiguity integral measure shows a good potential. We also integrate this measure through various steps of the stereo matching pipeline in order to improve the performance estimation of the disparity map. First, we include ambiguity integral measure during the Semi Global Matching optimization step. The objective is to weight, by ambiguity integral measure, the influence of points in the SGM regularization to reduce the impact of ambiguous points. Secondly, we use ambiguity as an input of a disparity refinement deep learning architecture in order to easily locate noisy area and preserve details.

scholarly journals Disparity Map Generation from Illumination Variant Stereo Images Using Efficient Hierarchical Dynamic Programming

2014 ◽  
Vol 2014 ◽  
pp. 1-12
Author(s):  
Viral H. Borisagar ◽  
Mukesh A. Zaveri
Keyword(s):  
Dynamic Programming ◽  
Stereo Matching ◽  
Stereo Image ◽  
Stereo Pair ◽  
Image Pair ◽  
Stereo Images ◽  
Disparity Map ◽  
Illumination Variation ◽  
Matching Problem ◽  
Wide Range

A novel hierarchical stereo matching algorithm is presented which gives disparity map as output from illumination variant stereo pair. Illumination difference between two stereo images can lead to undesirable output. Stereo image pair often experience illumination variations due to many factors like real and practical situation, spatially and temporally separated camera positions, environmental illumination fluctuation, and the change in the strength or position of the light sources. Window matching and dynamic programming techniques are employed for disparity map estimation. Good quality disparity map is obtained with the optimized path. Homomorphic filtering is used as a preprocessing step to lessen illumination variation between the stereo images. Anisotropic diffusion is used to refine disparity map to give high quality disparity map as a final output. The robust performance of the proposed approach is suitable for real life circumstances where there will be always illumination variation between the images. The matching is carried out in a sequence of images representing the same scene, however in different resolutions. The hierarchical approach adopted decreases the computation time of the stereo matching problem. This algorithm can be helpful in applications like robot navigation, extraction of information from aerial surveys, 3D scene reconstruction, and military and security applications. Similarity measure SAD is often sensitive to illumination variation. It produces unacceptable disparity map results for illumination variant left and right images. Experimental results show that our proposed algorithm produces quality disparity maps for both wide range of illumination variant and invariant stereo image pair.

scholarly journals THE EFFECT OF SHADOW AREA ON SGM ALGORITHM AND DISPARITY MAP REFINEMENT FROM HIGH RESOLUTION SATELLITE STEREO IMAGES

2017 ◽  
Vol XLII-4/W4 ◽  
pp. 281-286
Author(s):  
N. Tatar ◽  
M. Saadatseresht ◽  
H. Arefi
Keyword(s):  
High Resolution ◽  
Urban Areas ◽  
High Performance ◽  
Stereo Matching ◽  
Image Data ◽  
Stereo Pair ◽  
Stereo Images ◽  
Disparity Map ◽  
Shadow Area ◽  
Global Matching

Semi Global Matching (SGM) algorithm is known as a high performance and reliable stereo matching algorithm in photogrammetry community. However, there are some challenges using this algorithm especially for high resolution satellite stereo images over urban areas and images with shadow areas. As it can be seen, unfortunately the SGM algorithm computes highly noisy disparity values for shadow areas around the tall neighborhood buildings due to mismatching in these lower entropy areas. In this paper, a new method is developed to refine the disparity map in shadow areas. The method is based on the integration of potential of panchromatic and multispectral image data to detect shadow areas in object level. In addition, a RANSAC plane fitting and morphological filtering are employed to refine the disparity map. The results on a stereo pair of GeoEye-1 captured over Qom city in Iran, shows a significant increase in the rate of matched pixels compared to standard SGM algorithm.

scholarly journals Fast global stereo matching via energy pyramid minimization

2014 ◽  
Vol II-3 ◽  
pp. 41-48
Author(s):  
B. Conejo ◽  
S. Leprince ◽  
F. Ayoub ◽  
J. P. Avouac
Keyword(s):  
Random Fields ◽  
Stereo Matching ◽  
Conditional Random Fields ◽  
Optimal Solution ◽  
Stereo Pair ◽  
Optimization Approach ◽  
Disparity Map ◽  
Image Pyramids ◽  
Global Matching ◽  
Coarse To Fine

We define a global matching framework based on energy pyramid, the Global Matching via Energy Pyramid (GM-EP) algorithm, which estimates the disparity map from a single stereo-pair by solving an energy minimization problem. We efficiently address this minimization by globally optimizing a coarse to fine sequence of sparse Conditional Random Fields (CRF) directly defined on the energy. This global discrete optimization approach guarantees that at each scale we obtain a near optimal solution, and we demonstrate its superiority over state of the art image pyramid approaches through application to real stereo-pairs. We conclude that multiscale approaches should be build on energy pyramids rather than on image pyramids.

scholarly journals EVALUATION OF DEEP LEARNING BASED STEREO MATCHING METHODS: FROM GROUND TO AERIAL IMAGES

2018 ◽  
Vol XLII-2 ◽  
pp. 593-597 ◽  
Author(s):  
J. Liu ◽  
S. Ji ◽  
C. Zhang ◽  
Z. Qin
Keyword(s):  
Computer Vision ◽  
Deep Learning ◽  
Stereo Matching ◽  
Learning Strategy ◽  
Fine Tuning ◽  
Aerial Images ◽  
Aerial Image ◽  
Disparity Map ◽  
Direct Model ◽  
Global Matching

Dense stereo matching has been extensively studied in photogrammetry and computer vision. In this paper we evaluate the application of deep learning based stereo methods, which were raised from 2016 and rapidly spread, on aerial stereos other than ground images that are commonly used in computer vision community. Two popular methods are evaluated. One learns matching cost with a convolutional neural network (known as MC-CNN); the other produces a disparity map in an end-to-end manner by utilizing both geometry and context (known as GC-net). First, we evaluate the performance of the deep learning based methods for aerial stereo images by a direct model reuse. The models pre-trained on KITTI 2012, KITTI 2015 and Driving datasets separately, are directly applied to three aerial datasets. We also give the results of direct training on target aerial datasets. Second, the deep learning based methods are compared to the classic stereo matching method, Semi-Global Matching(SGM), and a photogrammetric software, SURE, on the same aerial datasets. Third, transfer learning strategy is introduced to aerial image matching based on the assumption of a few target samples available for model fine tuning. It experimentally proved that the conventional methods and the deep learning based methods performed similarly, and the latter had greater potential to be explored.

scholarly journals A Joint 2D-3D Complementary Network for Stereo Matching

Sensors ◽  
2021 ◽  
Vol 21 (4) ◽  
pp. 1430
Author(s):  
Xiaogang Jia ◽  
Wei Chen ◽  
Zhengfa Liang ◽  
Xin Luo ◽  
Mingfei Wu ◽  
...  
Keyword(s):  
Stereo Matching ◽  
Computational Cost ◽  
Research Field ◽  
Disparity Map ◽  
Improve Performance ◽  
Cost Aggregation ◽  
Disparity Range ◽  
Public Datasets ◽  
Coarse To Fine ◽  
Speed And Accuracy

Stereo matching is an important research field of computer vision. Due to the dimension of cost aggregation, current neural network-based stereo methods are difficult to trade-off speed and accuracy. To this end, we integrate fast 2D stereo methods with accurate 3D networks to improve performance and reduce running time. We leverage a 2D encoder-decoder network to generate a rough disparity map and construct a disparity range to guide the 3D aggregation network, which can significantly improve the accuracy and reduce the computational cost. We use a stacked hourglass structure to refine the disparity from coarse to fine. We evaluated our method on three public datasets. According to the KITTI official website results, Our network can generate an accurate result in 80 ms on a modern GPU. Compared to other 2D stereo networks (AANet, DeepPruner, FADNet, etc.), our network has a big improvement in accuracy. Meanwhile, it is significantly faster than other 3D stereo networks (5× than PSMNet, 7.5× than CSN and 22.5× than GANet, etc.), demonstrating the effectiveness of our method.

Efficient interscanline consistency enforcing method for dynamic programming-based dense stereo matching algorithms

2013 ◽  
Vol 22 (4) ◽  
pp. 043028 ◽  
Author(s):  
Behzad Salehian ◽  
Abolghasem A. Raie ◽  
Ali M. Fotouhi ◽  
Meisam Norouzi
Keyword(s):  
Dynamic Programming ◽  
Stereo Matching ◽  
Dense Stereo Matching
Sign in / Sign up

Export Citation Format

Share Document