Superpixel Guided Network for Three-dimensional Stereo Matching

Author(s):  
Xiaoqian Ye ◽  
Xinzhu Sang ◽  
Duo Chen ◽  
Peng Wang ◽  
Kuiru Wang ◽  
...  
2021 ◽  
Vol 10 (4) ◽  
pp. 234
Author(s):  
Jing Ding ◽  
Zhigang Yan ◽  
Xuchen We

To obtain effective indoor moving target localization, a reliable and stable moving target localization method based on binocular stereo vision is proposed in this paper. A moving target recognition extraction algorithm, which integrates displacement pyramid Horn–Schunck (HS) optical flow, Delaunay triangulation and Otsu threshold segmentation, is presented to separate a moving target from a complex background, called the Otsu Delaunay HS (O-DHS) method. Additionally, a stereo matching algorithm based on deep matching and stereo vision is presented to obtain dense stereo matching points pairs, called stereo deep matching (S-DM). The stereo matching point pairs of the moving target were extracted with the moving target area and stereo deep matching point pairs, then the three dimensional coordinates of the points in the moving target area were reconstructed according to the principle of binocular vision’s parallel structure. Finally, the moving target was located by the centroid method. The experimental results showed that this method can better resist image noise and repeated texture, can effectively detect and separate moving targets, and can match stereo image points in repeated textured areas more accurately and stability. This method can effectively improve the effectiveness, accuracy and robustness of three-dimensional moving target coordinates.


2020 ◽  
pp. 1-10
Author(s):  
Linlin Wang

With the continuous development of computer science and technology, symbol recognition systems may be converted from two-dimensional space to three-dimensional space. Therefore, this article mainly introduces the symbol recognition system based on 3D stereo vision. The three-dimensional image is taken by the visual coordinate measuring machine in two places on the left and right. Perform binocular stereo matching on the edge of the feature points of the two images. A corner detection algorithm combining SUSAN and Harris is used to detect the left and right camera calibration templates. The two-dimensional coordinate points of the object are determined by the image stereo matching module, and the three-dimensional discrete coordinate points of the object space can be obtained according to the transformation relationship between the image coordinates and the actual object coordinates. Then draw the three-dimensional model of the object through the three-dimensional drawing software. Experimental data shows that the logic resources and memory resources occupied by image preprocessing account for 30.4% and 27.4% of the entire system, respectively. The results show that the system can calibrate the internal and external parameters of the camera. In this way, the camera calibration result will be more accurate and the range will be wider. At the same time, it can effectively make up for the shortcomings of traditional modeling techniques to ensure the measurement accuracy of the detection system.


2013 ◽  
Vol 670 ◽  
pp. 202-207 ◽  
Author(s):  
Jun Ting Cheng ◽  
C. Zhao ◽  
W.L. Zhao ◽  
W.H. Wu

In the development of a three-dimensional measurement system, binocular stereo matching is the most important and difficult. In the basis of introducing selective principles of matching algorithm, a new stereo matching algorithm for binocular vision is put forward that is named noncoded difference measuring distance. The algorithm effectively grapples with the problem of searching for the coincidence relation of raster and can efficiently and accurately obtain three-dimensional world coordinates of the entities. Experiment results show that this 3D measuring machine can effectively measure the 3D solid profile of free surface. During the evaluation test for accuracy, scan a standard plane. Fit all 3D points in one plane, and then the flatness value of this plane is obtained. The flatness value of the standard plane has been ultimately measured as: ± 0.0462mm, this measuring accuracy can completely satisfy the requirements of rapid prototyping or CNC machining, it as well as achieves the stated accuracy (± 0.05mm).


Author(s):  
Manish Kumar ◽  
Devendra P. Garg

This paper discusses the use of multiple vision sensors and a proximity sensor to obtain three-dimensional occupancy profile of robotic workspace, identify key features, and obtain a 3-D model of the objects in the work space. The present research makes use of three identical vision sensors. Two of these sensors are mounted on a stereo rig on the sidewall of the robotic workcell. The third vision sensor is located above the workcell. The vision sensors on the stereo rig provide information about three-dimensional position of any point in the robotic workspace. The camera to robot calibration for these vision sensors in stereo configuration has been obtained with the help of a three-layered feedforward neural network. Squared Sum of Difference (SSD) algorithm has been used to obtain the stereo matching. Similarly, camera to robot transformation for the camera located above the work cell has been obtained with the help of a three-layered feedforward neural network. Three-dimensional positional information from vision sensors on stereo rig and two-dimensional positional information from a camera located above the workcell and a proximity sensor mounted on the robot wrist have been fused with the help of Bayesian technique to obtain more accurate positional information about locations in workspace.


2015 ◽  
Vol 2015 ◽  
pp. 1-15
Author(s):  
Huan Liu ◽  
Kuangrong Hao ◽  
Yongsheng Ding ◽  
Chunjuan Ouyang

Stereo feature matching is a technique that finds an optimal match in two images from the same entity in the three-dimensional world. The stereo correspondence problem is formulated as an optimization task where an energy function, which represents the constraints on the solution, is to be minimized. A novel intelligent biological network (Bio-Net), which involves the human B-T cells immune system into neural network, is proposed in this study in order to learn the robust relationship between the input feature points and the output matched points. A model from input-output data (left reference point-right target point) is established. In the experiments, the abdomen reconstructions for different-shape mannequins are then performed by means of the proposed method. The final results are compared and analyzed, which demonstrate that the proposed approach greatly outperforms the single neural network and the conventional matching algorithm in precise. Particularly, as far as time cost and efficiency, the proposed method exhibits its significant promising and potential for improvement. Hence, it is entirely considered as an effective and feasible alternative option for stereo matching.


2011 ◽  
Vol 81 (20) ◽  
pp. 2168-2179 ◽  
Author(s):  
Bugao Xu ◽  
Wurong Yu ◽  
RongWu Wang

This paper introduces a three-dimensional (3D) imaging system designed for objective evaluation of fabric pilling. Thesystem was aimed at reconstructing high-fidelity 3D surfaces of fabric by using only two side-by-side images of a pilling fabric captured by a pair of regular digital cameras without special lighting. The robust calibration and stereo-matching algorithms were implemented to make the system insusceptible to fabric structures, colors, fiber contents and other factors. The depth data provide the most relevant information for pilling segmentation and measurements, because pilling is the protrusion of entangled fibers. 3D measurement data can be used for not only evaluating pilling appearance, but also for understanding pilling mechanisms in different abrasive treatments.


2013 ◽  
Vol 748 ◽  
pp. 624-628
Author(s):  
Zhu Lin Li

A gradation stereo matching algorithm based on edge feature points was proposed. Its basic idea is: firstly edge feature points of image pair were extracted; then, gradient invariability and singular eigenvalue invariability were analyzed, two-grade stereo matching method was build, foundation matrix was solved further, and three-grade stereo matching algorithm was finished by foundation matrix guidance. The result indicates that the algorithm can improve matching precision, from 58.3% to 73.2%, it is simple and utility, and it is important for object recognition, tracking, and three-dimensional reconstruction.


Author(s):  
S. Bullinger ◽  
C. Bodensteiner ◽  
M. Arens

Abstract. The reconstruction of accurate three-dimensional environment models is one of the most fundamental goals in the field of photogrammetry. Since satellite images provide suitable properties for obtaining large-scale environment reconstructions, there exist a variety of Stereo Matching based methods to reconstruct point clouds for satellite image pairs. Recently, a Structure from Motion (SfM) based approach has been proposed, which allows to reconstruct point clouds from multiple satellite images. In this work, we propose an extension of this SfM based pipeline that allows us to reconstruct not only point clouds but watertight meshes including texture information. We provide a detailed description of several steps that are mandatory to exploit state-of-the-art mesh reconstruction algorithms in the context of satellite imagery. This includes a decomposition of finite projective camera calibration matrices, a skew correction of corresponding depth maps and input images as well as the recovery of real-world depth maps from reparameterized depth values. The paper presents an extensive quantitative evaluation on multi-date satellite images demonstrating that the proposed pipeline combined with current meshing algorithms outperforms state-of-the-art point cloud reconstruction algorithms in terms of completeness and median error. We make the source code of our pipeline publicly available.


Sign in / Sign up

Export Citation Format

Share Document