scholarly journals AN AUTOMATIC 3D RECONSTRUCTION METHOD BASED ON MULTI-VIEW STEREO VISION FOR THE MOGAO GROTTOES

Author(s):  
J. Xiong ◽  
S. Zhong ◽  
L. Zheng

This paper presents an automatic three-dimensional reconstruction method based on multi-view stereo vision for the Mogao Grottoes. 3D digitization technique has been used in cultural heritage conservation and replication over the past decade, especially the methods based on binocular stereo vision. However, mismatched points are inevitable in traditional binocular stereo matching due to repeatable or similar features of binocular images. In order to reduce the probability of mismatching greatly and improve the measure precision, a portable four-camera photographic measurement system is used for 3D modelling of a scene. Four cameras of the measurement system form six binocular systems with baselines of different lengths to add extra matching constraints and offer multiple measurements. Matching error based on epipolar constraint is introduced to remove the mismatched points. Finally, an accurate point cloud can be generated by multi-images matching and sub-pixel interpolation. Delaunay triangulation and texture mapping are performed to obtain the 3D model of a scene. The method has been tested on 3D reconstruction several scenes of the Mogao Grottoes and good results verify the effectiveness of the method.

2013 ◽  
Vol 278-280 ◽  
pp. 861-865
Author(s):  
Qing Ji Gao ◽  
Lu Yang

To the baggage specification automatically detection problem of self-service bag drop system, a baggage size detection algorithm based on stereo vision is proposed. The algorithm is based on binocular stereo vision measurement principle. Firstly, the canny edges of baggage image are extracted as the feature points. With the disparity gradient constraint and epipolar constraint, Stereo matching algorithm based on edge features is proposed, meanwhile, the two images play a symmetric role to ensure the reliability of matching in the matching process. The coordinates of the three dimensional points are derived with approximation of the middle point of the common perpendicular line in different planes. Experimental results show that the proposed algorithm can detect the baggage specification with appropriate accuracy.


2021 ◽  
Vol 10 (4) ◽  
pp. 234
Author(s):  
Jing Ding ◽  
Zhigang Yan ◽  
Xuchen We

To obtain effective indoor moving target localization, a reliable and stable moving target localization method based on binocular stereo vision is proposed in this paper. A moving target recognition extraction algorithm, which integrates displacement pyramid Horn–Schunck (HS) optical flow, Delaunay triangulation and Otsu threshold segmentation, is presented to separate a moving target from a complex background, called the Otsu Delaunay HS (O-DHS) method. Additionally, a stereo matching algorithm based on deep matching and stereo vision is presented to obtain dense stereo matching points pairs, called stereo deep matching (S-DM). The stereo matching point pairs of the moving target were extracted with the moving target area and stereo deep matching point pairs, then the three dimensional coordinates of the points in the moving target area were reconstructed according to the principle of binocular vision’s parallel structure. Finally, the moving target was located by the centroid method. The experimental results showed that this method can better resist image noise and repeated texture, can effectively detect and separate moving targets, and can match stereo image points in repeated textured areas more accurately and stability. This method can effectively improve the effectiveness, accuracy and robustness of three-dimensional moving target coordinates.


2013 ◽  
Vol 333-335 ◽  
pp. 199-206
Author(s):  
Chuan Wang ◽  
Jie Yang ◽  
Yan Wei Zhou

A method of measuring the radius of circular parts by binocular stereo vision technology is proposed. First of all the interior and exterior parameters of cameras are acquired by the camera calibration technology. Then the epipolar constraint can be calculated which contains the calibrated information. The image matching which uses the epipolar constraint is done to find the matching points. The three dimensional (3D) coordinates of edges points are reconstructed through trigonometry reconstruction. At last the analytic expression of the plane in which the circle lies and the circles radius are calculated in two steps by Levenberg-Marquardt (LM) algorithm. The proposed method does not require the prior knowledge of position between the measuring plane and the calibration plane which monocular measurement needs. Experimental results show that the measurement has high precision.


2013 ◽  
Vol 303-306 ◽  
pp. 313-317 ◽  
Author(s):  
Zhong Wei Zhou ◽  
Min Xu ◽  
Wei Fu ◽  
Ji Zeng Zhao

The goal of this paper is to present a method for object tracking and positioning based on stereo vision in real time. The method effectively combined stereo matching algorithm with object tracking algorithm, and calculated the spatial location information of the object by using binocular stereo vision while the object is being tracked. The stereo matching used dynamic programming, image pyramids and control points modification algorithm, and the object tracking mainly utilized CamShift algorithm in this paper. The experimental results have confirmed that the proposed method realized real-time tracking for moving object, accurate calculating for the object three-dimensional coordinates, which meet the applied needs of servo follow-up system.


2014 ◽  
Vol 962-965 ◽  
pp. 2809-2813 ◽  
Author(s):  
Jie Yu ◽  
Yu Min Ge ◽  
Bao Shu Li ◽  
Shang Chen

Binocular stereo vision is an important branch of robot vision technology, it use two cameras in different position or a camera which can be move or rotate to shoot the same scene images, by calculating the parallax of spatial point in two images, get the spatial location information. There is a study based on the binocular stereo vision for three-dimensional spatial reconstruction, in view of the problem of vision image acquisition, camera calibration,stereo matching and 3d reconstruction in the binocular stereo application technology.


2015 ◽  
Vol 2015 ◽  
pp. 1-9 ◽  
Author(s):  
Qi Peng ◽  
Lifen Tu ◽  
Kaibing Zhang ◽  
Sidong Zhong

An effective automatic 3D reconstruction method using a portable four-camera photographic measurement system (PFCPMS) is proposed. By taking advantage of the complementary stereo information from four cameras, a fast and highly accurate feature point matching algorithm is developed for 3D reconstruction. Specifically, we first utilize a projection method to obtain a large number of dense feature points. And then a reduction and clustering treatment is applied to simplify the Delaunay triangulation process and reconstruct a 3D model for each scene. In addition, a 3D model stitching approach is proposed to further improve the performance of the limited field-of-view for image-based method. The experimental results tested on the 172 cave in Mogao Grottoes indicate that the proposed method is effective to reconstruct a 3D scene with a low-cost four-camera photographic measurement system.


2010 ◽  
Vol 20-23 ◽  
pp. 487-492 ◽  
Author(s):  
Ze Tao Jiang ◽  
Qing Hui Xiao ◽  
Ling Hong Zhu

A new feature points extraction method is presented, which consider pixel as hexagonal. The method quasi increases the density of image pixel, expands the dynamic range of feature point extraction, increases the number of the features and resolves the problem of deformation of reconstruction which was leaded by lack of feature points. Firstly, the method was successful applied to sift operator of features extraction in this paper and then use dense stereo matching method to find the matching point of the image sequences. Secondly, through the RANSAC method to eliminate mistake matches, and by the camera matrix, calculate the corresponding points’ three-dimensional coordinates of space. Finally, the 3D model can be established through the partition merging triangulation method and texture mapping. Experimental results show that this method can get more accurate matches pairs and achieve a satisfactory effect of 3D reconstruction.


2020 ◽  
pp. 1-10
Author(s):  
Linlin Wang

With the continuous development of computer science and technology, symbol recognition systems may be converted from two-dimensional space to three-dimensional space. Therefore, this article mainly introduces the symbol recognition system based on 3D stereo vision. The three-dimensional image is taken by the visual coordinate measuring machine in two places on the left and right. Perform binocular stereo matching on the edge of the feature points of the two images. A corner detection algorithm combining SUSAN and Harris is used to detect the left and right camera calibration templates. The two-dimensional coordinate points of the object are determined by the image stereo matching module, and the three-dimensional discrete coordinate points of the object space can be obtained according to the transformation relationship between the image coordinates and the actual object coordinates. Then draw the three-dimensional model of the object through the three-dimensional drawing software. Experimental data shows that the logic resources and memory resources occupied by image preprocessing account for 30.4% and 27.4% of the entire system, respectively. The results show that the system can calibrate the internal and external parameters of the camera. In this way, the camera calibration result will be more accurate and the range will be wider. At the same time, it can effectively make up for the shortcomings of traditional modeling techniques to ensure the measurement accuracy of the detection system.


2013 ◽  
Vol 670 ◽  
pp. 202-207 ◽  
Author(s):  
Jun Ting Cheng ◽  
C. Zhao ◽  
W.L. Zhao ◽  
W.H. Wu

In the development of a three-dimensional measurement system, binocular stereo matching is the most important and difficult. In the basis of introducing selective principles of matching algorithm, a new stereo matching algorithm for binocular vision is put forward that is named noncoded difference measuring distance. The algorithm effectively grapples with the problem of searching for the coincidence relation of raster and can efficiently and accurately obtain three-dimensional world coordinates of the entities. Experiment results show that this 3D measuring machine can effectively measure the 3D solid profile of free surface. During the evaluation test for accuracy, scan a standard plane. Fit all 3D points in one plane, and then the flatness value of this plane is obtained. The flatness value of the standard plane has been ultimately measured as: ± 0.0462mm, this measuring accuracy can completely satisfy the requirements of rapid prototyping or CNC machining, it as well as achieves the stated accuracy (± 0.05mm).


Sign in / Sign up

Export Citation Format

Share Document