scholarly journals A Single Image 3D Reconstruction Method Based on a Novel Monocular Vision System

Sensors ◽  
2020 ◽  
Vol 20 (24) ◽  
pp. 7045
Author(s):  
Fupei Wu ◽  
Shukai Zhu ◽  
Weilin Ye

Three-dimensional (3D) reconstruction and measurement are popular techniques in precision manufacturing processes. In this manuscript, a single image 3D reconstruction method is proposed based on a novel monocular vision system, which includes a three-level charge coupled device (3-CCD) camera and a ring structured multi-color light emitting diode (LED) illumination. Firstly, a procedure for the calibration of the illumination’s parameters, including LEDs’ mounted angles, distribution density and incident angles, is proposed. Secondly, the incident light information, the color distribution information and gray level information are extracted from the acquired image, and the 3D reconstruction model is built based on the camera imaging model. Thirdly, the surface height information of the detected object within the field of view is computed based on the built model. The proposed method aims at solving the uncertainty and the slow convergence issues arising in 3D surface topography reconstruction using current shape-from-shading (SFS) methods. Three-dimensional reconstruction experimental tests are carried out on convex, concave, angular surfaces and on a mobile subscriber identification module (SIM) card slot, showing relative errors less than 3.6%, respectively. Advantages of the proposed method include a reduced time for 3D surface reconstruction compared to other methods, demonstrating good suitability of the proposed method in reconstructing surface 3D morphology.

2012 ◽  
Vol 157-158 ◽  
pp. 1008-1011
Author(s):  
Hui Huang Zhao ◽  
Yao Nan Wang ◽  
Ya Qi Sun ◽  
Jian Zhen Chen

Human face three-dimensional (3D) reconstruction is a challenging problem. In this paper, we propose a human face fast- 3D- reconstruction method based on image processing with a single image. Shape from shading (SFS) is chosen to reconstruct the human face. First, SFS theory is introduced. It has the advantage of fast 3D reconstruction and only need a single image. Secondly, because the noise will affect the 3D reconstruction result greatly, wavelet transform and wavelet packet transform are introduced and used in image denoising respectively. The experiment has shown that the method based on wavelet transform produces the best denoising result than wavelet packet transform. At last, a human face 3D reconstruction algorithm based on a single image is proposed. The experimental results show that a human face 3D model can be reconstructed in fast by proposed algorithm.


Sensors ◽  
2021 ◽  
Vol 21 (17) ◽  
pp. 5909
Author(s):  
Qingyu Jia ◽  
Liang Chang ◽  
Baohua Qiang ◽  
Shihao Zhang ◽  
Wu Xie ◽  
...  

Real-time 3D reconstruction is one of the current popular research directions of computer vision, and it has become the core technology in the fields of virtual reality, industrialized automatic systems, and mobile robot path planning. Currently, there are three main problems in the real-time 3D reconstruction field. Firstly, it is expensive. It requires more varied sensors, so it is less convenient. Secondly, the reconstruction speed is slow, and the 3D model cannot be established accurately in real time. Thirdly, the reconstruction error is large, which cannot meet the requirements of scenes with accuracy. For this reason, we propose a real-time 3D reconstruction method based on monocular vision in this paper. Firstly, a single RGB-D camera is used to collect visual information in real time, and the YOLACT++ network is used to identify and segment the visual information to extract part of the important visual information. Secondly, we combine the three stages of depth recovery, depth optimization, and deep fusion to propose a three-dimensional position estimation method based on deep learning for joint coding of visual information. It can reduce the depth error caused by the depth measurement process, and the accurate 3D point values of the segmented image can be obtained directly. Finally, we propose a method based on the limited outlier adjustment of the cluster center distance to optimize the three-dimensional point values obtained above. It improves the real-time reconstruction accuracy and obtains the three-dimensional model of the object in real time. Experimental results show that this method only needs a single RGB-D camera, which is not only low cost and convenient to use, but also significantly improves the speed and accuracy of 3D reconstruction.


Author(s):  
Suhana Chikatla ◽  
Ukaiko Bitrus-Ojiambo

The purpose of this chapter is to provide a basic understanding of how three-dimensional (3D) statistical visual displays aid in education. The chapter seeks to discuss the importance of surface objects, scenes, and environments reconstructed to enhance the interpretation of charts. Further described are the different types of 3D charts available: bar, line, and pie charts. The chapter also provides enlightenment about two new concepts: the “3D actual” and “3D obvious” charts. Overall, the chapter focuses on the theoretical background, pedagogical practice, usability, and applicability of using 3D surface charts. The chapter, in addition, provides explanations based on research done by Chikatla (2010), Dempsey, Chikatla, and Inpornvijit (2008), Fisher, Dempsey, and Marousky (1997), and Dempsey and Armstrong (1997).


2010 ◽  
Vol 33 ◽  
pp. 299-303
Author(s):  
Zhong Yan Liu ◽  
Guo Quan Wang ◽  
Dong Ping Wang

A method was proposed to gain three-dimensional (3D) reconstruction based on binocular view geometry. Images used to calibrate cameras and reconstruct car’s rearview mirror by image acquisition system, by calibration image, a camera's intrinsic and extrinsic parameters, projective and fundamental matrixes were drawn by Matlab7.1;the collected rearview mirror images is pretreated to draw refined laser, extracted feature points, find the very appropriate match points by epipolar geometry principle; according to the camera imaging model to calculate the coordinates of space points, display point cloud, fitting space points to reconstruct car’s rearview mirror; experimental results show this method can better restore the car’s rearview mirror of 3D information.


2013 ◽  
Vol 321-324 ◽  
pp. 862-867
Author(s):  
Fei Tao ◽  
Ping An Mu ◽  
Shu Guang Dai ◽  
Jia Xing Shen

This paper put forward a 3D reconstruction method of the headlight contours based on laser scanning technology and robotics. Firstly, according to the present three-dimensional measurement techniques, the article put forward a set of headlight contour detection method based on the analytic geometry model and the line laser source scanning principle. It establishes a 3D scanning model and coordinate transformation model for 3D reconstruction of the headlight contour. Secondly, according to the demanding accuracy it structures the 3D reconstruction system. Finally it realizes the 3D reconstruction of the headlight contour based on the method, and the result is tested and evaluated matching effect, the result shows that can effectively realize the 3D reconstruction of headlight contour and the method has a good stability.


2021 ◽  
Vol 11 (11) ◽  
pp. 5111
Author(s):  
Zhihua Wu ◽  
Gongfa Chen ◽  
Qiong Ding ◽  
Bing Yuan ◽  
Xiaomei Yang

This paper presents a measurement method of bridge vibration based on three-dimensional (3D) reconstruction. A video of bridge model vibration is recorded by an unmanned aerial vehicle (UAV), and the displacement of target points on the bridge model is tracked by the digital image correlation (DIC) method. Due to the UAV motion, the DIC-tracked displacement of the bridge model includes the absolute displacement caused by the excitation and the false displacement induced by the UAV motion. Therefore, the UAV motion must be corrected to measure the real displacement. Using four corner points on a fixed object plane as the reference points, the projection matrix for each frame of images can be estimated by the UAV camera calibration, and then the 3D world coordinates of the target points on the bridge model can be recovered. After that, the real displacement of the target points can be obtained. To verify the correctness of the results, the operational modal analysis (OMA) method is used to extract the natural frequencies of the bridge model. The results show that the first natural frequency obtained from the proposed method is consistent with the one obtained from the homography-based method. By further comparing with the homography-based correction method, it is found that the 3D reconstruction method can effectively overcome the limitation of the homography-based method that the fixed reference points and the target points must be coplanar.


Author(s):  
J. Xiong ◽  
S. Zhong ◽  
L. Zheng

This paper presents an automatic three-dimensional reconstruction method based on multi-view stereo vision for the Mogao Grottoes. 3D digitization technique has been used in cultural heritage conservation and replication over the past decade, especially the methods based on binocular stereo vision. However, mismatched points are inevitable in traditional binocular stereo matching due to repeatable or similar features of binocular images. In order to reduce the probability of mismatching greatly and improve the measure precision, a portable four-camera photographic measurement system is used for 3D modelling of a scene. Four cameras of the measurement system form six binocular systems with baselines of different lengths to add extra matching constraints and offer multiple measurements. Matching error based on epipolar constraint is introduced to remove the mismatched points. Finally, an accurate point cloud can be generated by multi-images matching and sub-pixel interpolation. Delaunay triangulation and texture mapping are performed to obtain the 3D model of a scene. The method has been tested on 3D reconstruction several scenes of the Mogao Grottoes and good results verify the effectiveness of the method.


2021 ◽  
Vol 24 (3) ◽  
pp. 485-504
Author(s):  
Alexander Sergeevich Tarasov ◽  
Vlada Vladimirovna Kugurakova

This article focuses on improving the 3D reconstruction of a human model from a single pixel-aligned implicit function image presented by FaceBook Research. The drawbacks of the method are revealed, associated with limiting the quality of the original image, recommendations are presented to avoid its incorrect operation, and approaches to improve the original model are proposed, which increase the identity of the resulting model by 1.33 times. We also worked out the tactics of subsequent texture mapping and implementation of a set of animations.


Sign in / Sign up

Export Citation Format

Share Document