3D reconstruction from a stereo pair without the knowledge of intrinsic or extrinsic parameters

Author(s):  
T.J. McKinley ◽  
M.M. McWaters ◽  
V.K. Jain
2021 ◽  
Vol 13 (11) ◽  
pp. 2185
Author(s):  
Yu Tao ◽  
Sylvain Douté ◽  
Jan-Peter Muller ◽  
Susan J. Conway ◽  
Nicolas Thomas ◽  
...  

We introduce a novel ultra-high-resolution Digital Terrain Model (DTM) processing system using a combination of photogrammetric 3D reconstruction, image co-registration, image super-resolution restoration, shape-from-shading DTM refinement, and 3D co-alignment methods. Technical details of the method are described, and results are demonstrated using a 4 m/pixel Trace Gas Orbiter Colour and Stereo Surface Imaging System (CaSSIS) panchromatic image and an overlapping 6 m/pixel Mars Reconnaissance Orbiter Context Camera (CTX) stereo pair to produce a 1 m/pixel CaSSIS Super-Resolution Restoration (SRR) DTM for different areas over Oxia Planum on Mars—the future ESA ExoMars 2022 Rosalind Franklin rover’s landing site. Quantitative assessments are made using profile measurements and the counting of resolvable craters, in comparison with the publicly available 1 m/pixel High-Resolution Imaging Experiment (HiRISE) DTM. These assessments demonstrate that the final resultant 1 m/pixel CaSSIS DTM from the proposed processing system has achieved comparable and sometimes more detailed 3D reconstruction compared to the overlapping HiRISE DTM.


Sensors ◽  
2019 ◽  
Vol 19 (23) ◽  
pp. 5082 ◽  
Author(s):  
Zhang ◽  
Huang ◽  
Zhao

With extensive application of RGB-D cameras in robotics, computer vision, and many other fields, accurate calibration becomes more and more critical to the sensors. However, most existing models for calibrating depth and the relative pose between a depth camera and an RGB camera are not universally applicable to many different kinds of RGB-D cameras. In this paper, by using the collinear equation and space resection of photogrammetry, we present a new model to correct the depth and calibrate the relative pose between depth and RGB cameras based on a 3D control field. We establish a rigorous relationship model between the two cameras; then, we optimize the relative parameters of two cameras by least-squares iteration. For depth correction, based on the extrinsic parameters related to object space, the reference depths are calculated by using a collinear equation. Then, we calibrate the depth measurements with consideration of the distortion of pixels in depth images. We apply Kinect-2 to verify the calibration parameters by registering depth and color images. We test the effect of depth correction based on 3D reconstruction. Compared to the registration results from a state-of-the-art calibration model, the registration results obtained with our calibration parameters improve dramatically. Likewise, the performances of 3D reconstruction demonstrate obvious improvements after depth correction.


2021 ◽  
Vol 47 (4) ◽  
pp. 162-169
Author(s):  
Mohammed Aldelgawy ◽  
Isam Abu-Qasmieh

This paper aims to calibrate smartphone’s rear dual camera system which is composed of two lenses, namely; wide-angle lens and telephoto lens. The proposed approach handles large sized images. Calibration was done by capturing 13 photos for a chessboard pattern from different exposure positions. First, photos were captured in dual camera mode. Then, for both wide-angle and telephoto lenses, image coordinates for node points of the chessboard were extracted. Afterwards, intrinsic, extrinsic, and lens distortion parameters for each lens were calculated. In order to enhance the accuracy of the calibration model, a constrained least-squares solution was applied. The applied constraint was that the relative extrinsic parameters of both wide-angle and telephoto lenses were set as constant regardless of the exposure position. Moreover, photos were rectified in order to eliminate the effect of lens distortion. For results evaluation, two oriented photos were chosen to perform a stereo-pair intersection. Then, the node points of the chessboard pattern were used as check points.


2010 ◽  
Vol 33 ◽  
pp. 299-303
Author(s):  
Zhong Yan Liu ◽  
Guo Quan Wang ◽  
Dong Ping Wang

A method was proposed to gain three-dimensional (3D) reconstruction based on binocular view geometry. Images used to calibrate cameras and reconstruct car’s rearview mirror by image acquisition system, by calibration image, a camera's intrinsic and extrinsic parameters, projective and fundamental matrixes were drawn by Matlab7.1;the collected rearview mirror images is pretreated to draw refined laser, extracted feature points, find the very appropriate match points by epipolar geometry principle; according to the camera imaging model to calculate the coordinates of space points, display point cloud, fitting space points to reconstruct car’s rearview mirror; experimental results show this method can better restore the car’s rearview mirror of 3D information.


3D Research ◽  
2015 ◽  
Vol 6 (1) ◽  
Author(s):  
Soulaiman El hazzat ◽  
Abderrahim Saaidi ◽  
Antoine Karam ◽  
Khalid Satori

Author(s):  
S. Tripodi ◽  
L. Duan ◽  
F. Trastour ◽  
V. Poujad ◽  
L. Laurore ◽  
...  

<p><strong>Abstract.</strong> Automatic city modeling from satellite imagery is a popular yet challenging topic in remote sensing, driven by numerous applications such as telecommunications, defence and urban mamagement. In this paper, we present an automated chain for large-scale 3D reconstruction of urban scenes with a Level of Detail 1 from satellite images. The proposed framework relies on two key ingredient. First, from a stereo pair of images, we estimate a digital terrain model and a digital height model, by using a novel set of feature descriptors based on multiscale morphological analysis. Second, inspired by recent works in machine learning, we extract in an automatic way contour polygons of buildings, by adopting a fully convolutional network U-Net followed by a polygonization of the predicted mask of buildings. We demonstrate the potential of our chain by reconstructing in an automated way different areas of the world.</p>


Author(s):  
E.-K. Stathopoulou ◽  
F. Remondino

<p><strong>Abstract.</strong> Patch-based stereo is nowadays a commonly used image-based technique for dense 3D reconstruction in large scale multi-view applications. The typical steps of such a pipeline can be summarized in stereo pair selection, depth map computation, depth map refinement and, finally, fusion in order to generate a complete and accurate representation of the scene in 3D. In this study, we aim to support the standard dense 3D reconstruction of scenes as implemented in the open source library OpenMVS by using semantic priors. To this end, during the depth map fusion step, along with the depth consistency check between depth maps of neighbouring views referring to the same part of the 3D scene, we impose extra semantic constraints in order to remove possible errors and selectively obtain segmented point clouds per label, boosting automation towards this direction. In order to reassure semantic coherence between neighbouring views, additional semantic criterions can be considered, aiming to eliminate mismatches of pixels belonging in different classes.</p>


Sign in / Sign up

Export Citation Format

Share Document