3D reconstruction using an uncalibrated stereo pair of encoded images

Author(s):  
P. Lavoie ◽  
D. Ionescu ◽  
E. Petriu
2021 ◽  
Vol 13 (11) ◽  
pp. 2185
Author(s):  
Yu Tao ◽  
Sylvain Douté ◽  
Jan-Peter Muller ◽  
Susan J. Conway ◽  
Nicolas Thomas ◽  
...  

We introduce a novel ultra-high-resolution Digital Terrain Model (DTM) processing system using a combination of photogrammetric 3D reconstruction, image co-registration, image super-resolution restoration, shape-from-shading DTM refinement, and 3D co-alignment methods. Technical details of the method are described, and results are demonstrated using a 4 m/pixel Trace Gas Orbiter Colour and Stereo Surface Imaging System (CaSSIS) panchromatic image and an overlapping 6 m/pixel Mars Reconnaissance Orbiter Context Camera (CTX) stereo pair to produce a 1 m/pixel CaSSIS Super-Resolution Restoration (SRR) DTM for different areas over Oxia Planum on Mars—the future ESA ExoMars 2022 Rosalind Franklin rover’s landing site. Quantitative assessments are made using profile measurements and the counting of resolvable craters, in comparison with the publicly available 1 m/pixel High-Resolution Imaging Experiment (HiRISE) DTM. These assessments demonstrate that the final resultant 1 m/pixel CaSSIS DTM from the proposed processing system has achieved comparable and sometimes more detailed 3D reconstruction compared to the overlapping HiRISE DTM.


3D Research ◽  
2015 ◽  
Vol 6 (1) ◽  
Author(s):  
Soulaiman El hazzat ◽  
Abderrahim Saaidi ◽  
Antoine Karam ◽  
Khalid Satori

Author(s):  
S. Tripodi ◽  
L. Duan ◽  
F. Trastour ◽  
V. Poujad ◽  
L. Laurore ◽  
...  

<p><strong>Abstract.</strong> Automatic city modeling from satellite imagery is a popular yet challenging topic in remote sensing, driven by numerous applications such as telecommunications, defence and urban mamagement. In this paper, we present an automated chain for large-scale 3D reconstruction of urban scenes with a Level of Detail 1 from satellite images. The proposed framework relies on two key ingredient. First, from a stereo pair of images, we estimate a digital terrain model and a digital height model, by using a novel set of feature descriptors based on multiscale morphological analysis. Second, inspired by recent works in machine learning, we extract in an automatic way contour polygons of buildings, by adopting a fully convolutional network U-Net followed by a polygonization of the predicted mask of buildings. We demonstrate the potential of our chain by reconstructing in an automated way different areas of the world.</p>


Author(s):  
E.-K. Stathopoulou ◽  
F. Remondino

<p><strong>Abstract.</strong> Patch-based stereo is nowadays a commonly used image-based technique for dense 3D reconstruction in large scale multi-view applications. The typical steps of such a pipeline can be summarized in stereo pair selection, depth map computation, depth map refinement and, finally, fusion in order to generate a complete and accurate representation of the scene in 3D. In this study, we aim to support the standard dense 3D reconstruction of scenes as implemented in the open source library OpenMVS by using semantic priors. To this end, during the depth map fusion step, along with the depth consistency check between depth maps of neighbouring views referring to the same part of the 3D scene, we impose extra semantic constraints in order to remove possible errors and selectively obtain segmented point clouds per label, boosting automation towards this direction. In order to reassure semantic coherence between neighbouring views, additional semantic criterions can be considered, aiming to eliminate mismatches of pixels belonging in different classes.</p>


Author(s):  
Lee D. Peachey ◽  
Lou Fodor ◽  
John C. Haselgrove ◽  
Stanley M. Dunn ◽  
Junqing Huang

Stereo pairs of electron microscope images provide valuable visual impressions of the three-dimensional nature of specimens, including biological objects. Beyond this one seeks quantitatively accurate models and measurements of the three dimensional positions and sizes of structures in the specimen. In our laboratory, we have sought to combine high resolution video cameras with high performance computer graphics systems to improve both the ease of building 3D reconstructions and the accuracy of 3D measurements, by using multiple tilt images of the same specimen tilted over a wider range of angles than can be viewed stereoscopically. Ultimately we also wish to automate the reconstruction and measurement process, and have initiated work in that direction.Figure 1 is a stereo pair of 400 kV images from a 1 micrometer thick transverse section of frog skeletal muscle stained with the Golgi stain. This stain selectively increases the density of the transverse tubular network in these muscle cells, and it is this network that we reconstruct in this example.


Author(s):  
M. Marko ◽  
A. Leith ◽  
D. Parsons

The use of serial sections and computer-based 3-D reconstruction techniques affords an opportunity not only to visualize the shape and distribution of the structures being studied, but also to determine their volumes and surface areas. Up until now, this has been done using serial ultrathin sections.The serial-section approach differs from the stereo logical methods of Weibel in that it is based on the Information from a set of single, complete cells (or organelles) rather than on a random 2-dimensional sampling of a population of cells. Because of this, it can more easily provide absolute values of volume and surface area, especially for highly-complex structures. It also allows study of individual variation among the cells, and study of structures which occur only infrequently.We have developed a system for 3-D reconstruction of objects from stereo-pair electron micrographs of thick specimens.


Author(s):  
William P. Wergin ◽  
Eric F. Erbe

The eye-brain complex allows those of us with normal vision to perceive and evaluate our surroundings in three-dimensions (3-D). The principle factor that makes this possible is parallax - the horizontal displacement of objects that results from the independent views that the left and right eyes detect and simultaneously transmit to the brain for superimposition. The common SEM micrograph is a 2-D representation of a 3-D specimen. Depriving the brain of the 3-D view can lead to erroneous conclusions about the relative sizes, positions and convergence of structures within a specimen. In addition, Walter has suggested that the stereo image contains information equivalent to a two-fold increase in magnification over that found in a 2-D image. Because of these factors, stereo pair analysis should be routinely employed when studying specimens.Imaging complementary faces of a fractured specimen is a second method by which the topography of a specimen can be more accurately evaluated.


Author(s):  
W. Lin ◽  
J. Gregorio ◽  
T.J. Holmes ◽  
D. H. Szarowski ◽  
J.N. Turner

A low-light level video microscope with long working distance objective lenses has been built as part of our integrated three-dimensional (3-D) light microscopy workstation (Fig. 1). It allows the observation of living specimens under sufficiently low light illumination that no significant photobleaching or alternation of specimen physiology is produced. The improved image quality, depth discrimination and 3-D reconstruction provides a versatile intermediate resolution system that replaces the commonly used dissection microscope for initial image recording and positioning of microelectrodes for neurobiology. A 3-D image is displayed on-line to guide the execution of complex experiments. An image composed of 40 optical sections requires 7 minutes to process and display a stereo pair.The low-light level video microscope utilizes long working distance objective lenses from Mitutoyo (10X, 0.28NA, 37 mm working distance; 20X, 0.42NA, 20 mm working distance; 50X, 0.42NA, 20 mm working distance). They provide enough working distance to allow the placement of microelectrodes in the specimen.


Sign in / Sign up

Export Citation Format

Share Document