Comparison of Visual Descriptors for 3D Reconstruction of Non-rigid Planar Surfaces

Author(s):  
Michał Bednarek
Author(s):  
H. M. Mohammed ◽  
N. El-Sheimy

<p><strong>Abstract.</strong> Image segmentation is an essential task in many computer vision applications such as object detection and recognition, object tracking, image classification, 3D reconstruction. Most of the current techniques utilise the colour or grayscale information of an image without considering the camera geometry. In this paper, a method is proposed to utilise the camera relative orientation of a pair of images to find a reliable object segmentation. The inputs to the method are a rectified image pair and a disparity map which could be computed from the rectified image pair, the disparity map is used to determine a set of local homographies between planar surfaces in the two images. The planar surfaces are corresponding to image segments despite the inconsistency of the RGB information. Homography based segmentation alone is not reliable due to possible noise in the disparity map and existence of non-planar objects in the scene. Therefore, an RGB technique is used as a complementary approach to enhance the segmentation result. Two colour-based segmentation techniques are used here, the first is the colour edge detector, and the second is Grabcut. Experimental results show the although the colour edge detector is a simpler algorithm than Grabcut, it does not include noisy data in the segmentation results. the This useful for 3D reconstruction, as it is preferable to exclude noisy areas like the sky and window glass. The outcome of the proposed segmentation algorithm is an object-based segmentation of the pair of images as well as a segmented disparity map.</p>


2020 ◽  
Vol 12 (23) ◽  
pp. 3886
Author(s):  
Jahanzeb Hafeez ◽  
Jaehyun Lee ◽  
Soonchul Kwon ◽  
Sungjae Ha ◽  
Gitaek Hur ◽  
...  

Image-based three-dimensional (3D) reconstruction is a process of extracting 3D information from an object or entire scene while using low-cost vision sensors. A structure-from-motion coupled with multi-view stereo (SFM-MVS) pipeline is a widely used technique that allows 3D reconstruction from a collection of unordered images. The SFM-MVS pipeline typically comprises different processing steps, including feature extraction and feature matching, which provide the basis for automatic 3D reconstruction. However, surfaces with poor visual texture (repetitive, monotone, etc.) challenge the feature extraction and matching stage and affect the quality of reconstruction. The projection of image patterns while using a video projector during the image acquisition process is a well-known technique that has been shown to be successful for such surfaces. In this study, we evaluate the performance of different feature extraction methods on texture-less surfaces with the application of synthetically generated noise patterns (images). Seven state-of-the-art feature extraction methods (HARRIS, Shi-Tomasi, MSER, SIFT, SURF, KAZE, and BRISK) are evaluated on problematic surfaces in two experimental phases. In the first phase, the 3D reconstruction of real and virtual planar surfaces evaluates image patterns while using all feature extraction methods, where the patterns with uniform histograms have the most suitable morphological features. The best performing pattern from Phase One is used in Phase Two experiments in order to recreate a polygonal model of a 3D printed object using all of the feature extraction methods. The KAZE algorithm achieved the lowest standard deviation and mean distance values of 0.0635 mm and −0.00921 mm, respectively.


2019 ◽  
Vol 8 (8) ◽  
pp. 360
Author(s):  
Sheng’en Liu ◽  
Hui Yi ◽  
Xiangning Chen ◽  
Decheng Wang ◽  
Wei Jin

Large-scale three-dimensional (3D) reconstruction from multi-view images is used to generate 3D mesh surfaces, which are usually built for urban areas and are widely applied in many research hotspots, such as smart cities. Their simplification is a significant step for 3D roaming, pattern recognition, and other research fields. The simplification quality has been assessed in several studies. On the one hand, almost all studies on surface simplification have measured simplification errors using the surface comparison tool Metro, which does not preserve sufficient detail. On the other hand, the reconstruction precision of urban surfaces varies as a result of homogeneity or heterogeneity. Therefore, it is difficult to assess simplification quality without surface classification. These difficulties are addressed in this study by first classifying urban surfaces into planar surfaces, detailed surfaces, and urban frameworks according to the simplification errors of different types of surfaces and then measuring these errors after sampling. A series of assessment indexes are also provided to contribute to the advancement of simplification algorithms.


Author(s):  
C. W. Price ◽  
E. F. Lindsey ◽  
R. M. Franks ◽  
M. A. Lane

Diamond-point turning is an efficient technique for machining low-density polystyrene foam, and the surface finish can be substantially improved by grinding. However, both diamond-point turning and grinding tend to tear and fracture cell walls and leave asperities formed by agglomerations of fragmented cell walls. Vibratoming is proving to be an excellent technique to form planar surfaces in polystyrene, and the machining characteristics of vibratoming and diamond-point turning are compared.Our work has demonstrated that proper evaluation of surface structures in low density polystyrene foam requires stereoscopic examinations; tilts of + and − 3 1/2 degrees were used for the stereo pairs. Coating does not seriously distort low-density polystyrene foam. Therefore, the specimens were gold-palladium coated and examined in a Hitachi S-800 FESEM at 5 kV.


Author(s):  
Jose-Maria Carazo ◽  
I. Benavides ◽  
S. Marco ◽  
J.L. Carrascosa ◽  
E.L. Zapata

Obtaining the three-dimensional (3D) structure of negatively stained biological specimens at a resolution of, typically, 2 - 4 nm is becoming a relatively common practice in an increasing number of laboratories. A combination of new conceptual approaches, new software tools, and faster computers have made this situation possible. However, all these 3D reconstruction processes are quite computer intensive, and the middle term future is full of suggestions entailing an even greater need of computing power. Up to now all published 3D reconstructions in this field have been performed on conventional (sequential) computers, but it is a fact that new parallel computer architectures represent the potential of order-of-magnitude increases in computing power and should, therefore, be considered for their possible application in the most computing intensive tasks.We have studied both shared-memory-based computer architectures, like the BBN Butterfly, and local-memory-based architectures, mainly hypercubes implemented on transputers, where we have used the algorithmic mapping method proposed by Zapata el at. In this work we have developed the basic software tools needed to obtain a 3D reconstruction from non-crystalline specimens (“single particles”) using the so-called Random Conical Tilt Series Method. We start from a pair of images presenting the same field, first tilted (by ≃55°) and then untilted. It is then assumed that we can supply the system with the image of the particle we are looking for (ideally, a 2D average from a previous study) and with a matrix describing the geometrical relationships between the tilted and untilted fields (this step is now accomplished by interactively marking a few pairs of corresponding features in the two fields). From here on the 3D reconstruction process may be run automatically.


Author(s):  
Adriana Verschoor ◽  
Ronald Milligan ◽  
Suman Srivastava ◽  
Joachim Frank

We have studied the eukaryotic ribosome from two vertebrate species (rabbit reticulocyte and chick embryo ribosomes) in several different electron microscopic preparations (Fig. 1a-d), and we have applied image processing methods to two of the types of images. Reticulocyte ribosomes were examined in both negative stain (0.5% uranyl acetate, in a double-carbon preparation) and frozen hydrated preparation as single-particle specimens. In addition, chick embryo ribosomes in tetrameric and crystalline assemblies in frozen hydrated preparation have been examined. 2D averaging, multivariate statistical analysis, and classification methods have been applied to the negatively stained single-particle micrographs and the frozen hydrated tetramer micrographs to obtain statistically well defined projection images of the ribosome (Fig. 2a,c). 3D reconstruction methods, the random conical reconstruction scheme and weighted back projection, were applied to the negative-stain data, and several closely related reconstructions were obtained. The principal 3D reconstruction (Fig. 2b), which has a resolution of 3.7 nm according to the differential phase residual criterion, can be compared to the images of individual ribosomes in a 2D tetramer average (Fig. 2c) at a similar resolution, and a good agreement of the general morphology and of many of the characteristic features is seen.Both data sets show the ribosome in roughly the same ’view’ or orientation, with respect to the adsorptive surface in the electron microscopic preparation, as judged by the agreement in both the projected form and the distribution of characteristic density features. The negative-stain reconstruction reveals details of the ribosome morphology; the 2D frozen-hydrated average provides projection information on the native mass-density distribution within the structure. The 40S subunit appears to have an elongate core of higher density, while the 60S subunit shows a more complex pattern of dense features, comprising a rather globular core, locally extending close to the particle surface.


2007 ◽  
Vol 3 (1) ◽  
pp. 89-113
Author(s):  
Zoltán Gillay ◽  
László Fenyvesi

There was a method developed that generates the three-dimensional model of not axisymmetric produce, based on an arbitrary number of photos. The model can serve as a basis for calculating the surface area and the volume of produce. The efficiency of the reconstruction was tested on bell peppers and artificial shapes. In case of bell peppers 3-dimensional reconstruction was created from 4 images rotated in 45° angle intervals. The surface area and the volume were estimated on the basis of the reconstructed area. Furthermore, a new and simple reference method was devised to give precise results for the surface area of bell pepper. The results show that this 3D reconstruction-based surface area and volume calculation method is suitable to determine the surface area and volume of definite bell peppers with an acceptable error.


Sign in / Sign up

Export Citation Format

Share Document