Semantic Correspondence with Geometric Structure Analysis

This article studies the correspondence problem for semantically similar images, which is challenging due to the joint visual and geometric deformations. We introduce the Flip-aware Distance Ratio method (FDR) to solve this problem from the perspective of geometric structure analysis. First, a distance ratio constraint is introduced to enforce the geometric consistencies between images with large visual variations, whereas local geometric jitters are tolerated via a smoothness term. For challenging cases with symmetric structures, our proposed method exploits Curl to suppress the mismatches. Subsequently, image correspondence is formulated as a permutation problem, for which we propose a Gradient Guided Simulated Annealing (GGSA) algorithm to perform a robust discrete optimization. Experiments on simulated and real-world datasets, where both visual and geometric deformations are present, indicate that our method significantly improves the baselines for both visually and semantically similar images.

3D reconstruction system for semi-automatic estimation of objects length and area by means of stereo vision

It is mandatory to characterize dimensionally the manufactured industrial pieces for quality control purposes. As it is not possible to touch some pieces when trying to retrieve dimensional information, then non-invasive techniques are required to do so. Stereo vision is a passive technology which is both robust and accurate for non-invasive applications. For this reason, in this work we describe the design and implementation of a 3D reconstruction system for the estimation of the length and area of certain objects. This tool allows to easily incorporate new image correspondence techniques to its main execution pipeline. We carry some experiments and show certain benefits when selecting an accurate image correspondence technique for the estimation of the length and area.

TOWARDS COMPLETE, GEO-REFERENCED 3D MODELS FROM CROWD-SOURCED AMATEUR IMAGES

Despite a lot of recent research, photogrammetric reconstruction from crowd-sourced imagery is plagued by a number of recurrent problems. (i) The resulting models are chronically incomplete, because even touristic landmarks are photographed mostly from a few “canonical” viewpoints. (ii) Man-made constructions tend to exhibit repetitive structure and rotational symmetries, which lead to gross errors in the 3D reconstruction and aggravate the problem of incomplete reconstruction. (iii) The models are normally not geo-referenced. In this paper, we investigate the possibility of using sparse GNSS geo-tags from digital cameras to address these issues and push the boundaries of crowd-sourced photogrammetry. A small proportion of the images in Internet collections (≈ 10 %) do possess geo-tags. While the individual geo-tags are very inaccurate, they nevertheless can help to address the problems above. By providing approximate geo-reference for partial reconstructions they make it possible to fuse those pieces into more complete models; the capability to fuse partial reconstruction opens up the possibility to be more restrictive in the matching phase and avoid errors due to repetitive structure; and collectively, the redundant set of low-quality geo-tags can provide reasonably accurate absolute geo-reference. We show that even few, noisy geo-tags can help to improve architectural models, compared to puristic structure-from-motion only based on image correspondence.