scholarly journals DP-MVS: Detail Preserving Multi-View Surface Reconstruction of Large-Scale Scenes

2021 ◽  
Vol 13 (22) ◽  
pp. 4569
Author(s):  
Liyang Zhou ◽  
Zhuang Zhang ◽  
Hanqing Jiang ◽  
Han Sun ◽  
Hujun Bao ◽  
...  
Keyword(s):  
Point Cloud ◽  
Large Scale ◽  
State Of The Art ◽  
Depth Estimation ◽  
Surface Mesh ◽  
Depth Maps ◽  
Surface Meshing ◽  
Dense Point ◽  
Dense 3D Reconstruction ◽  
Memory Efficient

This paper presents an accurate and robust dense 3D reconstruction system for detail preserving surface modeling of large-scale scenes from multi-view images, which we named DP-MVS. Our system performs high-quality large-scale dense reconstruction, which preserves geometric details for thin structures, especially for linear objects. Our framework begins with a sparse reconstruction carried out by an incremental Structure-from-Motion. Based on the reconstructed sparse map, a novel detail preserving PatchMatch approach is applied for depth estimation of each image view. The estimated depth maps of multiple views are then fused to a dense point cloud in a memory-efficient way, followed by a detail-aware surface meshing method to extract the final surface mesh of the captured scene. Experiments on ETH3D benchmark show that the proposed method outperforms other state-of-the-art methods on F1-score, with the running time more than 4 times faster. More experiments on large-scale photo collections demonstrate the effectiveness of the proposed framework for large-scale scene reconstruction in terms of accuracy, completeness, memory saving, and time efficiency.

scholarly journals GEOREFERENCING AND REPROJECTION ERROR INVESTIGATION ON IMAGE BASED 3D DIGITIZATION AND MAPPING OF HISTORICAL BUILDINGS

2019 ◽  
Vol XLII-2/W11 ◽  
pp. 71-75
Author(s):  
C. Altuntas
Keyword(s):  
Point Cloud ◽  
Large Scale ◽  
Cloud Model ◽  
Low Cost ◽  
Three Dimensional ◽  
Control Points ◽  
Historical Buildings ◽  
Reprojection Error ◽  
Dense Point ◽  
Point Cloud Model

<p><strong>Abstract.</strong> Image based dense point cloud creation is easy and low-cost application for three dimensional digitization of small and large scale objects and surfaces. It is especially attractive method for cultural heritage documentation. Reprojection error on conjugate keypoints indicates accuracy of the model and keypoint localisation in this method. In addition, sequential registration of the images from large scale historical buildings creates big cumulative registration error. Thus, accuracy of the model should be increased with the control points or loop close imaging. The registration of point point cloud model into the georeference system is performed using control points. In this study historical Sultan Selim Mosque that was built in sixteen century by Great Architect Sinan was modelled via photogrammetric dense point cloud. The reprojection error and number of keypoints were evaluated for different base/length ratio. In addition, georeferencing accuracy was evaluated with many configuration of control points with loop and without loop closure imaging.</p>

scholarly journals Attention-Based View Selection Networks for Light-Field Disparity Estimation

2020 ◽  
Vol 34 (07) ◽  
pp. 12095-12103
Author(s):  
Yu-Ju Tsai ◽  
Yu-Lun Liu ◽  
Ming Ouhyoung ◽  
Yung-Yu Chuang
Keyword(s):  
Light Field ◽  
State Of The Art ◽  
Depth Estimation ◽  
Disparity Estimation ◽  
View Selection ◽  
Deep Network ◽  
Depth Maps ◽  
Improve Accuracy ◽  
Light Field Image ◽  
Symmetric Property

This paper introduces a novel deep network for estimating depth maps from a light field image. For utilizing the views more effectively and reducing redundancy within views, we propose a view selection module that generates an attention map indicating the importance of each view and its potential for contributing to accurate depth estimation. By exploring the symmetric property of light field views, we enforce symmetry in the attention map and further improve accuracy. With the attention map, our architecture utilizes all views more effectively and efficiently. Experiments show that the proposed method achieves state-of-the-art performance in terms of accuracy and ranks the first on a popular benchmark for disparity estimation for light field images.

scholarly journals A REGISTRATION METHOD OF POINT CLOUDS COLLECTED BY MOBILE LIDAR USING SOLELY STANDARD LAS FILES INFORMATION

2017 ◽  
Vol XLII-1/W1 ◽  
pp. 121-128 ◽  
Author(s):  
L. Gézero ◽  
C. Antunes
Keyword(s):  
Point Cloud ◽  
Large Scale ◽  
Auxiliary Information ◽  
Point Clouds ◽  
Registration Method ◽  
Digital Terrain ◽  
Terrain Models ◽  
Dense Point ◽  
Fully Automatic ◽  
Method Point

In the last few years, LiDAR sensors installed in terrestrial vehicles have been revealed as an efficient method to collect very dense 3D georeferenced information. The possibility of creating very dense point clouds representing the surface surrounding the sensor, at a given moment, in a very fast, detailed and easy way, shows the potential of this technology to be used for cartography and digital terrain models production in large scale. However, there are still some limitations associated with the use of this technology. When several acquisitions of the same area with the same device, are made, differences between the clouds can be observed. The range of that differences can go from few centimetres to some several tens of centimetres, mainly in urban and high vegetation areas where the occultation of the GNSS system introduces a degradation of the georeferenced trajectory. Along this article a different method point cloud registration is proposed. In addition to the efficiency and speed of execution, the main advantages of the method are related to the fact that the adjustment is continuously made over the trajectory, based on the GPS time. The process is fully automatic and only information recorded in the standard LAS files is used, without the need for any auxiliary information, in particular regarding the trajectory.

scholarly journals 3D SURFACE RECONSTRUCTION FROM MULTI-DATE SATELLITE IMAGES

2021 ◽  
Vol XLIII-B2-2021 ◽  
pp. 313-320
Author(s):  
S. Bullinger ◽  
C. Bodensteiner ◽  
M. Arens
Keyword(s):  
Large Scale ◽  
Satellite Images ◽  
Stereo Matching ◽  
State Of The Art ◽  
Satellite Image ◽  
Three Dimensional ◽  
Point Clouds ◽  
Reconstruction Algorithms ◽  
Depth Maps ◽  
Median Error

Abstract. The reconstruction of accurate three-dimensional environment models is one of the most fundamental goals in the field of photogrammetry. Since satellite images provide suitable properties for obtaining large-scale environment reconstructions, there exist a variety of Stereo Matching based methods to reconstruct point clouds for satellite image pairs. Recently, a Structure from Motion (SfM) based approach has been proposed, which allows to reconstruct point clouds from multiple satellite images. In this work, we propose an extension of this SfM based pipeline that allows us to reconstruct not only point clouds but watertight meshes including texture information. We provide a detailed description of several steps that are mandatory to exploit state-of-the-art mesh reconstruction algorithms in the context of satellite imagery. This includes a decomposition of finite projective camera calibration matrices, a skew correction of corresponding depth maps and input images as well as the recovery of real-world depth maps from reparameterized depth values. The paper presents an extensive quantitative evaluation on multi-date satellite images demonstrating that the proposed pipeline combined with current meshing algorithms outperforms state-of-the-art point cloud reconstruction algorithms in terms of completeness and median error. We make the source code of our pipeline publicly available.

scholarly journals A fast and memory efficient MLCS algorithm by character merging for DNA sequences alignment

2019 ◽  
Author(s):  
Sen Liu ◽  
Yuping Wang ◽  
Wuning Tong ◽  
Shiwei Wei
Keyword(s):  
Dna Sequences ◽  
Directed Acyclic Graph ◽  
Large Scale ◽  
State Of The Art ◽  
Longest Common Subsequence ◽  
Sequence Length ◽  
Acyclic Graph ◽  
Character Sequences ◽  
Common Subsequence ◽  
Memory Efficient

Abstract Motivation Multiple longest common subsequence (MLCS) problem is searching all longest common subsequences of multiple character sequences. It appears in many fields such as data mining, DNA alignment, bioinformatics, text editing and so on. With the increasing in sequence length and number of sequences, the existing dynamic programming algorithms and the dominant point-based algorithms become ineffective and inefficient, especially for large-scale MLCS problems. Results In this paper, by considering the characteristics of DNA sequences with many consecutively repeated characters, we first design a character merging scheme which merges the consecutively repeated characters in the sequences. As a result, it shortens the length of sequences considered and saves the space of storing all sequences. To further reduce the space and time costs, we construct a weighted directed acyclic graph which is much smaller than widely used directed acyclic graph for MLCS problems. Based on these techniques, we propose a fast and memory efficient algorithm for MLCS problems. Finally, the experiments are conducted and the proposed algorithm is compared with several state-of-the art algorithms. The experimental results show that the proposed algorithm performs better than the compared state-of-the art algorithms in both time and space costs. Availability and implementation https://www.ncbi.nlm.nih.gov/nuccore and https://github.com/liusen1006/MLCS.

scholarly journals 3D Human Pose Estimation via Explicit Compositional Depth Maps

2020 ◽  
Vol 34 (07) ◽  
pp. 12378-12385
Author(s):  
Haiping Wu ◽  
Bin Xiao
Keyword(s):  
Large Scale ◽  
State Of The Art ◽  
Superior Performance ◽  
Projection Model ◽  
Depth Maps ◽  
3D Camera ◽  
Camera Perspective ◽  
Monocular Image ◽  
Human Pose ◽  
Body Joints

In this work, we tackle the problem of estimating 3D human pose in camera space from a monocular image. First, we propose to use densely-generated limb depth maps to ease the learning of body joints depth, which are well aligned with image cues. Then, we design a lifting module from 2D pixel coordinates to 3D camera coordinates which explicitly takes the depth values as inputs, and is aligned with camera perspective projection model. We show our method achieves superior performance on large-scale 3D pose datasets Human3.6M and MPI-INF-3DHP, and sets the new state-of-the-art.

scholarly journals Semantic 3D Reconstruction with Learning MVS and 2D Segmentation of Aerial Images

2020 ◽  
Vol 10 (4) ◽  
pp. 1275
Author(s):  
Zizhuang Wei ◽  
Yao Wang ◽  
Hongwei Yi ◽  
Yisong Chen ◽  
Guoping Wang
Keyword(s):  
Point Cloud ◽  
Large Scale ◽  
Point Clouds ◽  
Aerial Images ◽  
Experimental Result ◽  
Fusion Procedure ◽  
3D Geometry ◽  
Dense Point ◽  
Semantic Point ◽  
Projection Error

Semantic modeling is a challenging task that has received widespread attention in recent years. With the help of mini Unmanned Aerial Vehicles (UAVs), multi-view high-resolution aerial images of large-scale scenes can be conveniently collected. In this paper, we propose a semantic Multi-View Stereo (MVS) method to reconstruct 3D semantic models from 2D images. Firstly, 2D semantic probability distribution is obtained by Convolutional Neural Network (CNN). Secondly, the calibrated cameras poses are determined by Structure from Motion (SfM), while the depth maps are estimated by learning MVS. Combining 2D segmentation and 3D geometry information, dense point clouds with semantic labels are generated by a probability-based semantic fusion method. In the final stage, the coarse 3D semantic point cloud is optimized by both local and global refinements. By making full use of the multi-view consistency, the proposed method efficiently produces a fine-level 3D semantic point cloud. The experimental result evaluated by re-projection maps achieves 88.4% Pixel Accuracy on the Urban Drone Dataset (UDD). In conclusion, our graph-based semantic fusion procedure and refinement based on local and global information can suppress and reduce the re-projection error.

scholarly journals Ground-distance segmentation of 3D LiDAR point cloud toward autonomous driving

2020 ◽  
Vol 9 ◽  
Author(s):  
Jian Wu ◽  
Qingxiong Yang
Keyword(s):  
Point Cloud ◽  
Large Scale ◽  
Ground Plane ◽  
Semantic Segmentation ◽  
Point Clouds ◽  
Autonomous Driving ◽  
Urban Environments ◽  
Cloud Data ◽  
Dense Point ◽  
3D Lidar

In this paper, we study the semantic segmentation of 3D LiDAR point cloud data in urban environments for autonomous driving, and a method utilizing the surface information of the ground plane was proposed. In practice, the resolution of a LiDAR sensor installed in a self-driving vehicle is relatively low and thus the acquired point cloud is indeed quite sparse. While recent work on dense point cloud segmentation has achieved promising results, the performance is relatively low when directly applied to sparse point clouds. This paper is focusing on semantic segmentation of the sparse point clouds obtained from 32-channel LiDAR sensor with deep neural networks. The main contribution is the integration of the ground information which is used to group ground points far away from each other. Qualitative and quantitative experiments on two large-scale point cloud datasets show that the proposed method outperforms the current state-of-the-art.

Sign in / Sign up

Export Citation Format

Share Document