scholarly journals A 3D Reconstruction Method Using Multisensor Fusion in Large-Scale Indoor Scenes

Complexity ◽  
2020 ◽  
Vol 2020 ◽  
pp. 1-14
Author(s):  
Panlong Gu ◽  
Fengyu Zhou ◽  
Dianguo Yu ◽  
Fang Wan ◽  
Wei Wang ◽  
...  
Keyword(s):  
3D Reconstruction ◽  
Real Time ◽  
Large Scale ◽  
Reconstruction Method ◽  
Loop Closure ◽  
Mapping Algorithm ◽  
Localization And Mapping ◽  
Indoor Scenes ◽  
Slam Algorithm ◽  
Robot Position

RGBD camera-based VSLAM (Visual Simultaneous Localization and Mapping) algorithm is usually applied to assist robots with real-time mapping. However, due to the limited measuring principle, accuracy, and distance of the equipped camera, this algorithm has typical disadvantages in the large and dynamic scenes with complex lightings, such as poor mapping accuracy, easy loss of robot position, and much cost on computing resources. Regarding these issues, this paper proposes a new method of 3D interior construction, which combines laser radar and an RGBD camera. Meanwhile, it is developed based on the Cartographer laser SLAM algorithm. The proposed method mainly takes two steps. The first step is to do the 3D reconstruction using the Cartographer algorithm and RGBD camera. It firstly applies the Cartographer algorithm to calculate the pose of the RGBD camera and to generate a submap. Then, a real-time 3D point cloud generated by using the RGBD camera is inserted into the submap, and the real-time interior construction is finished. The second step is to improve Cartographer loop-closure quality by the visual loop-closure for the sake of correcting the generated map. Compared with traditional methods in large-scale indoor scenes, the proposed algorithm in this paper shows higher precision, faster speed, and stronger robustness in such contexts, especially with complex light and dynamic objects, respectively.

CROWD-SOURCED VISUAL DATA COLLECTION FOR MONITORING INDOOR CONSTRUCTION IN 3D

2018 ◽  
Vol 5 (1) ◽  
Author(s):  
Fouad Amer ◽  
Mani Golparvar-Fard
Keyword(s):  
Data Collection ◽  
3D Reconstruction ◽  
Structure From Motion ◽  
Reconstruction Algorithm ◽  
Point Clouds ◽  
Reconstruction Method ◽  
Visual Data ◽  
Mapping Algorithm ◽  
3D Point Clouds ◽  
Localization And Mapping

Complete and accurate 3D monitoring of indoor construction progress using visual data is challenging. It requires (a) capturing a large number of overlapping images, which is time-consuming and labor-intensive to collect, and (b) processing using Structure from Motion (SfM) algorithms, which can be computationally expensive. To address these inefficiencies, this paper proposes a hybrid SfM-SLAM 3D reconstruction algorithm along with a decentralized data collection workflow to map indoor construction work locations in 3D and any desired frequency. The hybrid 3D reconstruction method is composed of a pipeline of Structure from Motion (SfM) coupled with Multi-View Stereo (MVS) to generate 3D point clouds and a SLAM (Simultaneous Localization and Mapping) algorithm to register the separately formed models together. Our SfM and SLAM pipelines are built on binary Oriented FAST and Rotated BRIEF (ORB) descriptors to tightly couple these two separate reconstruction workflows and enable fast computation. To elaborate the data capture workflow and validate the proposed method, a case study was conducted on a real-world construction site. Compared to state-of-the-art methods, our preliminary results show a decrease in both registration error and processing time, demonstrating the potential of using daily images captured by different trades coupled with weekly walkthrough videos captured by a field engineer for complete 3D visual monitoring of indoor construction operations.

scholarly journals A Poisson Equation-Based Method for 3D Reconstruction of Animated Images

2021 ◽  
Vol 2021 ◽  
pp. 1-11
Author(s):  
Ziang Lei
Keyword(s):  
3D Reconstruction ◽  
Real Time ◽  
Large Scale ◽  
Least Square ◽  
Reconstruction Method ◽  
Feature Points ◽  
Computing Power ◽  
To Come ◽  
Point Detection ◽  
Considerable Period

3D reconstruction techniques for animated images and animation techniques for faces are important research in computer graphics-related fields. Traditional 3D reconstruction techniques for animated images mainly rely on expensive 3D scanning equipment and a lot of time-consuming postprocessing manually and require the scanned animated subject to remain in a fixed pose for a considerable period. In recent years, the development of large-scale computing power of computer-related hardware, especially distributed computing, has made it possible to come up with a real-time and efficient solution. In this paper, we propose a 3D reconstruction method for multivisual animated images based on Poisson’s equation theory. The calibration theory is used to calibrate the multivisual animated images, obtain the internal and external parameters of the camera calibration module, extract the feature points from the animated images of each viewpoint by using the corner point detection operator, then match and correct the extracted feature points by using the least square median method, and complete the 3D reconstruction of the multivisual animated images. The experimental results show that the proposed method can obtain the 3D reconstruction results of multivisual animation images quickly and accurately and has certain real-time and reliability.

A two-level optimized graph-based simultaneous localization and mapping algorithm

2018 ◽  
Vol 45 (6) ◽  
pp. 758-765
Author(s):  
Hui Xiong ◽  
Youping Chen ◽  
Xiaoping Li ◽  
Bing Chen
Keyword(s):  
Simultaneous Localization And Mapping ◽  
Environmental Information ◽  
Indoor Environments ◽  
Construction Process ◽  
Loop Closure ◽  
Content Type ◽  
Mapping Algorithm ◽  
Localization And Mapping ◽  
Slam Algorithm ◽  
Estimated Error

PurposeBecause submaps including a subset of the global map contain more environmental information, submap-based graph simultaneous localization and mapping (SLAM) has been studied by many researchers. In most of those studies, helpful environmental information was not taken into consideration when designed the termination criterion of the submap construction process. After optimizing the graph, cumulative error within the submaps was also ignored. To address those problems, this paper aims to propose a two-level optimized graph-based SLAM algorithm.Design/methodology/approachSubmaps are updated by extended Kalman filter SLAM while no geometric-shaped landmark models are needed; raw laser scans are treated as landmarks. A more reasonable criterion called the uncertainty index is proposed to combine with the size of the submap to terminate the submap construction process. After a submap is completed and a loop closure is found, a two-level optimization process is performed to minimize the loop closure error and the accumulated error within the submaps.FindingsSimulation and experimental results indicate that the estimated error of the proposed algorithm is small, and the maps generated are consistent whether in global or local.Practical implicationsThe proposed method is robust to sparse pedestrians and can be adapted to most indoor environments.Originality/valueIn this paper, a two-level optimized graph-based SLAM algorithm is proposed.

scholarly journals Feature Selection Criteria for Real Time EKF-SLAM Algorithm

10.5772/7237 ◽  
2009 ◽  
Vol 6 (3) ◽  
pp. 21 ◽  
Author(s):  
Fernando Auat Cheein ◽  
Gustavo Scaglia ◽  
Fernando di Sciasio ◽  
Ricardo Carelli
Keyword(s):  
Feature Selection ◽  
Real Time ◽  
Selection Criteria ◽  
Selection Procedure ◽  
Computational Time ◽  
Mapping Algorithm ◽  
Localization And Mapping ◽  
Selection Approach ◽  
Feature Selection Approach ◽  
Slam Algorithm

This paper presents a seletion procedure for environmet features for the correction stage of a SLAM (Simultaneous Localization and Mapping) algorithm based on an Extended Kalman Filter (EKF). This approach decreases the computational time of the correction stage which allows for real and constant-time implementations of the SLAM. The selection procedure consists in chosing the features the SLAM system state covariance is more sensible to. The entire system is implemented on a mobile robot equipped with a range sensor laser. The features extracted from the environment correspond to lines and corners. Experimental results of the real time SLAM algorithm and an analysis of the processing-time consumed by the SLAM with the feature selection procedure proposed are shown. A comparison between the feature selection approach proposed and the classical sequential EKF-SLAM along with an entropy feature selection approach is also performed.

scholarly journals REAL-TIME DENSE 3D RECONSTRUCTION FROM MONOCULAR VIDEO DATA CAPTURED BY LOW-COST UAVS

2021 ◽  
Vol XLIII-B2-2021 ◽  
pp. 361-368
Author(s):  
M. Hermann ◽  
B. Ruf ◽  
M. Weinmann
Keyword(s):  
3D Reconstruction ◽  
Real Time ◽  
Low Cost ◽  
Video Stream ◽  
Video Data ◽  
Depth Sensor ◽  
Oblique View ◽  
Localization And Mapping ◽  
Slam Algorithm ◽  
Self Motion

Abstract. Real-time 3D reconstruction enables fast dense mapping of the environment which benefits numerous applications, such as navigation or live evaluation of an emergency. In contrast to most real-time capable approaches, our method does not need an explicit depth sensor. Instead, we only rely on a video stream from a camera and its intrinsic calibration. By exploiting the self-motion of the unmanned aerial vehicle (UAV) flying with oblique view around buildings, we estimate both camera trajectory and depth for selected images with enough novel content. To create a 3D model of the scene, we rely on a three-stage processing chain. First, we estimate the rough camera trajectory using a simultaneous localization and mapping (SLAM) algorithm. Once a suitable constellation is found, we estimate depth for local bundles of images using a Multi-View Stereo (MVS) approach and then fuse this depth into a global surfel-based model. For our evaluation, we use 55 video sequences with diverse settings, consisting of both synthetic and real scenes. We evaluate not only the generated reconstruction but also the intermediate products and achieve competitive results both qualitatively and quantitatively. At the same time, our method can keep up with a 30 fps video for a resolution of 768 × 448 pixels.

A Robust and Real-Time Full 3D Reconstruction Method Based on Multiple Kinect

2018 ◽  
pp. 1420-1428
Author(s):  
Xiongfeng Peng ◽  
Liaoyuan Zeng ◽  
Wenyi Wang ◽  
Zhili Liu ◽  
Yifeng Yang ◽  
...  
Keyword(s):  
3D Reconstruction ◽  
Real Time ◽  
Reconstruction Method

scholarly journals The dynamic connectome: towards large-scale 3D reconstruction of brain activity in real-time

2013 ◽  
Vol 14 (Suppl 1) ◽  
pp. P407 ◽  
Author(s):  
Xerxes D Arsiwalla ◽  
Alberto Betella ◽  
Enrique Martinez ◽  
Pedro Omedas ◽  
Riccardo Zucca ◽  
...  
Keyword(s):  
3D Reconstruction ◽  
Real Time ◽  
Large Scale ◽  
Brain Activity

scholarly journals REINFORCEMENT LEARNING HELPS SLAM: LEARNING TO BUILD MAPS

2020 ◽  
Vol XLIII-B4-2020 ◽  
pp. 329-335
Author(s):  
N. Botteghi ◽  
B. Sirmacek ◽  
R. Schulte ◽  
M. Poel ◽  
C. Brune
Keyword(s):  
Reinforcement Learning ◽  
Real Time ◽  
A Priori ◽  
Simultaneous Localization And Mapping ◽  
Indoor Environments ◽  
Robot Localization ◽  
Robust Solution ◽  
Localization And Mapping ◽  
Reward Functions ◽  
Slam Algorithm

Abstract. In this research, we investigate the use of Reinforcement Learning (RL) for an effective and robust solution for exploring unknown and indoor environments and reconstructing their maps. We benefit from a Simultaneous Localization and Mapping (SLAM) algorithm for real-time robot localization and mapping. Three different reward functions are compared and tested in different environments with growing complexity. The performances of the three different RL-based path planners are assessed not only on the training environments, but also on an a priori unseen environment to test the generalization properties of the policies. The results indicate that RL-based planners trained to maximize the coverage of the map are able to consistently explore and construct the maps of different indoor environments.

Sign in / Sign up

Export Citation Format

Share Document