scholarly journals FOVEON VS BAYER: COMPARISON OF 3D RECONSTRUCTION PERFORMANCES

Author(s):  
M. Vlachos ◽  
D. Skarlatos ◽  
P. Bodin

<p><strong>Abstract.</strong> The main idea of this particular study was to validate if the new FOVEON technology implemented by sigma cameras can provide better overall results and outperform the traditional Bayer pattern sensor cameras regarding the radiometric information that records as well as the photogrammetric point cloud quality that can provide. Based on that, the scope of this paper is separated into two evaluations. First task is to evaluate the quality of information reconstructed during de-mosaicking step for Bayer pattern cameras by detecting potential additional colour distortion added during the de-mosaicking step, and second task is the geometric comparisons of point clouds generated by the photos by Bayer and FOVEON sensors against a reference point cloud. The first phase of the study is done using various de-mosaicking algorithms to process various artificial Bayern pattern images and then compare them with reference FOVEON images. The second phase of the study is carried on by reconstructing 3D point clouds of the same objects captured by a Bayer and a FOVEON sensor respectively and then comparing the various point clouds with a reference one, generated by a structured light hand-held scanner. The comparison is separated into two parts, where initially we evaluate five separate point clouds (RGB, Gray, Red, Green, Blue) for each camera sensor per site and then a second comparison is evaluated on colour classified RGB point cloud segments.</p>

Author(s):  
Robert Niederheiser ◽  
Martin Mokroš ◽  
Julia Lange ◽  
Helene Petschko ◽  
Günther Prasicek ◽  
...  

Terrestrial photogrammetry nowadays offers a reasonably cheap, intuitive and effective approach to 3D-modelling. However, the important choice, which sensor and which software to use is not straight forward and needs consideration as the choice will have effects on the resulting 3D point cloud and its derivatives. <br><br> We compare five different sensors as well as four different state-of-the-art software packages for a single application, the modelling of a vegetated rock face. The five sensors represent different resolutions, sensor sizes and price segments of the cameras. The software packages used are: (1) Agisoft PhotoScan Pro (1.16), (2) Pix4D (2.0.89), (3) a combination of Visual SFM (V0.5.22) and SURE (1.2.0.286), and (4) MicMac (1.0). We took photos of a vegetated rock face from identical positions with all sensors. Then we compared the results of the different software packages regarding the ease of the workflow, visual appeal, similarity and quality of the point cloud. <br><br> While PhotoScan and Pix4D offer the user-friendliest workflows, they are also “black-box” programmes giving only little insight into their processing. Unsatisfying results may only be changed by modifying settings within a module. The combined workflow of Visual SFM, SURE and CloudCompare is just as simple but requires more user interaction. MicMac turned out to be the most challenging software as it is less user-friendly. However, MicMac offers the most possibilities to influence the processing workflow. The resulting point-clouds of PhotoScan and MicMac are the most appealing.


Author(s):  
F. He ◽  
A. Habib ◽  
A. Al-Rawabdeh

In this paper, we proposed a new refinement procedure for the semi-global dense image matching. In order to remove outliers and improve the disparity image derived from the semi-global algorithm, both the local smoothness constraint and point cloud segments are utilized. Compared with current refinement technique, which usually assumes the correspondences between planar surfaces and 2D image segments, our proposed approach can effectively deal with object with both planar and curved surfaces. Meanwhile, since 3D point clouds contain more precise geometric information regarding to the reconstructed objects, the planar surfaces identified in our approach can be more accurate. In order to illustrate the feasibility of our approach, several experimental tests are conducted on both Middlebury test and real UAV-image datasets. The results demonstrate that our approach has a good performance on improving the quality of the derived dense image-based point cloud.


2020 ◽  
Vol 12 (17) ◽  
pp. 2748
Author(s):  
Arttu Julin ◽  
Matti Kurkela ◽  
Toni Rantanen ◽  
Juho-Pekka Virtanen ◽  
Mikko Maksimainen ◽  
...  

Terrestrial laser scanning (TLS) enables the efficient production of high-density colored 3D point clouds of real-world environments. An increasing number of applications from visual and automated interpretation to photorealistic 3D visualizations and experiences rely on accurate and reliable color information. However, insufficient attention has been put into evaluating the colorization quality of the 3D point clouds produced applying TLS. We have developed a method for the evaluation of the point cloud colorization quality of TLS systems with integrated imaging sensors. Our method assesses the capability of several tested systems to reproduce colors and details of a scene by measuring objective image quality metrics from 2D images that were rendered from 3D scanned test charts. The results suggest that the detected problems related to color reproduction (i.e., measured differences in color, white balance, and exposure) could be mitigated in data processing while the issues related to detail reproduction (i.e., measured sharpness and noise) are less in the control of a scanner user. Despite being commendable 3D measuring instruments, improving the colorization tools and workflows, and automated image processing pipelines would potentially increase not only the quality and production efficiency but also the applicability of colored 3D point clouds.


Author(s):  
Robert Niederheiser ◽  
Martin Mokroš ◽  
Julia Lange ◽  
Helene Petschko ◽  
Günther Prasicek ◽  
...  

Terrestrial photogrammetry nowadays offers a reasonably cheap, intuitive and effective approach to 3D-modelling. However, the important choice, which sensor and which software to use is not straight forward and needs consideration as the choice will have effects on the resulting 3D point cloud and its derivatives. &lt;br&gt;&lt;br&gt; We compare five different sensors as well as four different state-of-the-art software packages for a single application, the modelling of a vegetated rock face. The five sensors represent different resolutions, sensor sizes and price segments of the cameras. The software packages used are: (1) Agisoft PhotoScan Pro (1.16), (2) Pix4D (2.0.89), (3) a combination of Visual SFM (V0.5.22) and SURE (1.2.0.286), and (4) MicMac (1.0). We took photos of a vegetated rock face from identical positions with all sensors. Then we compared the results of the different software packages regarding the ease of the workflow, visual appeal, similarity and quality of the point cloud. &lt;br&gt;&lt;br&gt; While PhotoScan and Pix4D offer the user-friendliest workflows, they are also “black-box” programmes giving only little insight into their processing. Unsatisfying results may only be changed by modifying settings within a module. The combined workflow of Visual SFM, SURE and CloudCompare is just as simple but requires more user interaction. MicMac turned out to be the most challenging software as it is less user-friendly. However, MicMac offers the most possibilities to influence the processing workflow. The resulting point-clouds of PhotoScan and MicMac are the most appealing.


Author(s):  
K. Zhou ◽  
B. Gorte ◽  
S. Zlatanova

(Semi)-automatic facade reconstruction from terrestrial LiDAR point clouds is often affected by both quality of point cloud itself and imperfectness of object recognition algorithms. In this paper, we employ regularities, which exist on façades, to mitigate these problems. For example, doors, windows and balconies often have orthogonal and parallel boundaries. Many windows are constructed with the same shape. They may be arranged at the same lines and distance intervals, so do different windows. By identifying regularities among objects with relatively poor quality, these can be applied to calibrate the objects and improve their quality. The paper focuses on the regularities among the windows, which is the majority of objects on the wall. Regularities are classified into three categories: within an individual window, among similar windows and among different windows. Nine cases are specified as a reference for exploration. A hierarchical clustering method is employed to identify and apply regularities in a feature space, where regularities can be identified from clusters. To find the corresponding features in the nine cases of regularities, two phases are distinguished for similar and different windows. In the first phase, ICP (iterative closest points) is used to identify groups of similar windows. The registered points and a number of transformation matrices are used to identify and apply regularities among similar windows. In the second phase, features are extracted from the boundaries of the different windows. When applying regularities by relocating windows, the connections, called chains, established among the similar windows in the first phase are preserved. To test the performance of the algorithms, two datasets from terrestrial LiDAR point clouds are used. Both show good effects on the reconstructed model, while still matching with original point cloud, preventing over or under-regularization.


Author(s):  
K. Zhou ◽  
B. Gorte ◽  
S. Zlatanova

(Semi)-automatic facade reconstruction from terrestrial LiDAR point clouds is often affected by both quality of point cloud itself and imperfectness of object recognition algorithms. In this paper, we employ regularities, which exist on façades, to mitigate these problems. For example, doors, windows and balconies often have orthogonal and parallel boundaries. Many windows are constructed with the same shape. They may be arranged at the same lines and distance intervals, so do different windows. By identifying regularities among objects with relatively poor quality, these can be applied to calibrate the objects and improve their quality. The paper focuses on the regularities among the windows, which is the majority of objects on the wall. Regularities are classified into three categories: within an individual window, among similar windows and among different windows. Nine cases are specified as a reference for exploration. A hierarchical clustering method is employed to identify and apply regularities in a feature space, where regularities can be identified from clusters. To find the corresponding features in the nine cases of regularities, two phases are distinguished for similar and different windows. In the first phase, ICP (iterative closest points) is used to identify groups of similar windows. The registered points and a number of transformation matrices are used to identify and apply regularities among similar windows. In the second phase, features are extracted from the boundaries of the different windows. When applying regularities by relocating windows, the connections, called chains, established among the similar windows in the first phase are preserved. To test the performance of the algorithms, two datasets from terrestrial LiDAR point clouds are used. Both show good effects on the reconstructed model, while still matching with original point cloud, preventing over or under-regularization.


Author(s):  
V. Walter ◽  
M. Kölle ◽  
D. Collmar ◽  
Y. Zhang

Abstract. In this article, we present a two-level approach for the crowd-based collection of vehicles from 3D point clouds. In the first level, the crowdworkers are asked to identify the coarse positions of vehicles in 2D rasterized shadings that were derived from the 3D point cloud. In order to increase the quality of the results, we utilize the wisdom of the crowd principle which says that averaging multiple estimates of a group of individuals provides an outcome that is often better than most of the underlying estimates or even better than the best estimate. For this, each crowd job is duplicated 10 times and the multiple results are integrated with a DBSCAN cluster algorithm. In the second level, we use the integrated results as pre-information for extracting small subsets of the 3D point cloud that are then presented to crowdworkers for approximating the included vehicle by means of a Minimum Bounding Box (MBB). Again, the crowd jobs are duplicated 10 times and an average bounding box is calculated from the individual bounding boxes. We will discuss the quality of the results of both steps and show that the wisdom of the crowd significantly improves the completeness as well as the geometric quality. With a tenfold acquisition, we have achieve a completeness of 93.3 percent and a geometric deviation of less than 1 m for 95 percent of the collected vehicles.


Sensors ◽  
2021 ◽  
Vol 21 (4) ◽  
pp. 1228
Author(s):  
Ting On Chan ◽  
Linyuan Xia ◽  
Yimin Chen ◽  
Wei Lang ◽  
Tingting Chen ◽  
...  

Ancient pagodas are usually parts of hot tourist spots in many oriental countries due to their unique historical backgrounds. They are usually polygonal structures comprised by multiple floors, which are separated by eaves. In this paper, we propose a new method to investigate both the rotational and reflectional symmetry of such polygonal pagodas through developing novel geometric models to fit to the 3D point clouds obtained from photogrammetric reconstruction. The geometric model consists of multiple polygonal pyramid/prism models but has a common central axis. The method was verified by four datasets collected by an unmanned aerial vehicle (UAV) and a hand-held digital camera. The results indicate that the models fit accurately to the pagodas’ point clouds. The symmetry was realized by rotating and reflecting the pagodas’ point clouds after a complete leveling of the point cloud was achieved using the estimated central axes. The results show that there are RMSEs of 5.04 cm and 5.20 cm deviated from the perfect (theoretical) rotational and reflectional symmetries, respectively. This concludes that the examined pagodas are highly symmetric, both rotationally and reflectionally. The concept presented in the paper not only work for polygonal pagodas, but it can also be readily transformed and implemented for other applications for other pagoda-like objects such as transmission towers.


Geosciences ◽  
2021 ◽  
Vol 11 (2) ◽  
pp. 75
Author(s):  
Dario Carrea ◽  
Antonio Abellan ◽  
Marc-Henri Derron ◽  
Neal Gauvin ◽  
Michel Jaboyedoff

The use of 3D point clouds to improve the understanding of natural phenomena is currently applied in natural hazard investigations, including the quantification of rockfall activity. However, 3D point cloud treatment is typically accomplished using nondedicated (and not optimal) software. To fill this gap, we present an open-source, specific rockfall package in an object-oriented toolbox developed in the MATLAB® environment. The proposed package offers a complete and semiautomatic 3D solution that spans from extraction to identification and volume estimations of rockfall sources using state-of-the-art methods and newly implemented algorithms. To illustrate the capabilities of this package, we acquired a series of high-quality point clouds in a pilot study area referred to as the La Cornalle cliff (West Switzerland), obtained robust volume estimations at different volumetric scales, and derived rockfall magnitude–frequency distributions, which assisted in the assessment of rockfall activity and long-term erosion rates. An outcome of the case study shows the influence of the volume computation on the magnitude–frequency distribution and ensuing erosion process interpretation.


Sensors ◽  
2020 ◽  
Vol 21 (1) ◽  
pp. 201
Author(s):  
Michael Bekele Maru ◽  
Donghwan Lee ◽  
Kassahun Demissie Tola ◽  
Seunghee Park

Modeling a structure in the virtual world using three-dimensional (3D) information enhances our understanding, while also aiding in the visualization, of how a structure reacts to any disturbance. Generally, 3D point clouds are used for determining structural behavioral changes. Light detection and ranging (LiDAR) is one of the crucial ways by which a 3D point cloud dataset can be generated. Additionally, 3D cameras are commonly used to develop a point cloud containing many points on the external surface of an object around it. The main objective of this study was to compare the performance of optical sensors, namely a depth camera (DC) and terrestrial laser scanner (TLS) in estimating structural deflection. We also utilized bilateral filtering techniques, which are commonly used in image processing, on the point cloud data for enhancing their accuracy and increasing the application prospects of these sensors in structure health monitoring. The results from these sensors were validated by comparing them with the outputs from a linear variable differential transformer sensor, which was mounted on the beam during an indoor experiment. The results showed that the datasets obtained from both the sensors were acceptable for nominal deflections of 3 mm and above because the error range was less than ±10%. However, the result obtained from the TLS were better than those obtained from the DC.


Sign in / Sign up

Export Citation Format

Share Document