scholarly journals PROJECTOR-BASED AUGMENTED REALITY FOR QUALITY INSPECTION OF SCANNED OBJECTS

Author(s):  
J. Kern ◽  
M. Weinmann ◽  
S. Wursthorn

After scanning or reconstructing the geometry of objects, we need to inspect the result of our work. Are there any parts missing? Is every detail covered in the desired quality? We typically do this by looking at the resulting point clouds or meshes of our objects on-screen. What, if we could see the information directly visualized on the object itself? Augmented reality is the generic term for bringing virtual information into our real environment. In our paper, we show how we can project any 3D information like thematic visualizations or specific monitoring information with reference to our object onto the object’s surface itself, thus augmenting it with additional information. For small objects that could for instance be scanned in a laboratory, we propose a low-cost method involving a projector-camera system to solve this task. The user only needs a calibration board with coded fiducial markers to calibrate the system and to estimate the projector’s pose later on for projecting textures with information onto the object’s surface. Changes within the projected 3D information or of the projector’s pose will be applied in real-time. Our results clearly reveal that such a simple setup will deliver a good quality of the augmented information.

Author(s):  
D. Pagliari ◽  
N. E. Cazzaniga ◽  
L. Pinto

Nowadays, devices and applications that require navigation solutions are continuously growing. For instance, consider the increasing demand of mapping information or the development of applications based on users’ location. In some case it could be sufficient an approximate solution (e.g. at room level), but in the large amount of cases a better solution is required. <br><br> The navigation problem has been solved from a long time using Global Navigation Satellite System (GNSS). However, it can be unless in obstructed areas, such as in urban areas or inside buildings. An interesting low cost solution is photogrammetry, assisted using additional information to scale the photogrammetric problem and recovering a solution also in critical situation for image-based methods (e.g. poor textured surfaces). In this paper, the use of assisted photogrammetry has been tested for both outdoor and indoor scenarios. Outdoor navigation problem has been faced developing a positioning system with Ground Control Points extracted from urban maps as constrain and tie points automatically extracted from the images acquired during the survey. The proposed approach has been tested under different scenarios, recovering the followed trajectory with an accuracy of 0.20 m. <br><br> For indoor navigation a solution has been thought to integrate the data delivered by Microsoft Kinect, by identifying interesting features on the RGB images and re-projecting them on the point clouds generated from the delivered depth maps. Then, these points have been used to estimate the rotation matrix between subsequent point clouds and, consequently, to recover the trajectory with few centimeters of error.


Materials ◽  
2021 ◽  
Vol 14 (18) ◽  
pp. 5187
Author(s):  
Víctor Meana ◽  
Eduardo Cuesta ◽  
Braulio J. Álvarez

To ensure that measurements can be made with non-contact metrology technologies, it is necessary to use verification and calibration procedures using precision artefacts as reference elements. In this environment, the need for increasingly accurate but also more cost-effective calibration artefacts is a clear demand in industry. The aim of this work is to demonstrate the feasibility of using low-cost precision spheres as reference artefacts in calibration and verification procedures of non-contact metrological equipment. Specifically, low-cost precision stainless steel spheres are used as reference artefacts. Obviously, for such spheres to be used as standard artefacts, it is necessary to change their optical behavior by removing their high brightness. For this purpose, the spheres are subjected to a manual sandblasting process, which is also a very low-cost process. The equipment used to validate the experiment is a laser triangulation sensor mounted on a Coordinate Measuring Machine (CMM). The CMM touch probe, which is much more accurate, will be used as a device for measuring the influence of sandblasting on the spheres. Subsequently, the influence of this post-processing is also checked with the laser triangulation sensor. Ultimately, the improvement in the quality of the point clouds captured by the laser sensor will be tested after removing the brightness, which distorts and reduces the quantity of points as well as the quality of the point clouds. In addition to the number of points obtained, the parameters used to study the effect of sandblasting on each sphere, both in contact probing and laser scanning, are the measured diameter, the form error, as well as the standard deviation of the point cloud regarding the best-fit sphere.


Author(s):  
S. Altman ◽  
W. Xiao ◽  
B. Grayson

Terrestrial photogrammetry is an accessible method of 3D digital modelling, and can be done with low-cost consumer grade equipment. Globally there are many undocumented buildings, particularly in the developing world, that could benefit from 3D modelling for documentation, redesign or restoration. Areas with buildings at risk of destruction by natural disaster or war could especially benefit. This study considers a range of variables that affect the quality of photogrammetric results. Different point clouds of the same building are produced with different variables, and they are systematically tested to see how the output was affected. This is done by geometrically comparing them to a laser scanned point cloud of the same building. It finally considers how best results can be achieved for different applications, how to mitigate negative effects, and the limits of this technique.


Author(s):  
A. Scianna ◽  
G. F. Gaglio ◽  
M. La Guardia

Abstract. The case study, faced in this paper, arises in the context of Interreg Italia-Malta European project named I-Access, dedicated to the improvement of accessibility to Cultural Heritage (CH). Accessibility considered not only as the demolition of physical architectural barriers, but also as the possibility of fruition of CH through technological tools that can increase its perception and knowledge. Last achievements in photogrammetry and terrestrial laser scanner (TLS) technology offered new methods of data acquisition in the field of CH, giving the possibility of monitoring and processing big data, in the form of point clouds. Ever in this field, reverse engineering techniques and computer graphics are even more used for involving visitors to discover CH, with navigation into 3D reconstructions, empowering the real visualization adding further 3D information through the Augmented Reality (AR). At the same time, recent advances on rapid prototyping technologies grant the automated 3D printing of scaled 3D model reconstructions of real CH elements allowing the tactile fruition of visitors that suffer from visual defects and the connection with 3D AR visualizations. The presented work shows how these technologies could revive an historical square, the Piazza Garraffo in Palermo (Italy), with the virtual insertion of its baroque fountain, originally placed there. The final products of this work are an indoor and an outdoor AR mobile application, that allow the visualization of the historical original asset of the square. This study case shows how the mixing of AR and the rapid prototyping technologies could be useful for the improvement of the fruition of CH. This work could be considered a multidisciplinary experimentation, where different technologies, today still in development, contribute to the same goal aimed at improving the accessibility of the monument for enhancing the fruition of CH.


Sensors ◽  
2019 ◽  
Vol 19 (3) ◽  
pp. 700 ◽  
Author(s):  
Anna Fryskowska

Three-dimensional (3D) mapping of power lines is very important for power line inspection. Many remotely-sensed data products like light detection and ranging (LiDAR) have been already studied for power line surveys. More and more data are being obtained via photogrammetric measurements. This increases the need for the implementation of advanced processing techniques. In recent years, there have been several developments in visualisation techniques using UAV (unmanned aerial vehicle) platform photography. The most modern of such imaging systems have the ability to generate dense point clouds. However, image-based point cloud accuracy is very often various (unstable) and dependent on the radiometric quality of images and the efficiency of image processing algorithms. The main factor influencing the point cloud quality is noise. Such problems usually arise with data obtained via low-cost UAV platforms. Therefore, generated point clouds representing power lines are usually incomplete and noisy. To obtain a complete and accurate 3D model of power lines and towers, it is necessary to develop improved data processing algorithms. The experiment tested the algorithms on power lines with different voltages. This paper presents the wavelet-based method of processing data acquired with a low-cost UAV camera. The proposed, original method involves the application of algorithms for coarse filtration and precise filtering. In addition, a new way of calculating the recommended flight height was proposed. At the end, the accuracy assessment of this two-stage filtration process was examined. For this, point quality indices were proposed. The experimental results show that the proposed algorithm improves the quality of low-cost point clouds. The proposed methods improve the accuracy of determining the parameters of the lines by more than twice. About 10% of noise is reduced by using the wavelet-based approach.


2020 ◽  
Vol 12 (8) ◽  
pp. 1240 ◽  
Author(s):  
Xabier Blanch ◽  
Antonio Abellan ◽  
Marta Guinau

The emerging use of photogrammetric point clouds in three-dimensional (3D) monitoring processes has revealed some constraints with respect to the use of LiDAR point clouds. Oftentimes, point clouds (PC) obtained by time-lapse photogrammetry have lower density and precision, especially when Ground Control Points (GCPs) are not available or the camera system cannot be properly calibrated. This paper presents a new workflow called Point Cloud Stacking (PCStacking) that overcomes these restrictions by making the most of the iterative solutions in both camera position estimation and internal calibration parameters that are obtained during bundle adjustment. The basic principle of the stacking algorithm is straightforward: it computes the median of the Z coordinates of each point for multiple photogrammetric models to give a resulting PC with a greater precision than any of the individual PC. The different models are reconstructed from images taken simultaneously from, at least, five points of view, reducing the systematic errors associated with the photogrammetric reconstruction workflow. The algorithm was tested using both a synthetic point cloud and a real 3D dataset from a rock cliff. The synthetic data were created using mathematical functions that attempt to emulate the photogrammetric models. Real data were obtained by very low-cost photogrammetric systems specially developed for this experiment. Resulting point clouds were improved when applying the algorithm in synthetic and real experiments, e.g., 25th and 75th error percentiles were reduced from 3.2 cm to 1.4 cm in synthetic tests and from 1.5 cm to 0.5 cm in real conditions.


Author(s):  
D. Holdener ◽  
S. Nebiker ◽  
S. Blaser

The demand for capturing indoor spaces is rising with the digitalization trend in the construction industry. An efficient solution for measuring challenging indoor environments is mobile mapping. Image-based systems with 360° panoramic coverage allow a rapid data acquisition and can be processed to georeferenced 3D images hosted in cloud-based 3D geoinformation services. For the multiview stereo camera system presented in this paper, a 360° coverage is achieved with a layout consisting of five horizontal stereo image pairs in a circular arrangement. The design is implemented as a low-cost solution based on a 3D printed camera rig and action cameras with fisheye lenses. The fisheye stereo system is successfully calibrated with accuracies sufficient for the applied measurement task. A comparison of 3D distances with reference data delivers maximal deviations of 3 cm on typical distances in indoor space of 2-8 m. Also the automatic computation of coloured point clouds from the stereo pairs is demonstrated.


Author(s):  
R. Rofallski ◽  
C. Tholen ◽  
P. Helmholz ◽  
I. Parnum ◽  
T. Luhmann

Abstract. Artificial reefs provide an efficient way to improve marine life abundance in the oceans, including growth on the structure itself. Photogrammetric methods provide suitable tools to measure marine growth. This paper focusses on cubic reefs placed in Western Australia. The capturing platform featured a photogrammetric multi-sensor system for unmanned underwater vehicles attached to a low-cost vehicle BlueROV2. The multi-sensor system and its photogrammetric data captured was calibrated, adjusted and analyzed employing a structure-from-motion processing pipeline. Novel automated image masking techniques were developed and applied to the data to significantly reduce noise in the derived dense point clouds. Results show improvements of signal to noise ratio of more than 50 %, while maintaining a complete representation of the observed artificial reef.


2019 ◽  
Vol 11 (6) ◽  
pp. 717 ◽  
Author(s):  
Jianping Li ◽  
Bisheng Yang ◽  
Yangzi Cong ◽  
Lin Cao ◽  
Xiaoyao Fu ◽  
...  

Automatic 3D forest mapping and individual tree characteristics estimation are essential for forest management and ecosystem maintenance. The low-cost unmanned aerial vehicle (UAV) laser scanning (ULS) is a newly developed tool for cost-effectively collecting 3D information and attempts to use it for 3D forest mapping have been made, due to its capability to provide 3D information with a lower cost and higher flexibility than the standard ULS and airborne laser scanning (ALS). As the direct georeferenced point clouds may suffer from distortion caused by the poor performance of a low-cost inertial measurement unit (IMU), and 3D forest mapping using low-cost ULS poses a great challenge. Therefore, this paper utilized global navigation satellite system (GNSS) and IMU aided Structure-from-Motion (SfM) for trajectory estimation, and, hence, overcomes the poor performance of low-cost IMUs. The accuracy of the low-cost ULS point clouds was compared with the ground truth data collected by a commercial ULS system. Furthermore, the effectiveness of individual trees segmentation and tree characteristics estimation derived from the low-cost ULS point clouds were accessed. Experiments were undertaken in Dongtai forest farm, Yancheng City, Jiangsu Province, China. The results showed that the low-cost ULS achieved good point clouds quality from visual inspection and comparable individual tree segmentation results (P = 0.87, r = 0.84, F= 0.85) with the commercial system. Individual tree height estimation performed well (coefficient of determination (R2 ) = 0.998, root-mean-square error (RMSE) = 0.323 m) using the low-cost ULS. As for individual tree crown diameter estimation, low-cost ULS achieved good results (R2 = 0.806, RMSE = 0.195 m) after eliminating outliers. In general, such results illustrated the high potential of the low-cost ULS in 3D forest mapping, even though 3D forest mapping using the low-cost ULS requires further research.


2020 ◽  
Vol 9 (4) ◽  
pp. 269 ◽  
Author(s):  
Efstathios Adamopoulos ◽  
Fulvio Rinaudo

Passive sensors, operating in the visible (VIS) spectrum, have widely been used towards the trans-disciplinary documentation, understanding, and protection of tangible cultural heritage (CH). Although, many heritage science fields benefit significantly from additional information that can be acquired in the near-infrared (NIR) spectrum. NIR imagery, captured for heritage applications, has been mostly investigated with two-dimensional (2D) approaches or by 2D-to-three-dimensional (3D) integrations following complicated techniques, including expensive imaging sensors and setups. The availability of high-resolution digital modified cameras and software implementations of Structure-from-Motion (SfM) and Multiple-View-Stereo (MVS) algorithms, has made the production of models with spectral textures more feasible than ever. In this research, a short review of image-based 3D modeling with NIR data is attempted. The authors aim to investigate the use of near-infrared imagery from relatively low-cost modified sensors for heritage digitization, alongside the usefulness of spectral textures produced, oriented towards heritage science. Therefore, thorough experimentation and assessment with different software are conducted and presented, utilizing NIR imagery and SfM/MVS methods. Dense 3D point clouds and textured meshes have been produced and evaluated for their metric validity and radiometric quality, comparing to results produced from VIS imagery. The datasets employed come from heritage assets of different dimensions, from an archaeological site to a medium-sized artwork, to evaluate implementation on different levels of accuracy and specifications of texture resolution.


Sign in / Sign up

Export Citation Format

Share Document