scholarly journals Automated Indoor Image Localization to Support a Post-Event Building Assessment

Sensors ◽  
2020 ◽  
Vol 20 (6) ◽  
pp. 1610
Author(s):  
Xiaoyu Liu ◽  
Shirley J. Dyke ◽  
Chul Min Yeum ◽  
Ilias Bilionis ◽  
Ali Lenjani ◽  
...  

Image data remains an important tool for post-event building assessment and documentation. After each natural hazard event, significant efforts are made by teams of engineers to visit the affected regions and collect useful image data. In general, a global positioning system (GPS) can provide useful spatial information for localizing image data. However, it is challenging to collect such information when images are captured in places where GPS signals are weak or interrupted, such as the indoor spaces of buildings. The inability to document the images’ locations hinders the analysis, organization, and documentation of these images as they lack sufficient spatial context. In this work, we develop a methodology to localize images and link them to locations on a structural drawing. A stream of images can readily be gathered along the path taken through a building using a compact camera. These images may be used to compute a relative location of each image in a 3D point cloud model, which is reconstructed using a visual odometry algorithm. The images may also be used to create local 3D textured models for building-components-of-interest using a structure-from-motion algorithm. A parallel set of images that are collected for building assessment is linked to the image stream using time information. By projecting the point cloud model to the structural drawing, the images can be overlaid onto the drawing, providing clear context information necessary to make use of those images. Additionally, components- or damage-of-interest captured in these images can be reconstructed in 3D, enabling detailed assessments having sufficient geospatial context. The technique is demonstrated by emulating post-event building assessment and data collection in a real building.

10.29007/9sk3 ◽  
2020 ◽  
Author(s):  
Naai-Jung Shih ◽  
Cheng-Yu Hsieh ◽  
Yi Chen ◽  
Pei-Huang Diao

Traditional computer simulation is replaced by 3D scans of the temporary urban fabric in a Taiwan heritage site for the quantitative assessment of local evolvement. The transfer of as-built point cloud model to the vertical and horizontal sections enables the inspections of evolved openness types on an old street enclosed by building facades and remodeled building components. Temporary fabrics, which consist of the installations and components, are represented in terms of the modification ratio on facade. The ratio contributes to the balance between the maintenance of cultural identity and the development of supporting commercial facilities made by local efforts. The variation changes along the old street cross districts of preservation, commercial and residential areas. Result shows the highest ratio exist in commercial district, where the highest ground activity along the entire street has created a typology of T or enclosed section of open space, as shown in point cloud model which is so realistic that no former computer models can display.


Author(s):  
C. Altuntas

<p><strong>Abstract.</strong> Image based dense point cloud creation is easy and low-cost application for three dimensional digitization of small and large scale objects and surfaces. It is especially attractive method for cultural heritage documentation. Reprojection error on conjugate keypoints indicates accuracy of the model and keypoint localisation in this method. In addition, sequential registration of the images from large scale historical buildings creates big cumulative registration error. Thus, accuracy of the model should be increased with the control points or loop close imaging. The registration of point point cloud model into the georeference system is performed using control points. In this study historical Sultan Selim Mosque that was built in sixteen century by Great Architect Sinan was modelled via photogrammetric dense point cloud. The reprojection error and number of keypoints were evaluated for different base/length ratio. In addition, georeferencing accuracy was evaluated with many configuration of control points with loop and without loop closure imaging.</p>


Author(s):  
L. Zhang ◽  
P. van Oosterom ◽  
H. Liu

Abstract. Point clouds have become one of the most popular sources of data in geospatial fields due to their availability and flexibility. However, because of the large amount of data and the limited resources of mobile devices, the use of point clouds in mobile Augmented Reality applications is still quite limited. Many current mobile AR applications of point clouds lack fluent interactions with users. In our paper, a cLoD (continuous level-of-detail) method is introduced to filter the number of points to be rendered considerably, together with an adaptive point size rendering strategy, thus improve the rendering performance and remove visual artifacts of mobile AR point cloud applications. Our method uses a cLoD model that has an ideal distribution over LoDs, with which can remove unnecessary points without sudden changes in density as present in the commonly used discrete level-of-detail approaches. Besides, camera position, orientation and distance from the camera to point cloud model is taken into consideration as well. With our method, good interactive visualization of point clouds can be realized in the mobile AR environment, with both nice visual quality and proper resource consumption.


Symmetry ◽  
2019 ◽  
Vol 12 (1) ◽  
pp. 28 ◽  
Author(s):  
Chao Wang

In order to improve the accuracy of semantic model intrinsic detection, a skeleton-based high-level semantic model intrinsic self-symmetry detection method is proposed. The semantic analysis of the model set is realized by the uniform segmentation of the model within the same style, the component correspondence of the model between different styles, and the shape content clustering. Based on the results of clustering analysis, for a given three-dimensional (3D) point cloud model, according to the curve skeleton, the skeleton point pairs reflecting the symmetry between the model surface points are obtained by the election method, and the symmetry is extended to the model surface vertices according to these skeleton point pairs. With the help of skeleton, the symmetry of the point cloud model is obtained, and then the symmetry region of point cloud model is obtained by the symmetric correspondence matrix and spectrum method, so as to realize the intrinsic symmetry detection of the model. The experimental results show that the proposed method has the advantages of less time, high accuracy, and high reliability.


Agronomy ◽  
2019 ◽  
Vol 9 (11) ◽  
pp. 774 ◽  
Author(s):  
Sun ◽  
Wang ◽  
Ding ◽  
Lu ◽  
Sun

Information on fruit tree canopies is important for decision making in orchard management, including irrigation, fertilization, spraying, and pruning. An unmanned aerial vehicle (UAV) imaging system was used to establish an orchard three-dimensional (3D) point-cloud model. A row-column detection method was developed based on the probability density estimation and rapid segmentation of the point-cloud data for each apple tree, through which the tree canopy height, H, width, W, and volume, V, were determined for remote orchard canopy evaluation. When the ground sampling distance (GSD) was in the range of 2.13 to 6.69 cm/px, the orchard point-cloud model had a measurement accuracy of 100.00% for the rows and 90.86% to 98.20% for the columns. The coefficient of determination, R2, was in the range of 0.8497 to 0.9376, 0.8103 to 0.9492, and 0.8032 to 0.9148, respectively, and the average relative error was in the range of 1.72% to 3.42%, 2.18% to 4.92%, and 7.90% to 13.69%, respectively, among the H, W, and V values measured manually and by UAV photogrammetry. The results showed that UAV visual imaging is suitable for 3D morphological remote canopy evaluations, facilitates orchard canopy informatization, and contributes substantially to efficient management and control of modern standard orchards.


Sensors ◽  
2019 ◽  
Vol 19 (15) ◽  
pp. 3345 ◽  
Author(s):  
Guoxiang Sun ◽  
Xiaochan Wang ◽  
Ye Sun ◽  
Yongqian Ding ◽  
Wei Lu

Nondestructive plant growth measurement is essential for researching plant growth and health. A nondestructive measurement system to retrieve plant information includes the measurement of morphological and physiological information, but most systems use two independent measurement systems for the two types of characteristics. In this study, a highly integrated, multispectral, three-dimensional (3D) nondestructive measurement system for greenhouse tomato plants was designed. The system used a Kinect sensor, an SOC710 hyperspectral imager, an electric rotary table, and other components. A heterogeneous sensing image registration technique based on the Fourier transform was proposed, which was used to register the SOC710 multispectral reflectance in the Kinect depth image coordinate system. Furthermore, a 3D multiview RGB-D image-reconstruction method based on the pose estimation and self-calibration of the Kinect sensor was developed to reconstruct a multispectral 3D point cloud model of the tomato plant. An experiment was conducted to measure plant canopy chlorophyll and the relative chlorophyll content was measured by the soil and plant analyzer development (SPAD) measurement model based on a 3D multispectral point cloud model and a single-view point cloud model and its performance was compared and analyzed. The results revealed that the measurement model established by using the characteristic variables from the multiview point cloud model was superior to the one established using the variables from the single-view point cloud model. Therefore, the multispectral 3D reconstruction approach is able to reconstruct the plant multispectral 3D point cloud model, which optimizes the traditional two-dimensional image-based SPAD measurement method and can obtain a precise and efficient high-throughput measurement of plant chlorophyll.


Sign in / Sign up

Export Citation Format

Share Document