A Vehicle-Borne Mobile Mapping System Based Framework for Semantic Segmentation and Modeling on Overhead Catenary System Using Deep Learning

Overhead catenary system (OCS) automatic detection is of important significance for the safe operation and maintenance of electrified railways. The vehicle-borne mobile mapping system (VMMS) may significantly improve the data acquisition. This paper proposes a VMMS-based framework to realize the automatic detection and modelling of OCS. The proposed framework performed semantic segmentation, model reconstruction and geometric parameters detection based on LiDAR point cloud using VMMS. Firstly, an enhanced VMMS is designed for accurate data generation. Secondly, an automatic searching method based on a two-level stereo frame is designed to filter the irrelevant non-OCS point cloud. Then, a deep learning network based on multi-scale feature fusion and an attention mechanism (MFF_A) is trained for semantic segmentation on a catenary facility. Finally, the 3D modelling is performed based on the OCS segmentation result, and geometric parameters are then extracted. The experimental case study was conducted on a 100 km high-speed railway in Guangxi, China. The experimental results show that the proposed framework has a better accuracy of 96.37%, outperforming other state-of-art methods for segmentation. Compared with traditional manual laser measurement, the proposed framework can achieve a trustable accuracy within 10 mm for OCS geometric parameter detection.

Automatic Registration of Mobile Mapping System Lidar Points and Panoramic-Image Sequences by Relative Orientation Model

To register mobile mapping system (MMS) lidar points and panoramic-image sequences, a relative orientation model of panoramic images (PROM) is proposed. The PROM is suitable for cases in which attitude or orientation parameters are unknown in the panoramic-image sequence. First, feature points are extracted and matched from panoramic-image pairs using the SURF algorithm. Second, these matched feature points are used to solve the relative attitude parameters in the PROM. Then, combining the PROM with the absolute position and attitude parameters of the initial panoramic image, the MMS lidar points and panoramic-image sequence are registered. Finally, the registration accuracy of the PROM method is assessed using corresponding points manually selected from the MMSlidar points and panoramic-image sequence. The results show that three types of MMSdata sources are registered accurately based on the proposed registration method. Our method transforms the registration of panoramic images and lidar points into image feature-point matching, which is suitable for diverse road scenes compared with existing methods.

Leveraging LiDAR Intensity to Evaluate Roadway Pavement Markings

The United States has over 8.8 million lane miles nationwide, which require regular maintenance and evaluations of sign retroreflectivity, pavement markings, and other pavement information. Pavement markings convey crucial information to drivers as well as connected and autonomous vehicles for lane delineations. Current means of evaluation are by human inspection or semi-automated dedicated vehicles, which often capture one to two pavement lines at a time. Mobile LiDAR is also frequently used by agencies to map signs and infrastructure as well as assess pavement conditions and drainage profiles. This paper presents a case study where over 70 miles of US-52 and US-41 in Indiana were assessed, utilizing both a mobile retroreflectometer and a LiDAR mobile mapping system. Comparing the intensity data from LiDAR data and the retroreflective readings, there was a linear correlation for right edge pavement markings with an R2 of 0.87 and for the center skip line a linear correlation with an R2 of 0.63. The p-values were 0.000 and 0.000, respectively. Although there are no published standards for using LiDAR to evaluate pavement marking retroreflectivity, these results suggest that mobile LiDAR is a viable tool for network level monitoring of retroreflectivity.

COMPARISON OF MULTI-SOURCE DATA, INTEGRATED SURVEY FOR COMPLEX ARCHITECTURE DOCUMENTATION

The metric documentation of architectural complexes requires today the use of several integrated survey methodologies. This need is an answer to the morphology of the object such as dimension, geometry, inaccessible areas and urban context. These properties inhibit the use of single surveying techniques and force the integration of Geomatics tools. In addition, the metric documentation of Cultural heritage objects not always requires uniform accuracy and resolution, therefore the integration of different surveying methodologies and techniques become the only effective solution both from a technical and economic point of view. The integration, that is today adopted as normal strategy, allows also the better understanding of the benefits which can arise to speed up the metric documentation of Cultural Heritage objects and the benefits that each of the possible surveying techniques can have thanks to the integration of the different potentialities. This study starting from an integrated survey, performed whit a combined use of Mobile Mapping System (MMS), Unmanned Aerial Vehicles (UAV) and Terrestrial Laser Scanner (TLS) and show the results of the comparisons between the possible achievable accuracies by using a correct integration between the different used technologies and the ones achievable by using the same techniques as independent tools.The case study is the architectural complex of the Ducal Palace in Gubbio (Italy), located upstream of the most important town square facing the cathedral in a very complex but realistic urban context.

INVESTIGATING THE PERFORMANCE OF A HANDHELD MOBILE MAPPING SYSTEM IN DIFFERENT OUTDOOR SCENARIOS

In recent years, portable Mobile Mapping Systems (MMSs) are emerging as valuable survey instruments for fast and efficient mapping of both internal and external environments. The aim of this work is to assess the performance of a commercial handheld MMS, Gexcel HERON Lite, in two different outdoor applications. The first is the mapping of a large building, which represents a standard use-case scenario of this technology. Through the second case study, that consists in the survey of a torrent reach, we investigate instead the applicability of the handheld MMS for natural environment monitoring, a field in which portable systems are not yet widely employed. Quantitative and qualitative assessment is presented, comparing the point clouds obtained from the HERON Lite system against reference models provided by traditional techniques (i.e., Terrestrial Laser Scanning and Photogrammetry).