scholarly journals Automatic Detection of Cracks in Asphalt Pavement Using Deep Learning to Overcome Weaknesses in Images and GIS Visualization

2021 ◽  
Vol 11 (3) ◽  
pp. 892
Author(s):  
Pang-jo Chun ◽  
Tatsuro Yamane ◽  
Yukino Tsuzuki
Keyword(s):  
Neural Network ◽  
Deep Learning ◽  
Convolutional Neural Network ◽  
Asphalt Pavement ◽  
Automatic Inspection ◽  
Mobile Mapping ◽  
Mapping System ◽  
Mobile Mapping System ◽  
High Crack ◽  
Pavement Damage

The crack ratio is one of the indices used to quantitatively evaluate the soundness of asphalt pavement. However, since the inspection of pavement requires much labor and cost, automatic inspection of pavement damage by image analysis is required in order to reduce the burden of such work. In this study, a system was constructed that automatically detects and evaluates cracks from images of pavement using a convolutional neural network, a kind of deep learning. The most novel aspect of this study is that the accuracy was recursively improved through retraining the convolutional neural network (CNN) by collecting images which had previously been incorrectly analyzed. Then, study and implementation were conducted of a system for plotting the results in a GIS. In addition, an experiment was carried out applying this system to images actually taken from an MMS (mobile mapping system), and this confirmed that the system had high crack evaluation performance.

scholarly journals Deep Learning Based Pavement Inspection Using Self-Reconfigurable Robot

Sensors ◽  
2021 ◽  
Vol 21 (8) ◽  
pp. 2595
Author(s):  
Balakrishnan Ramalingam ◽  
Abdullah Aamir Hayat ◽  
Mohan Rajesh Elara ◽  
Braulio Félix Gómez ◽  
Lim Yi ◽  
...  
Keyword(s):  
Deep Learning ◽  
Semantic Segmentation ◽  
High Accuracy ◽  
Experimental Results ◽  
Mobile Mapping ◽  
Mapping System ◽  
Mobile Mapping System ◽  
Reconfigurable Robot ◽  
Nvidia Gpu ◽  
Inspection Task

The pavement inspection task, which mainly includes crack and garbage detection, is essential and carried out frequently. The human-based or dedicated system approach for inspection can be easily carried out by integrating with the pavement sweeping machines. This work proposes a deep learning-based pavement inspection framework for self-reconfigurable robot named Panthera. Semantic segmentation framework SegNet was adopted to segment the pavement region from other objects. Deep Convolutional Neural Network (DCNN) based object detection is used to detect and localize pavement defects and garbage. Furthermore, Mobile Mapping System (MMS) was adopted for the geotagging of the defects. The proposed system was implemented and tested with the Panthera robot having NVIDIA GPU cards. The experimental results showed that the proposed technique identifies the pavement defects and litters or garbage detection with high accuracy. The experimental results on the crack and garbage detection are presented. It is found that the proposed technique is suitable for deployment in real-time for garbage detection and, eventually, sweeping or cleaning tasks.

Deep Learning for Asphalt Pavement Cracking Recognition Using Convolutional Neural Network

2017 ◽  
Author(s):  
Kelvin C. P. Wang ◽  
Allen Zhang ◽  
Joshua Qiang Li ◽  
Yue Fei ◽  
Cheng Chen ◽  
...  
Keyword(s):  
Neural Network ◽  
Deep Learning ◽  
Convolutional Neural Network ◽  
Asphalt Pavement

scholarly journals TACK PROJECT: TUNNEL AND BRIDGE AUTOMATIC CRACK MONITORING USING DEEP LEARNING AND PHOTOGRAMMETRY

2020 ◽  
Vol XLIII-B4-2020 ◽  
pp. 741-745
Author(s):  
V. Belloni ◽  
A. Sjölander ◽  
R. Ravanelli ◽  
M. Crespi ◽  
A. Nascetti
Keyword(s):  
Deep Learning ◽  
Crack Detection ◽  
Learning Algorithm ◽  
Primary Source ◽  
Large Set ◽  
Mobile Mapping ◽  
Ongoing Research ◽  
Infrastructure Monitoring ◽  
Mapping System ◽  
Mobile Mapping System

Abstract. Civil infrastructures, such as tunnels and bridges, are directly related to the overall economic and demographic growth of countries. The aging of these infrastructures increases the probability of catastrophic failures that results in loss of lives and high repair costs; all over the world, these factors drive the need for advanced infrastructure monitoring systems. For these reasons, in the last years, different types of devices and innovative infrastructure monitoring techniques have been investigated to automate the process and overcome the main limitation of standard visual inspections that are used nowadays. This paper presents some preliminary findings of an ongoing research project, named TACK, that combines advanced deep learning techniques and innovative photogrammetric algorithms to develop a monitoring system. Specifically, the project focuses on the development of an automatic procedure for crack detection and measurement using images of tunnels and bridges acquired with a mobile mapping system. In this paper, some preliminary results are shown to investigate the potential of a deep learning algorithm in detecting cracks occurred in concrete material. The model is a CNN (Convolutional Neural Network) based on the U-Net architecture; in this study, we tested the transferability of the model that has been trained on a small available labeled dataset and tested on a large set of images acquired using a customized mobile mapping system. The results have shown that it is possible to effectively detect cracks in unseen imagery and that the primary source of errors is the false positive detection of crack-like objects (i.e., contact wires, cables and tile borders).

scholarly journals Pavement Distress Detection with Deep Learning Using the Orthoframes Acquired by a Mobile Mapping System

2019 ◽  
Vol 9 (22) ◽  
pp. 4829 ◽  
Author(s):  
Andri Riid ◽  
Roland Lõuk ◽  
Rene Pihlak ◽  
Aleksei Tepljakov ◽  
Kristina Vassiljeva
Keyword(s):  
Deep Learning ◽  
Network Models ◽  
Successful Implementation ◽  
Neural Network Models ◽  
Mobile Mapping ◽  
Pavement Distress ◽  
Mapping System ◽  
Source Data ◽  
Mobile Mapping System ◽  
Pavement Distress Detection

The subject matter of this research article is automatic detection of pavement distress on highway roads using computer vision algorithms. Specifically, deep learning convolutional neural network models are employed towards the implementation of the detector. Source data for training the detector come in the form of orthoframes acquired by a mobile mapping system. Compared to our previous work, the orthoframes are generally of better quality, but more importantly, in this work, we introduce a manual preprocessing step: sets of orthoframes are carefully selected for training and manually digitized to ensure adequate performance of the detector. Pretrained convolutional neural networks are then fine-tuned for the problem of pavement distress detection. Corresponding experimental results are provided and analyzed and indicate a successful implementation of the detector.

scholarly journals A Vehicle-Borne Mobile Mapping System Based Framework for Semantic Segmentation and Modeling on Overhead Catenary System Using Deep Learning

2021 ◽  
Vol 13 (23) ◽  
pp. 4939
Author(s):  
Lei Xu ◽  
Shunyi Zheng ◽  
Jiaming Na ◽  
Yuanwei Yang ◽  
Chunlin Mu ◽  
...  
Keyword(s):  
Deep Learning ◽  
Point Cloud ◽  
Feature Fusion ◽  
Automatic Detection ◽  
Semantic Segmentation ◽  
Geometric Parameters ◽  
Mobile Mapping ◽  
Mapping System ◽  
Mobile Mapping System ◽  
Catenary System

Overhead catenary system (OCS) automatic detection is of important significance for the safe operation and maintenance of electrified railways. The vehicle-borne mobile mapping system (VMMS) may significantly improve the data acquisition. This paper proposes a VMMS-based framework to realize the automatic detection and modelling of OCS. The proposed framework performed semantic segmentation, model reconstruction and geometric parameters detection based on LiDAR point cloud using VMMS. Firstly, an enhanced VMMS is designed for accurate data generation. Secondly, an automatic searching method based on a two-level stereo frame is designed to filter the irrelevant non-OCS point cloud. Then, a deep learning network based on multi-scale feature fusion and an attention mechanism (MFF_A) is trained for semantic segmentation on a catenary facility. Finally, the 3D modelling is performed based on the OCS segmentation result, and geometric parameters are then extracted. The experimental case study was conducted on a 100 km high-speed railway in Guangxi, China. The experimental results show that the proposed framework has a better accuracy of 96.37%, outperforming other state-of-art methods for segmentation. Compared with traditional manual laser measurement, the proposed framework can achieve a trustable accuracy within 10 mm for OCS geometric parameter detection.

Convolutional Neural Network of Atomic Surface Structures to Predict Binding Energies for High-Throughput Screening of Catalysts

2019 ◽  
Author(s):  
Seoin Back ◽  
Junwoong Yoon ◽  
Nianhan Tian ◽  
Wen Zhong ◽  
Kevin Tran ◽  
...  
Keyword(s):  
Neural Network ◽  
Deep Learning ◽  
Convolutional Neural Network ◽  
High Throughput ◽  
High Throughput Screening ◽  
Binding Energies ◽  
Surface Structures ◽  
Voronoi Polyhedra ◽  
Atomic Surface

We present an application of deep-learning convolutional neural network of atomic surface structures using atomic and Voronoi polyhedra-based neighbor information to predict adsorbate binding energies for the application in catalysis.

scholarly journals Effectiveness of transfer learning for enhancing tumor classification with a convolutional neural network on frozen sections

2020 ◽  
Vol 10 (1) ◽  
Author(s):  
Young-Gon Kim ◽  
Sungchul Kim ◽  
Cristina Eunbee Cho ◽  
In Hye Song ◽  
Hee Jin Lee ◽  
...  
Keyword(s):  
Neural Network ◽  
Deep Learning ◽  
Convolutional Neural Network ◽  
Transfer Learning ◽  
Frozen Section ◽  
Medical Center ◽  
External Validation ◽  
Model Performance ◽  
Classification Model ◽  
Training Dataset

AbstractFast and accurate confirmation of metastasis on the frozen tissue section of intraoperative sentinel lymph node biopsy is an essential tool for critical surgical decisions. However, accurate diagnosis by pathologists is difficult within the time limitations. Training a robust and accurate deep learning model is also difficult owing to the limited number of frozen datasets with high quality labels. To overcome these issues, we validated the effectiveness of transfer learning from CAMELYON16 to improve performance of the convolutional neural network (CNN)-based classification model on our frozen dataset (N = 297) from Asan Medical Center (AMC). Among the 297 whole slide images (WSIs), 157 and 40 WSIs were used to train deep learning models with different dataset ratios at 2, 4, 8, 20, 40, and 100%. The remaining, i.e., 100 WSIs, were used to validate model performance in terms of patch- and slide-level classification. An additional 228 WSIs from Seoul National University Bundang Hospital (SNUBH) were used as an external validation. Three initial weights, i.e., scratch-based (random initialization), ImageNet-based, and CAMELYON16-based models were used to validate their effectiveness in external validation. In the patch-level classification results on the AMC dataset, CAMELYON16-based models trained with a small dataset (up to 40%, i.e., 62 WSIs) showed a significantly higher area under the curve (AUC) of 0.929 than those of the scratch- and ImageNet-based models at 0.897 and 0.919, respectively, while CAMELYON16-based and ImageNet-based models trained with 100% of the training dataset showed comparable AUCs at 0.944 and 0.943, respectively. For the external validation, CAMELYON16-based models showed higher AUCs than those of the scratch- and ImageNet-based models. Model performance for slide feasibility of the transfer learning to enhance model performance was validated in the case of frozen section datasets with limited numbers.

scholarly journals Matching Large Baseline Oblique Stereo Images Using an End-to-End Convolutional Neural Network

2021 ◽  
Vol 13 (2) ◽  
pp. 274
Author(s):  
Guobiao Yao ◽  
Alper Yilmaz ◽  
Li Zhang ◽  
Fei Meng ◽  
Haibin Ai ◽  
...  
Keyword(s):  
Neural Network ◽  
Deep Learning ◽  
Convolutional Neural Network ◽  
Stereo Matching ◽  
Least Square ◽  
Affine Invariant ◽  
Stereo Images ◽  
Distance Ratio ◽  
Matching Algorithm ◽  
End To End

The available stereo matching algorithms produce large number of false positive matches or only produce a few true-positives across oblique stereo images with large baseline. This undesired result happens due to the complex perspective deformation and radiometric distortion across the images. To address this problem, we propose a novel affine invariant feature matching algorithm with subpixel accuracy based on an end-to-end convolutional neural network (CNN). In our method, we adopt and modify a Hessian affine network, which we refer to as IHesAffNet, to obtain affine invariant Hessian regions using deep learning framework. To improve the correlation between corresponding features, we introduce an empirical weighted loss function (EWLF) based on the negative samples using K nearest neighbors, and then generate deep learning-based descriptors with high discrimination that is realized with our multiple hard network structure (MTHardNets). Following this step, the conjugate features are produced by using the Euclidean distance ratio as the matching metric, and the accuracy of matches are optimized through the deep learning transform based least square matching (DLT-LSM). Finally, experiments on Large baseline oblique stereo images acquired by ground close-range and unmanned aerial vehicle (UAV) verify the effectiveness of the proposed approach, and comprehensive comparisons demonstrate that our matching algorithm outperforms the state-of-art methods in terms of accuracy, distribution and correct ratio. The main contributions of this article are: (i) our proposed MTHardNets can generate high quality descriptors; and (ii) the IHesAffNet can produce substantial affine invariant corresponding features with reliable transform parameters.

Sign in / Sign up

Export Citation Format

Share Document