scholarly journals Bridge Crack Semantic Segmentation Based on Improved Deeplabv3+

2021 ◽  
Vol 9 (6) ◽  
pp. 671
Author(s):  
Huixuan Fu ◽  
Dan Meng ◽  
Wenhui Li ◽  
Yuchao Wang
Keyword(s):  
Crack Detection ◽  
Detection Method ◽  
Semantic Segmentation ◽  
Learning Technology ◽  
Data Set ◽  
Original Algorithm ◽  
Bridge Maintenance ◽  
Segmentation Accuracy ◽  
Spatial Pyramid Pooling ◽  
Traditional Image

Cracks are the main goal of bridge maintenance and accurate detection of cracks will help ensure their safe use. Aiming at the problem that traditional image processing methods are difficult to accurately detect cracks, deep learning technology was introduced and a crack detection method based on an improved DeepLabv3+ semantic segmentation algorithm was proposed. In the network structure, the densely connected atrous spatial pyramid pooling module was introduced into the DeepLabv3+ network, which enabled the network to obtain denser pixel sampling, thus enhancing the ability of the network to extract detail features. While obtaining a larger receptive field, the number of network parameters was consistent with the original algorithm. The images of bridge cracks under different environmental conditions were collected, and then a concrete bridge crack segmentation data set was established, and the segmentation model was obtained through end-to-end training of the network. The experimental results showed that the improved DeepLabv3+ algorithm had higher crack segmentation accuracy than the original DeepLabv3+ algorithm, with an average intersection ratio reaching 82.37%, and the segmentation of crack details was more accurate, which proved the effectiveness of the proposed algorithm.

scholarly journals Automatic Tunnel Crack Detection Based on U-Net and a Convolutional Neural Network with Alternately Updated Clique

Sensors ◽  
2020 ◽  
Vol 20 (3) ◽  
pp. 717 ◽  
Author(s):  
Gang Li ◽  
Biao Ma ◽  
Shuanhai He ◽  
Xueli Ren ◽  
Qiangwei Liu
Keyword(s):  
Neural Network ◽  
Convolutional Neural Network ◽  
Crack Width ◽  
Crack Detection ◽  
Detection Method ◽  
Learning Algorithm ◽  
Semantic Segmentation ◽  
Fully Convolutional Networks ◽  
Deep Learning Algorithm ◽  
Mean Width

Regular crack inspection of tunnels is essential to guarantee their safe operation. At present, the manual detection method is time-consuming, subjective and even dangerous, while the automatic detection method is relatively inaccurate. Detecting tunnel cracks is a challenging task since cracks are tiny, and there are many noise patterns in the tunnel images. This study proposes a deep learning algorithm based on U-Net and a convolutional neural network with alternately updated clique (CliqueNet), called U-CliqueNet, to separate cracks from background in the tunnel images. A consumer-grade DSC-WX700 camera (SONY, Wuxi, China) was used to collect 200 original images, then cracks are manually marked and divided into sub-images with a resolution of 496   ×   496 pixels. A total of 60,000 sub-images were obtained in the dataset of tunnel cracks, among which 50,000 were used for training and 10,000 were used for testing. The proposed framework conducted training and testing on this dataset, the mean pixel accuracy (MPA), mean intersection over union (MIoU), precision and F1-score are 92.25%, 86.96%, 86.32% and 83.40%, respectively. We compared the U-CliqueNet with fully convolutional networks (FCN), U-net, Encoder–decoder network (SegNet) and the multi-scale fusion crack detection (MFCD) algorithm using hypothesis testing, and it’s proved that the MIoU predicted by U-CliqueNet was significantly higher than that of the other four algorithms. The area, length and mean width of cracks can be calculated, and the relative error between the detected mean crack width and the actual mean crack width ranges from −11.20% to 18.57%. The results show that this framework can be used for fast and accurate crack semantic segmentation of tunnel images.

scholarly journals Panicle-3D: Efficient Phenotyping Tool for Precise Semantic Segmentation of Rice Panicle Point Cloud

2021 ◽  
Vol 2021 ◽  
pp. 1-9
Author(s):  
Liang Gong ◽  
Xiaofeng Du ◽  
Kai Zhu ◽  
Ke Lin ◽  
Qiaojun Lou ◽  
...  
Keyword(s):  
Point Cloud ◽  
Network Models ◽  
Semantic Segmentation ◽  
Spatial Location ◽  
Point Clouds ◽  
Utilization Efficiency ◽  
Data Set ◽  
Cloud Data ◽  
Point Cloud Segmentation ◽  
Segmentation Accuracy

The automated measurement of crop phenotypic parameters is of great significance to the quantitative study of crop growth. The segmentation and classification of crop point cloud help to realize the automation of crop phenotypic parameter measurement. At present, crop spike-shaped point cloud segmentation has problems such as fewer samples, uneven distribution of point clouds, occlusion of stem and spike, disorderly arrangement of point clouds, and lack of targeted network models. The traditional clustering method can realize the segmentation of the plant organ point cloud with relatively independent spatial location, but the accuracy is not acceptable. This paper first builds a desktop-level point cloud scanning apparatus based on a structured-light projection module to facilitate the point cloud acquisition process. Then, the rice ear point cloud was collected, and the rice ear point cloud data set was made. In addition, data argumentation is used to improve sample utilization efficiency and training accuracy. Finally, a 3D point cloud convolutional neural network model called Panicle-3D was designed to achieve better segmentation accuracy. Specifically, the design of Panicle-3D is aimed at the multiscale characteristics of plant organs, combined with the structure of PointConv and long and short jumps, which accelerates the convergence speed of the network and reduces the loss of features in the process of point cloud downsampling. After comparison experiments, the segmentation accuracy of Panicle-3D reaches 93.4%, which is higher than PointNet. Panicle-3D is suitable for other similar crop point cloud segmentation tasks.

scholarly journals Solder Joint Defect Detection in the Connectors Using Improved Faster-RCNN Algorithm

2021 ◽  
Vol 11 (2) ◽  
pp. 576
Author(s):  
Kaihua Zhang ◽  
Haikuo Shen
Keyword(s):  
Solder Joint ◽  
Defect Detection ◽  
Data Augmentation ◽  
Detection Method ◽  
Detection Algorithm ◽  
Detection Methods ◽  
Detection Accuracy ◽  
Data Set ◽  
Electronic Products ◽  
Original Algorithm

The miniaturization and high integration of electronic products have higher and higher requirements for welding of internal components of electronic products. A welding quality detection method has always been one of the important research contents in the industry, among which, the research on solder joint defect detection of a connector has gradually attracted people’s attention with the development of image detection algorithm. The traditional solder joint detection method of connector adopts manual detection or automatic detection methods, which is inefficient and not safe enough. With the development of deep learning, the application of a deep convolutional neural network to target detection has become a research hotspot. In this paper, a data set of connector solder joint samples was made and the number of image samples was expanded to more than 3 times of the original by using data augmentation. Clustering generates anchor boxes and transfer learning with ResNet-101 were fused, so an improved faster region-based convolutional neural networks (Faster RCNN) algorithm was proposed. The experiment verified that the improved algorithm proposed in this paper had a great improvement in all aspects compared with the original algorithm. The average detection accuracy of this method can reach 94%, and the detection rate of some defects can even reach 100%, which can completely meet the industrial requirements.

Asphalt pavement crack detection based on multi-scale full convolutional network

2021 ◽  
Vol 40 (1) ◽  
pp. 1495-1508
Author(s):  
Yangxu Wu ◽  
Wanting Yang ◽  
Jinxiao Pan ◽  
Ping Chen
Keyword(s):  
Crack Detection ◽  
Asphalt Pavement ◽  
Semantic Segmentation ◽  
Svm Classifier ◽  
Convolutional Network ◽  
Data Set ◽  
Important Indicator ◽  
Standard Data ◽  
Multi Scale ◽  
Pavement Crack Detection

Pavement crack assessment is an important indicator for evaluating road health. However, due to the dark color of the asphalt pavement and the texture characteristics of the pavement, current asphalt pavement crack detection technology cannot meet the requirements of accuracy and efficiency. In this paper, we propose an end-to-end multi-scale full convolutional neural network to achieve the semantic segmentation of cracks in road images by learning the crack characteristics in the complex fine grain background of asphalt pavement. The method uses DenseNet and deconvolution network framework to achieve pixel-level detection and fuses features learned from different scales of convolutional kernels through a full convolutional network to obtain richer information on multi-scale features, allowing more detailed representation of crack features in high-resolution images. And the back end joins the SVM classifier to achieve crack classification after crack segmentation. Then we create a road test standard data set containing 12 cracks and evaluate it on the data. The experimental results show that the method achieves good segmentation effect for 12 types of cracks, and the crack segmentation for asphalt pavement is better than the most advanced methods.

scholarly journals Automatic Bridge Crack Detection Using a Convolutional Neural Network

2019 ◽  
Vol 9 (14) ◽  
pp. 2867 ◽  
Author(s):  
Hongyan Xu ◽  
Xiu Su ◽  
Yi Wang ◽  
Huaiyu Cai ◽  
Kerang Cui ◽  
...  
Keyword(s):  
Neural Network ◽  
Convolutional Neural Network ◽  
Crack Detection ◽  
Transportation Safety ◽  
Detection Accuracy ◽  
Learning Technology ◽  
Convolutional Network ◽  
Detection Model ◽  
Proposed Model ◽  
Spatial Pyramid Pooling

Concrete bridge crack detection is critical to guaranteeing transportation safety. The introduction of deep learning technology makes it possible to automatically and accurately detect cracks in bridges. We proposed an end-to-end crack detection model based on the convolutional neural network (CNN), taking the advantage of atrous convolution, Atrous Spatial Pyramid Pooling (ASPP) module and depthwise separable convolution. The atrous convolution obtains a larger receptive field without reducing the resolution. The ASPP module enables the network to extract multi-scale context information, while the depthwise separable convolution reduces computational complexity. The proposed model achieved a detection accuracy of 96.37% without pre-training. Experiments showed that, compared with traditional classification models, the proposed model has a better performance. Besides, the proposed model can be embedded in any convolutional network as an effective feature extraction structure.

scholarly journals Deep Neural Network-Based Semantic Segmentation of Microvascular Decompression Images

Sensors ◽  
2021 ◽  
Vol 21 (4) ◽  
pp. 1167
Author(s):  
Ruifeng Bai ◽  
Shan Jiang ◽  
Haijiang Sun ◽  
Yifan Yang ◽  
Guiju Li
Keyword(s):  
Semantic Segmentation ◽  
Fine Tuning ◽  
Cerebral Vessel ◽  
Current State ◽  
Proposed Model ◽  
Segmentation Accuracy ◽  
Spatial Pyramid Pooling ◽  
Boundary Information ◽  
True Color ◽  
Good Research

Image semantic segmentation has been applied more and more widely in the fields of satellite remote sensing, medical treatment, intelligent transportation, and virtual reality. However, in the medical field, the study of cerebral vessel and cranial nerve segmentation based on true-color medical images is in urgent need and has good research and development prospects. We have extended the current state-of-the-art semantic-segmentation network DeepLabv3+ and used it as the basic framework. First, the feature distillation block (FDB) was introduced into the encoder structure to refine the extracted features. In addition, the atrous spatial pyramid pooling (ASPP) module was added to the decoder structure to enhance the retention of feature and boundary information. The proposed model was trained by fine tuning and optimizing the relevant parameters. Experimental results show that the encoder structure has better performance in feature refinement processing, improving target boundary segmentation precision, and retaining more feature information. Our method has a segmentation accuracy of 75.73%, which is 3% better than DeepLabv3+.

scholarly journals AIRPORT RUNWAY SEMANTIC SEGMENTATION BASED ON DCNN IN HIGH SPATIAL RESOLUTION REMOTE SENSING IMAGES

2020 ◽  
Vol XLII-3/W10 ◽  
pp. 361-366
Author(s):  
Z. C. Men ◽  
J. Jiang ◽  
X. Guo ◽  
L. J. Chen ◽  
D. S. Liu
Keyword(s):  
Remote Sensing ◽  
Detection Method ◽  
Semantic Segmentation ◽  
Cross Entropy ◽  
Remote Sensing Images ◽  
Data Set ◽  
Entropy Loss ◽  
South Korean ◽  
Airport Detection ◽  
Airport Runway

Abstract. Due to the diverse structure and complex background of airports, fast and accurate airport detection in remote sensing images is challenging. Currently, airport detection method is mostly based on boxes, but pixel-based detection method which identifies airport runway outline has been merely reported. In this paper, a framework using deep convolutional neural network is proposed to accurately identify runway contour from high resolution remote sensing images. Firstly, we make a large and medium airport runway semantic segmentation data set (excluding the south Korean region) including 1,464 airport runways. Then DeepLabv3 semantic segmentation network with cross-entropy loss is trained using airport runway dataset. After the training using cross-entropy loss, lovasz-softmax loss function is used to train network and improve the intersection-over-union (IoU) score by 5.9%. The IoU score 0.75 is selected as the threshold of whether the runway is detected and we get accuracy and recall are 96.64% and 94.32% respectively. Compared with the state-of-the-art method, our method improves 1.3% and 1.6% of accuracy and recall respectively. We extract the number of airport runway as well as their basic contours of all the Korean large and medium airports from the remote sensing images across South Korea. The results show that our method can effectively detect the runway contour from the remote sensing images of a large range of complex scenes, and can provide a reference for the detection of the airport.

Intelligent crack detection based on attention mechanism in convolution neural network

2021 ◽  
pp. 136943322098663
Author(s):  
Xiaoning Cui ◽  
Qicai Wang ◽  
Jinpeng Dai ◽  
Yanjin Xue ◽  
Yun Duan
Keyword(s):  
Neural Network ◽  
Crack Detection ◽  
Semantic Segmentation ◽  
Attention Mechanism ◽  
Data Set ◽  
Multi Scale ◽  
Critical Areas ◽  
Intelligent Detection ◽  
Segmentation Task ◽  
Segmentation Models

The intelligent detection of distress in concrete is a research hotspot in structural health monitoring. In this study, Att-Unet, an improved attention-mechanism fully convolutional neural network model, was proposed to realize end-to-end pixel-level crack segmentation. Att-Unet consists of three parts: encoding module, decoding module, and AG (Attention Gate) module. The benefits associated with this module can effectively extract multi-scale features of cracks, focus on critical areas, and reconstruct semantics, to significantly improve the crack segmentation capability of the Att-Unet model. On the same data set, the mainstream semantic segmentation models (FCN and Unet) were trained simultaneously. Upon comparing and analyzing the calculated results of Att-Unet model with those of FCN and Unet, the results are as follows: for crack images under different conditions, Att-Unet achieved better results in accuracy, precision and F1-scores. Besides, Att-Unet showed higher feature extraction accuracy and better generalization ability in the crack segmentation task.

scholarly journals A Real-Time Bridge Crack Detection Method Based on an Improved Inception-Resnet-v2 Structure

IEEE Access ◽  
2021 ◽  
pp. 1-1
Author(s):  
Jinkang Wang ◽  
Xiaohui He ◽  
Shao Faming ◽  
Guanlin Lu ◽  
Hu Cong ◽  
...  
Keyword(s):  
Real Time ◽  
Crack Detection ◽  
Detection Method
Sign in / Sign up

Export Citation Format

Share Document