scholarly journals Real-Time Underwater Maritime Object Detection in Side-Scan Sonar Images Based on Transformer-YOLOv5

2021 ◽  
Vol 13 (18) ◽  
pp. 3555
Author(s):  
Yongcan Yu ◽  
Jianhu Zhao ◽  
Quanhua Gong ◽  
Chao Huang ◽  
Gen Zheng ◽  
...  
Keyword(s):  
Object Detection ◽  
Real Time ◽  
Target Recognition ◽  
Automatic Target Recognition ◽  
Target Localization ◽  
Average Precision ◽  
Image Preprocessing ◽  
Side Scan Sonar ◽  
Sonar Images ◽  
Underwater Target

To overcome the shortcomings of the traditional manual detection of underwater targets in side-scan sonar (SSS) images, a real-time automatic target recognition (ATR) method is proposed in this paper. This method consists of image preprocessing, sampling, ATR by integration of the transformer module and YOLOv5s (that is, TR–YOLOv5s), and target localization. By considering the target-sparse and feature-barren characteristics of SSS images, a novel TR–YOLOv5s network and a down-sampling principle are put forward, and the attention mechanism is introduced in the method to meet the requirements of accuracy and efficiency for underwater target recognition. Experiments verified the proposed method achieved 85.6% mean average precision (mAP) and 87.8% macro-F2 score, and brought 12.5% and 10.6% gains compared with the YOLOv5s network trained from scratch, and had the real-time recognition speed of about 0.068 s per image.

scholarly journals RT-Seg: A Real-Time Semantic Segmentation Network for Side-Scan Sonar Images

Sensors ◽  
2019 ◽  
Vol 19 (9) ◽  
pp. 1985
Author(s):  
Qi Wang ◽  
Meihan Wu ◽  
Fei Yu ◽  
Chen Feng ◽  
Kaige Li ◽  
...  
Keyword(s):  
High Resolution ◽  
Real Time ◽  
Autonomous Underwater Vehicle ◽  
Semantic Segmentation ◽  
Processing Unit ◽  
Real Time Processing ◽  
Side Scan Sonar ◽  
Network Training ◽  
Sonar Sensor ◽  
Sonar Images

Real-time processing of high-resolution sonar images is of great significance for the autonomy and intelligence of autonomous underwater vehicle (AUV) in complex marine environments. In this paper, we propose a real-time semantic segmentation network termed RT-Seg for Side-Scan Sonar (SSS) images. The proposed architecture is based on a novel encoder-decoder structure, in which the encoder blocks utilized Depth-Wise Separable Convolution and a 2-way branch for improving performance, and a corresponding decoder network is implemented to restore the details of the targets, followed by a pixel-wise classification layer. Moreover, we use patch-wise strategy for splitting the high-resolution image into local patches and applying them to network training. The well-trained model is used for testing high-resolution SSS images produced by sonar sensor in an onboard Graphic Processing Unit (GPU). The experimental results show that RT-Seg can greatly reduce the number of parameters and floating point operations compared to other networks. It runs at 25.67 frames per second on an NVIDIA Jetson AGX Xavier on 500*500 inputs with excellent segmentation result. Further insights on the speed and accuracy trade-off are discussed in this paper.

scholarly journals Comparison of YOLO v3, Faster R-CNN, and SSD for Real-Time Pill Identification

2021 ◽  
Author(s):  
Lu Tan ◽  
Tianran Huangfu ◽  
Liyao Wu ◽  
Wenying Chen
Keyword(s):  
Object Detection ◽  
Real Time ◽  
Hospital Pharmacy ◽  
Correct Identification ◽  
Single Shot ◽  
Average Precision ◽  
Basic Principles ◽  
Image Dataset ◽  
The Mean ◽  
Detection Speed

Abstract Background: The correct identification of pills is very important to ensure the safe administration of drugs to patients. We used three currently mainstream object detection models, respectively Faster R-CNN, Single Shot Multi-Box Detector (SSD), and You Only Look Once v3(YOLO v3), to identify pills and compare the associated performance.Methods: In this paper, we introduce the basic principles of three object detection models. We trained each algorithm on a pill image dataset and analyzed the performance of the three models to determine the best pill recognition model. Finally, these models are then used to detect difficult samples and compare the results.Results: The mean average precision (MAP) of Faster R-CNN reached 87.69% but YOLO v3 had a significant advantage in detection speed where the frames per second (FPS) was more than eight times than that of Faster R-CNN. This means that YOLO v3 can operate in real time with a high MAP of 80.17%. The YOLO v3 algorithm also performed better in the comparison of difficult sample detection results. In contrast, SSD did not achieve the highest score in terms of MAP or FPS.Conclusion: Our study shows that YOLO v3 has advantages in detection speed while maintaining certain MAP and thus can be applied for real-time pill identification in a hospital pharmacy environment.

scholarly journals Sonar image recognition of underwater target based on convolutional neural network

2021 ◽  
Vol 39 (2) ◽  
pp. 285-291
Author(s):  
Leilei Jin ◽  
Hong LIANG ◽  
Changsheng Yang
Keyword(s):  
Neural Network ◽  
Convolutional Neural Network ◽  
Image Recognition ◽  
Target Recognition ◽  
Saliency Detection ◽  
Image Features ◽  
Feature Maps ◽  
Sonar Image ◽  
Sonar Images ◽  
Underwater Target

Underwater target recognition is one core technology of underwater unmanned detection. To improve the accuracy of underwater automatic target recognition, a sonar image recognition method based on convolutional neural network was proposed and the underwater target recognition model was established according to the characteristics of sonar images. Firstly, the sonar image was segmented and clipped with a saliency detection method to reduce the dimension of input data, and to reduce the interference of image background to the feature extraction process. Secondly, by using stacked convolutional layers and pooling layers, the high-level semantic information of the target was automatically learned from the input sonar image, to avoid damaging the effective information caused by extracting image features manually. Finally, the spatial pyramid pooling method was used to extract the multi-scale information from the sonar feature maps, which was to make up for the lack of detailed information of sonar images and solve the problem caused by the inconsistent size of input images. On the collected sonar image dataset, the experimental results show that the target recognition accuracy of the present method can recognize underwater targets more accurately and efficiently than the conventional convolutional neural networks.

Sign in / Sign up

Export Citation Format

Share Document