scholarly journals DEEP LEARNING FOR VESSEL DETECTION AND IDENTIFICATION FROM SPACEBORNE OPTICAL IMAGERY

2021 ◽  
Vol V-3-2021 ◽  
pp. 303-310
Author(s):  
G. Matasci ◽  
J. Plante ◽  
K. Kasa ◽  
P. Mousavi ◽  
A. Stewart ◽  
...  
Keyword(s):  
Deep Learning ◽  
Large Scale ◽  
Input Image ◽  
Automatic Identification ◽  
Identification System ◽  
Optical Remote Sensing ◽  
Detection Model ◽  
Model Based ◽  
Optical Images ◽  
Vessel Detection

Abstract. We present a deep learning-based vessel detection and (re-)identification approach from spaceborne optical images. We introduce these two components as part of a maritime surveillance from space pipeline and present experimental results on challenging real-world maritime datasets derived from WorldView imagery. First, we developed a vessel detection model based on RetinaNet achieving a performance of 0.795 F1-score on a challenging multi-scale dataset. We then collected a large-scale dataset for vessel identification by applying the detection model on 200+ optical images, detecting the vessels therein and assigning them an identity via an Automatic Identification System association framework. A vessel re-identification model based on Twin neural networks has then been trained on this dataset featuring 2500+ unique vessels with multiple repeated occurrences across different acquisitions. The model allows to naturally establish similarities between vessel images. It returns a relevant ranking of candidate vessels from a database when provided an input image for a specific vessel the user might be interested in, with top-1 and top-10 accuracies of 38.7% and 76.5%, respectively. This study demonstrates the potential offered by the latest advances in deep learning and computer vision when applied to optical remote sensing imagery in a maritime context, opening new opportunities for automated vessel monitoring and tracking capabilities from space.

scholarly journals Ship Identification and Characterization in Sentinel-1 SAR Images with Multi-Task Deep Learning

2019 ◽  
Vol 11 (24) ◽  
pp. 2997 ◽  
Author(s):  
Clément Dechesne ◽  
Sébastien Lefèvre ◽  
Rodolphe Vadaine ◽  
Guillaume Hajduch ◽  
Ronan Fablet
Keyword(s):  
Neural Network ◽  
Deep Learning ◽  
Network Architecture ◽  
Large Scale ◽  
Visual Analysis ◽  
Automatic Identification ◽  
Identification System ◽  
Human Observer ◽  
Convolutional Network ◽  
Ship Detection

The monitoring and surveillance of maritime activities are critical issues in both military and civilian fields, including among others fisheries’ monitoring, maritime traffic surveillance, coastal and at-sea safety operations, and tactical situations. In operational contexts, ship detection and identification is traditionally performed by a human observer who identifies all kinds of ships from a visual analysis of remotely sensed images. Such a task is very time consuming and cannot be conducted at a very large scale, while Sentinel-1 SAR data now provide a regular and worldwide coverage. Meanwhile, with the emergence of GPUs, deep learning methods are now established as state-of-the-art solutions for computer vision, replacing human intervention in many contexts. They have been shown to be adapted for ship detection, most often with very high resolution SAR or optical imagery. In this paper, we go one step further and investigate a deep neural network for the joint classification and characterization of ships from SAR Sentinel-1 data. We benefit from the synergies between AIS (Automatic Identification System) and Sentinel-1 data to build significant training datasets. We design a multi-task neural network architecture composed of one joint convolutional network connected to three task specific networks, namely for ship detection, classification, and length estimation. The experimental assessment shows that our network provides promising results, with accurate classification and length performance (classification overall accuracy: 97.25%, mean length error: 4.65 m ± 8.55 m).

scholarly journals LS-SSDD-v1.0: A Deep Learning Dataset Dedicated to Small Ship Detection from Large-Scale Sentinel-1 SAR Images

2020 ◽  
Vol 12 (18) ◽  
pp. 2997 ◽  
Author(s):  
Tianwen Zhang ◽  
Xiaoling Zhang ◽  
Xiao Ke ◽  
Xu Zhan ◽  
Jun Shi ◽  
...  
Keyword(s):  
Deep Learning ◽  
Large Scale ◽  
Google Earth ◽  
Detection Methods ◽  
False Alarms ◽  
Automatic Identification ◽  
Identification System ◽  
Sar Images ◽  
Ship Detection ◽  
Small Ship

Ship detection in synthetic aperture radar (SAR) images is becoming a research hotspot. In recent years, as the rise of artificial intelligence, deep learning has almost dominated SAR ship detection community for its higher accuracy, faster speed, less human intervention, etc. However, today, there is still a lack of a reliable deep learning SAR ship detection dataset that can meet the practical migration application of ship detection in large-scene space-borne SAR images. Thus, to solve this problem, this paper releases a Large-Scale SAR Ship Detection Dataset-v1.0 (LS-SSDD-v1.0) from Sentinel-1, for small ship detection under large-scale backgrounds. LS-SSDD-v1.0 contains 15 large-scale SAR images whose ground truths are correctly labeled by SAR experts by drawing support from the Automatic Identification System (AIS) and Google Earth. To facilitate network training, the large-scale images are directly cut into 9000 sub-images without bells and whistles, providing convenience for subsequent detection result presentation in large-scale SAR images. Notably, LS-SSDD-v1.0 has five advantages: (1) large-scale backgrounds, (2) small ship detection, (3) abundant pure backgrounds, (4) fully automatic detection flow, and (5) numerous and standardized research baselines. Last but not least, combined with the advantage of abundant pure backgrounds, we also propose a Pure Background Hybrid Training mechanism (PBHT-mechanism) to suppress false alarms of land in large-scale SAR images. Experimental results of ablation study can verify the effectiveness of the PBHT-mechanism. LS-SSDD-v1.0 can inspire related scholars to make extensive research into SAR ship detection methods with engineering application value, which is conducive to the progress of SAR intelligent interpretation technology.

scholarly journals Automatic Identification of Overpass Structures: A Method of Deep Learning

2019 ◽  
Vol 8 (9) ◽  
pp. 421 ◽  
Author(s):  
Hao Li ◽  
Maosheng Hu ◽  
Youxin Huang
Keyword(s):  
Deep Learning ◽  
Target Detection ◽  
Road Network ◽  
Large Scale ◽  
Training Data ◽  
Fine Tuning ◽  
Automatic Identification ◽  
Detection Model ◽  
Network Pattern ◽  
Accuracy Performance

The identification of overpass structures in road networks has great significance for multi-scale modeling of roads, congestion analysis, and vehicle navigation. The traditional vector-based methods identify overpasses by the methodologies coming from computational geometry and graph theory, and they overly rely on the artificially designed features and have poor adaptability to complex scenes. This paper presents a novel method of identifying overpasses based on a target detection model (Faster-RCNN). This method utilizes raster representation of vector data and convolutional neural networks (CNNs) to learn task adaptive features from raster data, then identifies the location of an overpass by a Region Proposal network (RPN). The contribution of this paper is: (1) An overpass labelling geodatabase (OLGDB) for the OpenStreetMap (OSM) road network data of six typical cities in China is established; (2) Three different CNNs (ZF-net, VGG-16, Inception-ResNet V2) are integrated into Faster-RCNN and evaluated by accuracy performance; (3) The optimal combination of learning rate and batchsize is determined by fine-tuning; and (4) Five geometric metrics (perimeter, area, squareness, circularity, and W/L) are synthetized into image bands to enhance the training data, and their contribution to the overpass identification task is determined. The experimental results have shown that the proposed method has good accuracy performance (around 90%), and could be improved with the expansion of OLGDB and switching to more sophisticated target detection models. The deep learning target detection model has great application potential in large-scale road network pattern recognition, it can task-adaptively learn road structure features and easily extend to other road network patterns.

Statistical Analysis of the Detection Probability of the TianTuo-3 Space-based AIS

2017 ◽  
Vol 71 (2) ◽  
pp. 467-481 ◽  
Author(s):  
Shiyou Li ◽  
Lihu Chen ◽  
Xiaoqian Chen ◽  
Yong Zhao ◽  
Lei Yang
Keyword(s):  
Statistical Analysis ◽  
Detection Probability ◽  
High Probability ◽  
Distribution Density ◽  
Automatic Identification ◽  
Identification System ◽  
Receiving Antenna ◽  
Defense Technology ◽  
Vessel Detection ◽  
National University

The Micro-Nano satellite TianTuo-3 (TT-3) developed by the National University of Defense Technology (NUDT) was successfully launched on 20 September 2015. The space-based Automatic Identification System (AIS) on board TT-3 works well and stably receives AIS signals from global vessels. In this work, we perform statistical analysis on the detection probability of the vessels in the concerned areas by using the TT-3 AIS data. The results suggest that the detection probability of vessels decreases as the distribution density increases, especially in the offshore areas of dense traffic and the TT3-AIS vessel detection probability in the oceans can be higher than 40%, indicating that the TT-3 AIS has achieved a high probability of coverage of vessels for a single receiving antenna. The analysis results will present helpful references both in evaluating the potential application of satellite-based AIS and for designing the next generation space-based AIS which might greatly improve the detection probability of ocean-going vessels.

Deep Learning Based Active Monitoring for Anti-collision between Vessels and Bridges

2019 ◽  
Author(s):  
Limu Chen ◽  
Ye Xia ◽  
Dexiong Pan ◽  
Chengbin Wang
Keyword(s):  
Decision Making ◽  
Deep Learning ◽  
Object Detection ◽  
Large Scale ◽  
Data Augmentation ◽  
Information Support ◽  
Single Shot ◽  
Active Monitoring ◽  
Detection Model ◽  
Comparison Results

<p>Deep-learning based navigational object detection is discussed with respect to active monitoring system for anti-collision between vessel and bridge. Motion based object detection method widely used in existing anti-collision monitoring systems is incompetent in dealing with complicated and changeable waterway for its limitations in accuracy, robustness and efficiency. The video surveillance system proposed contains six modules, including image acquisition, detection, tracking, prediction, risk evaluation and decision-making, and the detection module is discussed in detail. A vessel-exclusive dataset with tons of image samples is established for neural network training and a SSD (Single Shot MultiBox Detector) based object detection model with both universality and pertinence is generated attributing to tactics of sample filtering, data augmentation and large-scale optimization, which make it capable of stable and intelligent vessel detection. Comparison results with conventional methods indicate that the proposed deep-learning method shows remarkable advantages in robustness, accuracy, efficiency and intelligence. In-situ test is carried out at Songpu Bridge in Shanghai, and the results illustrate that the method is qualified for long-term monitoring and providing information support for further analysis and decision making.</p>

scholarly journals EmbeddedPigDet—Fast and Accurate Pig Detection for Embedded Board Implementations

2020 ◽  
Vol 10 (8) ◽  
pp. 2878 ◽  
Author(s):  
Jihyun Seo ◽  
Hanse Ahn ◽  
Daewon Kim ◽  
Sungju Lee ◽  
Yongwha Chung ◽  
...  
Keyword(s):  
Deep Learning ◽  
Large Scale ◽  
Low Cost ◽  
Input Image ◽  
Monitoring Cost ◽  
Fast Detection ◽  
Execution Speed ◽  
Pig Farm ◽  
Integrated Performance ◽  
Speed And Accuracy

Automated pig monitoring is an important issue in the surveillance environment of a pig farm. For a large-scale pig farm in particular, practical issues such as monitoring cost should be considered but such consideration based on low-cost embedded boards has not yet been reported. Since low-cost embedded boards have more limited computing power than typical PCs and have tradeoffs between execution speed and accuracy, achieving fast and accurate detection of individual pigs for “on-device” pig monitoring applications is very challenging. Therefore, in this paper, we propose a method for the fast detection of individual pigs by reducing the computational workload of 3 × 3 convolution in widely-used, deep learning-based object detectors. Then, in order to recover the accuracy of the “light-weight” deep learning-based object detector, we generate a three-channel composite image as its input image, through “simple” image preprocessing techniques. Our experimental results on an NVIDIA Jetson Nano embedded board show that the proposed method can improve the integrated performance of both execution speed and accuracy of widely-used, deep learning-based object detectors, by a factor of up to 8.7.

scholarly journals The Assisted Positioning Technology for High Speed Train Based on Deep Learning

2020 ◽  
Vol 10 (23) ◽  
pp. 8625
Author(s):  
Yali Song ◽  
Yinghong Wen
Keyword(s):  
Deep Learning ◽  
High Speed ◽  
Detection Method ◽  
Generative Adversarial Networks ◽  
Single Shot ◽  
High Speed Train ◽  
Data Set ◽  
Detection Model ◽  
Model Based ◽  
Cumulative Error

In the positioning process of a high-speed train, cumulative error may result in a reduction in the positioning accuracy. The assisted positioning technology based on kilometer posts can be used as an effective method to correct the cumulative error. However, the traditional detection method of kilometer posts is time-consuming and complex, which greatly affects the correction efficiency. Therefore, in this paper, a kilometer post detection model based on deep learning is proposed. Firstly, the Deep Convolutional Generative Adversarial Networks (DCGAN) algorithm is introduced to construct an effective kilometer post data set. This greatly reduces the cost of real data acquisition and provides a prerequisite for the construction of the detection model. Then, by using the existing optimization as a reference and further simplifying the design of the Single Shot multibox Detector (SSD) model according to the specific application scenario of this paper, the kilometer post detection model based on an improved SSD algorithm is established. Finally, from the analysis of the experimental results, we know that the detection model established in this paper ensures both detection accuracy and efficiency. The accuracy of our model reached 98.92%, while the detection time was only 35.43 ms. Thus, our model realizes the rapid and accurate detection of kilometer posts and improves the assisted positioning technology based on kilometer posts by optimizing the detection method.

Sign in / Sign up

Export Citation Format

Share Document