scholarly journals Unmanned aerial vehicles and deep learning for assessment of anthropogenic marine debris on beaches on an island in a semi-enclosed sea in Japan

2021 ◽  
Author(s):  
Kosuke Takaya ◽  
Atsuki Shibata ◽  
Yuji Mizuno ◽  
Takeshi Ise
Keyword(s):  
Deep Learning ◽  
High Resolution ◽  
Survey Methods ◽  
Low Cost ◽  
Marine Debris ◽  
Training Dataset ◽  
Effective Control ◽  
Debris Accumulation ◽  
Before And After ◽  
Inland Sea Of Japan

Abstract The increasing prevalence of marine debris is a global problem, and urgent action for amelioration is needed. Identifying hotspots where marine debris accumulates will enable effective control; however, knowledge on the location of accumulation hotspots remains incomplete. In particular, marine debris accumulation on beaches is a concern. Surveys of beaches require intensive human effort, and survey methods are not standardized. If marine debris monitoring is conducted using a standardized method, data from different regions can be compared. With an unmanned aerial vehicle (UAV) and deep learning computational methods, monitoring a wide area at a low cost in a standardized way may be possible. In this study, we aimed to identify marine debris on beaches through deep learning using high-resolution UAV images by conducting a survey on Narugashima Island in the Seto Inland Sea of Japan. The flight altitude relative to the ground was set to 5 m, and images of a 0.81-ha area were obtained. Flight was conducted twice: before and after the beach cleaning. The combination of UAVs equipped with a zoom lens and operation at a low altitude allows for the acquisition of high resolution images of 1.1 mm/pixel. The training dataset (2970 images) was annotated by using VoTT, categorizing them into two classes: “anthropogenic marine debris” and “natural objects.” Using RetinaNet, marine debris was identified with an average sensitivity of 51% and a precision of 76%. In addition, the abundance and area of marine debris coverage were estimated. In this study, it was revealed that the combination of UAVs and deep learning enables the effective identification of marine debris. The effects of cleanup activities by citizens were able to be quantified. This method can widely be used to evaluate the effectiveness of citizen efforts toward beach cleaning and low-cost long-term monitoring.

scholarly journals Confronting Deep-Learning and Biodiversity Challenges for Automatic Video-Monitoring of Marine Ecosystems

Sensors ◽  
2022 ◽  
Vol 22 (2) ◽  
pp. 497
Author(s):  
Sébastien Villon ◽  
Corina Iovan ◽  
Morgan Mangeas ◽  
Laurent Vigliola
Keyword(s):  
Deep Learning ◽  
Data Augmentation ◽  
Low Cost ◽  
Video Recording ◽  
Species Abundance ◽  
Automatic Monitoring ◽  
Training Dataset ◽  
Data Generation ◽  
Automatic Assessment ◽  
Open Set

With the availability of low-cost and efficient digital cameras, ecologists can now survey the world’s biodiversity through image sensors, especially in the previously rather inaccessible marine realm. However, the data rapidly accumulates, and ecologists face a data processing bottleneck. While computer vision has long been used as a tool to speed up image processing, it is only since the breakthrough of deep learning (DL) algorithms that the revolution in the automatic assessment of biodiversity by video recording can be considered. However, current applications of DL models to biodiversity monitoring do not consider some universal rules of biodiversity, especially rules on the distribution of species abundance, species rarity and ecosystem openness. Yet, these rules imply three issues for deep learning applications: the imbalance of long-tail datasets biases the training of DL models; scarce data greatly lessens the performances of DL models for classes with few data. Finally, the open-world issue implies that objects that are absent from the training dataset are incorrectly classified in the application dataset. Promising solutions to these issues are discussed, including data augmentation, data generation, cross-entropy modification, few-shot learning and open set recognition. At a time when biodiversity faces the immense challenges of climate change and the Anthropocene defaunation, stronger collaboration between computer scientists and ecologists is urgently needed to unlock the automatic monitoring of biodiversity.

scholarly journals DEEP LEARNING BASED ROOF TYPE CLASSIFICATION USING VERY HIGH RESOLUTION AERIAL IMAGERY

2021 ◽  
Vol XLIII-B3-2021 ◽  
pp. 55-60
Author(s):  
M. Buyukdemircioglu ◽  
R. Can ◽  
S. Kocaman
Keyword(s):  
Deep Learning ◽  
High Resolution ◽  
Urban Areas ◽  
Image Features ◽  
Training Data ◽  
Fine Tuning ◽  
Computer Hardware ◽  
Geographical Information ◽  
Training Dataset ◽  
Very High

Abstract. Automatic detection, segmentation and reconstruction of buildings in urban areas from Earth Observation (EO) data are still challenging for many researchers. Roof is one of the most important element in a building model. The three-dimensional geographical information system (3D GIS) applications generally require the roof type and roof geometry for performing various analyses on the models, such as energy efficiency. The conventional segmentation and classification methods are often based on features like corners, edges and line segments. In parallel to the developments in computer hardware and artificial intelligence (AI) methods including deep learning (DL), image features can be extracted automatically. As a DL technique, convolutional neural networks (CNNs) can also be used for image classification tasks, but require large amount of high quality training data for obtaining accurate results. The main aim of this study was to generate a roof type dataset from very high-resolution (10 cm) orthophotos of Cesme, Turkey, and to classify the roof types using a shallow CNN architecture. The training dataset consists 10,000 roof images and their labels. Six roof type classes such as flat, hip, half-hip, gable, pyramid and complex roofs were used for the classification in the study area. The prediction performance of the shallow CNN model used here was compared with the results obtained from the fine-tuning of three well-known pre-trained networks, i.e. VGG-16, EfficientNetB4, ResNet-50. The results show that although our CNN has slightly lower performance expressed with the overall accuracy, it is still acceptable for many applications using sparse data.

scholarly journals Plant detection and counting from high-resolution RGB images acquired from UAVs: comparison between deep-learning and handcrafted methods with application to maize, sugar beet, and sunflower crops

2021 ◽  
Author(s):  
Etienne David ◽  
Gaëtan Daubige ◽  
François Joudelat ◽  
Philippe Burger ◽  
Alexis Comar ◽  
...  
Keyword(s):  
Deep Learning ◽  
High Resolution ◽  
Sugar Beet ◽  
Plant Development ◽  
Plant Density ◽  
Development Stage ◽  
Training Dataset ◽  
Testing Dataset ◽  
Weed Infestation ◽  
Rgb Images

1AbstractPlants density is a key information on crop growth. Usually done manually, this task can beneficiate from advances in image analysis technics. Automated detection of individual plants in images is a key step to estimate this density. To develop and evaluate dedicated processing technics, high resolution RGB images were acquired from UAVs during several years and experiments over maize, sugar beet and sunflower crops at early stages. A total of 16247 plants have been labelled interactively. We compared the performances of handcrafted method (HC) to those of deep-learning (DL). HC method consists in segmenting the image into green and background pixels, identifying rows, then objects corresponding to plants thanks to knowledge of the sowing pattern as prior information. DL method is based on the Faster RCNN model trained over 2/3 of the images selected to represent a good balance between plant development stage and sessions. One model is trained for each crop.Results show that DL generally outperforms HC, particularly for maize and sunflower crops. The quality of images appears mandatory for HC methods where image blur and complex background induce difficulties for the segmentation step. Performances of DL methods are also limited by image quality as well as the presence of weeds. An hybrid method (HY) was proposed to eliminate weeds between the rows using the rules used for the HC method. HY improves slightly DL performances in the case of high weed infestation. A significant level of variability of plant detection performances is observed between the several experiments. This was explained by the variability of image acquisition conditions including illumination, plant development stage, background complexity and weed infestation. We tested an active learning approach where few images corresponding to the conditions of the testing dataset were complementing the training dataset for DL. Results show a drastic increase of performances for all crops, with relative RMSE below 5% for the estimation of the plant density.

scholarly journals A Deep Learning-Based Method for Quantifying and Mapping the Grain Size on Pebble Beaches

2020 ◽  
Vol 12 (21) ◽  
pp. 3659
Author(s):  
Antoine Soloy ◽  
Imen Turki ◽  
Matthieu Fournier ◽  
Stéphane Costa ◽  
Bastien Peuziat ◽  
...  
Keyword(s):  
Deep Learning ◽  
Land Surface ◽  
High Efficiency ◽  
Learning Algorithm ◽  
Low Cost ◽  
Methodological Approach ◽  
Morphological Characteristics ◽  
Image Resolution ◽  
Training Dataset ◽  
Sediment Size

This article proposes a new methodological approach to measure and map the size of coarse clasts on a land surface from photographs. This method is based on the use of the Mask Regional Convolutional Neural Network (R-CNN) deep learning algorithm, which allows the instance segmentation of objects after an initial training on manually labeled data. The algorithm is capable of identifying and classifying objects present in an image at the pixel scale, without human intervention, in a matter of seconds. This work demonstrates that it is possible to train the model to detect non-overlapping coarse sediments on scaled images, in order to extract their individual size and morphological characteristics with high efficiency (R2 = 0.98; Root Mean Square Error (RMSE) = 3.9 mm). It is then possible to measure element size profiles over a sedimentary body, as it was done on the pebble beach of Etretat (Normandy, France) in order to monitor the granulometric spatial variability before and after a storm. Applied at a larger scale using Unmanned Aerial Vehicle (UAV) derived ortho-images, the method allows the accurate characterization and high-resolution mapping of the surface coarse sediment size, as it was performed on the two pebble beaches of Etretat (D50 = 5.99 cm) and Hautot-sur-Mer (D50 = 7.44 cm) (Normandy, France). Validation results show a very satisfying overall representativity (R2 = 0.45 and 0.75; RMSE = 6.8 mm and 9.3 mm at Etretat and Hautot-sur-Mer, respectively), while the method remains fast, easy to apply and low-cost, although the method remains limited by the image resolution (objects need to be longer than 4 cm), and could still be improved in several ways, for instance by adding more manually labeled data to the training dataset, and by considering more accurate methods than the ellipse fitting for measuring the particle sizes.

scholarly journals Can the Structure Similarity of Training Patches Affect the Sea Surface Temperature Deep Learning Super-Resolution?

2021 ◽  
Vol 13 (18) ◽  
pp. 3568
Author(s):  
Bo Ping ◽  
Yunshan Meng ◽  
Cunjin Xue ◽  
Fenzhen Su
Keyword(s):  
Deep Learning ◽  
High Resolution ◽  
Image Quality ◽  
Surface Temperature ◽  
Sea Surface Temperature ◽  
Super Resolution ◽  
Sea Surface ◽  
Training Dataset ◽  
Low Resolution ◽  
Structure Similarity

Meso- and fine-scale sea surface temperature (SST) is an essential parameter in oceanographic research. Remote sensing is an efficient way to acquire global SST. However, single infrared-based and microwave-based satellite-derived SST cannot obtain complete coverage and high-resolution SST simultaneously. Deep learning super-resolution (SR) techniques have exhibited the ability to enhance spatial resolution, offering the potential to reconstruct the details of SST fields. Current SR research focuses mainly on improving the structure of the SR model instead of training dataset selection. Different from generating the low-resolution images by downscaling the corresponding high-resolution images, the high- and low-resolution SST are derived from different sensors. Hence, the structure similarity of training patches may affect the SR model training and, consequently, the SST reconstruction. In this study, we first discuss the influence of training dataset selection on SST SR performance, showing that the training dataset determined by the structure similarity index (SSIM) of 0.6 can result in higher reconstruction accuracy and better image quality. In addition, in the practical stage, the spatial similarity between the low-resolution input and the objective high-resolution output is a key factor for SST SR. Moreover, the training dataset obtained from the actual AMSR2 and MODIS SST images is more suitable for SST SR because of the skin and sub-skin temperature difference. Finally, the SST reconstruction accuracies obtained from different SR models are relatively consistent, yet the differences in reconstructed image quality are rather significant.

scholarly journals Hyperspectral and Multispectral Image Fusion by Deep Neural Network in a Self-Supervised Manner

2021 ◽  
Vol 13 (16) ◽  
pp. 3226
Author(s):  
Jianhao Gao ◽  
Jie Li ◽  
Menghui Jiang
Keyword(s):  
Neural Network ◽  
Deep Learning ◽  
High Resolution ◽  
Image Fusion ◽  
Multispectral Image ◽  
Hyperspectral Images ◽  
Training Dataset ◽  
Diffusion Method ◽  
Simple Diffusion ◽  
Fusion Methods

Compared with multispectral sensors, hyperspectral sensors obtain images with high- spectral resolution at the cost of spatial resolution, which constrains the further and precise application of hyperspectral images. An intelligent idea to obtain high-resolution hyperspectral images is hyperspectral and multispectral image fusion. In recent years, many studies have found that deep learning-based fusion methods outperform the traditional fusion methods due to the strong non-linear fitting ability of convolution neural network. However, the function of deep learning-based methods heavily depends on the size and quality of training dataset, constraining the application of deep learning under the situation where training dataset is not available or of low quality. In this paper, we introduce a novel fusion method, which operates in a self-supervised manner, to the task of hyperspectral and multispectral image fusion without training datasets. Our method proposes two constraints constructed by low-resolution hyperspectral images and fake high-resolution hyperspectral images obtained from a simple diffusion method. Several simulation and real-data experiments are conducted with several popular remote sensing hyperspectral data under the condition where training datasets are unavailable. Quantitative and qualitative results indicate that the proposed method outperforms those traditional methods by a large extent.

scholarly journals Deep Learning with Unsupervised Data Labeling for Weeds Detection on UAV Images

2018 ◽  
Author(s):  
M Dian Bah ◽  
Adel Hafiane ◽  
Raphael Canals
Keyword(s):  
Deep Learning ◽  
Precision Agriculture ◽  
Low Cost ◽  
Classification Problem ◽  
Training Data ◽  
Training Dataset ◽  
Second Phase ◽  
Agricultural Field ◽  
Uav Images ◽  
The Right

In recent years, weeds is responsible for most of the agricultural yield losses. To deal with this threat, farmers resort to spraying pesticides throughout the field. Such method not only requires huge quantities of herbicides but impact environment and humans health. One way to reduce the cost and environmental impact is to allocate the right doses of herbicide at the right place and at the right time (Precision Agriculture). Nowadays, Unmanned Aerial Vehicle (UAV) is becoming an interesting acquisition system for weeds localization and management due to its ability to obtain the images of the entire agricultural field with a very high spatial resolution and at low cost. Despite the important advances in UAV acquisition systems, automatic weeds detection remains a challenging problem because of its strong similarity with the crops. Recently Deep Learning approach has shown impressive results in different complex classification problem. However, this approach needs a certain amount of training data but, creating large agricultural datasets with pixel-level annotations by expert is an extremely time consuming task. In this paper, we propose a novel fully automatic learning method using Convolutional Neuronal Networks (CNNs) with unsupervised training dataset collection for weeds detection from UAV images. The proposed method consists in three main phases. First we automatically detect the crop lines and using them to identify the interline weeds. In the second phase, interline weeds are used to constitute the training dataset. Finally, we performed CNNs on this dataset to build a model able to detect the crop and weeds in the images. The results obtained are comparable to the traditional supervised training data labeling. The accuracy gaps are 1.5% in the spinach field and 6% in the bean field.

scholarly journals Application of Deep Learning in Integrated Pest Management: A Real-Time System for Detection and Diagnosis of Oilseed Rape Pests

2019 ◽  
Vol 2019 ◽  
pp. 1-14 ◽  
Author(s):  
Yong He ◽  
Hong Zeng ◽  
Yangyang Fan ◽  
Shuaisheng Ji ◽  
Jianjian Wu
Keyword(s):  
Deep Learning ◽  
Integrated Pest Management ◽  
Pest Management ◽  
Real Time ◽  
Oilseed Rape ◽  
Data Augmentation ◽  
Low Cost ◽  
Response Speed ◽  
Original Model ◽  
Real Time System

In this paper, we proposed an approach to detect oilseed rape pests based on deep learning, which improves the mean average precision (mAP) to 77.14%; the result increased by 9.7% with the original model. We adopt this model to mobile platform to let every farmer able to use this program, which will diagnose pests in real time and provide suggestions on pest controlling. We designed an oilseed rape pest imaging database with 12 typical oilseed rape pests and compared the performance of five models, SSD w/Inception is chosen as the optimal model. Moreover, for the purpose of the high mAP, we have used data augmentation (DA) and added a dropout layer. The experiments are performed on the Android application we developed, and the result shows that our approach surpasses the original model obviously and is helpful for integrated pest management. This application has improved environmental adaptability, response speed, and accuracy by contrast with the past works and has the advantage of low cost and simple operation, which are suitable for the pest monitoring mission of drones and Internet of Things (IoT).

scholarly journals Label3DMaize: toolkit for 3D point cloud data annotation of maize shoots

GigaScience ◽  
2021 ◽  
Vol 10 (5) ◽  
Author(s):  
Teng Miao ◽  
Weiliang Wen ◽  
Yinglun Li ◽  
Sheng Wu ◽  
Chao Zhu ◽  
...  
Keyword(s):  
Deep Learning ◽  
Point Cloud ◽  
Training Dataset ◽  
Growth Stages ◽  
3D Point Cloud ◽  
Plant Structure ◽  
Data Annotation ◽  
Cloud Data ◽  
Point Cloud Segmentation ◽  
Different Growth Stages

Abstract Background The 3D point cloud is the most direct and effective data form for studying plant structure and morphology. In point cloud studies, the point cloud segmentation of individual plants to organs directly determines the accuracy of organ-level phenotype estimation and the reliability of the 3D plant reconstruction. However, highly accurate, automatic, and robust point cloud segmentation approaches for plants are unavailable. Thus, the high-throughput segmentation of many shoots is challenging. Although deep learning can feasibly solve this issue, software tools for 3D point cloud annotation to construct the training dataset are lacking. Results We propose a top-to-down point cloud segmentation algorithm using optimal transportation distance for maize shoots. We apply our point cloud annotation toolkit for maize shoots, Label3DMaize, to achieve semi-automatic point cloud segmentation and annotation of maize shoots at different growth stages, through a series of operations, including stem segmentation, coarse segmentation, fine segmentation, and sample-based segmentation. The toolkit takes ∼4–10 minutes to segment a maize shoot and consumes 10–20% of the total time if only coarse segmentation is required. Fine segmentation is more detailed than coarse segmentation, especially at the organ connection regions. The accuracy of coarse segmentation can reach 97.2% that of fine segmentation. Conclusion Label3DMaize integrates point cloud segmentation algorithms and manual interactive operations, realizing semi-automatic point cloud segmentation of maize shoots at different growth stages. The toolkit provides a practical data annotation tool for further online segmentation research based on deep learning and is expected to promote automatic point cloud processing of various plants.

Sign in / Sign up

Export Citation Format

Share Document