scholarly journals MULTI-TEMPORAL SAR IMAGE DESPECKLING BASED A CONVOLUTIONAL NEURAL NETWORK

2020 ◽  
Vol V-5-2020 ◽  
pp. 101-107
Author(s):  
C. Zhou ◽  
J. Li ◽  
H. Shen ◽  
Q. Yuan
Keyword(s):  
Neural Network ◽  
Convolutional Neural Network ◽  
Spatial Information ◽  
Intrinsic Property ◽  
Temporal Correlation ◽  
Real Data ◽  
Sufficient Information ◽  
Sar Images ◽  
Multi Temporal ◽  
Sar Imagery

Abstract. Speckle noise is an intrinsic property of Synthetic Aperture Radar (SAR) imagery, which affects the quality of image. Single-temporal despeckling methods usually pay attention to the utilization of spatial information, but sometimes due to lack of sufficient information, the despeckling image is too smooth or losses some information about edge details. However, multi-temporal SAR images can provide extra information for despeckling resulting in better performance. Therefore, in this paper, we proposed a novel multi-temporal SAR despeckling method based a convolutional neural network (MSAR-CNN) embedded temporal and spatial attention (TSA) module to deeply mine the spatial and temporal correlation of multitemporal SAR images. The whole network, which is end-to-end trained with simulate realistic SAR data, consists of several residual blocks. In addition, the simulated and real-data experiments demonstrate that the proposed MSAR-CNN outperforms most of the mainstream methods in both the quantitative evaluation indexes and visual effects.

scholarly journals Detection of Oil Spill Using SAR Imagery Based on AlexNet Model

2021 ◽  
Vol 2021 ◽  
pp. 1-14
Author(s):  
Xinzhe Wang ◽  
Jiaxu Liu ◽  
Shuai Zhang ◽  
Qiwen Deng ◽  
Zhuo Wang ◽  
...  
Keyword(s):  
Neural Network ◽  
Convolutional Neural Network ◽  
Oil Spill ◽  
Oil Spills ◽  
Speckle Noise ◽  
Optimization Methods ◽  
Sar Images ◽  
Connection Weight ◽  
Imaging Characteristics ◽  
Sar Imagery

Synthetic aperture radar (SAR) plays an irreplaceable role in the monitoring of marine oil spills. However, due to the limitation of its imaging characteristics, it is difficult to use traditional image processing methods to effectively extract oil spill information from SAR images with coherent speckle noise. In this paper, the convolutional neural network AlexNet model is used to extract the oil spill information from SAR images by taking advantage of its features of local connection, weight sharing, and learning for image representation. The existing remote sensing images of the oil spills in recent years in China are used to build a dataset. These images are enhanced by translation and flip of the dataset, and so on and then sent to the established deep convolutional neural network for training. The prediction model is obtained through optimization methods such as Adam. During the prediction, the predicted image is cut into several blocks, and the error information is removed by corrosion expansion and Gaussian filtering after the image is spliced again. Experiments based on actual oil spill SAR datasets demonstrate the effectiveness of the modified AlexNet model compared with other approaches.

scholarly journals Dual-Channel Convolutional Neural Network for Bare Surface Soil Moisture Inversion Based on Polarimetric Scattering Models

2021 ◽  
Vol 13 (22) ◽  
pp. 4503
Author(s):  
Qiang Yin ◽  
Junlang Li ◽  
Fei Ma ◽  
Deliang Xiang ◽  
Fan Zhang
Keyword(s):  
Neural Network ◽  
Soil Moisture ◽  
Convolutional Neural Network ◽  
Spatial Information ◽  
Real Data ◽  
Equation Model ◽  
Coarse Grained ◽  
Dual Channel ◽  
Wide Range ◽  
Soil Moisture Inversion

The polarimetric synthetic aperture radar (PolSAR) can be used to obtain soil moisture by inverting scattering models at high resolution. The convolutional neural network (CNN) has been recently introduced to estimate soil roughness for PolSAR data, which need to be driven by a large amount of data. In this paper, a dual-channel CNN based on polarimetric models is proposed for soil moisture inversion, and it aims to further expand the applicable range of roughness in the X-Bragg model by integration with the integral equation model (IEM). Meanwhile, it fully utilizes the spatial information of PolSAR images to relax the number of required training samples when real data on the surface are difficult to obtain. Besides, we designed a framework based on this network. Coarse-grained inversion and fine-grained inversion of soil moisture are carried out through the qualitative classification network and the quantitative regression network, respectively. Experiments on simulated and airborne E-SAR data show that the proposed network can accurately fit the nonlinear relationship between polarization parameters and soil moisture, so as to improve the inversion accuracy with a small number of samples. In our experiments, the average inversion accuracy reached 95.39%, and the root mean square error (RMSE) of the regression network was 0.98%. This method can be applied to a wide range of soil moisture monitoring applications.

Method of determination of the text direction on the image with the use of convolutional neural network

2020 ◽  
pp. 96-99
Author(s):  
P.L. Nikolaev
Keyword(s):  
Neural Network ◽  
Convolutional Neural Network ◽  
Deep Neural Network ◽  
Binary Classification ◽  
Synthetic Data ◽  
Real Data ◽  
Method Of Determination ◽  
Classification Of Images

This article deals with method of binary classification of images with small text on them Classification is based on the fact that the text can have 2 directions – it can be positioned horizontally and read from left to right or it can be turned 180 degrees so the image must be rotated to read the sign. This type of text can be found on the covers of a variety of books, so in case of recognizing the covers, it is necessary first to determine the direction of the text before we will directly recognize it. The article suggests the development of a deep neural network for determination of the text position in the context of book covers recognizing. The results of training and testing of a convolutional neural network on synthetic data as well as the examples of the network functioning on the real data are presented.

scholarly journals Application of Convolutional Neural Network for Spatiotemporal Bias Correction of Daily Satellite-Based Precipitation

2020 ◽  
Vol 12 (17) ◽  
pp. 2731
Author(s):  
Xuan-Hien Le ◽  
Giha Lee ◽  
Kwansue Jung ◽  
Hyun-uk An ◽  
Seungsoo Lee ◽  
...  
Keyword(s):  
Neural Network ◽  
Standard Deviation ◽  
Convolutional Neural Network ◽  
Bias Correction ◽  
Temporal Correlation ◽  
Precipitation Data ◽  
Climate Data ◽  
Extreme Rainfall Events ◽  
Essential Components ◽  
Deviation Method

Spatiotemporal precipitation data is one of the essential components in modeling hydrological problems. Although the estimation of these data has achieved remarkable accuracy owning to the recent advances in remote-sensing technology, gaps remain between satellite-based precipitation and observed data due to the dependence of precipitation on the spatiotemporal distribution and the specific characteristics of the area. This paper presents an efficient approach based on a combination of the convolutional neural network and the autoencoder architecture, called the convolutional autoencoder (ConvAE) neural network, to correct the pixel-by-pixel bias for satellite-based products. The two daily gridded precipitation datasets with a spatial resolution of 0.25° employed are Asian Precipitation-Highly Resolved Observational Data Integration towards Evaluation (APHRODITE) as the observed data and Precipitation Estimation from Remotely Sensed Information using Artificial Neural Networks-Climate Data Record (PERSIANN-CDR) as the satellite-based data. Furthermore, the Mekong River basin was selected as a case study, because it is one of the largest river basins, spanning six countries, most of which are developing countries. In addition to the ConvAE model, another bias correction method based on the standard deviation method was also introduced. The performance of the bias correction methods was evaluated in terms of the probability distribution, temporal correlation, and spatial correlation of precipitation. Compared with the standard deviation method, the ConvAE model demonstrated superior and stable performance in most comparisons conducted. Additionally, the ConvAE model also exhibited impressive performance in capturing extreme rainfall events, distribution trends, and described spatial relationships between adjacent grid cells well. The findings of this study highlight the potential of the ConvAE model to resolve the precipitation bias correction problem. Thus, the ConvAE model could be applied to other satellite-based products, higher-resolution precipitation data, or other issues related to gridded data.

scholarly journals ARPEGE cloud cover forecast post-processing with convolutional neural network

2020 ◽  
Author(s):  
Florian Dupuy ◽  
Olivier Mestre ◽  
Léo Pfitzner
Keyword(s):  
Neural Network ◽  
Machine Learning ◽  
Convolutional Neural Network ◽  
Random Forests ◽  
Cloud Cover ◽  
Spatial Information ◽  
Weather Prediction ◽  
Excellent Result ◽  
Machine Learning Algorithms ◽  
Post Processing

<p>Cloud cover is a crucial information for many applications such as planning land observation missions from space. However, cloud cover remains a challenging variable to forecast, and Numerical Weather Prediction (NWP) models suffer from significant biases, hence justifying the use of statistical post-processing techniques. In our application, the ground truth is a gridded cloud cover product derived from satellite observations over Europe, and predictors are spatial fields of various variables produced by ARPEGE (Météo-France global NWP) at the corresponding lead time.</p><p>In this study, ARPEGE cloud cover is post-processed using a convolutional neural network (CNN). CNN is the most popular machine learning tool to deal with images. In our case, CNN allows to integrate spatial information contained in NWP outputs. We show that a simple U-Net architecture produces significant improvements over Europe. Compared to the raw ARPEGE forecasts, MAE drops from 25.1 % to 17.8 % and RMSE decreases from 37.0 % to 31.6 %. Considering specific needs for earth observation, special interest was put on forecasts with low cloud cover conditions (< 10 %). For this particular nebulosity class, we show that hit rate jumps from 40.6 to 70.7 (which is the order of magnitude of what can be achieved using classical machine learning algorithms such as random forests) while false alarm decreases from 38.2 to 29.9. This is an excellent result, since improving hit rates by means of random forests usually also results in a slight increase of false alarms.</p>

scholarly journals Remote Sensing Landslide Recognition Based on Convolutional Neural Network

2019 ◽  
Vol 2019 ◽  
pp. 1-12 ◽  
Author(s):  
Yu Wang ◽  
Xiaofei Wang ◽  
Junfan Jian
Keyword(s):  
Neural Network ◽  
Remote Sensing ◽  
Convolutional Neural Network ◽  
Large Scale ◽  
Vegetation Index ◽  
Near Infrared ◽  
Spatial Information ◽  
Spectral Characteristics ◽  
Remote Sensing Images ◽  
Landslide Event

Landslides are a type of frequent and widespread natural disaster. It is of great significance to extract location information from the landslide in time. At present, most articles still select single band or RGB bands as the feature for landslide recognition. To improve the efficiency of landslide recognition, this study proposed a remote sensing recognition method based on the convolutional neural network of the mixed spectral characteristics. Firstly, this paper tried to add NDVI (normalized difference vegetation index) and NIRS (near-infrared spectroscopy) to enhance the features. Then, remote sensing images (predisaster and postdisaster images) with same spatial information but different time series information regarding landslide are taken directly from GF-1 satellite as input images. By combining the 4 bands (red + green + blue + near-infrared) of the prelandslide remote sensing images with the 4 bands of the postlandslide images and NDVI images, images with 9 bands were obtained, and the band values reflecting the changing characteristics of the landslide were determined. Finally, a deep learning convolutional neural network (CNN) was introduced to solve the problem. The proposed method was tested and verified with remote sensing data from the 2015 large-scale landslide event in Shanxi, China, and 2016 large-scale landslide event in Fujian, China. The results showed that the accuracy of the method was high. Compared with the traditional methods, the recognition efficiency was improved, proving the effectiveness and feasibility of the method.

scholarly journals Cloud Removal with Fusion of High Resolution Optical and SAR Images Using Generative Adversarial Networks

2020 ◽  
Vol 12 (1) ◽  
pp. 191 ◽  
Author(s):  
Jianhao Gao ◽  
Qiangqiang Yuan ◽  
Jie Li ◽  
Hai Zhang ◽  
Xin Su
Keyword(s):  
Neural Network ◽  
Convolutional Neural Network ◽  
Optical Image ◽  
Optical Data ◽  
Generative Adversarial Networks ◽  
Second Step ◽  
Missing Information ◽  
Sar Images ◽  
Generative Adversarial Network ◽  
Cloud Removal

The existence of clouds is one of the main factors that contributes to missing information in optical remote sensing images, restricting their further applications for Earth observation, so how to reconstruct the missing information caused by clouds is of great concern. Inspired by the image-to-image translation work based on convolutional neural network model and the heterogeneous information fusion thought, we propose a novel cloud removal method in this paper. The approach can be roughly divided into two steps: in the first step, a specially designed convolutional neural network (CNN) translates the synthetic aperture radar (SAR) images into simulated optical images in an object-to-object manner; in the second step, the simulated optical image, together with the SAR image and the optical image corrupted by clouds, is fused to reconstruct the corrupted area by a generative adversarial network (GAN) with a particular loss function. Between the first step and the second step, the contrast and luminance of the simulated optical image are randomly altered to make the model more robust. Two simulation experiments and one real-data experiment are conducted to confirm the effectiveness of the proposed method on Sentinel 1/2, GF 2/3 and airborne SAR/optical data. The results demonstrate that the proposed method outperforms state-of-the-art algorithms that also employ SAR images as auxiliary data.

scholarly journals Integration of Convolutional Neural Network and Error Correction for Indoor Positioning

2020 ◽  
Vol 9 (2) ◽  
pp. 74
Author(s):  
Eric Hsueh-Chan Lu ◽  
Jing-Mei Ciou
Keyword(s):  
Neural Network ◽  
Convolutional Neural Network ◽  
Error Correction ◽  
Spatial Information ◽  
Rapid Development ◽  
Indoor Positioning ◽  
Experimental Results ◽  
Global Navigation Satellite Systems ◽  
Signal Interference ◽  
Position Vector

With the rapid development of surveying and spatial information technologies, more and more attention has been given to positioning. In outdoor environments, people can easily obtain positioning services through global navigation satellite systems (GNSS). In indoor environments, the GNSS signal is often lost, while other positioning problems, such as dead reckoning and wireless signals, will face accumulated errors and signal interference. Therefore, this research uses images to realize a positioning service. The main concept of this work is to establish a model for an indoor field image and its coordinate information and to judge its position by image eigenvalue matching. Based on the architecture of PoseNet, the image is input into a 23-layer convolutional neural network according to various sizes to train end-to-end location identification tasks, and the three-dimensional position vector of the camera is regressed. The experimental data are taken from the underground parking lot and the Palace Museum. The preliminary experimental results show that this new method designed by us can effectively improve the accuracy of indoor positioning by about 20% to 30%. In addition, this paper also discusses other architectures, field sizes, camera parameters, and error corrections for this neural network system. The preliminary experimental results show that the angle error correction method designed by us can effectively improve positioning by about 20%.

Sign in / Sign up

Export Citation Format

Share Document