scholarly journals SUPERVISED DETECTION OF BOMB CRATERS IN HISTORICAL AERIAL IMAGES USING CONVOLUTIONAL NEURAL NETWORKS

2019 ◽  
Vol XLII-2/W16 ◽  
pp. 67-74 ◽  
Author(s):  
D. Clermont ◽  
C. Kruse ◽  
F. Rottensteiner ◽  
C. Heipke
Keyword(s):  
Neural Networks ◽  
World War Ii ◽  
Convolutional Neural Networks ◽  
Classification Problem ◽  
Aerial Images ◽  
Explosion Hazard ◽  
World War ◽  
Combining Data ◽  
The Given

<p><strong>Abstract.</strong> The aftermath of the air strikes during World War II is still present today. Numerous bombs dropped by planes did not explode, still exist in the ground and pose a considerable explosion hazard. Tracking down these duds can be tackled by detecting bomb craters. The existence of a dud can be inferred from the existence of a crater. This work proposes a method for the automatic detection of bomb craters in aerial wartime images. First of all, crater candidates are extracted from an image using a blob detector. Based on given crater references, for every candidate it is checked whether it, in fact, represents a crater or not. Candidates from various aerial images are used to train, validate and test Convolutional Neural Networks (CNNs) in the context of a two-class classification problem. A loss function (controlling what the CNNs are learning) is adapted to the given task. The trained CNNs are then used for the classification of crater candidates. Our work focuses on the classification of crater candidates and we investigate if combining data from related domains is beneficial for the classification. We achieve a F1-score of up to 65.4% when classifying crater candidates with a realistic class distribution.</p>

scholarly journals ADVERSARIAL DOMAIN ADAPTATION FOR THE CLASSIFICATION OF AERIAL IMAGES AND HEIGHT DATA USING CONVOLUTIONAL NEURAL NETWORKS

2019 ◽  
Vol IV-2/W7 ◽  
pp. 197-204 ◽  
Author(s):  
D. Wittich ◽  
F. Rottensteiner
Keyword(s):  
Neural Networks ◽  
Convolutional Neural Networks ◽  
Domain Adaptation ◽  
Feature Representation ◽  
Training Data ◽  
Aerial Images ◽  
Remotely Sensed Data ◽  
Target Domain ◽  
Deep Convolutional Neural Networks

<p><strong>Abstract.</strong> Domain adaptation (DA) can drastically decrease the amount of training data needed to obtain good classification models by leveraging available data from a source domain for the classification of a new (target) domains. In this paper, we address deep DA, i.e. DA with deep convolutional neural networks (CNN), a problem that has not been addressed frequently in remote sensing. We present a new method for semi-supervised DA for the task of pixel-based classification by a CNN. After proposing an encoder-decoder-based fully convolutional neural network (FCN), we adapt a method for adversarial discriminative DA to be applicable to the pixel-based classification of remotely sensed data based on this network. It tries to learn a feature representation that is domain invariant; domain-invariance is measured by a classifier’s incapability of predicting from which domain a sample was generated. We evaluate our FCN on the ISPRS labelling challenge, showing that it is close to the best-performing models. DA is evaluated on the basis of three domains. We compare different network configurations and perform the representation transfer at different layers of the network. We show that when using a proper layer for adaptation, our method achieves a positive transfer and thus an improved classification accuracy in the target domain for all evaluated combinations of source and target domains.</p>

scholarly journals TOWARDS BETTER CLASSIFICATION OF LAND COVER AND LAND USE BASED ON CONVOLUTIONAL NEURAL NETWORKS

2019 ◽  
Vol XLII-2/W13 ◽  
pp. 139-146
Author(s):  
C. Yang ◽  
F. Rottensteiner ◽  
C. Heipke
Keyword(s):  
Neural Networks ◽  
Land Use ◽  
Land Cover ◽  
Convolutional Neural Networks ◽  
Land Cover Classification ◽  
Aerial Images ◽  
Infrared Band ◽  
Rgb Images ◽  
Geospatial Databases

<p><strong>Abstract.</strong> Land use and land cover are two important variables in remote sensing. Commonly, the information of land use is stored in geospatial databases. In order to update such databases, we present a new approach to determine the land cover and to classify land use objects using convolutional neural networks (CNN). High-resolution aerial images and derived data such as digital surface models serve as input. An encoder-decoder based CNN is used for land cover classification. We found a composite including the infrared band and height data to outperform RGB images in land cover classification. We also propose a CNN-based methodology for the prediction of land use label from the geospatial databases, where we use masks representing object shape, the RGB images and the pixel-wise class scores of land cover as input. For this task, we developed a two-branch network where the first branch considers the whole area of an image, while the second branch focuses on a smaller relevant area. We evaluated our methods using two sites and achieved an overall accuracy of up to 89.6% and 81.7% for land cover and land use, respectively. We also tested our methods for land cover classification using the Vaihingen dataset of the ISPRS 2D semantic labelling challenge and achieved an overall accuracy of 90.7%.</p>

scholarly journals The analysis of VERITAS muon images using convolutional neural networks

2016 ◽  
Vol 12 (S325) ◽  
pp. 173-179 ◽  
Author(s):  
Qi Feng ◽  
Tony T. Y. Lin ◽  
Keyword(s):  
Neural Networks ◽  
Convolutional Neural Networks ◽  
Gamma Ray ◽  
Cosmic Ray ◽  
Classification Problem ◽  
Machine Learning Algorithms ◽  
Cherenkov Telescopes ◽  
Small Set ◽  
Regression Problems

AbstractImaging atmospheric Cherenkov telescopes (IACTs) are sensitive to rare gamma-ray photons, buried in the background of charged cosmic-ray (CR) particles, the flux of which is several orders of magnitude greater. The ability to separate gamma rays from CR particles is important, as it is directly related to the sensitivity of the instrument. This gamma-ray/CR-particle classification problem in IACT data analysis can be treated with the rapidly-advancing machine learning algorithms, which have the potential to outperform the traditional box-cut methods on image parameters. We present preliminary results of a precise classification of a small set of muon events using a convolutional neural networks model with the raw images as input features. We also show the possibility of using the convolutional neural networks model for regression problems, such as the radius and brightness measurement of muon events, which can be used to calibrate the throughput efficiency of IACTs.

Video Stream Gender Classification Using Shallow CNN

2020 ◽  
pp. 2155001
Author(s):  
Oleksii Gorokhovatskyi ◽  
Olena Peredrii
Keyword(s):  
Neural Networks ◽  
Convolutional Neural Networks ◽  
Classification Accuracy ◽  
Classification Problem ◽  
Video Stream ◽  
Gender Classification ◽  
Single Frame ◽  
Static Image ◽  
Image Datasets

This paper describes the investigation results about the usage of shallow (limited by few layers only) convolutional neural networks (CNNs) to solve the video-based gender classification problem. Different architectures of shallow CNN are proposed, trained and tested using balanced and unbalanced static image datasets. The influence of diverse voting over confidences methods, applied for frame-by-frame gender classification of the video stream, is investigated for possible enhancement of the classification accuracy. The possibility of the grouping of shallow networks into ensembles is investigated; it has been shown that the accuracy may be more improved with the further voting of separate shallow CNN classification results inside an ensemble over a single frame or different ones.

scholarly journals IMPROVING THE CLASSIFICATION OF LAND USE OBJECTS USING DENSE CONNECTIVITY OF CONVOLUTIONAL NEURAL NETWORKS

2020 ◽  
Vol XLIII-B2-2020 ◽  
pp. 667-673
Author(s):  
A. Gujrathi ◽  
C. Yang ◽  
F. Rottensteiner ◽  
K. M. Buddhiraju ◽  
C. Heipke
Keyword(s):  
Neural Networks ◽  
Land Use ◽  
Convolutional Neural Networks ◽  
Spatial Databases ◽  
Aerial Images ◽  
Automatic Process ◽  
Surface Model ◽  
Land Use Classification ◽  
Global Average

Abstract. Land use is an important variable in remote sensing which describes the functions carried out on a piece of land in order to obtain benefits and is especially useful to the personnel working in the fields of urban management and planning. The land use information is maintained by national mapping agencies in geo-spatial databases. Commonly, land use data is stored in the form of polygon objects; the label of the object indicates land use. The main goal of classification of land use objects is to update an existing database in an automatic process. Recently, Convolutional Neural Networks (CNN) have been widely used to tackle this task utilizing high resolution aerial images (and derived data such as digital surface model). One big challenge classifying polygons is to deal with the large variation in their geometrical extent. For this challenge, we adopt the method of Yang et al. (2019) to decompose polygons into regular patches of fixed size. The decomposition leads to two sets of polygons: small and large, where the former suffers from a lower identification rate. In this paper, we propose CNN methods which incorporate dense connectivity and integrate it with intermediate information via global average pooling to improve land use classification, mainly focusing on small polygons. We present different network variants by incorporating intermediate information via global average pooling from different stages of the network. We test our methods on two sites; our experiments show that the dense connectivity and integration of intermediate information has a positive effect not only on the classification accuracy on the whole but also on the identification of small polygons.

scholarly journals Photometric Classification of Early-time Supernova Light Curves with SCONE

2022 ◽  
Vol 163 (2) ◽  
pp. 57
Author(s):  
Helen Qu ◽  
Masao Sako
Keyword(s):  
Neural Networks ◽  
Light Curve ◽  
Convolutional Neural Networks ◽  
Software Package ◽  
Early Time ◽  
Classification Problem ◽  
Light Curves ◽  
Model Code ◽  
Time Space

Abstract In this work, we present classification results on early supernova light curves from SCONE, a photometric classifier that uses convolutional neural networks to categorize supernovae (SNe) by type using light-curve data. SCONE is able to identify SN types from light curves at any stage, from the night of initial alert to the end of their lifetimes. Simulated LSST SNe light curves were truncated at 0, 5, 15, 25, and 50 days after the trigger date and used to train Gaussian processes in wavelength and time space to produce wavelength–time heatmaps. SCONE uses these heatmaps to perform six-way classification between SN types Ia, II, Ibc, Ia-91bg, Iax, and SLSN-I. SCONE is able to perform classification with or without redshift, but we show that incorporating redshift information improves performance at each epoch. SCONE achieved 75% overall accuracy at the date of trigger (60% without redshift), and 89% accuracy 50 days after trigger (82% without redshift). SCONE was also tested on bright subsets of SNe (r < 20 mag) and produced 91% accuracy at the date of trigger (83% without redshift) and 95% five days after trigger (94.7% without redshift). SCONE is the first application of convolutional neural networks to the early-time photometric transient classification problem. All of the data processing and model code developed for this paper can be found in the SCONE software package 1 1 github.com/helenqu/scone located at github.com/helenqu/scone (Qu 2021).

scholarly journals Dog Breed Identification with Fine tuning of Pre-trained models

2019 ◽  
Vol 8 (2S11) ◽  
pp. 3677-3680
Keyword(s):  
Neural Networks ◽  
Transfer Learning ◽  
Convolutional Neural Networks ◽  
Classification Problem ◽  
Training Data ◽  
Fine Tuning ◽  
Dog Breed ◽  
Classification Of Images ◽  
Multiclass Classifier

Dog Breed identification is a specific application of Convolutional Neural Networks. Though the classification of Images by Convolutional Neural Network serves to be efficient method, still it has few drawbacks. Convolutional Neural Networks requires a large amount of images as training data and basic time for training the data and to achieve higher accuracy on the classification. To overcome this substantial time we use Transfer Learning. In computer vision, transfer learning refers to the use of a pre-trained models to train the CNN. By Transfer learning, a pre-trained model is trained to provide solution to classification problem which is similar to the classification problem we have. In this project we are using various pre-trained models like VGG16, Xception, InceptionV3 to train over 1400 images covering 120 breeds out of which 16 breeds of dogs were used as classes for training and obtain bottleneck features from these pre-trained models. Finally, Logistic Regression a multiclass classifier is used to identify the breed of the dog from the images and obtained 91%, 94%,95% validation accuracy for these different pre-trained models VGG16, Xception, InceptionV3.

scholarly journals CLASSIFICATION OF LAND COVER AND LAND USE BASED ON CONVOLUTIONAL NEURAL NETWORKS

2018 ◽  
Vol IV-3 ◽  
pp. 251-258 ◽  
Author(s):  
Chun Yang ◽  
Franz Rottensteiner ◽  
Christian Heipke
Keyword(s):  
Neural Networks ◽  
Land Use ◽  
Land Cover ◽  
Convolutional Neural Networks ◽  
Input Data ◽  
Input Image ◽  
Aerial Images ◽  
Positive Contribution ◽  
Land Use Classification

Land cover describes the physical material of the earth’s surface, whereas land use describes the socio-economic function of a piece of land. Land use information is typically collected in geospatial databases. As such databases become outdated quickly, an automatic update process is required. This paper presents a new approach to determine land cover and to classify land use objects based on convolutional neural networks (CNN). The input data are aerial images and derived data such as digital surface models. Firstly, we apply a CNN to determine the land cover for each pixel of the input image. We compare different CNN structures, all of them based on an encoder-decoder structure for obtaining dense class predictions. Secondly, we propose a new CNN-based methodology for the prediction of the land use label of objects from a geospatial database. In this context, we present a strategy for generating image patches of identical size from the input data, which are classified by a CNN. Again, we compare different CNN architectures. Our experiments show that an overall accuracy of up to 85.7&amp;thinsp;% and 77.4&amp;thinsp;% can be achieved for land cover and land use, respectively. The classification of land cover has a positive contribution to the classification of the land use classification.

CNN-based Classification of Degraded Images

2020 ◽  
Vol 2020 (10) ◽  
pp. 28-1-28-7 ◽  
Author(s):  
Kazuki Endo ◽  
Masayuki Tanaka ◽  
Masatoshi Okutomi
Keyword(s):  
Neural Networks ◽  
Image Restoration ◽  
Image Classification ◽  
Convolutional Neural Networks ◽  
Deep Convolutional Neural Networks ◽  
Alternative Approach ◽  
Degraded Image ◽  
Degraded Images ◽  
Straightforward Approach

Classification of degraded images is very important in practice because images are usually degraded by compression, noise, blurring, etc. Nevertheless, most of the research in image classification only focuses on clean images without any degradation. Some papers have already proposed deep convolutional neural networks composed of an image restoration network and a classification network to classify degraded images. This paper proposes an alternative approach in which we use a degraded image and an additional degradation parameter for classification. The proposed classification network has two inputs which are the degraded image and the degradation parameter. The estimation network of degradation parameters is also incorporated if degradation parameters of degraded images are unknown. The experimental results showed that the proposed method outperforms a straightforward approach where the classification network is trained with degraded images only.

Sign in / Sign up

Export Citation Format

Share Document