Temporally Generalizable Land Cover Classification: A Recurrent Convolutional Neural Network Unveils Major Coastal Change through Time

The ability to accurately classify land cover in periods before appropriate training and validation data exist is a critical step towards understanding subtle long-term impacts of climate change. These trends cannot be properly understood and distinguished from individual disturbance events or decadal cycles using only a decade or less of data. Understanding these long-term changes in low lying coastal areas, home to a huge proportion of the global population, is of particular importance. Relatively simple deep learning models that extract representative spatiotemporal patterns can lead to major improvements in temporal generalizability. To provide insight into major changes in low lying coastal areas, our study (1) developed a recurrent convolutional neural network that incorporates spectral, spatial, and temporal contexts for predicting land cover class, (2) evaluated this model across time and space and compared this model to conventional Random Forest and Support Vector Machine methods as well as other deep learning approaches, and (3) applied this model to classify land cover across 20 years of Landsat 5 data in the low-lying coastal plain of North Carolina, USA. We observed striking changes related to sea level rise that support evidence on a smaller scale of agricultural land and forests transitioning into wetlands and “ghost forests”. This work demonstrates that recurrent convolutional neural networks should be considered when a model is needed that can generalize across time and that they can help uncover important trends necessary for understanding and responding to climate change in vulnerable coastal regions.

Download Full-text

Early Detection of Plant Viral Disease Using Hyperspectral Imaging and Deep Learning

Sensors ◽

10.3390/s21030742 ◽

2021 ◽

Vol 21 (3) ◽

pp. 742

Author(s):

Canh Nguyen ◽

Vasit Sagan ◽

Matthew Maimaitiyiming ◽

Maitiniyazi Maimaitijiang ◽

Sourav Bhadra ◽

...

Keyword(s):

Neural Network ◽

Deep Learning ◽

Early Detection ◽

Convolutional Neural Network ◽

Near Infrared ◽

Hyperspectral Data ◽

Viral Diseases ◽

Support Vector ◽

Spectral Features ◽

Feature Spaces

Early detection of grapevine viral diseases is critical for early interventions in order to prevent the disease from spreading to the entire vineyard. Hyperspectral remote sensing can potentially detect and quantify viral diseases in a nondestructive manner. This study utilized hyperspectral imagery at the plant level to identify and classify grapevines inoculated with the newly discovered DNA virus grapevine vein-clearing virus (GVCV) at the early asymptomatic stages. An experiment was set up at a test site at South Farm Research Center, Columbia, MO, USA (38.92 N, −92.28 W), with two grapevine groups, namely healthy and GVCV-infected, while other conditions were controlled. Images of each vine were captured by a SPECIM IQ 400–1000 nm hyperspectral sensor (Oulu, Finland). Hyperspectral images were calibrated and preprocessed to retain only grapevine pixels. A statistical approach was employed to discriminate two reflectance spectra patterns between healthy and GVCV vines. Disease-centric vegetation indices (VIs) were established and explored in terms of their importance to the classification power. Pixel-wise (spectral features) classification was performed in parallel with image-wise (joint spatial–spectral features) classification within a framework involving deep learning architectures and traditional machine learning. The results showed that: (1) the discriminative wavelength regions included the 900–940 nm range in the near-infrared (NIR) region in vines 30 days after sowing (DAS) and the entire visual (VIS) region of 400–700 nm in vines 90 DAS; (2) the normalized pheophytization index (NPQI), fluorescence ratio index 1 (FRI1), plant senescence reflectance index (PSRI), anthocyanin index (AntGitelson), and water stress and canopy temperature (WSCT) measures were the most discriminative indices; (3) the support vector machine (SVM) was effective in VI-wise classification with smaller feature spaces, while the RF classifier performed better in pixel-wise and image-wise classification with larger feature spaces; and (4) the automated 3D convolutional neural network (3D-CNN) feature extractor provided promising results over the 2D convolutional neural network (2D-CNN) in learning features from hyperspectral data cubes with a limited number of samples.

Download Full-text

Deep learning model for protein disease classification

Current Bioinformatics ◽

10.2174/1574893616666211108094205 ◽

2021 ◽

Vol 16 ◽

Author(s):

Farida Alaaeldin Mostafa ◽

Yasmine Mohamed Afify ◽

Rasha Mohamed Ismail ◽

Nagwa Lotfy Badr

Keyword(s):

Neural Network ◽

Support Vector Machine ◽

Deep Learning ◽

Convolutional Neural Network ◽

Network Model ◽

Neural Network Model ◽

Protein Analysis ◽

Kernel Functions ◽

Support Vector ◽

Feature Descriptors

Background: Protein sequence analysis helps in the prediction of protein functions. As the number of proteins increases, it gives the bioinformaticians a challenge to analyze and study the similarity between them. Most of the existing protein analysis methods use Support Vector Machine. Deep learning did not receive much attention regarding protein analysis as it is noted that little work focused on studying the protein diseases classification. Objective: The contribution of this paper is to present a deep learning approach that classifies protein diseases based on protein descriptors. Methods: Different protein descriptors are used and decomposed into modified feature descriptors. Uniquely, we introduce using Convolutional Neural Network model to learn and classify protein diseases. The modified feature descriptors are fed to the Convolutional Neural Network model on a dataset of 1563 protein sequences classified into 3 different disease classes: Aids, Tumor suppressor, and Proto oncogene. Results: The usage of the modified feature descriptors shows a significant increase in the performance of the Convolutional Neural Network model over Support Vector Machine using different kernel functions. One modified feature descriptor improved by 19.8%, 27.9%, 17.6%, 21.5%, 17.3%, and 22% for evaluation metrics: Area Under the Curve, Matthews Correlation Coefficient, Accuracy, F1-score, Recall, and Precision, respectively. Conclusion: Results show that the prediction of the proposed modified feature descriptors significantly surpasses that of Support Vector Machine model.

Download Full-text

Method for Mapping Rice Fields in Complex Landscape Areas Based on Pre-Trained Convolutional Neural Network from HJ-1 A/B Data

ISPRS International Journal of Geo-Information ◽

10.3390/ijgi7110418 ◽

2018 ◽

Vol 7 (11) ◽

pp. 418 ◽

Cited By ~ 12

Author(s):

Tian Jiang ◽

Xiangnan Liu ◽

Ling Wu

Keyword(s):

Neural Network ◽

Remote Sensing ◽

Time Series ◽

Deep Learning ◽

Convolutional Neural Network ◽

Vegetation Index ◽

Southern China ◽

Series Data ◽

Support Vector ◽

Complex Landscape

Accurate and timely information about rice planting areas is essential for crop yield estimation, global climate change and agricultural resource management. In this study, we present a novel pixel-level classification approach that uses convolutional neural network (CNN) model to extract the features of enhanced vegetation index (EVI) time series curve for classification. The goal is to explore the practicability of deep learning techniques for rice recognition in complex landscape regions, where rice is easily confused with the surroundings, by using mid-resolution remote sensing images. A transfer learning strategy is utilized to fine tune a pre-trained CNN model and obtain the temporal features of the EVI curve. Support vector machine (SVM), a traditional machine learning approach, is also implemented in the experiment. Finally, we evaluate the accuracy of the two models. Results show that our model performs better than SVM, with the overall accuracies being 93.60% and 91.05%, respectively. Therefore, this technique is appropriate for estimating rice planting areas in southern China on the basis of a pre-trained CNN model by using time series data. And more opportunity and potential can be found for crop classification by remote sensing and deep learning technique in the future study.

Download Full-text

Deep Learning Assisted Neonatal Cry Classification via Support Vector Machine Models

Frontiers in Public Health ◽

10.3389/fpubh.2021.670352 ◽

2021 ◽

Vol 9 ◽

Author(s):

Ashwini K ◽

P. M. Durai Raj Vincent ◽

Kathiravan Srinivasan ◽

Chuan-Yu Chang

Keyword(s):

Neural Network ◽

Machine Learning ◽

Support Vector Machine ◽

Feature Extraction ◽

Deep Learning ◽

Convolutional Neural Network ◽

Support Vector ◽

Svm Classifier ◽

Infant Cry ◽

Learning Techniques

Neonatal infants communicate with us through cries. The infant cry signals have distinct patterns depending on the purpose of the cries. Preprocessing, feature extraction, and feature selection need expert attention and take much effort in audio signals in recent days. In deep learning techniques, it automatically extracts and selects the most important features. For this, it requires an enormous amount of data for effective classification. This work mainly discriminates the neonatal cries into pain, hunger, and sleepiness. The neonatal cry auditory signals are transformed into a spectrogram image by utilizing the short-time Fourier transform (STFT) technique. The deep convolutional neural network (DCNN) technique takes the spectrogram images for input. The features are obtained from the convolutional neural network and are passed to the support vector machine (SVM) classifier. Machine learning technique classifies neonatal cries. This work combines the advantages of machine learning and deep learning techniques to get the best results even with a moderate number of data samples. The experimental result shows that CNN-based feature extraction and SVM classifier provides promising results. While comparing the SVM-based kernel techniques, namely radial basis function (RBF), linear and polynomial, it is found that SVM-RBF provides the highest accuracy of kernel-based infant cry classification system provides 88.89% accuracy.

Download Full-text

Integrating Multitemporal Sentinel-1/2 Data for Coastal Land Cover Classification Using a Multibranch Convolutional Neural Network: A Case of the Yellow River Delta

Remote Sensing ◽

10.3390/rs11091006 ◽

2019 ◽

Vol 11 (9) ◽

pp. 1006 ◽

Cited By ~ 16

Author(s):

Quanlong Feng ◽

Jianyu Yang ◽

Dehai Zhu ◽

Jiantao Liu ◽

Hao Guo ◽

...

Keyword(s):

Neural Network ◽

Remote Sensing ◽

Deep Learning ◽

Land Cover ◽

Convolutional Neural Network ◽

Classification Accuracy ◽

Yellow River ◽

Rapid Development ◽

Land Cover Classification ◽

Coastal Land

Coastal land cover classification is a significant yet challenging task in remote sensing because of the complex and fragmented nature of coastal landscapes. However, availability of multitemporal and multisensor remote sensing data provides opportunities to improve classification accuracy. Meanwhile, rapid development of deep learning has achieved astonishing results in computer vision tasks and has also been a popular topic in the field of remote sensing. Nevertheless, designing an effective and concise deep learning model for coastal land cover classification remains problematic. To tackle this issue, we propose a multibranch convolutional neural network (MBCNN) for the fusion of multitemporal and multisensor Sentinel data to improve coastal land cover classification accuracy. The proposed model leverages a series of deformable convolutional neural networks to extract representative features from a single-source dataset. Extracted features are aggregated through an adaptive feature fusion module to predict final land cover categories. Experimental results indicate that the proposed MBCNN shows good performance, with an overall accuracy of 93.78% and a Kappa coefficient of 0.9297. Inclusion of multitemporal data improves accuracy by an average of 6.85%, while multisensor data contributes to 3.24% of accuracy increase. Additionally, the featured fusion module in this study also increases accuracy by about 2% when compared with the feature-stacking method. Results demonstrate that the proposed method can effectively mine and fuse multitemporal and multisource Sentinel data, which improves coastal land cover classification accuracy.

Download Full-text

OIL PATTERN IDENTIFICATION ANALYSIS USING SEMANTIC DEEP LEARNING METHOD FROM PLEIADES-1B SATELIITE IMAGERY WITH ARCGIS PRO SOFTWARE (Case Study: Village “A”)

IOP Conference Series Earth and Environmental Science ◽

10.1088/1755-1315/936/1/012021 ◽

2021 ◽

Vol 936 (1) ◽

pp. 012021

Author(s):

Novi Anita ◽

Bangun Muljo Sukojo ◽

Sondy Hardian Meisajiwa ◽

Muhammad Alfian Romadhon

Keyword(s):

Neural Network ◽

Deep Learning ◽

High Resolution ◽

Land Cover ◽

Convolutional Neural Network ◽

Local Community ◽

Confusion Matrix ◽

Test Method ◽

Oil Refinery ◽

Thermal Data

Abstract There are many petroleum mining activities scattered in developing countries, such as Indonesia. Indonesia is one of the largest oil-producing countries in Southeast Asia with the 23rd ranking. Since the Dutch era, Indonesia has produced a very large amount of petroleum. One of the oil producing areas is “A” Village. There is an old well that produces petroleum oil which is still active with an age of more than 100 years, for now the oil well is still used by the local community as the main source of livelihood. With this activity, resulting in an oil pattern around the old oil refinery, which over time will absorb into the ground. This study aims to analyze and identify the oil pattern around the old oil refinery in the “A” area. The data used is in the form of High-Resolution Satellite Imagery (CSRT), namely Pleiades-1B with a spatial resolution of 1.5 meters. Data were identified using the Deep Learning Semantic method. For the limitation of this research is the administrative limit of XX Regency with a scale of 1: 25,000 as supporting data when cutting the image. The method used is the Deep Learning Convolutional Neural Network series. This research is based on how to wait for the method of the former oil spill which is the consideration of the consideration used. This study produced a land cover map that was classified into 3 categories, namely oil patterns area, area not affected by oil and vegetation. As a supporting value to show the accuracy of the classification results, an accuracy test method is used with the confusion matrix method. To show the accuracy of this study using thermal data taken from the field. Thermal data used in the form of numbers that show the temperature of each land cover. Based on the above reference, a research related to the analysis of very high-resolution image data (Pleiades-1B) will be conducted to examine the oil pattern. This research uses the deep learning series convolutional neural network (CNN) method. With this research, it is hoped that it can help agencies in knowing the right method to identify oil in mainland areas.

Download Full-text

Soil Classification Based on Deep Learning Algorithm and Visible Near-Infrared Spectroscopy

Journal of Spectroscopy ◽

10.1155/2021/1508267 ◽

2021 ◽

Vol 2021 ◽

pp. 1-11

Author(s):

Xueying Li ◽

Pingping Fan ◽

Zongmin Li ◽

Guangyuan Chen ◽

Huimin Qiu ◽

...

Keyword(s):

Neural Network ◽

Infrared Spectroscopy ◽

Land Cover ◽

Convolutional Neural Network ◽

Near Infrared Spectroscopy ◽

Near Infrared ◽

Learning Algorithm ◽

Support Vector ◽

Deep Learning Algorithm ◽

Different Types

Changes in land cover will cause the changes in the climate and environmental characteristics, which has an important influence on the social economy and ecosystem. The main form of land cover is different types of soil. Compared with traditional methods, visible and near-infrared spectroscopy technology can classify different types of soil rapidly, effectively, and nondestructively. Based on the visible near-infrared spectroscopy technology, this paper takes the soil of six different land cover types in Qingdao, China orchards, woodlands, tea plantations, farmlands, bare lands, and grasslands as examples and establishes a convolutional neural network classification model. The classification results of different number of training samples are analyzed and compared with the support vector machine algorithm. Under the condition that Kennard–Stone algorithm divides the calibration set, the classification results of six different soil types and single six soil types by convolutional neural network are better than those by the support vector machine. Under the condition of randomly dividing the calibration set according to the proportion of 1/3 and 1/4, the classification results by convolutional neural network are also better. The aim of this study is to analyze the feasibility of land cover classification with small samples by convolutional neural network and, according to the deep learning algorithm, to explore new methods for rapid, nondestructive, and accurate classification of the land cover.

Download Full-text

Utilização de técnicas de Machine Learning e de Deep Learning para a predição de casos de internações causadas por dengue em municípios da Paraíba

10.5753/ercemapi.2021.17914 ◽

2021 ◽

Author(s):

Ewerthon Dyego de Araújo Batista ◽

Wellington Candeia de Araújo ◽

Romeryto Vieira Lira ◽

Laryssa Izabel de Araújo Batista

Keyword(s):

Neural Network ◽

Machine Learning ◽

Deep Learning ◽

Random Forest ◽

Convolutional Neural Network ◽

Support Vector Regression ◽

Multilayer Perceptron ◽

Support Vector

Dengue é um problema de saúde pública no Brasil, os casos da doença voltaram a crescer na Paraíba. O boletim epidemiológico da Paraíba, divulgado em agosto de 2021, informa um aumento de 53% de casos em relação ao ano anterior. Técnicas de Machine Learning (ML) e de Deep Learning estão sendo utilizadas como ferramentas para a predição da doença e suporte ao seu combate. Por meio das técnicas Random Forest (RF), Support Vector Regression (SVR), Multilayer Perceptron (MLP), Long ShortTerm Memory (LSTM) e Convolutional Neural Network (CNN), este artigo apresenta um sistema capaz de realizar previsões de internações causadas por dengue para as cidades Bayeux, Cabedelo, João Pessoa e Santa Rita. O sistema conseguiu realizar previsões para Bayeux com taxa de erro 0,5290, já em Cabedelo o erro foi 0,92742, João Pessoa 9,55288 e Santa Rita 0,74551.

Download Full-text

Mapping Paddy Rice Using a Convolutional Neural Network (CNN) with Landsat 8 Datasets in the Dongting Lake Area, China

Remote Sensing ◽

10.3390/rs10111840 ◽

2018 ◽

Vol 10 (11) ◽

pp. 1840 ◽

Cited By ~ 21

Author(s):

Meng Zhang ◽

Hui Lin ◽

Guangxing Wang ◽

Hua Sun ◽

Jing Fu

Keyword(s):

Neural Network ◽

Deep Learning ◽

Convolutional Neural Network ◽

Land Surface ◽

Single Channel ◽

Paddy Rice ◽

Support Vector ◽

Landsat 8 ◽

Lake Area ◽

Machine Method

Rice is one of the world’s major staple foods, especially in China. Highly accurate monitoring on rice-producing land is, therefore, crucial for assessing food supplies and productivity. Recently, the deep-learning convolutional neural network (CNN) has achieved considerable success in remote-sensing data analysis. A CNN-based paddy-rice mapping method using the multitemporal Landsat 8, phenology data, and land-surface temperature (LST) was developed during this study. First, the spatial–temporal adaptive reflectance fusion model (STARFM) was used to blend the moderate-resolution imaging spectroradiometer (MODIS) and Landsat data for obtaining multitemporal Landsat-like data. Subsequently, the threshold method is applied to derive the phenological variables from the Landsat-like (Normalized difference vegetation index) NDVI time series. Then, a generalized single-channel algorithm was employed to derive LST from the Landsat 8. Finally, multitemporal Landsat 8 spectral images, combined with phenology and LST data, were employed to extract paddy-rice information using a patch-based deep-learning CNN algorithm. The results show that the proposed method achieved an overall accuracy of 97.06% and a Kappa coefficient of 0.91, which are 6.43% and 0.07 higher than that of the support vector machine method, and 7.68% and 0.09 higher than that of the random forest method, respectively. Moreover, the Landsat-derived rice area is strongly correlated (R2 = 0.9945) with government statistical data, demonstrating that the proposed method has potential in large-scale paddy-rice mapping using moderate spatial resolution images.

Download Full-text