Swin Transformer and Deep Convolutional Neural Networks for Coastal Wetland Classification Using Sentinel-1, Sentinel-2, and LiDAR Data

The use of machine learning algorithms to classify complex landscapes has been revolutionized by the introduction of deep learning techniques, particularly in remote sensing. Convolutional neural networks (CNNs) have shown great success in the classification of complex high-dimensional remote sensing imagery, specifically in wetland classification. On the other hand, the state-of-the-art natural language processing (NLP) algorithms are transformers. Although the transformers have been studied for a few remote sensing applications, the integration of deep CNNs and transformers has not been studied, particularly in wetland mapping. As such, in this study, we explore the potential and possible limitations to be overcome regarding the use of a multi-model deep learning network with the integration of a modified version of the well-known deep CNN network of VGG-16, a 3D CNN network, and Swin transformer for complex coastal wetland classification. Moreover, we discuss the potential and limitation of the proposed multi-model technique over several solo models, including a random forest (RF), support vector machine (SVM), VGG-16, 3D CNN, and Swin transformer in the pilot site of Saint John city located in New Brunswick, Canada. In terms of F-1 score, the multi-model network obtained values of 0.87, 0.88, 0.89, 0.91, 0.93, 0.93, and 0.93 for the recognition of shrub wetland, fen, bog, aquatic bed, coastal marsh, forested wetland, and freshwater marsh, respectively. The results suggest that the multi-model network is superior to other solo classifiers from 3.36% to 33.35% in terms of average accuracy. Results achieved in this study suggest the high potential for integrating and using CNN networks with the cutting-edge transformers for the classification of complex landscapes in remote sensing.

Swin Transformer for Complex Coastal Wetland Classification Using the Integration of Sentinel-1 and Sentinel-2 Imagery

The emergence of deep learning techniques has revolutionized the use of machine learning algorithms to classify complicated environments, notably in remote sensing. Convolutional Neural Networks (CNNs) have shown considerable promise in classifying challenging high-dimensional remote sensing data, particularly in the classification of wetlands. State-of-the-art Natural Language Processing (NLP) algorithms, on the other hand, are transformers. Despite the fact that transformers have been utilized for a few remote sensing applications, they have not been compared to other well-known CNN networks in complex wetland classification. As such, for the classification of complex coastal wetlands in the study area of Saint John city, located in New Brunswick, Canada, we modified and employed the Swin Transformer algorithm. Moreover, the developed transformer classifier results were compared with two well-known deep CNNs of AlexNet and VGG-16. In terms of average accuracy, the proposed Swin Transformer algorithm outperformed the AlexNet and VGG-16 techniques by 14.3% and 44.28%, respectively. The proposed Swin Transformer classifier obtained F-1 scores of 0.65, 0.71, 0.73, 0.78, 0.82, 0.84, and 0.84 for the recognition of coastal marsh, shrub, bog, fen, aquatic bed, forested wetland, and freshwater marsh, respectively. The results achieved in this study suggest the high capability of transformers over very deep CNN networks for the classification of complex landscapes in remote sensing.

The RADARSAT Constellation Mission Core Applications: First Results

The Canadian RADARSAT Constellation Mission (RCM) has passed its early operation phase with the performance evaluation being currently active. This evaluation aims to confirm that the innovative design of the mission’s synthetic aperture radar (SAR) meets the expectations of intended users. In this study, we provide an overview of initial results obtained for three high-priority applications; flood mapping, sea ice analysis, and wetland classification. In our study, the focus is on results obtained using not only linear polarization, but also the adopted Compact Polarimetric (CP) architecture in RCM. Our study shows a promising level of agreement between RCM and RADARSAT-2 performance in flood mapping using dual-polarized HH-HV SAR data over Red River, Manitoba, suggesting smooth continuity between the two satellite missions for operational flood mapping. Visual analysis of coincident RCM CP and RADARSAT-2 dual-polarized HH-HV SAR imagery over the Resolute Passage, Canadian Central Arctic, highlighted an improved contrast between sea ice classes in dry ice winter conditions. A statistical analysis using selected sea ice samples confirmed the increased contrast between thin and both rough and deformed ice in CP SAR. This finding is expected to enhance Canadian Ice Service’s (CIS) operational visual analysis of sea ice in RCM SAR imagery for ice chart production. Object-oriented classification of a wetland area in Newfoundland and Labrador by fusion of RCM dual-polarized VV-VH data and Sentinel-2 optical imagery revealed promising classification results, with an overall accuracy of 91.1% and a kappa coefficient of 0.87. Marsh presented the highest user’s and producer’s accuracies (87.77% and 82.08%, respectively) compared to fog, fen, and swamp.

Object-Based Multigrained Cascade Forest Method for Wetland Classification Using Sentinel-2 and Radarsat-2 Imagery

The development of advanced and efficient methods for mapping and monitoring wetland regions is essential for wetland resources conservation, management, and sustainable development. Although remote sensing technology has been widely used for detecting wetlands information, it remains a challenge for wetlands classification due to the extremely complex spatial patterns and fuzzy boundaries. This study aims to implement a comprehensive and effective classification scheme for wetland land covers. To achieve this goal, a novel object-based multigrained cascade forest (OGCF) method with multisensor data (including Sentinel-2 and Radarsat-2 remote sensing imagery) was proposed to classify the wetlands and their adjacent land cover classes in the wetland National Natural Reserve. Moreover, a hybrid selection method (ReliefF-RF) was proposed to optimize the feature set in which the spectral and polarimetric decomposition features are contained. We obtained six spectral features from visible and shortwave infrared bands and 10 polarimetric decomposition features from the H/A/Alpha, Pauli, and Krogager decomposition methods. The experimental results showed that the OGCF method with multisource features for land cover classification in wetland regions achieved the overall accuracy and kappa coefficient of 88.20% and 0.86, respectively, which outperformed the support vector machine (SVM), extreme gradient boosting (XGBoost), random forest (RF), and deep neural network (DNN). The accuracy of the wetland classes ranged from 75.00% to 97.53%. The proposed OGCF method exhibits a good application potential for wetland land cover classification. The classification scheme in this study will make a positive contribution to wetland inventory and monitoring and be able to provide technical support for protecting and developing natural resources.

A COMPARISON OF TREE-BASED ALGORITHMS FOR COMPLEX WETLAND CLASSIFICATION USING THE GOOGLE EARTH ENGINE

Wetlands are endangered ecosystems that are required to be systematically monitored. Wetlands have significant contributions to the well-being of human-being, fauna, and fungi. They provide vital services, including water storage, carbon sequestration, food security, and protecting the shorelines from floods. Remote sensing is preferred over the other conventional earth observation methods such as field surveying. It provides the necessary tools for the systematic and standardized method of large-scale wetland mapping. On the other hand, new cloud computing technologies for the storage and processing of large-scale remote sensing big data such as the Google Earth Engine (GEE) have emerged. As such, for the complex wetland classification in the pilot site of the Avalon, Newfoundland, Canada, we compare the results of three tree-based classifiers of the Decision Tree (DT), Random Forest (RF), and Extreme Gradient Boosting (XGB) available in the GEE code editor using Sentinel-2 images. Based on the results, the XGB classifier with an overall accuracy of 82.58% outperformed the RF (82.52%) and DT (77.62%) classifiers.

A Synergic Use of Sentinel-1 and Sentinel-2 Imagery for Complex Wetland Classification Using Generative Adversarial Network (GAN) Scheme

Due to anthropogenic activities and climate change, many natural ecosystems, especially wetlands, are lost or changing at a rapid pace. For the last decade, there has been increasing attention towards developing new tools and methods for the mapping and classification of wetlands using remote sensing. At the same time, advances in artificial intelligence and machine learning, particularly deep learning models, have provided opportunities to advance wetland classification methods. However, the developed deep and very deep algorithms require a higher number of training samples, which is costly, logistically demanding, and time-consuming. As such, in this study, we propose a Deep Convolutional Neural Network (DCNN) that uses a modified architecture of the well-known DCNN of the AlexNet and a Generative Adversarial Network (GAN) for the generation and classification of Sentinel-1 and Sentinel-2 data. Applying to an area of approximately 370 sq. km in the Avalon Peninsula, Newfoundland, the proposed model with an average accuracy of 92.30% resulted in F-1 scores of 0.82, 0.85, 0.87, 0.89, and 0.95 for the recognition of swamp, fen, marsh, bog, and shallow water, respectively. Moreover, the proposed DCNN model improved the F-1 score of bog, marsh, fen, and swamp wetland classes by 4%, 8%, 11%, and 26%, respectively, compared to the original CNN network of AlexNet. These results reveal that the proposed model is highly capable of the generation and classification of Sentinel-1 and Sentinel-2 wetland samples and can be used for large-extent classification problems.

Synergetic Classification of Coastal Wetlands over the Yellow River Delta with GF-3 Full-Polarization SAR and Zhuhai-1 OHS Hyperspectral Remote Sensing

The spatial distribution of coastal wetlands affects their ecological functions. Wetland classification is a challenging task for remote sensing research due to the similarity of different wetlands. In this study, a synergetic classification method developed by fusing the 10 m Zhuhai-1 Constellation Orbita Hyperspectral Satellite (OHS) imagery with 8 m C-band Gaofen-3 (GF-3) full-polarization Synthetic Aperture Radar (SAR) imagery was proposed to offer an updated and reliable quantitative description of the spatial distribution for the entire Yellow River Delta coastal wetlands. Three classical machine learning algorithms, namely, the maximum likelihood (ML), Mahalanobis distance (MD), and support vector machine (SVM), were used for the synergetic classification of 18 spectral, index, polarization, and texture features. The results showed that the overall synergetic classification accuracy of 97% is significantly higher than that of single GF-3 or OHS classification, proving the performance of the fusion of full-polarization SAR data and hyperspectral data in wetland mapping. The synergy of polarimetric SAR (PolSAR) and hyperspectral imagery enables high-resolution classification of wetlands by capturing images throughout the year, regardless of cloud cover. The proposed method has the potential to provide wetland classification results with high accuracy and better temporal resolution in different regions. Detailed and reliable wetland classification results would provide important wetlands information for better understanding the habitat area of species, migration corridors, and the habitat change caused by natural and anthropogenic disturbances.