Image Splicing Localization via Semi-global Network and Fully Connected Conditional Random Fields

2019 ◽  
pp. 252-266
Author(s):  
Xiaodong Cun ◽  
Chi-Man Pun
Keyword(s):  
Random Fields ◽  
Conditional Random Fields ◽  
Global Network ◽  
Image Splicing ◽  
Fully Connected ◽  
Image Splicing Localization

scholarly journals An Automatic Extraction Method for Hatched Residential Areas in Raster Maps Based on Multi-Scale Feature Fusion

2021 ◽  
Vol 10 (12) ◽  
pp. 831
Author(s):  
Jianhua Wu ◽  
Jiaqi Xiong ◽  
Yu Zhao ◽  
Xiang Hu
Keyword(s):  
Random Fields ◽  
Conditional Random Fields ◽  
Feature Fusion ◽  
Gabor Filter ◽  
Residential Areas ◽  
Change Analysis ◽  
Land Quality ◽  
Multi Scale ◽  
Raster Maps ◽  
Fully Connected

Extracting the residential areas from digital raster maps is beneficial for research on land use change analysis and land quality assessment. In traditional methods for extracting residential areas in raster maps, parameters must be set manually; these methods also suffer from low extraction accuracy and inefficiency. Therefore, we have proposed an automatic method for extracting the hatched residential areas from raster maps based on a multi-scale U-Net and fully connected conditional random fields. The experimental results showed that the model that was based on a multi-scale U-Net with fully connected conditional random fields achieved scores of 97.05% in Dice, 94.26% in Intersection over Union, 94.92% in recall, 93.52% in precision and 99.52% in accuracy. Compared to the FCN-8s, the five metrics increased by 1.47%, 2.72%, 1.07%, 4.56% and 0.26%, respectively and compared to the U-Net, they increased by 0.84%, 1.56%, 3.00%, 0.65% and 0.13%, respectively. Our method also outperformed the Gabor filter-based algorithm in the number of identified objects and the accuracy of object contour locations. Furthermore, we were able to extract all of the hatched residential areas from a sheet of raster map. These results demonstrate that our method has high accuracy in object recognition and contour position, thereby providing a new method with strong potential for the extraction of hatched residential areas.

scholarly journals Fully Connected Conditional Random Fields for High-Resolution Remote Sensing Land Use/Land Cover Classification with Convolutional Neural Networks

2018 ◽  
Vol 10 (12) ◽  
pp. 1889 ◽  
Author(s):  
Bin Zhang ◽  
Cunpeng Wang ◽  
Yonglin Shen ◽  
Yueyan Liu
Keyword(s):  
Remote Sensing ◽  
High Resolution ◽  
Random Fields ◽  
Conditional Random Fields ◽  
Svm Classifier ◽  
Spectral Features ◽  
Remote Sensing Images ◽  
Feature Descriptors ◽  
New Feature ◽  
Fully Connected

The interpretation of land use and land cover (LULC) is an important issue in the fields of high-resolution remote sensing (RS) image processing and land resource management. Fully training a new or existing convolutional neural network (CNN) architecture for LULC classification requires a large amount of remote sensing images. Thus, fine-tuning a pre-trained CNN for LULC detection is required. To improve the classification accuracy for high resolution remote sensing images, it is necessary to use another feature descriptor and to adopt a classifier for post-processing. A fully connected conditional random fields (FC-CRF), to use the fine-tuned CNN layers, spectral features, and fully connected pairwise potentials, is proposed for image classification of high-resolution remote sensing images. First, an existing CNN model is adopted, and the parameters of CNN are fine-tuned by training datasets. Then, the probabilities of image pixels belong to each class type are calculated. Second, we consider the spectral features and digital surface model (DSM) and combined with a support vector machine (SVM) classifier, the probabilities belong to each LULC class type are determined. Combined with the probabilities achieved by the fine-tuned CNN, new feature descriptors are built. Finally, FC-CRF are introduced to produce the classification results, whereas the unary potentials are achieved by the new feature descriptors and SVM classifier, and the pairwise potentials are achieved by the three-band RS imagery and DSM. Experimental results show that the proposed classification scheme achieves good performance when the total accuracy is about 85%.

scholarly journals SAR Image Classification Using Fully Connected Conditional Random Fields Combined with Deep Learning and Superpixel Boundary Constraint

2021 ◽  
Vol 13 (2) ◽  
pp. 271
Author(s):  
Zhensheng Sun ◽  
Miao Liu ◽  
Peng Liu ◽  
Juan Li ◽  
Tao Yu ◽  
...  
Keyword(s):  
Remote Sensing ◽  
Image Classification ◽  
Random Fields ◽  
Conditional Random Fields ◽  
Microwave Remote Sensing ◽  
Electromagnetic Spectrum ◽  
Sar Image ◽  
Sensing Applications ◽  
Boundary Constraint ◽  
Fully Connected

As one of the most important active remote sensing technologies, synthetic aperture radar (SAR) provides advanced advantages of all-day, all-weather, and strong penetration capabilities. Due to its unique electromagnetic spectrum and imaging mechanism, the dimensions of remote sensing data have been considerably expanded. Important for fundamental research in microwave remote sensing, SAR image classification has been proven to have great value in many remote sensing applications. Many widely used SAR image classification algorithms rely on the combination of hand-designed features and machine learning classifiers, which still experience many issues that remain to be resolved and overcome, including optimized feature representation, the fuzzy confusion of speckle noise, the widespread applicability, and so on. To mitigate some of the issues and to improve the pattern recognition of high-resolution SAR images, a ConvCRF model combined with superpixel boundary constraint is developed. The proposed algorithm can successfully combine the local and global advantages of fully connected conditional random fields and deep models. An optimizing strategy using a superpixel boundary constraint in the inference iterations more efficiently preserves structure details. The experimental results demonstrate that the proposed method provides competitive advantages over other widely used models. In the land cover classification experiments using the MSTAR, E-SAR and GF-3 datasets, the overall accuracy of our proposed method achieves 90.18 ± 0.37, 91.63 ± 0.27, and 90.91 ± 0.31, respectively. Regarding the issues of SAR image classification, a novel integrated learning containing local and global image features can bring practical implications.

scholarly journals Fully Connected Conditional Random Fields for High-Resolution Remote Sensing Land Use/Land Cover Classification with Convolutional Neural Networks

2018 ◽  
Author(s):  
Bin Zhang ◽  
Cunpeng Wang ◽  
Yonglin Shen ◽  
Yueyan Liu
Keyword(s):  
Remote Sensing ◽  
High Resolution ◽  
Random Fields ◽  
Conditional Random Fields ◽  
Svm Classifier ◽  
Spectral Features ◽  
Remote Sensing Images ◽  
Feature Descriptors ◽  
New Feature ◽  
Fully Connected

The interpretation of land use and land cover (LULC) is an important issue in the fields of high-resolution remote sensing (RS) image processing and land resource management. Fully training a new or existing convolutional neural network (CNN) architecture for LULC classification requires a large amount of remote sensing images. Thus, fine-tuning a pre-trained CNN for LULC detection is required. To improve the classification accuracy for high resolution remote sensing images, it is necessary to use another feature descriptor and to adopt a classifier for post-processing. A fully connected conditional random fields (FC-CRF), to use the fine-tuned CNN layers, spectral features, and fully connected pairwise potentials, is proposed for image classification of high-resolution remote sensing images. First, an existing CNN model is adopted, and the parameters of CNN are fine-tuned by training datasets. Then, the probabilities of image pixels belong to each class type are calculated. Second, we consider the spectral features and digital surface model (DSM) and combined with a support vector machine (SVM) classifier, the probabilities belong to each LULC class type are determined. Combined with the probabilities achieved by the fine-tuned CNN, new feature descriptors are built. Finally, FC-CRF are introduced to produce the classification results, whereas the unary potentials are achieved by the new feature descriptors and SVM classifier, and the pairwise potentials are achieved by the three-band RS imagery and DSM. Experimental results show that the proposed classification scheme achieves good performance when the total accuracy is about 85%.

Sign in / Sign up

Export Citation Format

Share Document