scholarly journals A CNN-Based Pan-Sharpening Method for Integrating Panchromatic and Multispectral Images Using Landsat 8

2019 ◽  
Vol 11 (22) ◽  
pp. 2606 ◽  
Author(s):  
Zhiqiang Li ◽  
Chengqi Cheng
Keyword(s):  
Spatial Resolution ◽  
Mean Squared Error ◽  
High Spatial Resolution ◽  
Multispectral Image ◽  
Landsat 8 ◽  
Spectral Angle Mapper ◽  
Learning Capacity ◽  
Panchromatic Image ◽  
Highly Nonlinear ◽  
Construction Tasks

The increasing availability of sensors enables the combination of a high-spatial-resolution panchromatic image and a low-spatial-resolution multispectral image, which has become a hotspot in recent years for many applications. To address the spectral and spatial distortions that adversely affect the conventional methods, a pan-sharpening method based on a convolutional neural network (CNN) architecture is proposed in this paper, where the low-spatial-resolution multispectral image is upgraded and integrated with the high-spatial-resolution panchromatic image to produce a new multispectral image with high spatial resolution. Based on the pyramid structure of the CNN architecture, the proposed method has high learning capacity to generate more representative and robust hierarchical features for construction tasks. Moreover, the highly nonlinear fusion process can be effectively simulated by stacking several linear filtering layers, which is suitable for learning the complex mapping relationship between a high-spatial-resolution panchromatic and low-spatial-resolution multispectral image. Both qualitative and quantitative experimental analyses were carried out on images captured from a Landsat 8 on-board operational land imager (LOI) sensor to demonstrate the method’s performance. The results regarding the sensitivity analysis of the involved parameters indicate the effects of parameters on the performance of our CNN-based pan-sharpening approach. Additionally, our CNN-based pan-sharpening approach outperforms other existing conventional pan-sharpening methods with a more promising fusion result for different landcovers, with differences in Erreur Relative Globale Adimensionnelle de Synthse (ERGAS), root-mean-squared error (RMSE), and spectral angle mapper (SAM) of 0.69, 0.0021, and 0.81 on average, respectively.

scholarly journals Enhanced Back-Projection as Postprocessing for Pansharpening

2019 ◽  
Vol 11 (6) ◽  
pp. 712 ◽  
Author(s):  
Junmin Liu ◽  
Jing Ma ◽  
Rongrong Fei ◽  
Huirong Li ◽  
Jiangshe Zhang
Keyword(s):  
Spatial Resolution ◽  
Modulation Transfer Function ◽  
High Spatial Resolution ◽  
Multispectral Image ◽  
Back Projection ◽  
Modulation Transfer ◽  
Panchromatic Image ◽  
Consistency Property ◽  
High Pass ◽  
Satellite Sensor

Pansharpening is the process of integrating a high spatial resolution panchromatic image with a low spatial resolution multispectral image to obtain a multispectral image with high spatial and spectral resolution. Over the last decade, several algorithms have been developed for pansharpening. In this paper, a technique, called enhanced back-projection (EBP), is introduced and applied as postprocessing on the pansharpening. The proposed EBP first enhances the spatial details of the pansharpening results by histogram matching and high-pass modulation, followed by a back-projection process, which takes into account the modulation transfer function (MTF) of the satellite sensor such that the pansharpening results obey the consistency property. The EBP is validated on four datasets acquired by different satellites and several commonly used pansharpening methods. The pansharpening results achieve substantial improvements by this postprocessing technique, which is widely applicable and requires no modification of existing pansharpening methods.

scholarly journals Hyperspectral Pansharpening Based on Homomorphic Filtering and Weighted Tensor Matrix

2019 ◽  
Vol 11 (9) ◽  
pp. 1005
Author(s):  
Jiahui Qu ◽  
Yunsong Li ◽  
Qian Du ◽  
Wenqian Dong ◽  
Bobo Xi
Keyword(s):  
Spatial Resolution ◽  
Spatial Information ◽  
Mean Squared Error ◽  
High Spatial Resolution ◽  
Experimental Results ◽  
Spectral Information ◽  
Morphological Operation ◽  
Effective Technique ◽  
Squared Error ◽  
Homomorphic Filtering

Hyperspectral pansharpening is an effective technique to obtain a high spatial resolution hyperspectral (HS) image. In this paper, a new hyperspectral pansharpening algorithm based on homomorphic filtering and weighted tensor matrix (HFWT) is proposed. In the proposed HFWT method, open-closing morphological operation is utilized to remove the noise of the HS image, and homomorphic filtering is introduced to extract the spatial details of each band in the denoised HS image. More importantly, a weighted root mean squared error-based method is proposed to obtain the total spatial information of the HS image, and an optimized weighted tensor matrix based strategy is presented to integrate spatial information of the HS image with spatial information of the panchromatic (PAN) image. With the appropriate integrated spatial details injection, the fused HS image is generated by constructing the suitable gain matrix. Experimental results over both simulated and real datasets demonstrate that the proposed HFWT method effectively generates the fused HS image with high spatial resolution while maintaining the spectral information of the original low spatial resolution HS image.

scholarly journals Joint Spatial-spectral Resolution Enhancement of Multispectral Images with Spectral Matrix Factorization and Spatial Sparsity Constraints

2020 ◽  
Vol 12 (6) ◽  
pp. 993 ◽  
Author(s):  
Chen Yi ◽  
Yong-qiang Zhao ◽  
Jonathan Cheung-Wai Chan ◽  
Seong G. Kong
Keyword(s):  
Spatial Resolution ◽  
Spectral Resolution ◽  
High Spatial Resolution ◽  
Resolution Enhancement ◽  
Multispectral Image ◽  
Observation Model ◽  
Multispectral Images ◽  
Spectral Matrix ◽  
Spectral Bands ◽  
Landsat 7

This paper presents a joint spatial-spectral resolution enhancement technique to improve the resolution of multispectral images in the spatial and spectral domain simultaneously. Reconstructed hyperspectral images (HSIs) from an input multispectral image represent the same scene in higher spatial resolution, with more spectral bands of narrower wavelength width than the input multispectral image. Many existing improvement techniques focus on spatial- or spectral-resolution enhancement, which may cause spectral distortions and spatial inconsistency. The proposed scheme introduces virtual intermediate variables to formulate a spectral observation model and a spatial observation model. The models alternately solve spectral dictionary and abundances to reconstruct desired high-resolution HSIs. An initial spectral dictionary is trained from prior HSIs captured in different landscapes. A spatial dictionary trained from a panchromatic image and its sparse coefficients provide high spatial-resolution information. The sparse coefficients are used as constraints to obtain high spatial-resolution abundances. Experiments performed on simulated datasets from AVIRIS/Landsat 7 and a real Hyperion/ALI dataset demonstrate that the proposed method outperforms the state-of-the-art spatial- and spectral-resolution enhancement methods. The proposed method also worked well for combination of exiting spatial- and spectral-resolution enhancement methods.

An empirical cross sensor model for high-resolution multispectral imagery

2020 ◽  
Author(s):  
Manivasagam Vellalapalayam Subramanian ◽  
Gregoriy Kaplan ◽  
Offer Rozenstein
Keyword(s):  
High Resolution ◽  
Spatial Resolution ◽  
Transformation Model ◽  
Sensor Data ◽  
Absolute Difference ◽  
Landsat 8 ◽  
Vegetation Monitoring ◽  
Spectral Angle Mapper ◽  
Statistical Measures ◽  
Sentinel 2

<p>The availability of public-domain high-resolution satellite imagery such as Sentinel-2 and Landsat-8 has increased earth observation (EO) studies across the globe. Empirically combining different EO sensor data into a single dataset increases the temporal coverage, which is useful for land-cover monitoring. In this study, a transformation model was developed for Sentinel-2 and Vegetation and Environmental New micro Spacecraft (VENμS) imagery over Israel. Both sensors offer high spatio-temporal resolution imagery, i.e., VENμS has a 10m spatial resolution with a two-day revisit period, and Sentinel-2 has a 10-20 m spatial resolution with a five-day revisit period. Near-simultaneously acquired imagery was employed for the transformation model development. The model coefficients were derived for the overlapping spectral regions of both sensors. Further, the transformation model performance was tested using various statistical measures, namely, orthogonal distance regression (ODR), spectral angle mapper (SAM), and mean absolute difference (MAD). The validation results highlighted that MAD values were reduced between Sentinel-2 and transformed VENμS reflectance. Similarly, the ODR slope values became closer to one, and the overall spectral similarity increased as demonstrated by a decrease in SAM values. This transformation function creates a unified reflectance dataset in the form of a dense time-series of observation, especially useful for vegetation monitoring.</p>

scholarly journals Lunar Image Fusion using Wavelet Transform

2013 ◽  
pp. 211-215
Author(s):  
Dr.Vani. K ◽  
Anto. A. Micheal
Keyword(s):  
High Resolution ◽  
Image Fusion ◽  
Spatial Resolution ◽  
Spectral Resolution ◽  
Lunar Surface ◽  
High Spatial Resolution ◽  
Multispectral Image ◽  
High Spectral Resolution ◽  
Low Resolution ◽  
Mineral Mapping

This paper is an attempt to combine high resolution panchromatic lunar image with low resolution multispectral lunar image to produce a composite image using wavelet approach. There are many sensors that provide us image data about the lunar surface. The spatial resolution and spectral resolution is unique for each sensor, thereby resulting in limitation in extraction of information about the lunar surface. The high resolution panchromatic lunar image has high spatial resolution but low spectral resolution; the low resolution multispectral image has low spatial resolution but high spectral resolution. Extracting features such as craters, crater morphology, rilles and regolith surfaces with a low spatial resolution in multispectral image may not yield satisfactory results. A sensor which has high spatial resolution can provide better information when fused with the high spectral resolution. These fused image results pertain to enhanced crater mapping and mineral mapping in lunar surface. Since fusion using wavelet preserve spectral content needed for mineral mapping, image fusion has been done using wavelet approach.

scholarly journals FEASIBILITY STUDY OF LANDSAT-8 IMAGERY FOR RETRIEVING SEA SURFACE TEMPERATURE (CASE STUDY PERSIAN GULF)

2016 ◽  
Vol XLI-B8 ◽  
pp. 1107-1110
Author(s):  
F. Bayat ◽  
M. Hasanlou
Keyword(s):  
Surface Temperature ◽  
Sea Surface Temperature ◽  
Real Time ◽  
Spatial Resolution ◽  
Persian Gulf ◽  
High Spatial Resolution ◽  
Sea Surface ◽  
Landsat 8 ◽  
Spectral Bands ◽  
Sst Retrieval

Sea surface temperature (SST) is one of the critical parameters in marine meteorology and oceanography. The SST datasets are incorporated as conditions for ocean and atmosphere models. The SST needs to be investigated for various scientific phenomenon such as salinity, potential fishing zone, sea level rise, upwelling, eddies, cyclone predictions. On the other hands, high spatial resolution SST maps can illustrate eddies and sea surface currents. Also, near real time producing of SST map is suitable for weather forecasting and fishery applications. Therefore satellite remote sensing with wide coverage of data acquisition capability can use as real time tools for producing SST dataset. Satellite sensor such as AVHRR, MODIS and SeaWIFS are capable of extracting brightness values at different thermal spectral bands. These brightness temperatures are the sole input for the SST retrieval algorithms. Recently, Landsat-8 successfully launched and accessible with two instruments on-board: (1) the Operational Land Imager (OLI) with nine spectral bands in the visual, near infrared, and the shortwave infrared spectral regions; and (2) the Thermal Infrared Sensor (TIRS) with two spectral bands in the long wavelength infrared. The two TIRS bands were selected to enable the atmospheric correction of the thermal data using a split window algorithm (SWA). The TIRS instrument is one of the major payloads aboard this satellite which can observe the sea surface by using the split-window thermal infrared channels (CH10: 10.6 μm to 11.2 μm; CH11: 11.5 μm to 12.5 μm) at a resolution of 30 m. The TIRS sensors have three main advantages comparing with other previous sensors. First, the TIRS has two thermal bands in the atmospheric window that provide a new SST retrieval opportunity using the widely used split-window (SW) algorithm rather than the single channel method. Second, the spectral filters of TIRS two bands present narrower bandwidth than that of the thermal band on board on previous Landsat sensors. Third, TIRS is one of the best space born and high spatial resolution with 30&thinsp;m. in this regards, Landsat-8 can use the Split-Window (SW) algorithm for retrieving SST dataset. Although several SWs have been developed to use with other sensors, some adaptations are required in order to implement them for the TIRS spectral bands. Therefore, the objective of this paper is to develop a SW, adapted for use with Landsat-8 TIRS data, along with its accuracy assessment. In this research, that has been done for modelling SST using thermal Landsat 8-imagery of the Persian Gulf. Therefore, by incorporating contemporary in situ data and SST map estimated from other sensors like MODIS, we examine our proposed method with coefficient of determination (R2) and root mean square error (RMSE) on check point to model SST retrieval for Landsat-8 imagery. Extracted results for implementing different SW's clearly shows superiority of utilized method by R<sup>2</sup>&thinsp;=&thinsp;0.95 and RMSE&thinsp;=&thinsp;0.24.

scholarly journals EFFECT OF PANSHARPENED IMAGE ON SOME OF PIXEL BASED AND OBJECT BASED CLASSIFICATION ACCURACY

2016 ◽  
Vol XLI-B7 ◽  
pp. 235-239 ◽  
Author(s):  
P. Karakus ◽  
H. Karabork
Keyword(s):  
Spatial Resolution ◽  
Spectral Resolution ◽  
Classification Accuracy ◽  
Multispectral Image ◽  
Classification Method ◽  
Support Vector ◽  
Classification Methods ◽  
Panchromatic Image ◽  
Object Based ◽  
Spot 5

Classification is the most important method to determine type of crop contained in a region for agricultural planning. There are two types of the classification. First is pixel based and the other is object based classification method. While pixel based classification methods are based on the information in each pixel, object based classification method is based on objects or image objects that formed by the combination of information from a set of similar pixels. Multispectral image contains a higher degree of spectral resolution than a panchromatic image. Panchromatic image have a higher spatial resolution than a multispectral image. Pan sharpening is a process of merging high spatial resolution panchromatic and high spectral resolution multispectral imagery to create a single high resolution color image. The aim of the study was to compare the potential classification accuracy provided by pan sharpened image. In this study, SPOT 5 image was used dated April 2013. 5m panchromatic image and 10m multispectral image are pan sharpened. Four different classification methods were investigated: maximum likelihood, decision tree, support vector machine at the pixel level and object based classification methods. SPOT 5 pan sharpened image was used to classification sun flowers and corn in a study site located at Kadirli region on Osmaniye in Turkey. The effects of pan sharpened image on classification results were also examined. Accuracy assessment showed that the object based classification resulted in the better overall accuracy values than the others. The results that indicate that these classification methods can be used for identifying sun flower and corn and estimating crop areas.

scholarly journals Fusion of MODIS and Landsat-Like Images for Daily High Spatial Resolution NDVI

2020 ◽  
Vol 12 (8) ◽  
pp. 1297
Author(s):  
Roberto Filgueiras ◽  
Everardo Chartuni Mantovani ◽  
Elpídio Inácio Fernandes-Filho ◽  
Fernando França da Cunha ◽  
Daniel Althoff ◽  
...  
Keyword(s):  
Spatial Resolution ◽  
Regression Models ◽  
Vegetation Index ◽  
Normalized Difference Vegetation Index ◽  
High Spatial Resolution ◽  
Coefficient Of Determination ◽  
Mean Bias Error ◽  
Bias Error ◽  
Landsat 8 ◽  
Modis Ndvi

One of the obstacles in monitoring agricultural crops is the difficulty in understanding and mapping rapid changes of these crops. With the purpose of addressing this issue, this study aimed to model and fuse the Moderate Resolution Imaging Spectroradiometer (MODIS) Normalized Difference Vegetation Index (NDVI) using Landsat-like images to achieve daily high spatial resolution NDVI. The study was performed for the period of 2017 on a commercial farm of irrigated maize-soybean rotation in the western region of the state of Bahia, Brazil. To achieve the objective, the following procedures were performed: (i) Landsat-like images were upscaled to match the Landsat-8 spatial resolution (30 m); (ii) the reflectance of Landsat-like images was intercalibrated using the Landsat-8 as a reference; (iii) Landsat-like reflectance images were upscaled to match the MODIS sensor spatial resolution (250 m); (iv) regression models were trained daily to model MODIS NDVI using the upscaled Landsat-like reflectance images (250 m) of the closest day as the input; and (v) the intercalibrated version of the Landsat-like images (30 m) used in the previous step was used as the input for the trained model, resulting in a downscaled MODIS NDVI (30 m). To determine the best fitting model, we used the following statistical metrics: coefficient of determination (r2), root mean square error (RMSE), Nash–Sutcliffe efficiency index (NSE), mean bias error (MBE), and mean absolute error (MAE). Among the assessed regression models, the Cubist algorithm was sensitive to changes in agriculture and performed best in modeling of the Landsat-like MODIS NDVI. The results obtained in the present research are promising and can enable the monitoring of dynamic phenomena with images available free of charge, changing the way in which decisions are made using satellite images.

Sign in / Sign up

Export Citation Format

Share Document