New texture-based pansharpening method using wavelet packet transform and PCA

2020 ◽  
Vol 18 (04) ◽  
pp. 2050025
Author(s):  
Asma Abdolahpoor ◽  
Peyman Kabiri
Keyword(s):  
High Resolution ◽  
Image Fusion ◽  
Spatial Resolution ◽  
Wavelet Packet ◽  
Principal Component ◽  
Wavelet Packet Transform ◽  
Multispectral Image ◽  
Multispectral Images ◽  
Low Resolution ◽  
Panchromatic Image

Image fusion is an important concept in remote sensing. Earth observation satellites provide both high-resolution panchromatic and low-resolution multispectral images. Pansharpening is aimed on fusion of a low-resolution multispectral image with a high-resolution panchromatic image. Because of this fusion, a multispectral image with high spatial and spectral resolution is generated. This paper reports a new method to improve spatial resolution of the final multispectral image. The reported work proposes an image fusion method using wavelet packet transform (WPT) and principal component analysis (PCA) methods based on the textures of the panchromatic image. Initially, adaptive PCA (APCA) is applied to both multispectral and panchromatic images. Consequently, WPT is used to decompose the first principal component of multispectral and panchromatic images. Using WPT, high frequency details of both panchromatic and multispectral images are extracted. In areas with similar texture, extracted spatial details from the panchromatic image are injected into the multispectral image. Experimental results show that the proposed method can provide promising results in fusing multispectral images with high-spatial resolution panchromatic image. Moreover, results show that the proposed method can successfully improve spectral features of the multispectral image.

scholarly journals Lunar Image Fusion using Wavelet Transform

2013 ◽  
pp. 211-215
Author(s):  
Dr.Vani. K ◽  
Anto. A. Micheal
Keyword(s):  
High Resolution ◽  
Image Fusion ◽  
Spatial Resolution ◽  
Spectral Resolution ◽  
Lunar Surface ◽  
High Spatial Resolution ◽  
Multispectral Image ◽  
High Spectral Resolution ◽  
Low Resolution ◽  
Mineral Mapping

This paper is an attempt to combine high resolution panchromatic lunar image with low resolution multispectral lunar image to produce a composite image using wavelet approach. There are many sensors that provide us image data about the lunar surface. The spatial resolution and spectral resolution is unique for each sensor, thereby resulting in limitation in extraction of information about the lunar surface. The high resolution panchromatic lunar image has high spatial resolution but low spectral resolution; the low resolution multispectral image has low spatial resolution but high spectral resolution. Extracting features such as craters, crater morphology, rilles and regolith surfaces with a low spatial resolution in multispectral image may not yield satisfactory results. A sensor which has high spatial resolution can provide better information when fused with the high spectral resolution. These fused image results pertain to enhanced crater mapping and mineral mapping in lunar surface. Since fusion using wavelet preserve spectral content needed for mineral mapping, image fusion has been done using wavelet approach.

Hyperspectral and multispectral image fusion techniques for high resolution applications: a review

2021 ◽  
Author(s):  
Dioline Sara ◽  
Ajay Kumar Mandava ◽  
Arun Kumar ◽  
Shiny Duela ◽  
Anitha Jude
Keyword(s):  
High Resolution ◽  
Image Fusion ◽  
Multispectral Image

scholarly journals Super Resolution Digital Image Correlation (SR-DIC): an Alternative to Image Stitching at High Magnifications

2021 ◽  
Author(s):  
R. S. Hansen ◽  
D. W. Waldram ◽  
T. Q. Thai ◽  
R. B. Berke
Keyword(s):  
High Resolution ◽  
Digital Image Correlation ◽  
Spatial Resolution ◽  
Digital Image ◽  
Super Resolution ◽  
Image Correlation ◽  
Low Resolution ◽  
Strain Measurements ◽  
Resolution Image ◽  
High Resolution Image

Abstract Background High-resolution Digital Image Correlation (DIC) measurements have previously been produced by stitching of neighboring images, which often requires short working distances. Separately, the image processing community has developed super resolution (SR) imaging techniques, which improve resolution by combining multiple overlapping images. Objective This work investigates the novel pairing of super resolution with digital image correlation, as an alternative method to produce high-resolution full-field strain measurements. Methods First, an image reconstruction test is performed, comparing the ability of three previously published SR algorithms to replicate a high-resolution image. Second, an applied translation is compared against DIC measurement using both low- and super-resolution images. Third, a ring sample is mechanically deformed and DIC strain measurements from low- and super-resolution images are compared. Results SR measurements show improvements compared to low-resolution images, although they do not perfectly replicate the high-resolution image. SR-DIC demonstrates reduced error and improved confidence in measuring rigid body translation when compared to low resolution alternatives, and it also shows improvement in spatial resolution for strain measurements of ring deformation. Conclusions Super resolution imaging can be effectively paired with Digital Image Correlation, offering improved spatial resolution, reduced error, and increased measurement confidence.

scholarly journals A CNN-Based Pan-Sharpening Method for Integrating Panchromatic and Multispectral Images Using Landsat 8

2019 ◽  
Vol 11 (22) ◽  
pp. 2606 ◽  
Author(s):  
Zhiqiang Li ◽  
Chengqi Cheng
Keyword(s):  
Spatial Resolution ◽  
Mean Squared Error ◽  
High Spatial Resolution ◽  
Multispectral Image ◽  
Landsat 8 ◽  
Spectral Angle Mapper ◽  
Learning Capacity ◽  
Panchromatic Image ◽  
Highly Nonlinear ◽  
Construction Tasks

The increasing availability of sensors enables the combination of a high-spatial-resolution panchromatic image and a low-spatial-resolution multispectral image, which has become a hotspot in recent years for many applications. To address the spectral and spatial distortions that adversely affect the conventional methods, a pan-sharpening method based on a convolutional neural network (CNN) architecture is proposed in this paper, where the low-spatial-resolution multispectral image is upgraded and integrated with the high-spatial-resolution panchromatic image to produce a new multispectral image with high spatial resolution. Based on the pyramid structure of the CNN architecture, the proposed method has high learning capacity to generate more representative and robust hierarchical features for construction tasks. Moreover, the highly nonlinear fusion process can be effectively simulated by stacking several linear filtering layers, which is suitable for learning the complex mapping relationship between a high-spatial-resolution panchromatic and low-spatial-resolution multispectral image. Both qualitative and quantitative experimental analyses were carried out on images captured from a Landsat 8 on-board operational land imager (LOI) sensor to demonstrate the method’s performance. The results regarding the sensitivity analysis of the involved parameters indicate the effects of parameters on the performance of our CNN-based pan-sharpening approach. Additionally, our CNN-based pan-sharpening approach outperforms other existing conventional pan-sharpening methods with a more promising fusion result for different landcovers, with differences in Erreur Relative Globale Adimensionnelle de Synthse (ERGAS), root-mean-squared error (RMSE), and spectral angle mapper (SAM) of 0.69, 0.0021, and 0.81 on average, respectively.

scholarly journals Enhanced Back-Projection as Postprocessing for Pansharpening

2019 ◽  
Vol 11 (6) ◽  
pp. 712 ◽  
Author(s):  
Junmin Liu ◽  
Jing Ma ◽  
Rongrong Fei ◽  
Huirong Li ◽  
Jiangshe Zhang
Keyword(s):  
Spatial Resolution ◽  
Modulation Transfer Function ◽  
High Spatial Resolution ◽  
Multispectral Image ◽  
Back Projection ◽  
Modulation Transfer ◽  
Panchromatic Image ◽  
Consistency Property ◽  
High Pass ◽  
Satellite Sensor

Pansharpening is the process of integrating a high spatial resolution panchromatic image with a low spatial resolution multispectral image to obtain a multispectral image with high spatial and spectral resolution. Over the last decade, several algorithms have been developed for pansharpening. In this paper, a technique, called enhanced back-projection (EBP), is introduced and applied as postprocessing on the pansharpening. The proposed EBP first enhances the spatial details of the pansharpening results by histogram matching and high-pass modulation, followed by a back-projection process, which takes into account the modulation transfer function (MTF) of the satellite sensor such that the pansharpening results obey the consistency property. The EBP is validated on four datasets acquired by different satellites and several commonly used pansharpening methods. The pansharpening results achieve substantial improvements by this postprocessing technique, which is widely applicable and requires no modification of existing pansharpening methods.

Research on Fusion Approach for Hyperspectral Image and Multispectral Image of HJ-1A

2011 ◽  
Vol 356-360 ◽  
pp. 2897-2903
Author(s):  
Fen Fen Guo ◽  
Jian Rong Fan ◽  
Wen Qian Zang ◽  
Fei Liu ◽  
Huai Zhen Zhang
Keyword(s):  
Wavelet Transform ◽  
Spatial Resolution ◽  
Hyperspectral Image ◽  
3D Structure ◽  
Principal Component ◽  
Multispectral Image ◽  
Spectral Quality ◽  
Principal Component Transform ◽  
3D Wavelet Transform ◽  
Fusion Approach

The vacancy of hyperspectral image (HSI) in China is made up by HJ-1A satellite, which makes more study and application possible. But comparing with other HSI, low spatial resolution turns into a big limiting obstacle for application. In order to improve the HSI quality and make full use of the existing RS data, this paper proposed a fusion approach basing on 3D wavelet transform (3D WT) to fusing HJ-1A HSI and Multispectral image (MSI) using their 3D structure. Contrasting with the principal component transform (PCA) and Gram-Schmidt fusion approach, which are mature at present, 3D WT fusion approach use all bands of MSI to its advantage and the fusion result perform better in both spatial and spectral quality.

Multi-Spectral Image Fusion Using Intensity Modulation and Non-Separable Wavelet Frame

2005 ◽  
Author(s):  
Xuhong Yang ◽  
Zhongliang Jing ◽  
Jian-Xun Li
Keyword(s):  
Remote Sensing ◽  
High Resolution ◽  
Spatial Resolution ◽  
Intensity Modulation ◽  
Spectral Information ◽  
Wavelet Frame ◽  
Remote Sensing Images ◽  
Spectral Image ◽  
Panchromatic Image ◽  
Fusion Approach

A fusion approach is proposed to refine the resolution of multi-spectral images using the corresponding high-resolution panchromatic images. The technique is based on intensity modulation and non-separable wavelet frame. The high-resolution panchromatic image is decomposed by the non-separable wavelet frame. Then the wavelet coefficients are used as the factor of modulating to modulate the multi-spectral image. Experimental results indicate that, comparing with the traditional methods, the proposed method can efficiently preserve the spectral information while improving the spatial resolution of remote sensing images.

scholarly journals Joint Spatial-spectral Resolution Enhancement of Multispectral Images with Spectral Matrix Factorization and Spatial Sparsity Constraints

2020 ◽  
Vol 12 (6) ◽  
pp. 993 ◽  
Author(s):  
Chen Yi ◽  
Yong-qiang Zhao ◽  
Jonathan Cheung-Wai Chan ◽  
Seong G. Kong
Keyword(s):  
Spatial Resolution ◽  
Spectral Resolution ◽  
High Spatial Resolution ◽  
Resolution Enhancement ◽  
Multispectral Image ◽  
Observation Model ◽  
Multispectral Images ◽  
Spectral Matrix ◽  
Spectral Bands ◽  
Landsat 7

This paper presents a joint spatial-spectral resolution enhancement technique to improve the resolution of multispectral images in the spatial and spectral domain simultaneously. Reconstructed hyperspectral images (HSIs) from an input multispectral image represent the same scene in higher spatial resolution, with more spectral bands of narrower wavelength width than the input multispectral image. Many existing improvement techniques focus on spatial- or spectral-resolution enhancement, which may cause spectral distortions and spatial inconsistency. The proposed scheme introduces virtual intermediate variables to formulate a spectral observation model and a spatial observation model. The models alternately solve spectral dictionary and abundances to reconstruct desired high-resolution HSIs. An initial spectral dictionary is trained from prior HSIs captured in different landscapes. A spatial dictionary trained from a panchromatic image and its sparse coefficients provide high spatial-resolution information. The sparse coefficients are used as constraints to obtain high spatial-resolution abundances. Experiments performed on simulated datasets from AVIRIS/Landsat 7 and a real Hyperion/ALI dataset demonstrate that the proposed method outperforms the state-of-the-art spatial- and spectral-resolution enhancement methods. The proposed method also worked well for combination of exiting spatial- and spectral-resolution enhancement methods.

Sign in / Sign up

Export Citation Format

Share Document