scholarly journals Infrared and visible image fusion via octave Gaussian pyramid framework

2021 ◽  
Vol 11 (1) ◽  
Author(s):  
Lei Yan ◽  
Qun Hao ◽  
Jie Cao ◽  
Rizvi Saad ◽  
Kun Li ◽  
...  
Keyword(s):  
Image Fusion ◽  
Low Frequency ◽  
Objective Evaluation ◽  
Visible Image ◽  
Composite Image ◽  
Multiscale Decomposition ◽  
Gaussian Pyramid ◽  
Fusion Methods ◽  
Scale Spaces ◽  
Fusion Framework

AbstractImage fusion integrates information from multiple images (of the same scene) to generate a (more informative) composite image suitable for human and computer vision perception. The method based on multiscale decomposition is one of the commonly fusion methods. In this study, a new fusion framework based on the octave Gaussian pyramid principle is proposed. In comparison with conventional multiscale decomposition, the proposed octave Gaussian pyramid framework retrieves more information by decomposing an image into two scale spaces (octave and interval spaces). Different from traditional multiscale decomposition with one set of detail and base layers, the proposed method decomposes an image into multiple sets of detail and base layers, and it efficiently retains high- and low-frequency information from the original image. The qualitative and quantitative comparison with five existing methods (on publicly available image databases) demonstrate that the proposed method has better visual effects and scores the highest in objective evaluation.

scholarly journals Infrared and Visible Image Fusion with Hybrid Image Filtering

2020 ◽  
Vol 2020 ◽  
pp. 1-17
Author(s):  
Yongxin Zhang ◽  
Deguang Li ◽  
WenPeng Zhu
Keyword(s):  
Thermal Radiation ◽  
Image Fusion ◽  
Image Filtering ◽  
Divide And Conquer ◽  
Base Layer ◽  
Visible Image ◽  
Composite Image ◽  
Fusion Methods ◽  
Visible Images ◽  
Scene Information

Image fusion is an important technique aiming to generate a composite image from multiple images of the same scene. Infrared and visible images can provide the same scene information from different aspects, which is useful for target recognition. But the existing fusion methods cannot well preserve the thermal radiation and appearance information simultaneously. Thus, we propose an infrared and visible image fusion method by hybrid image filtering. We represent the fusion problem with a divide and conquer strategy. A Gaussian filter is used to decompose the source images into base layers and detail layers. An improved co-occurrence filter fuses the detail layers for preserving the thermal radiation of the source images. A guided filter fuses the base layers for retaining the background appearance information of the source images. Superposition of the fused base layer and fused detail layer generates the final fusion image. Subjective visual and objective quantitative evaluations comparing with other fusion algorithms demonstrate the better performance of the proposed method.

scholarly journals Multi-focus Image Fusion Using an Effective Discrete Wavelet Transform Based Algorithm

2014 ◽  
Vol 14 (2) ◽  
pp. 102-108 ◽  
Author(s):  
Yong Yang ◽  
Shuying Huang ◽  
Junfeng Gao ◽  
Zhongsheng Qian
Keyword(s):  
Wavelet Transform ◽  
Image Fusion ◽  
Discrete Wavelet Transform ◽  
High Frequency ◽  
Low Frequency ◽  
Objective Evaluation ◽  
Discrete Wavelet ◽  
Evaluation Indexes ◽  
Fused Image ◽  
Focus Image

Abstract In this paper, by considering the main objective of multi-focus image fusion and the physical meaning of wavelet coefficients, a discrete wavelet transform (DWT) based fusion technique with a novel coefficients selection algorithm is presented. After the source images are decomposed by DWT, two different window-based fusion rules are separately employed to combine the low frequency and high frequency coefficients. In the method, the coefficients in the low frequency domain with maximum sharpness focus measure are selected as coefficients of the fused image, and a maximum neighboring energy based fusion scheme is proposed to select high frequency sub-bands coefficients. In order to guarantee the homogeneity of the resultant fused image, a consistency verification procedure is applied to the combined coefficients. The performance assessment of the proposed method was conducted in both synthetic and real multi-focus images. Experimental results demonstrate that the proposed method can achieve better visual quality and objective evaluation indexes than several existing fusion methods, thus being an effective multi-focus image fusion method.

Infrared and visible image fusion methods and applications: A survey

2019 ◽  
Vol 45 ◽  
pp. 153-178 ◽  
Author(s):  
Jiayi Ma ◽  
Yong Ma ◽  
Chang Li
Keyword(s):  
Image Fusion ◽  
Visible Image ◽  
Fusion Methods

scholarly journals Infrared and Visible Image Fusion Techniques Based on Deep Learning: A Review

Electronics ◽  
2020 ◽  
Vol 9 (12) ◽  
pp. 2162
Author(s):  
Changqi Sun ◽  
Cong Zhang ◽  
Naixue Xiong
Keyword(s):  
Deep Learning ◽  
Image Fusion ◽  
Research Work ◽  
Image Features ◽  
Future Research ◽  
Learning Methods ◽  
Visible Image ◽  
Advantages And Disadvantages ◽  
Fusion Methods ◽  
Future Work

Infrared and visible image fusion technologies make full use of different image features obtained by different sensors, retain complementary information of the source images during the fusion process, and use redundant information to improve the credibility of the fusion image. In recent years, many researchers have used deep learning methods (DL) to explore the field of image fusion and found that applying DL has improved the time-consuming efficiency of the model and the fusion effect. However, DL includes many branches, and there is currently no detailed investigation of deep learning methods in image fusion. In this work, this survey reports on the development of image fusion algorithms based on deep learning in recent years. Specifically, this paper first conducts a detailed investigation on the fusion method of infrared and visible images based on deep learning, compares the existing fusion algorithms qualitatively and quantitatively with the existing fusion quality indicators, and discusses various fusions. The main contribution, advantages, and disadvantages of the algorithm. Finally, the research status of infrared and visible image fusion is summarized, and future work has prospected. This research can help us realize many image fusion methods in recent years and lay the foundation for future research work.

Multifocus image fusion using multiscale transform and convolutional sparse representation

2020 ◽  
pp. 2050061
Author(s):  
Chengfang Zhang
Keyword(s):  
Image Fusion ◽  
Sparse Representation ◽  
Low Frequency ◽  
Activity Level ◽  
Source Image ◽  
Level Measurement ◽  
Fused Image ◽  
Fusion Methods ◽  
Low Pass ◽  
Multiscale Transform

Multifocus image fusion can obtain an image with all objects in focus, which is beneficial for understanding the target scene. Multiscale transform (MST) and sparse representation (SR) have been widely used in multifocus image fusion. However, the contrast of the fused image is lost after multiscale reconstruction, and fine details tend to be smoothed for SR-based fusion. In this paper, we propose a fusion method based on MST and convolutional sparse representation (CSR) to address the inherent defects of both the MST- and SR-based fusion methods. MST is first performed on each source image to obtain the low-frequency components and detailed directional components. Then, CSR is applied in the low-pass fusion, while the high-pass bands are fused using the popular “max-absolute” rule as the activity level measurement. The fused image is finally obtained by performing inverse MST on the fused coefficients. The experimental results on multifocus images show that the proposed algorithm exhibits state-of-the-art performance in terms of definition.

Infrared and visible image fusion using dual-tree complex wavelet transform and convolutional sparse representation

2020 ◽  
Vol 39 (3) ◽  
pp. 4617-4629
Author(s):  
Chengrui Gao ◽  
Feiqiang Liu ◽  
Hua Yan
Keyword(s):  
Wavelet Transform ◽  
Image Fusion ◽  
Sparse Representation ◽  
High Frequency ◽  
Low Frequency ◽  
Infrared Images ◽  
Complex Wavelet Transform ◽  
Visible Image ◽  
Visible Images ◽  
Complex Wavelet

Infrared and visible image fusion refers to the technology that merges the visual details of visible images and thermal feature information of infrared images; it has been extensively adopted in numerous image processing fields. In this study, a dual-tree complex wavelet transform (DTCWT) and convolutional sparse representation (CSR)-based image fusion method was proposed. In the proposed method, the infrared images and visible images were first decomposed by dual-tree complex wavelet transform to characterize their high-frequency bands and low-frequency band. Subsequently, the high-frequency bands were enhanced by guided filtering (GF), while the low-frequency band was merged through convolutional sparse representation and choose-max strategy. Lastly, the fused images were reconstructed by inverse DTCWT. In the experiment, the objective and subjective comparisons with other typical methods proved the advantage of the proposed method. To be specific, the results achieved using the proposed method were more consistent with the human vision system and contained more texture detail information.

scholarly journals Infrared and Visible Image Fusion through Details Preservation

Sensors ◽  
2019 ◽  
Vol 19 (20) ◽  
pp. 4556 ◽  
Author(s):  
Yaochen Liu ◽  
Lili Dong ◽  
Yuanyuan Ji ◽  
Wenhai Xu
Keyword(s):  
Image Fusion ◽  
Subjective Evaluation ◽  
Objective Assessment ◽  
Decomposition Methods ◽  
Source Image ◽  
Fusion Method ◽  
Visible Image ◽  
Weighting Method ◽  
Fused Image ◽  
Fusion Methods

In many actual applications, fused image is essential to contain high-quality details for achieving a comprehensive representation of the real scene. However, existing image fusion methods suffer from loss of details because of the error accumulations of sequential tasks. This paper proposes a novel fusion method to preserve details of infrared and visible images by combining new decomposition, feature extraction, and fusion scheme. For decomposition, different from the most decomposition methods by guided filter, the guidance image contains only the strong edge of the source image but no other interference information so that rich tiny details can be decomposed into the detailed part. Then, according to the different characteristics of infrared and visible detail parts, a rough convolutional neural network (CNN) and a sophisticated CNN are designed so that various features can be fully extracted. To integrate the extracted features, we also present a multi-layer features fusion strategy through discrete cosine transform (DCT), which not only highlights significant features but also enhances details. Moreover, the base parts are fused by weighting method. Finally, the fused image is obtained by adding the fused detail and base part. Different from the general image fusion methods, our method not only retains the target region of source image but also enhances background in the fused image. In addition, compared with state-of-the-art fusion methods, our proposed fusion method has many advantages, including (i) better visual quality of fused-image subjective evaluation, and (ii) better objective assessment for those images.

Wavelet Transform with a Novel Integration Technique for Image Fusion

2011 ◽  
Vol 204-210 ◽  
pp. 1419-1422 ◽  
Author(s):  
Yong Yang
Keyword(s):  
Wavelet Transform ◽  
Image Fusion ◽  
High Frequency ◽  
Low Frequency ◽  
Experimental Results ◽  
Integration Technique ◽  
Frequency Bands ◽  
Fusion Methods ◽  
Fusion Scheme ◽  
Measures Of Performance

Image fusion is to combine several different source images to form a new image by using a certain method. Recent studies show that among a variety of image fusion algorithms, the wavelet-based method is more effective. In the wavelet-based method, the key technique is the fusion scheme, which can decide the final fused result. This paper presents a novel fusion scheme that integrates the wavelet decomposed coefficients in a quite separate way when fusing images. The method is formed by considering the different physical meanings of the coefficients in both the low frequency and high frequency bands. The fused results were compared with several existing fusion methods and evaluated by three measures of performance. The experimental results can demonstrate that the proposed method can achieve better performance than conventional image fusion methods.

Sign in / Sign up

Export Citation Format

Share Document