In order to solve the problem of spectral distortion and the fuzzy texture in visible and infrared image fusion technology, a novel visible and infrared image fusion method based on the Nonsubsampled Contourlet Transform (NSCT) and Pulse Coupled Neural Networks (PCNN) is proposed in this paper. First, we gain three components of visible image, luminance I, chrominance H and saturation S, using the IHS transform. Then, we gain three coefficients, low frequency sub-band, passband sub-band and high frequency coefficient by decomposing the component I and infrared image with the help of the NSCT. Next, we use weighted-sum method to fuse the low frequency sub-band and PCNN method to fuse the other sub-band coefficient respectively. At last, we gain the fusion image by using the inverse IHS transform on the fusion component I gained by the inverse NSCT transform. Experiments show that our method have better fusion quality and can be more better to keep the visible spectral and detail information than some traditional methods such as, Laplace method, Wavelet method and Lifting Wavelet method.
Infrared and Visible Image Fusion Method Based on ResNet in a Nonsubsampled Contourlet Transform Domain
