DEPSO With DTCWT Algorithm for Multimodal Medical Image Fusion

2021 ◽  
Vol 12 (4) ◽  
pp. 78-97
Author(s):  
Hassiba Talbi ◽  
Mohamed-Khireddine Kholladi
Keyword(s):  
Wavelet Transform ◽  
Image Fusion ◽  
High Frequency ◽  
Medical Image ◽  
Low Frequency ◽  
Weighted Average ◽  
Optimization Method ◽  
Absolute Maximum ◽  
Complex Wavelet Transform ◽  
Medical Image Fusion

In this paper, the authors propose an algorithm of hybrid particle swarm with differential evolution (DE) operator, termed DEPSO, with the help of a multi-resolution transform named dual tree complex wavelet transform (DTCWT) to solve the problem of multimodal medical image fusion. This hybridizing approach aims to combine algorithms in a judicious manner, where the resulting algorithm will contain the positive features of these different algorithms. This new algorithm decomposes the source images into high-frequency and low-frequency coefficients by the DTCWT, then adopts the absolute maximum method to fuse high-frequency coefficients; the low-frequency coefficients are fused by a weighted average method while the weights are estimated and enhanced by an optimization method to gain optimal results. The authors demonstrate by the experiments that this algorithm, besides its simplicity, provides a robust and efficient way to fuse multimodal medical images compared to existing wavelet transform-based image fusion algorithms.

scholarly journals Medical image fusion based on quaternion wavelet transform

2020 ◽  
Vol 14 ◽  
pp. 174830262093129
Author(s):  
Zhang Zhancheng ◽  
Luo Xiaoqing ◽  
Xiong Mengyu ◽  
Wang Zhiwen ◽  
Li Kai
Keyword(s):  
Wavelet Transform ◽  
Image Fusion ◽  
High Frequency ◽  
Medical Image ◽  
Low Frequency ◽  
Frequency Component ◽  
High Frequency Component ◽  
Medical Image Fusion ◽  
Quaternion Wavelet Transform ◽  
Fused Image

Medical image fusion can combine multi-modal images into an integrated higher-quality image, which can provide more comprehensive and accurate pathological information than individual image does. Traditional transform domain-based image fusion methods usually ignore the dependencies between coefficients and may lead to the inaccurate representation of source image. To improve the quality of fused image, a medical image fusion method based on the dependencies of quaternion wavelet transform coefficients is proposed. First, the source images are decomposed into low-frequency component and high-frequency component by quaternion wavelet transform. Then, a clarity evaluation index based on quaternion wavelet transform amplitude and phase is constructed and a contextual activity measure is designed. These measures are utilized to fuse the high-frequency coefficients and the choose-max fusion rule is applied to the low-frequency components. Finally, the fused image can be obtained by inverse quaternion wavelet transform. The experimental results on some brain multi-modal medical images demonstrate that the proposed method has achieved advanced fusion result.

scholarly journals Log-Gabor Energy Based Multimodal Medical Image Fusion in NSCT Domain

2014 ◽  
Vol 2014 ◽  
pp. 1-12 ◽  
Author(s):  
Yong Yang ◽  
Song Tong ◽  
Shuying Huang ◽  
Pan Lin
Keyword(s):  
Wavelet Transform ◽  
Image Fusion ◽  
High Frequency ◽  
Medical Image ◽  
Medical Images ◽  
Discrete Wavelet ◽  
Fusion Method ◽  
Complex Wavelet Transform ◽  
Medical Image Fusion ◽  
Log Gabor

Multimodal medical image fusion is a powerful tool in clinical applications such as noninvasive diagnosis, image-guided radiotherapy, and treatment planning. In this paper, a novel nonsubsampled Contourlet transform (NSCT) based method for multimodal medical image fusion is presented, which is approximately shift invariant and can effectively suppress the pseudo-Gibbs phenomena. The source medical images are initially transformed by NSCT followed by fusing low- and high-frequency components. The phase congruency that can provide a contrast and brightness-invariant representation is applied to fuse low-frequency coefficients, whereas the Log-Gabor energy that can efficiently determine the frequency coefficients from the clear and detail parts is employed to fuse the high-frequency coefficients. The proposed fusion method has been compared with the discrete wavelet transform (DWT), the fast discrete curvelet transform (FDCT), and the dual tree complex wavelet transform (DTCWT) based image fusion methods and other NSCT-based methods. Visually and quantitatively experimental results indicate that the proposed fusion method can obtain more effective and accurate fusion results of multimodal medical images than other algorithms. Further, the applicability of the proposed method has been testified by carrying out a clinical example on a woman affected with recurrent tumor images.

OPTIMIZED DUAL-TREE COMPLEX WAVELET TRANSFORM AND FUZZY ENTROPY FOR MULTI-MODAL MEDICAL IMAGE FUSION: A HYBRID META-HEURISTIC CONCEPT

2021 ◽  
pp. 2150024
Author(s):  
N. NAGARAJA KUMAR ◽  
T. JAYACHANDRA PRASAD ◽  
K. SATYA PRASAD
Keyword(s):  
Image Fusion ◽  
High Frequency ◽  
Medical Image ◽  
Low Frequency ◽  
Fuzzy Entropy ◽  
Complex Wavelet Transform ◽  
Swarm Optimization ◽  
Medical Image Fusion ◽  
Fused Image

In recent times, multi-modal medical image fusion has emerged as an important medical application tool. An important goal is to fuse the multi-modal medical images from diverse imaging modalities into a single fused image. The physicians broadly utilize this for precise identification and treatment of diseases. This medical image fusion approach will help the physician perform the combined diagnosis, interventional treatment, pre-operative planning, and intra-operative guidance in various medical applications by developing the corresponding information from clinical images through different modalities. In this paper, a novel multi-modal medical image fusion method is adopted using the intelligent method. Initially, the images from two different modalities are applied with optimized Dual-Tree Complex Wavelet Transform (DT-CWT) for splitting the images into high-frequency subbands and low-frequency subbands. As an improvement to the conventional DT-CWT, the filter coefficients are optimized by the hybrid meta-heuristic algorithm named as Hybrid Beetle and Salp Swarm Optimization (HBSSO) by merging the Salp Swarm Algorithm (SSA), and Beetle Swarm Optimization (BSO). Moreover, the fusion of the source images’ high-frequency subbands was done by the optimized type-2 Fuzzy Entropy. The upper and lower membership limits are optimized by the same hybrid HBSSO. The optimized type-2 fuzzy Entropy automatically selects high-frequency coefficients. Also, the fusion of the low-frequency sub-images is performed by the Averaging approach. Further, the inverse optimized DT-CWT on the fused image sets helps to obtain the final fused medical image. The main objective of the optimized DT-CWT and optimized type-2 fuzzy Entropy is to maximize the SSIM. The experimental results confirm that the developed approach outperforms the existing fusion algorithms in diverse performance measures.

Multimodality Medical Image Fusion Using M-Band Wavelet and Daubechies Complex Wavelet Transform for Radiation Therapy

Oncology ◽  
2017 ◽  
pp. 519-541
Author(s):  
Satishkumar S. Chavan ◽  
Sanjay N. Talbar
Keyword(s):  
Wavelet Transform ◽  
Image Fusion ◽  
Frequency Domain ◽  
Medical Image ◽  
Treatment Plan ◽  
Complex Wavelet Transform ◽  
Medical Image Fusion ◽  
Daubechies Complex Wavelet Transform ◽  
Fused Image ◽  
Complex Wavelet

The process of enriching the important details from various modality medical images by combining them into single image is called multimodality medical image fusion. It aids physicians in terms of better visualization, more accurate diagnosis and appropriate treatment plan for the cancer patient. The combined fused image is the result of merging of anatomical and physiological variations. It allows accurate localization of cancer tissues and more helpful for estimation of target volume for radiation. The details from both modalities (CT and MRI) are extracted in frequency domain by applying various transforms and combined them using variety of fusion rules to achieve the best quality of images. The performance and effectiveness of each transform on fusion results is evaluated subjectively as well as objectively. The fused images by algorithms in which feature extraction is achieved by M-Band Wavelet Transform and Daubechies Complex Wavelet Transform are superior over other frequency domain algorithms as per subjective and objective analysis.

scholarly journals Local energy match based non-sub sampled contourlet Transform for multi modal medical image fusion

2018 ◽  
Vol 7 (2.31) ◽  
pp. 165
Author(s):  
M Shyamala Devi ◽  
P Balamurugan
Keyword(s):  
Image Fusion ◽  
High Frequency ◽  
Medical Image ◽  
Gabor Filter ◽  
Low Frequency ◽  
Local Energy ◽  
Fusion Algorithm ◽  
Medical Image Fusion ◽  
Fused Image ◽  
Image Averaging

Image processing technology requires moreover the full image or the part of image which is to be processed from the user’s point of view like the radius of object etc. The main purpose of fusion is to diminish dissimilar error between the fused image and the input images. With respect to the medical diagnosis, the edges and outlines of the concerned objects is more important than extra information. So preserving the edge features of the image is worth for investigating the image fusion. The image with higher contrast contains more edge-like features. Here we propose a new medical image fusion scheme namely Local Energy Match NSCT based on discrete contourlet transformation, which is constructive to give the details of curve edges. It is used to progress the edge information of fused image by dropping the distortion. This transformation lead to crumbling of multimodal image addicted to finer and coarser details and finest details will be decayed into unusual resolution in dissimilar orientation. The input multimodal images namely CT and MRI images are first transformed by Non Sub sampled Contourlet Transformation (NSCT) which decomposes the image into low frequency and high frequency elements. In our system, the Low frequency coefficient of the image is fused by image averaging and Gabor filter bank algorithm. The processed High frequency coefficients of the image are fused by image averaging and gradient based fusion algorithm. Then the fused image is obtained by inverse NSCT with local energy match based coefficients. To evaluate the image fusion accuracy, Peak Signal to Noise Ratio (PSNR), Root Mean Square Error (RMSE) and Correlation Coefficient parameters are used in this work .

Infrared and visible image fusion using dual-tree complex wavelet transform and convolutional sparse representation

2020 ◽  
Vol 39 (3) ◽  
pp. 4617-4629
Author(s):  
Chengrui Gao ◽  
Feiqiang Liu ◽  
Hua Yan
Keyword(s):  
Wavelet Transform ◽  
Image Fusion ◽  
Sparse Representation ◽  
High Frequency ◽  
Low Frequency ◽  
Infrared Images ◽  
Complex Wavelet Transform ◽  
Visible Image ◽  
Visible Images ◽  
Complex Wavelet

Infrared and visible image fusion refers to the technology that merges the visual details of visible images and thermal feature information of infrared images; it has been extensively adopted in numerous image processing fields. In this study, a dual-tree complex wavelet transform (DTCWT) and convolutional sparse representation (CSR)-based image fusion method was proposed. In the proposed method, the infrared images and visible images were first decomposed by dual-tree complex wavelet transform to characterize their high-frequency bands and low-frequency band. Subsequently, the high-frequency bands were enhanced by guided filtering (GF), while the low-frequency band was merged through convolutional sparse representation and choose-max strategy. Lastly, the fused images were reconstructed by inverse DTCWT. In the experiment, the objective and subjective comparisons with other typical methods proved the advantage of the proposed method. To be specific, the results achieved using the proposed method were more consistent with the human vision system and contained more texture detail information.

scholarly journals Brain Medical Image Fusion Based on Dual-Branch CNNs in NSST Domain

2020 ◽  
Vol 2020 ◽  
pp. 1-15
Author(s):  
Zhaisheng Ding ◽  
Dongming Zhou ◽  
Rencan Nie ◽  
Ruichao Hou ◽  
Yanyu Liu
Keyword(s):  
Image Fusion ◽  
High Frequency ◽  
Medical Image ◽  
Low Frequency ◽  
Structural Features ◽  
Functional Information ◽  
Convolutional Network ◽  
Structure Information ◽  
Medical Image Fusion ◽  
Research Challenge

Computed tomography (CT) images show structural features, while magnetic resonance imaging (MRI) images represent brain tissue anatomy but do not contain any functional information. How to effectively combine the images of the two modes has become a research challenge. In this paper, a new framework for medical image fusion is proposed which combines convolutional neural networks (CNNs) and non-subsampled shearlet transform (NSST) to simultaneously cover the advantages of them both. This method effectively retains the functional information of the CT image and reduces the loss of brain structure information and spatial distortion of the MRI image. In our fusion framework, the initial weights integrate the pixel activity information from two source images that is generated by a dual-branch convolutional network and is decomposed by NSST. Firstly, the NSST is performed on the source images and the initial weights to obtain their low-frequency and high-frequency coefficients. Then, the first component of the low-frequency coefficients is fused by a novel fusion strategy, which simultaneously copes with two key issues in the fusion processing which are named energy conservation and detail extraction. The second component of the low-frequency coefficients is fused by the strategy that is designed according to the spatial frequency of the weight map. Moreover, the high-frequency coefficients are fused by the high-frequency components of the initial weight. Finally, the final image is reconstructed by the inverse NSST. The effectiveness of the proposed method is verified using pairs of multimodality images, and the sufficient experiments indicate that our method performs well especially for medical image fusion.

A Novel Fusion Rule for Medical Image Fusion in Complex Wavelet Transform Domain

2016 ◽  
Vol 16 (04) ◽  
pp. 1650022 ◽  
Author(s):  
Deepak Gambhir ◽  
Meenu Manchanda
Keyword(s):  
Wavelet Transform ◽  
Image Fusion ◽  
Medical Image ◽  
Fusion Rule ◽  
Complex Wavelet Transform ◽  
Fusion Rules ◽  
Medical Image Fusion ◽  
Fused Image ◽  
Complex Wavelet ◽  
Complex Coefficients

Medical image fusion is being used at large by clinical professionals for improved diagnosis and treatment of diseases. The main aim of image fusion process is to combine complete information from all input images into a single fused image. Therefore, a novel fusion rule is proposed for fusing medical images based on Daubechies complex wavelet transform (DCxWT). Input images are first decomposed using DCxWT. The complex coefficients so obtained are then fused using normalized correlation based fusion rule. Finally, the fused image is obtained by inverse DCxWT with all combined complex coefficients. The performance of the proposed method has been evaluated and compared both visually and objectively with DCxWT based fusion methods using state-of art fusion rules as well as with existing fusion techniques. Experimental results and comparative study demonstrate that the proposed fusion technique generates better results than existing fusion rules as well as with other fusion techniques.

Sign in / Sign up

Export Citation Format

Share Document