NSCT and focus measure optimization based multi-focus image fusion

2021 ◽  
pp. 1-13
Author(s):  
N. Aishwarya ◽  
C. BennilaThangammal ◽  
N.G. Praveena

Getting a complete description of scene with all the relevant objects in focus is a hot research area in surveillance, medicine and machine vision applications. In this work, transform based fusion method called as NSCT-FMO, is introduced to integrate the image pairs having different focus features. The NSCT-FMO approach basically contains four steps. Initially, the NSCT is applied on the input images to acquire the approximation and detailed structural information. Then, the approximation sub band coefficients are merged by employing the novel Focus Measure Optimization (FMO) approach. Next, the detailed sub-images are combined using Phase Congruency (PC). Finally, an inverse NSCT operation is conducted on synthesized sub images to obtain the initial synthesized image. To optimize the initial fused image, an initial decision map is first constructed and morphological post-processing technique is applied to get the final map. With the help of resultant map, the final synthesized output is produced by the selection of focused pixels from input images. Simulation analysis show that the NSCT-FMO approach achieves fair results as compared to traditional MST based methods both in qualitative and quantitative assessments.

Sensors ◽  
2020 ◽  
Vol 20 (22) ◽  
pp. 6647
Author(s):  
Xiang Yan ◽  
Syed Zulqarnain Gilani ◽  
Hanlin Qin ◽  
Ajmal Mian

Convolutional neural networks have recently been used for multi-focus image fusion. However, some existing methods have resorted to adding Gaussian blur to focused images, to simulate defocus, thereby generating data (with ground-truth) for supervised learning. Moreover, they classify pixels as ‘focused’ or ‘defocused’, and use the classified results to construct the fusion weight maps. This then necessitates a series of post-processing steps. In this paper, we present an end-to-end learning approach for directly predicting the fully focused output image from multi-focus input image pairs. The suggested approach uses a CNN architecture trained to perform fusion, without the need for ground truth fused images. The CNN exploits the image structural similarity (SSIM) to calculate the loss, a metric that is widely accepted for fused image quality evaluation. What is more, we also use the standard deviation of a local window of the image to automatically estimate the importance of the source images in the final fused image when designing the loss function. Our network can accept images of variable sizes and hence, we are able to utilize real benchmark datasets, instead of simulated ones, to train our network. The model is a feed-forward, fully convolutional neural network that can process images of variable sizes during test time. Extensive evaluation on benchmark datasets show that our method outperforms, or is comparable with, existing state-of-the-art techniques on both objective and subjective benchmarks.


Entropy ◽  
2021 ◽  
Vol 23 (2) ◽  
pp. 247
Author(s):  
Areeba Ilyas ◽  
Muhammad Shahid Farid ◽  
Muhammad Hassan Khan ◽  
Marcin Grzegorzek

Multi-focus image fusion is the process of combining focused regions of two or more images to obtain a single all-in-focus image. It is an important research area because a fused image is of high quality and contains more details than the source images. This makes it useful for numerous applications in image enhancement, remote sensing, object recognition, medical imaging, etc. This paper presents a novel multi-focus image fusion algorithm that proposes to group the local connected pixels with similar colors and patterns, usually referred to as superpixels, and use them to separate the focused and de-focused regions of an image. We note that these superpixels are more expressive than individual pixels, and they carry more distinctive statistical properties when compared with other superpixels. The statistical properties of superpixels are analyzed to categorize the pixels as focused or de-focused and to estimate a focus map. A spatial consistency constraint is ensured on the initial focus map to obtain a refined map, which is used in the fusion rule to obtain a single all-in-focus image. Qualitative and quantitative evaluations are performed to assess the performance of the proposed method on a benchmark multi-focus image fusion dataset. The results show that our method produces better quality fused images than existing image fusion techniques.


Author(s):  
Sagar T. Malsane ◽  
Smita S. Aher ◽  
R. B. Saudagar

Oral route is presently the gold standard in the pharmaceutical industry where it is regarded as the safest, most economical and most convenient method of drug delivery resulting in highest patient compliance. Over the past three decades, orally disintegrating tablets (FDTs) have gained considerable attention due to patient compliance. Usually, elderly people experience difficulty in swallowing the conventional dosage forms like tablets, capsules, solutions and suspensions because of tremors of extremities and dysphagia. In some cases such as motion sickness, sudden episodes of allergic attack or coughing, and an unavailability of water, swallowing conventional tablets may be difficult. One such problem can be solved in the novel drug delivery system by formulating “Fast dissolving tablets” (FDTs) which disintegrates or dissolves rapidly without water within few seconds in the mouth due to the action of superdisintegrant or maximizing pore structure in the formulation. The review describes the various formulation aspects, superdisintegrants employed and technologies developed for FDTs, along with various excipients, evaluation tests, marketed formulation and drugs used in this research area.


2011 ◽  
Vol 255-260 ◽  
pp. 2072-2076
Author(s):  
Yi Yong Han ◽  
Jun Ju Zhang ◽  
Ben Kang Chang ◽  
Yi Hui Yuan ◽  
Hui Xu

Under the assumption that human visual perception is highly adapted for extracting structural information from a scene, we present a new approach using structural similarity index for assessing quality in image fusion. The advantages of our measures are that they do not require a reference image and can be easily computed. Numerous simulations demonstrate that our measures are conform to subjective evaluations and can be able to assess different image fusion methods.


Symmetry ◽  
2020 ◽  
Vol 12 (6) ◽  
pp. 894 ◽  
Author(s):  
Nasser Tamim ◽  
M. Elshrkawey ◽  
Gamil Abdel Azim ◽  
Hamed Nassar

Segmentation of retinal blood vessels is the first step for several computer aided-diagnosis systems (CAD), not only for ocular disease diagnosis such as diabetic retinopathy (DR) but also of non-ocular disease, such as hypertension, stroke and cardiovascular diseases. In this paper, a supervised learning-based method, using a multi-layer perceptron neural network and carefully selected vector of features, is proposed. In particular, for each pixel of a retinal fundus image, we construct a 24-D feature vector, encoding information on the local intensity, morphology transformation, principal moments of phase congruency, Hessian, and difference of Gaussian values. A post-processing technique depending on mathematical morphological operators is used to optimise the segmentation. Moreover, the selected feature vector succeeded in outfitting the symmetric features that provided the final blood vessel probability as a binary map image. The proposed method is tested on three known datasets: Digital Retinal Image for Extraction (DRIVE), Structure Analysis of the Retina (STARE), and CHASED_DB1 datasets. The experimental results, both visual and quantitative, testify to the robustness of the proposed method. This proposed method achieved 0.9607, 0.7542, and 0.9843 in DRIVE, 0.9632, 0.7806, and 0.9825 on STARE, 0.9577, 0.7585 and 0.9846 in CHASE_DB1, with respectable accuracy, sensitivity, and specificity performance metrics. Furthermore, they testify that the method is superior to seven similar state-of-the-art methods.


2014 ◽  
Vol 14 (2) ◽  
pp. 102-108 ◽  
Author(s):  
Yong Yang ◽  
Shuying Huang ◽  
Junfeng Gao ◽  
Zhongsheng Qian

Abstract In this paper, by considering the main objective of multi-focus image fusion and the physical meaning of wavelet coefficients, a discrete wavelet transform (DWT) based fusion technique with a novel coefficients selection algorithm is presented. After the source images are decomposed by DWT, two different window-based fusion rules are separately employed to combine the low frequency and high frequency coefficients. In the method, the coefficients in the low frequency domain with maximum sharpness focus measure are selected as coefficients of the fused image, and a maximum neighboring energy based fusion scheme is proposed to select high frequency sub-bands coefficients. In order to guarantee the homogeneity of the resultant fused image, a consistency verification procedure is applied to the combined coefficients. The performance assessment of the proposed method was conducted in both synthetic and real multi-focus images. Experimental results demonstrate that the proposed method can achieve better visual quality and objective evaluation indexes than several existing fusion methods, thus being an effective multi-focus image fusion method.


Sensors ◽  
2018 ◽  
Vol 18 (9) ◽  
pp. 3120 ◽  
Author(s):  
Shanshan Hu ◽  
Huaiyang Wang ◽  
Yong Wang ◽  
Zhengshi Liu

A novel elastic body design idea of six-axis wrist force sensor with a floating beam was raised based on the analysis of the robot six-axis wrist force sensor with a floating beam. The design ideas improve the sensor’s dynamic performance significantly, while not reducing its sensitivity. First, the design ideas were described in detail, which were analyzed by mechanical modeling and were verified by finite element analysis. Second, the static simulation analysis of the novel elastomer of sensor was carried out. According to the strain distribution performance, the position of the strain gauges pasted and the connection mode of the full-bridge circuits were decided, which can achieve theoretical decoupling. Finally, the comparison between the static and dynamic performance of the novel sensor and the original sensor with floating beams was done. The results show that the static and dynamic performance of the novel six-axis wrist sensor are all better than the original sensor.


2018 ◽  
Vol 11 (4) ◽  
pp. 1937-1946
Author(s):  
Nancy Mehta ◽  
Sumit Budhiraja

Multimodal medical image fusion aims at minimizing the redundancy and collecting the relevant information using the input images acquired from different medical sensors. The main goal is to produce a single fused image having more information and has higher efficiency for medical applications. In this paper modified fusion method has been proposed in which NSCT decomposition is used to decompose the wavelet coefficients obtained after wavelet decomposition. NSCT being multidirectional,shift invariant transform provide better results.Guided filter has been used for the fusion of high frequency coefficients on account of its edge preserving property. Phase congruency is used for the fusion of low frequency coefficients due to its insensitivity to illumination contrast hence making it suitable for medical images. The simulated results show that the proposed technique shows better performance in terms of entropy, structural similarity index, Piella metric. The fusion response of the proposed technique is also compared with other fusion approaches; proving the effectiveness of the obtained fusion results.


Aerospace ◽  
2021 ◽  
Vol 8 (10) ◽  
pp. 297
Author(s):  
Yuntian Yang ◽  
Dawei Guo ◽  
Xiaokang Li ◽  
Leimin Deng ◽  
Bixuan Che ◽  
...  

The porous-media-based electrospray thruster is a cutting-edge micropropulsion technology that can revolutionize the capabilities of microsatellites. This paper reports the design, fabrication, and characterization of a novel porous-media borosilicate glass electrospray thruster. The porous glass used here is integrally formed by the phase separation method, which make it display outstanding pore uniformity and processability. The picosecond ultraviolet laser processing technique is applied to machine 361 emitters out of glass. Performance characteristic experiments are conducted with the thruster passively fed with ionic EMI-BF4 liquid. The results reveal that the per-emitter can emit up to 200.46 nA of ion current at 2 kV. The novel porous glass and the corresponding machine method present an opportunity to attain more-controllable emitter shapes, which has a positive impact on thruster lifetime and performance improvement.


Sign in / Sign up

Export Citation Format

Share Document