Multi-Scale HARRIS-PIIFD Features for Registration of Visible and Infrared Images

Author(s):  
Chenzhong Gao ◽  
Wei Li
Keyword(s):  
Author(s):  
Nashwan Jasim Hussein ◽  
Fei Hu ◽  
Hao Hu ◽  
Abdalrazak Tareq Rahem

A Concealed Weapon Detection (CWD) had been developed by a large number of researchers and technologies. As a result of the weakness of the infrared images in unique altogether graphic items, infrared and MMW images become inaccurate and insufficient to obviously detectand deal withweaponry objectsin an invisible setting. This article uses Multi Scale Retinex and contrast stretching image processing enhancement techniques to improve the recognition of weapons concealed below attire. Specifically, the focus of the study is on detecting weapons and ammos by enhancing the IR pictures based on image processing techniques. Evaluation techniques were empirically proved to be able to show the enhancement percentage progress.


2021 ◽  
Vol 14 (1) ◽  
pp. 15
Author(s):  
Shengguo Ge ◽  
Siti Nurulain Mohd Rum

The human body generates infrared radiation through the thermal movement of molecules. Based on this phenomenon, infrared images of the human body are often used for monitoring and tracking. Among them, key point location on infrared images of the human body is an important technology in medical infrared image processing. However, the fuzzy edges, poor detail resolution, and uneven brightness distribution of the infrared image of the human body cause great difficulties in positioning. Therefore, how to improve the positioning accuracy of key points in human infrared images has become the main research direction. In this study, a multi-scale convolution fusion deep residual network (Mscf-ResNet) model is proposed for human body infrared image positioning. This model is based on the traditional ResNet, changing the single-scale convolution to multi-scale and fusing the information of different receptive fields, so that the extracted features are more abundant and the degradation problem, caused by the excessively deep network, is avoided. The experiments show that our proposed method has higher key point positioning accuracy than other methods. At the same time, because the network structure of this paper is too deep, there are too many parameters and a large volume of calculations. Therefore, a more lightweight network model is the direction of future research.


2015 ◽  
Author(s):  
Haibo Luo ◽  
Lingyun Xu ◽  
Bin Hui ◽  
Zheng Chang

Sensors ◽  
2021 ◽  
Vol 21 (11) ◽  
pp. 3610
Author(s):  
Haonan Su ◽  
Cheolkon Jung ◽  
Long Yu

We formulate multi-spectral fusion and denoising for the luminance channel as a maximum a posteriori estimation problem in the wavelet domain. To deal with the discrepancy between RGB and near infrared (NIR) data in fusion, we build a discrepancy model and introduce the wavelet scale map. The scale map adjusts the wavelet coefficients of NIR data to have the same distribution as the RGB data. We use the priors of the wavelet scale map and its gradient as the contrast preservation term and gradient denoising term, respectively. Specifically, we utilize the local contrast and visibility measurements in the contrast preservation term to transfer the selected NIR data to the fusion result. We also use the gradient of NIR wavelet coefficients as the weight for the gradient denoising term in the wavelet scale map. Based on the wavelet scale map, we perform fusion of the RGB and NIR wavelet coefficients in the base and detail layers. To remove noise, we model the prior of the fused wavelet coefficients using NIR-guided Laplacian distributions. In the chrominance channels, we remove noise guided by the fused luminance channel. Based on the luminance variation after fusion, we further enhance the color of the fused image. Our experimental results demonstrated that the proposed method successfully performed the fusion of RGB and NIR images with noise reduction, detail preservation, and color enhancement.


2021 ◽  
Author(s):  
Chao Lu ◽  
Fansheng Chen ◽  
Xiaofeng Su ◽  
Dan Zeng

Abstract Infrared technology is a widely used in precision guidance and mine detection since it can capture the heat radiated outward from the target object. We use infrared (IR) thermography to get the infrared image of the buried obje cts. Compared to the visible images, infrared images present poor resolution, low contrast, and fuzzy visual effect, which make it difficult to segment the target object, specifically in the complex backgrounds. In this condition, traditional segmentation methods cannot perform well in infrared images since they are easily disturbed by the noise and non-target objects in the images. With the advance of deep convolutional neural network (CNN), the deep learning-based methods have made significant improvements in semantic segmentation task. However, few of them research Infrared image semantic segmentation, which is a more challenging scenario compared to visible images. Moreover, the lack of an Infrared image dataset is also a problem for current methods based on deep learning. We raise a multi-scale attentional feature fusion (MS-AFF) module for infrared image semantic segmentation to solve this problem. Precisely, we integrate a series of feature maps from different levels by an atrous spatial pyramid structure. In this way, the model can obtain rich representation ability on the infrared images. Besides, a global spatial information attention module is employed to let the model focus on the target region and reduce disturbance in infrared images' background. In addition, we propose an infrared segmentation dataset based on the infrared thermal imaging system. Extensive experiments conducted in the infrared image segmentation dataset show the superiority of our method.


2015 ◽  
Vol 71 ◽  
pp. 363-369 ◽  
Author(s):  
Zaifeng Shi ◽  
Jiangtao Xu ◽  
Yu zhang ◽  
Jufeng Zhao ◽  
Qing Xin

Electronics ◽  
2020 ◽  
Vol 9 (12) ◽  
pp. 2022
Author(s):  
Yongmei Ren ◽  
Jie Yang ◽  
Zhiqiang Guo ◽  
Qingnian Zhang ◽  
Hui Cao

Visible image quality is very susceptible to changes in illumination, and there are limitations in ship classification using images acquired by a single sensor. This study proposes a ship classification method based on an attention mechanism and multi-scale convolutional neural network (MSCNN) for visible and infrared images. First, the features of visible and infrared images are extracted by a two-stream symmetric multi-scale convolutional neural network module, and then concatenated to make full use of the complementary features present in multi-modal images. After that, the attention mechanism is applied to the concatenated fusion features to emphasize local details areas in the feature map, aiming to further improve feature representation capability of the model. Lastly, attention weights and the original concatenated fusion features are added element by element and fed into fully connected layers and Softmax output layer for final classification output. Effectiveness of the proposed method is verified on a visible and infrared spectra (VAIS) dataset, which shows 93.81% accuracy in classification results. Compared with other state-of-the-art methods, the proposed method could extract features more effectively and has better overall classification performance.


2015 ◽  
Vol 341 ◽  
pp. 199-209 ◽  
Author(s):  
Guangmang Cui ◽  
Huajun Feng ◽  
Zhihai Xu ◽  
Qi Li ◽  
Yueting Chen

Author(s):  
Ende Wang ◽  
Ping Jiang ◽  
Xuepeng Li ◽  
Hui Cao

AbstractStripe non-uniformity severely affects the quality of infrared images. It is challenging to remove stripe noise in low-texture images without blurring the details. We propose a single-frame image stripe correction algorithm that removes infrared noise while preserving image details. Firstly, wavelet transform is used for multi-scale analysis of the image. At the same time, Total variation model is used for small window to smooth the original image. The small-scale total variation model can well preserve the edge information of the image, but it will leave stripe noise. Therefore, according to the prior knowledge of the vertical component of the stripe noise, the spatial filtering is finally performed: the smoothed image is used as the guide image for the stripe noise denoising. It is possible to prevent the lead filter from mistaking the strong stripe noise as edge detail, resulting in corrected image residual streak noise. The algorithm is systematically evaluated by experiments on simulated images and original infrared images, as well as compared with the current advanced infrared stripe non-uniformity correction algorithms. It is proved that our algorithm can better eliminate stripe noise and preserve edge details.


2017 ◽  
Vol 54 (11) ◽  
pp. 111003
Author(s):  
许 磊 Xu Lei ◽  
崔光茫 Cui Guangmang ◽  
郑晨浦 Zheng Chenpu ◽  
赵巨峰 Zhao Jufeng

Sign in / Sign up

Export Citation Format

Share Document