A new thermal infrared and visible spectrum images-based pedestrian detection system

2018 ◽  
Vol 78 (12) ◽  
pp. 15861-15885 ◽  
Author(s):  
Redouan Lahmyed ◽  
Mohamed El Ansari ◽  
Ayoub Ellahyani
Keyword(s):  
Detection System ◽  
Pedestrian Detection ◽  
Visible Spectrum ◽  
Thermal Infrared

Real-Time Detection of Pedestrians

2016 ◽  
pp. 225-243
Author(s):  
Juan Serrano-Cuerda ◽  
José Carlos Castillo ◽  
María T. López ◽  
Antonio Fernández-Caballero
Keyword(s):  
Infrared Spectrum ◽  
Real Time ◽  
Video Surveillance ◽  
Pedestrian Detection ◽  
Visible Spectrum ◽  
Thermal Infrared ◽  
Lower Sensitivity ◽  
Key Technology ◽  
Infrared Cameras ◽  
Technological Limitations

Real-time pedestrian detection is a key technology for video surveillance. A widespread approach for detecting pedestrians is the use of color information. In recent times, the use of thermal infrared cameras has revealed to be an excellent alternative that offers good results in people segmentation. Nonetheless, thermal infrared cameras are very sensitive to the overall heat detected at each image. Moreover, a great amount of infrared images has low spatial resolution and lower sensitivity than visible spectrum images due to the technological limitations of infrared cameras. This chapter introduces a comparison of three different algorithms for real-time and robust pedestrian detection in the infrared spectrum. The aim of the paper is to look for the best algorithms prepared to resolve the conflicts that arise in the detection process in image sequences. We propose to use simple rules as conflict resolution mechanism when the outputs of the three algorithms do not coincide.

scholarly journals A Robust Thermal Infrared Vehicle and Pedestrian Detection Method in Complex Scenes

Sensors ◽  
2021 ◽  
Vol 21 (4) ◽  
pp. 1240
Author(s):  
Yang Liu ◽  
Hailong Su ◽  
Cao Zeng ◽  
Xiaoli Li
Keyword(s):  
Detection Method ◽  
Selection Process ◽  
Pedestrian Detection ◽  
Thermal Infrared ◽  
Single Shot ◽  
Detection Algorithms ◽  
Complex Scenes ◽  
Thermal Infrared Images ◽  
Online Feature Selection ◽  
Huge Challenge

In complex scenes, it is a huge challenge to accurately detect motion-blurred, tiny, and dense objects in the thermal infrared images. To solve this problem, robust thermal infrared vehicle and pedestrian detection method is proposed in this paper. An important weight parameter β is first proposed to reconstruct the loss function of the feature selective anchor-free (FSAF) module in its online feature selection process, and the FSAF module is optimized to enhance the detection performance of motion-blurred objects. The proposal of parameter β provides an effective solution to the challenge of motion-blurred object detection. Then, the optimized anchor-free branches of the FSAF module are plugged into the YOLOv3 single-shot detector and work jointly with the anchor-based branches of the YOLOv3 detector in both training and inference, which efficiently improves the detection precision of the detector for tiny and dense objects. Experimental results show that the method proposed is superior to other typical thermal infrared vehicle and pedestrian detection algorithms due to 72.2% mean average precision (mAP).

scholarly journals Multi-Scale Feature Pyramid Network: A Heavily Occluded Pedestrian Detection Network Based on ResNet

Sensors ◽  
2021 ◽  
Vol 21 (5) ◽  
pp. 1820
Author(s):  
Xiaotao Shao ◽  
Qing Wang ◽  
Wei Yang ◽  
Yun Chen ◽  
Yi Xie ◽  
...  
Keyword(s):  
Semantic Information ◽  
Detection System ◽  
Pedestrian Detection ◽  
Detection Accuracy ◽  
The Public ◽  
Scale Feature ◽  
Detection Algorithms ◽  
Multi Scale ◽  
Art Works ◽  
Feature Pyramid

The existing pedestrian detection algorithms cannot effectively extract features of heavily occluded targets which results in lower detection accuracy. To solve the heavy occlusion in crowds, we propose a multi-scale feature pyramid network based on ResNet (MFPN) to enhance the features of occluded targets and improve the detection accuracy. MFPN includes two modules, namely double feature pyramid network (FPN) integrated with ResNet (DFR) and repulsion loss of minimum (RLM). We propose the double FPN which improves the architecture to further enhance the semantic information and contours of occluded pedestrians, and provide a new way for feature extraction of occluded targets. The features extracted by our network can be more separated and clearer, especially those heavily occluded pedestrians. Repulsion loss is introduced to improve the loss function which can keep predicted boxes away from the ground truths of the unrelated targets. Experiments carried out on the public CrowdHuman dataset, we obtain 90.96% AP which yields the best performance, 5.16% AP gains compared to the FPN-ResNet50 baseline. Compared with the state-of-the-art works, the performance of the pedestrian detection system has been boosted with our method.

scholarly journals Integer arithmetic approximation of the hog algorithm used for pedestrian detection

2017 ◽  
Vol 14 (2) ◽  
pp. 329-346 ◽  
Author(s):  
Srdjan Sladojevic ◽  
Andras Anderla ◽  
Dubravko Culibrk ◽  
Darko Stefanovic ◽  
Bojan Lalic
Keyword(s):  
Classification Accuracy ◽  
System Performance ◽  
Detection System ◽  
Pedestrian Detection ◽  
Lessons Learned ◽  
People Detection ◽  
Algorithm Performance ◽  
Integer Arithmetic ◽  
Point Arithmetic ◽  
Angle Calculation

This paper presents the results of a study of the effects of integer (fixed-point) arithmetic implementation on classification accuracy of a popular open-source people detection system based on Histogram of Oriented Gradients. It is investigated how the system performance deviates from the reference algorithm performance as integer arithmetic is introduced with different bit-width in several critical parts of the system. In performed experiments, the effects of different bit-width integer arithmetic implementation for four key operations were separately considered: HoG descriptor magnitude calculation, HoG descriptor angle calculation, normalization and SVM classification. It is found that a 13-bit representation of variables is more than sufficient to accurately implement this system in integer arithmetic. The experiments in the paper are conducted for pedestrian detection and the methodology and the lessons learned from this study allow generalization of conclusions to a broader class of applications.

scholarly journals Pure FPGA Implementation of an HOG Based Real-Time Pedestrian Detection System

Sensors ◽  
2018 ◽  
Vol 18 (4) ◽  
pp. 1174 ◽  
Author(s):  
Jian Luo ◽  
Chang Lin
Keyword(s):  
Real Time ◽  
Detection System ◽  
Pedestrian Detection ◽  
Image Sensor ◽  
Frame Rate ◽  
External Memory ◽  
Support Vector ◽  
Svm Classification ◽  
Prior Art ◽  
Memory Modules

In this study, we propose a real-time pedestrian detection system using a FPGA with a digital image sensor. Comparing with some prior works, the proposed implementation realizes both the histogram of oriented gradients (HOG) and the trained support vector machine (SVM) classification on a FPGA. Moreover, the implementation does not use any external memory or processors to assist the implementation. Although the implementation implements both the HOG algorithm and the SVM classification in hardware without using any external memory modules and processors, the proposed implementation’s resource utilization of the FPGA is lower than most of the prior art. The main reasons resulting in the lower resource usage are: (1) simplification in the Getting Bin sub-module; (2) distributed writing and two shift registers in the Cell Histogram Generation sub-module; (3) reuse of each sum of the cell histogram in the Block Histogram Normalization sub-module; and (4) regarding a window of the SVM classification as 105 blocks of the SVM classification. Moreover, compared to Dalal and Triggs’s pure software HOG implementation, the proposed implementation‘s average detection rate is just about 4.05% less, but can achieve a much higher frame rate.

Sign in / Sign up

Export Citation Format

Share Document