Design Guidelines on Deep Learning–based Pedestrian Detection Methods for Supporting Autonomous Vehicles

2021 ◽  
Vol 54 (6) ◽  
pp. 1-36
Author(s):  
Azzedine Boukerche ◽  
Mingzhi Sha
Keyword(s):  
Deep Learning ◽  
Intelligent Transportation Systems ◽  
Autonomous Vehicles ◽  
Traffic Accidents ◽  
Pedestrian Detection ◽  
Transportation Systems ◽  
Design Guidelines ◽  
Detection Methods ◽  
Multi Scale ◽  
Present Design

Intelligent transportation systems (ITS) enable transportation participants to communicate with each other by sending and receiving messages, so that they can be aware of their surroundings and facilitate efficient transportation through better decision making. As an important part of ITS, autonomous vehicles can bring massive benefits by reducing traffic accidents. Correspondingly, much effort has been paid to the task of pedestrian detection, which is a fundamental task for supporting autonomous vehicles. With the progress of computational power in recent years, adopting deep learning–based methods has become a trend for improving the performance of pedestrian detection. In this article, we present design guidelines on deep learning–based pedestrian detection methods for supporting autonomous vehicles. First, we will introduce classic backbone models and frameworks, and we will analyze the inherent attributes of pedestrian detection. Then, we will illustrate and analyze representative pedestrian detectors from occlusion handling, multi-scale feature extraction, multi-perspective data utilization, and hard negatives handling these four aspects. Last, we will discuss the developments and trends in this area, followed by some open challenges.

scholarly journals Applications of Deep Learning Techniques for Pedestrian Detection in Smart Environments: A Comprehensive Study

2021 ◽  
Vol 2021 ◽  
pp. 1-14
Author(s):  
Fen He ◽  
Paria Karami Olia ◽  
Rozita Jamili Oskouei ◽  
Morteza Hosseini ◽  
Zhihao Peng ◽  
...  
Keyword(s):  
Deep Learning ◽  
Intelligent Transportation Systems ◽  
Smart Cities ◽  
Pedestrian Detection ◽  
Intelligent Transportation ◽  
Transportation Systems ◽  
Main Challenge ◽  
Learning Techniques ◽  
The World ◽  
Self Driving Cars

Intelligent transportation systems have been very well received by car companies, people, and governments around the world. The main challenge in the world of smart and self-driving cars is to identify obstacles, especially pedestrians, and take action to prevent collisions with them. Many studies in this field have been done by various researchers, but there are still many errors in the accurate detection of pedestrians in self-made cars made by different car companies, so in the research in this study, we focused on the use of deep learning techniques to identify pedestrians for the development of intelligent transportation systems and self-driving cars and pedestrian identification in smart cities, and then some of the most common deep learning techniques used by various researchers were reviewed. Finally, in this research, the challenges in each field are discovered, which can be very useful for students who are looking for an idea to do their dissertations and research in the field of smart transportation and smart cities.

Vision-based Autonomous Vehicle Recognition

2021 ◽  
Vol 54 (4) ◽  
pp. 1-37
Author(s):  
Azzedine Boukerche ◽  
Xiren Ma
Keyword(s):  
Deep Learning ◽  
Intelligent Transportation Systems ◽  
Comprehensive Evaluation ◽  
Autonomous Vehicle ◽  
Transportation Systems ◽  
Regional Security ◽  
Future Research ◽  
Learning Abilities ◽  
Vehicle Recognition ◽  
Model Recognition

Vision-based Automated Vehicle Recognition (VAVR) has attracted considerable attention recently. Particularly given the reliance on emerging deep learning methods, which have powerful feature extraction and pattern learning abilities, vehicle recognition has made significant progress. VAVR is an essential part of Intelligent Transportation Systems. The VAVR system can fast and accurately locate a target vehicle, which significantly helps improve regional security. A comprehensive VAVR system contains three components: Vehicle Detection (VD), Vehicle Make and Model Recognition (VMMR), and Vehicle Re-identification (VRe-ID). These components perform coarse-to-fine recognition tasks in three steps. In this article, we conduct a thorough review and comparison of the state-of-the-art deep learning--based models proposed for VAVR. We present a detailed introduction to different vehicle recognition datasets used for a comprehensive evaluation of the proposed models. We also critically discuss the major challenges and future research trends involved in each task. Finally, we summarize the characteristics of the methods for each task. Our comprehensive model analysis will help researchers that are interested in VD, VMMR, and VRe-ID and provide them with possible directions to solve current challenges and further improve the performance and robustness of models.

scholarly journals Light Field Image Quality Enhancement by a Lightweight Deformable Deep Learning Framework for Intelligent Transportation Systems

Electronics ◽  
2021 ◽  
Vol 10 (10) ◽  
pp. 1136
Author(s):  
David Augusto Ribeiro ◽  
Juan Casavílca Silva ◽  
Renata Lopes Rosa ◽  
Muhammad Saadi ◽  
Shahid Mumtaz ◽  
...  
Keyword(s):  
Deep Learning ◽  
Image Quality ◽  
Intelligent Transportation Systems ◽  
Light Field ◽  
State Of The Art ◽  
Intelligent Transportation ◽  
Transportation Systems ◽  
Machine Learning Algorithms ◽  
Learning Framework ◽  
Reconstruction Methods

Light field (LF) imaging has multi-view properties that help to create many applications that include auto-refocusing, depth estimation and 3D reconstruction of images, which are required particularly for intelligent transportation systems (ITSs). However, cameras can present a limited angular resolution, becoming a bottleneck in vision applications. Thus, there is a challenge to incorporate angular data due to disparities in the LF images. In recent years, different machine learning algorithms have been applied to both image processing and ITS research areas for different purposes. In this work, a Lightweight Deformable Deep Learning Framework is implemented, in which the problem of disparity into LF images is treated. To this end, an angular alignment module and a soft activation function into the Convolutional Neural Network (CNN) are implemented. For performance assessment, the proposed solution is compared with recent state-of-the-art methods using different LF datasets, each one with specific characteristics. Experimental results demonstrated that the proposed solution achieved a better performance than the other methods. The image quality results obtained outperform state-of-the-art LF image reconstruction methods. Furthermore, our model presents a lower computational complexity, decreasing the execution time.

Fog-based Intelligent Transportation System for Traffic Light Optimization

2021 ◽  
Vol 58 (S) ◽  
pp. 29-35
Author(s):  
Muhammad Rusyadi Ramli ◽  
Riesa Krisna Astuti Sakir ◽  
Dong-Seong Kim
Keyword(s):  
Intelligent Transportation Systems ◽  
Traffic Accidents ◽  
Intelligent Transportation System ◽  
Optimization Problems ◽  
Intelligent Transportation ◽  
Transportation Systems ◽  
Traffic Light ◽  
Traffic Condition ◽  
Dilemma Zone ◽  
Traffic Lights

This paper presents fog-based intelligent transportation systems (ITS) architecture for traffic light optimization. Specifically, each intersection consists of traffic lights equipped with a fog node. The roadside unit (RSU) node is deployed to monitor the traffic condition and transmit it to the fog node. The traffic light center (TLC) is used to collect the traffic condition from the fog nodes of all intersections. In this work, two traffic light optimization problems are addressed where each problem will be processed either on fog node or TLC according to their requirements. First, the high latency for the vehicle to decide the dilemma zone is addressed. In the dilemma zone, the vehicle may hesitate whether to accelerate or decelerate that can lead to traffic accidents if the decision is not taken quickly. This first problem is processed on the fog node since it requires a real-time process to accomplish. Second, the proposed architecture aims each intersection aware of its adjacent traffic condition. Thus, the TLC is used to estimate the total incoming number of vehicles based on the gathered information from all fog nodes of each intersection. The results show that the proposed fog-based ITS architecture has better performance in terms of network latency compared to the existing solution in which relies only on TLC.

scholarly journals An Advanced Deep Learning Approach for Multi-Object Counting in Urban Vehicular Environments

2021 ◽  
Vol 13 (12) ◽  
pp. 306
Author(s):  
Ahmed Dirir ◽  
Henry Ignatious ◽  
Hesham Elsayed ◽  
Manzoor Khan ◽  
Mohammed Adib ◽  
...  
Keyword(s):  
Deep Learning ◽  
Intelligent Transportation Systems ◽  
Smart Cities ◽  
Weather Conditions ◽  
Research Area ◽  
Transportation Systems ◽  
Detection Accuracy ◽  
Adverse Weather ◽  
Object Counting ◽  
The Impact

Object counting is an active research area that gained more attention in the past few years. In smart cities, vehicle counting plays a crucial role in urban planning and management of the Intelligent Transportation Systems (ITS). Several approaches have been proposed in the literature to address this problem. However, the resulting detection accuracy is still not adequate. This paper proposes an efficient approach that uses deep learning concepts and correlation filters for multi-object counting and tracking. The performance of the proposed system is evaluated using a dataset consisting of 16 videos with different features to examine the impact of object density, image quality, angle of view, and speed of motion towards system accuracy. Performance evaluation exhibits promising results in normal traffic scenarios and adverse weather conditions. Moreover, the proposed approach outperforms the performance of two recent approaches from the literature.

scholarly journals Deep Learning System for Vehicular Re-Routing and Congestion Avoidance

2019 ◽  
Vol 9 (13) ◽  
pp. 2717 ◽  
Author(s):  
Pedro Perez-Murueta ◽  
Alfonso Gómez-Espinosa ◽  
Cesar Cardenas ◽  
Miguel Gonzalez-Mendoza
Keyword(s):  
Deep Learning ◽  
Intelligent Transportation Systems ◽  
Urban Areas ◽  
Transportation Systems ◽  
Learning System ◽  
Traffic Network ◽  
Public And Private ◽  
Traffic Jam ◽  
Private Transportation ◽  
Alternative Routes

Delays in transportation due to congestion generated by public and private transportation are common in many urban areas of the world. To make transportation systems more efficient, intelligent transportation systems (ITS) are currently being developed. One of the objectives of ITS is to detect congested areas and redirect vehicles away from them. However, most existing approaches only react once the traffic jam has occurred and, therefore, the delay has already spread to more areas of the traffic network. We propose a vehicle redirection system to avoid congestion that uses a model based on deep learning to predict the future state of the traffic network. The model uses the information obtained from the previous step to determine the zones with possible congestion, and redirects the vehicles that are about to cross them. Alternative routes are generated using the entropy-balanced k Shortest Path algorithm (EBkSP). The proposal uses information obtained in real time by a set of probe cars to detect non-recurrent congestion. The results obtained from simulations in various scenarios have shown that the proposal is capable of reducing the average travel time (ATT) by up to 19%, benefiting a maximum of 38% of the vehicles.

Sign in / Sign up

Export Citation Format

Share Document