scholarly journals A Review of Deep Learning-Based Methods for Pedestrian Trajectory Prediction

Sensors ◽  
2021 ◽  
Vol 21 (22) ◽  
pp. 7543
Author(s):  
Bogdan Ilie Sighencea ◽  
Rareș Ion Stanciu ◽  
Cătălin Daniel Căleanu
Keyword(s):  
Deep Learning ◽  
Performance Metrics ◽  
Evaluation Process ◽  
Surveillance Systems ◽  
Driver Assistance ◽  
Driver Assistance Systems ◽  
Trajectory Prediction ◽  
Processing Technologies ◽  
Practical Applications ◽  
New Research

Pedestrian trajectory prediction is one of the main concerns of computer vision problems in the automotive industry, especially in the field of advanced driver assistance systems. The ability to anticipate the next movements of pedestrians on the street is a key task in many areas, e.g., self-driving auto vehicles, mobile robots or advanced surveillance systems, and they still represent a technological challenge. The performance of state-of-the-art pedestrian trajectory prediction methods currently benefits from the advancements in sensors and associated signal processing technologies. The current paper reviews the most recent deep learning-based solutions for the problem of pedestrian trajectory prediction along with employed sensors and afferent processing methodologies, and it performs an overview of the available datasets, performance metrics used in the evaluation process, and practical applications. Finally, the current work exposes the research gaps from the literature and outlines potential new research directions.

scholarly journals Experimental Validation on Intersection Turning Trajectory Prediction Method for Advanced Driver Assistance System Based on Triclothoidal Curve

2021 ◽  
Vol 11 (13) ◽  
pp. 5900
Author(s):  
Yohei Fujinami ◽  
Pongsathorn Raksincharoensak ◽  
Shunsaku Arita ◽  
Rei Kato
Keyword(s):  
Traffic Accidents ◽  
Computational Cost ◽  
Prediction Method ◽  
Smooth Curve ◽  
Assistance System ◽  
Driver Assistance ◽  
Driver Assistance Systems ◽  
Trajectory Prediction ◽  
Left Turn ◽  
Left Hand

Advanced driver assistance systems (ADAS) for crash avoidance, when making a right-turn in left-hand traffic or left-turn in right-hand traffic, are expected to further reduce the number of traffic accidents caused by automobiles. Accurate future trajectory prediction of an ego vehicle for risk prediction is important to activate the assistance system correctly. Our objectives are to propose a trajectory prediction method for ADAS for safe intersection turnings and to evaluate the effectiveness of the proposed prediction method. Our proposed curve generation method is capable of generating a smooth curve without discontinuities in the curvature. By incorporating the curve generation method into the vehicle trajectory prediction, the proposed method could simulate the actual driving path of human drivers at a low computational cost. The curve would be required to define positions, angles, and curvatures at its initial and terminal points. Driving experiments conducted at real city traffic intersections proved that the proposed method could predict the trajectory with a high degree of accuracy for various shapes and sizes of the intersections. This paper also describes a method to determine the terminal conditions of the curve generation method from intersection features. We set a hypothesis where the conditions can be defined individually from intersection geometry. From the hypothesis, a formula to determine the parameter was derived empirically from the driving experiments. Public road driving experiments indicated that the parameters for the trajectory prediction could be appropriately estimated by the obtained empirical formula.

scholarly journals Olympic Games Event Recognition via Transfer Learning with Photobombing Guided Data Augmentation

2021 ◽  
Vol 7 (2) ◽  
pp. 12
Author(s):  
Yousef I. Mohamad ◽  
Samah S. Baraheem ◽  
Tam V. Nguyen
Keyword(s):  
Deep Learning ◽  
Transfer Learning ◽  
Data Augmentation ◽  
Olympic Games ◽  
Event Recognition ◽  
Surveillance Systems ◽  
Video Captioning ◽  
Practical Applications ◽  
Sport Events ◽  
The Olympic Games

Automatic event recognition in sports photos is both an interesting and valuable research topic in the field of computer vision and deep learning. With the rapid increase and the explosive spread of data, which is being captured momentarily, the need for fast and precise access to the right information has become a challenging task with considerable importance for multiple practical applications, i.e., sports image and video search, sport data analysis, healthcare monitoring applications, monitoring and surveillance systems for indoor and outdoor activities, and video captioning. In this paper, we evaluate different deep learning models in recognizing and interpreting the sport events in the Olympic Games. To this end, we collect a dataset dubbed Olympic Games Event Image Dataset (OGED) including 10 different sport events scheduled for the Olympic Games Tokyo 2020. Then, the transfer learning is applied on three popular deep convolutional neural network architectures, namely, AlexNet, VGG-16 and ResNet-50 along with various data augmentation methods. Extensive experiments show that ResNet-50 with the proposed photobombing guided data augmentation achieves 90% in terms of accuracy.

scholarly journals Vision-Based Traffic Sign Detection and Recognition Systems: Current Trends and Challenges

Sensors ◽  
2019 ◽  
Vol 19 (9) ◽  
pp. 2093 ◽  
Author(s):  
Safat B. Wali ◽  
Majid A. Abdullah ◽  
Mahammad A. Hannan ◽  
Aini Hussain ◽  
Salina A. Samad ◽  
...  
Keyword(s):  
Performance Metrics ◽  
Driver Assistance ◽  
Driver Assistance Systems ◽  
Traffic Sign ◽  
Current Trends ◽  
Sign Detection ◽  
Comprehensive Survey ◽  
Future Vision ◽  
Traffic Sign Detection ◽  
Detection And Recognition

The automatic traffic sign detection and recognition (TSDR) system is very important research in the development of advanced driver assistance systems (ADAS). Investigations on vision-based TSDR have received substantial interest in the research community, which is mainly motivated by three factors, which are detection, tracking and classification. During the last decade, a substantial number of techniques have been reported for TSDR. This paper provides a comprehensive survey on traffic sign detection, tracking and classification. The details of algorithms, methods and their specifications on detection, tracking and classification are investigated and summarized in the tables along with the corresponding key references. A comparative study on each section has been provided to evaluate the TSDR data, performance metrics and their availability. Current issues and challenges of the existing technologies are illustrated with brief suggestions and a discussion on the progress of driver assistance system research in the future. This review will hopefully lead to increasing efforts towards the development of future vision-based TSDR system.

scholarly journals Can ADAS Distract Driver’s Attention? An RGB-D Camera and Deep Learning-Based Analysis

2021 ◽  
Vol 11 (24) ◽  
pp. 11587
Author(s):  
Luca Ulrich ◽  
Francesca Nonis ◽  
Enrico Vezzetti ◽  
Sandro Moos ◽  
Giandomenico Caruso ◽  
...  
Keyword(s):  
Deep Learning ◽  
Expression Recognition ◽  
Driver Assistance ◽  
Driver Assistance Systems ◽  
Driving Experience ◽  
Vehicle Accidents ◽  
Non Invasive ◽  
Driver Inattention ◽  
Assistance Systems ◽  
Invasive Techniques

Driver inattention is the primary cause of vehicle accidents; hence, manufacturers have introduced systems to support the driver and improve safety; nonetheless, advanced driver assistance systems (ADAS) must be properly designed not to become a potential source of distraction for the driver due to the provided feedback. In the present study, an experiment involving auditory and haptic ADAS has been conducted involving 11 participants, whose attention has been monitored during their driving experience. An RGB-D camera has been used to acquire the drivers’ face data. Subsequently, these images have been analyzed using a deep learning-based approach, i.e., a convolutional neural network (CNN) specifically trained to perform facial expression recognition (FER). Analyses to assess possible relationships between these results and both ADAS activations and event occurrences, i.e., accidents, have been carried out. A correlation between attention and accidents emerged, whilst facial expressions and ADAS activations resulted to be not correlated, thus no evidence that the designed ADAS are a possible source of distraction has been found. In addition to the experimental results, the proposed approach has proved to be an effective tool to monitor the driver through the usage of non-invasive techniques.

Imaging lidar prototype with homography and deep learning ranging methods

2022 ◽  
Author(s):  
Sehyeon Kim ◽  
Zhaowei Chen ◽  
Hossein Alisafaee
Keyword(s):  
Deep Learning ◽  
Autonomous Vehicles ◽  
Optical Element ◽  
Driver Assistance ◽  
Driver Assistance Systems ◽  
Lidar System ◽  
Time Performance ◽  
Potential Applications ◽  
Assistance Systems ◽  
Final System

Abstract We report on developing a non-scanning laser-based imaging lidar system based on a diffractive optical element with potential applications in advanced driver assistance systems, autonomous vehicles, drone navigation, and mobile devices. Our proposed lidar utilizes image processing, homography, and deep learning. Our emphasis in the design approach is on the compactness and cost of the final system for it to be deployable both as standalone and complementary to existing lidar sensors, enabling fusion sensing in the applications. This work describes the basic elements of the proposed lidar system and presents two potential ranging mechanisms, along with their experimental results demonstrating the real-time performance of our first prototype.

scholarly journals Intelligent Surveillance Systems: A Review

2020 ◽  
Vol 17 (2) ◽  
pp. 1-9
Author(s):  
Jose Manuel Mejia Muñoz ◽  
Adrián Mariscal Torres ◽  
Leticia Ortega Máynez
Keyword(s):  
Deep Learning ◽  
Literature Review ◽  
Surveillance Systems ◽  
Environment Protection ◽  
Security Systems ◽  
Intelligent Surveillance ◽  
Long Time ◽  
Area Surveillance ◽  
New Research

Security refers to the perceptions about an environment protection, it means without worry of suffer harm. This research offers a literature review about security subject, focused on autonomous surveillance, gathering in a single document the technical novelties about surveillance systems, their applications, and central components. During this research , we observe that deep learning its being applied for surveillance purpose, opening new research horizons, in an area which does not have been significant changes during about ten years, and we also found that new vast datasets are being produced to solve issues regarding security. We have also seen that, in terms of security, deep learning is highly viable to solve problems that have been implicit in security systems for a long time, this being able to turn deep learning into a new breakthrough with respect to systems programmed only by traditional vision algorithms, opening the possibility of becoming a mandatory accessory for security of systems. This research has been limited only on civil area surveillance systems, also we only use scientific articles for this, avoiding commercial technologies.

scholarly journals Potential of deep learning in drought assessment by extracting information from hydrometeorological precursors

2021 ◽  
Author(s):  
Rajib Maity ◽  
Mohd Imran Khan ◽  
Subharthi Sarkar ◽  
Riya Dutta ◽  
Subhra Sekhar Maity ◽  
...  
Keyword(s):  
Deep Learning ◽  
Performance Metrics ◽  
Climate Model ◽  
Meteorological Drought ◽  
Research Directions ◽  
Drought Assessment ◽  
Skill Scores ◽  
Basin Scale ◽  
New Research ◽  
Temperature Surface

Abstract This study explores the potential of deep learning (DL) approach to develop a model for basin-scale drought assessment using information from a set of primary hydrometeorological precursors, namely air temperature, surface pressure, wind speed, relative humidity, evaporation, soil moisture and geopotential height. The novelty of the study lies in extracting the information from the hydrometeorological precursors through the efficacy of DL algorithm, based on 1-dimensional convolutional neural network. Drought-prone regions, from where our study basins are selected, often suffer from the vagaries of rainfall that leads to drought-like situations. It is established that the proposed DL-based model is able to capture the underlying complex relationship between rainfall and the set of aforementioned hydrometeorological variables and subsequently, shows its promise for the basin-scale meteorological drought assessment as revealed through different performance metrics and skill scores. The accuracy of simulating the correct drought category, among the seven categories, is also high (>70%). Moreover, in general, the skill of any climate model is much higher for the primary meteorological variables as compared with other secondary or tertiary variables/phenomena, like droughts. Thus, the novelty of the proposed DL-based model also lies in the improved assessment of ensuing basin-scale meteorological droughts using the projected meteorological precursors and may lead to new research directions.

Sign in / Sign up

Export Citation Format

Share Document