scholarly journals Socially Aware Crowd Navigation with Multimodal Pedestrian Trajectory Prediction for Autonomous Vehicles

Author(s):  
Kunming Li ◽  
Mao Shan ◽  
Karan Narula ◽  
Stewart Worrall ◽  
Eduardo Nebot
Sensors ◽  
2020 ◽  
Vol 20 (17) ◽  
pp. 4703
Author(s):  
Yookhyun Yoon ◽  
Taeyeon Kim ◽  
Ho Lee ◽  
Jahnghyon Park

For driving safely and comfortably, the long-term trajectory prediction of surrounding vehicles is essential for autonomous vehicles. For handling the uncertain nature of trajectory prediction, deep-learning-based approaches have been proposed previously. An on-road vehicle must obey road geometry, i.e., it should run within the constraint of the road shape. Herein, we present a novel road-aware trajectory prediction method which leverages the use of high-definition maps with a deep learning network. We developed a data-efficient learning framework for the trajectory prediction network in the curvilinear coordinate system of the road and a lane assignment for the surrounding vehicles. Then, we proposed a novel output-constrained sequence-to-sequence trajectory prediction network to incorporate the structural constraints of the road. Our method uses these structural constraints as prior knowledge for the prediction network. It is not only used as an input to the trajectory prediction network, but is also included in the constrained loss function of the maneuver recognition network. Accordingly, the proposed method can predict a feasible and realistic intention of the driver and trajectory. Our method has been evaluated using a real traffic dataset, and the results thus obtained show that it is data-efficient and can predict reasonable trajectories at merging sections.


Author(s):  
Yuexin Ma ◽  
Xinge Zhu ◽  
Sibo Zhang ◽  
Ruigang Yang ◽  
Wenping Wang ◽  
...  

To safely and efficiently navigate in complex urban traffic, autonomous vehicles must make responsible predictions in relation to surrounding traffic-agents (vehicles, bicycles, pedestrians, etc.). A challenging and critical task is to explore the movement patterns of different traffic-agents and predict their future trajectories accurately to help the autonomous vehicle make reasonable navigation decision. To solve this problem, we propose a long short-term memory-based (LSTM-based) realtime traffic prediction algorithm, TrafficPredict. Our approach uses an instance layer to learn instances’ movements and interactions and has a category layer to learn the similarities of instances belonging to the same type to refine the prediction. In order to evaluate its performance, we collected trajectory datasets in a large city consisting of varying conditions and traffic densities. The dataset includes many challenging scenarios where vehicles, bicycles, and pedestrians move among one another. We evaluate the performance of TrafficPredict on our new dataset and highlight its higher accuracy for trajectory prediction by comparing with prior prediction methods.


2021 ◽  
Author(s):  
Haiyang Tang ◽  
Yujun Wang ◽  
Wenjie Yuan ◽  
Yuqi Sun

2021 ◽  
Vol 33 (5) ◽  
pp. 745-754
Author(s):  
Xuchuan Li ◽  
Lingkun Fan ◽  
Tao Chen ◽  
Shuaicong Guo

The ability to predict the motion of vehicles is essential for autonomous vehicles. Aiming at the problem that existing models cannot make full use of the external parameters including the outline of vehicles and the lane, we proposed a model to use the external parameters thoroughly when predicting the trajectory in the straight-line and non-free flow state. Meanwhile, dynamic sensitive area is proposed to filter out inconsequential surrounding vehicles. The historical trajectory of the vehicles and their external parameters are used as inputs. A shared Long Short-Term Memory (LSTM) cell is proposed to encode the explicit states obtained by mapping historical trajectory and external parameters. The hidden states of vehicles obtained from the last step are used to extract latent driving intent. Then, a convolution layer is designed to fuse hidden states to feed into the next prediction circle and a decoder is used to decode the hidden states of the vehicles to predict trajectory. The experiment result shows that the dynamic sensitive area can shorten the training time to 75.86% of the state-of-the-art work. Compared with other models, the accuracy of our model is improved by 23.7%. Meanwhile, the model's ability of anti-interference of external parameters is also improved.


Author(s):  
Yongshuai Zhi ◽  
Zhipeng Bao ◽  
Sumin Zhang ◽  
Rui He

Accurately predicting maneuvers and trajectory of vehicles are essential prerequisites for intelligent systems such as autonomous vehicles to achieve safe and high-quality decision making and motion planning. Motions of each vehicle in a scene is governed by the traffic context, that is, the motion and relative spatial positions of neighboring vehicles, and is also affected by its motion inertia, that is, the trajectory history. In this paper, we propose a novel scheme based on Bidirectional Gated Recurrent Unit (BiGRU) to conduct online multi-modal driving maneuvers and trajectory prediction. The motivation for this BiGRU based method relies on its enhanced prediction accuracy and computational efficiency in outputting the predicted results within the limited prediction horizon. We utilize a BiGRU to extract the complete history and future information of every point in the trajectory history sequence, apply dilated convolutional social (DCS) for learning interdependencies in vehicle motion, and subsequently use a GRU decoder model to make predictions. Additionally, our model simultaneously outputs a multi-modal predictive distribution over future trajectory and vehicle’s behavior prediction results. We evaluate our model using the publicly available NGSIM US-101and I-80 datasets. Our results show improvements over the state-of-the-art in terms of Root Mean Square Error (RMSE) values and Negative Log-Likelihoods (NLL). We also present a qualitative analysis of the model’s predicted maneuvers and multi-model trajectories for various traffic scenarios.


Sensors ◽  
2021 ◽  
Vol 21 (16) ◽  
pp. 5354
Author(s):  
Eunsan Jo ◽  
Myoungho Sunwoo ◽  
Minchul Lee

Predicting the trajectories of surrounding vehicles by considering their interactions is an essential ability for the functioning of autonomous vehicles. The subsequent movement of a vehicle is decided based on the multiple maneuvers of surrounding vehicles. Therefore, to predict the trajectories of surrounding vehicles, interactions among multiple maneuvers should be considered. Recent research has taken into account interactions that are difficult to express mathematically using data-driven deep learning methods. However, previous studies have only considered the interactions among observed trajectories due to subsequent maneuvers that are unobservable and numerous maneuver combinations. Thus, to consider the interaction among multiple maneuvers, this paper proposes a hierarchical graph neural network. The proposed hierarchical model approximately predicts the multiple maneuvers of vehicles and considers the interaction among the maneuvers by representing their relationships in a graph structure. The proposed method was evaluated using a publicly available dataset and a real driving dataset. Compared with previous methods, the results of the proposed method exhibited better prediction performance in highly interactive situations.


Sensors ◽  
2021 ◽  
Vol 21 (23) ◽  
pp. 8152
Author(s):  
Dongyeon Yu ◽  
Honggyu Lee ◽  
Taehoon Kim ◽  
Sung-Ho Hwang

It is essential for autonomous vehicles at level 3 or higher to have the ability to predict the trajectories of surrounding vehicles to safely and effectively plan and drive along trajectories in complex traffic situations. However, predicting the future behavior of vehicles is a challenging issue because traffic vehicles each have different drivers with different driving tendencies and intentions and they interact with each other. This paper presents a Long Short-Term Memory (LSTM) encoder–decoder model that utilizes an attention mechanism that focuses on certain information to predict vehicles’ trajectories. The proposed model was trained using the Highway Drone (HighD) dataset, which is a high-precision, large-scale traffic dataset. We also compared this model to previous studies. Our model effectively predicted future trajectories by using an attention mechanism to manage the importance of the driving flow of the target and adjacent vehicles and the target vehicle’s dynamics in each driving situation. Furthermore, this study presents a method of linearizing the road geometry such that the trajectory prediction model can be used in a variety of road environments. We verified that the road geometry linearization mechanism can improve the trajectory prediction model’s performance on various road environments in a virtual test-driving simulator constructed based on actual road data.


Sign in / Sign up

Export Citation Format

Share Document