Adaptive ground plane estimation for moving camera-based 3D object tracking

Author(s):  
Tao Liu ◽  
Yong Liu ◽  
Zheng Tang ◽  
Jenq-Neng Hwang
2021 ◽  
Vol 2021 ◽  
pp. 1-15
Author(s):  
Tao Liu ◽  
Yong Liu

Moving camera-based object tracking method for the intelligent transportation system (ITS) has drawn increasing attention. The unpredictability of driving environments and noise from the camera calibration, however, make conventional ground plane estimation unreliable and adversely affecting the tracking result. In this paper, we propose an object tracking system using an adaptive ground plane estimation algorithm, facilitated with constrained multiple kernel (CMK) tracking and Kalman filtering, to continuously update the location of moving objects. The proposed algorithm takes advantage of the structure from motion (SfM) to estimate the pose of moving camera, and then the estimated camera’s yaw angle is used as a feedback to improve the accuracy of the ground plane estimation. To further robustly and efficiently tracking objects under occlusion, the constrained multiple kernel tracking technique is adopted in the proposed system to track moving objects in 3D space (depth). The proposed system is evaluated on several challenging datasets, and the experimental results show the favorable performance, which not only can efficiently track on-road objects in a dashcam equipped on a free-moving vehicle but also can well handle occlusion in the tracking.


Sensors ◽  
2021 ◽  
Vol 21 (9) ◽  
pp. 2894
Author(s):  
Minh-Quan Dao ◽  
Vincent Frémont

Multi-Object Tracking (MOT) is an integral part of any autonomous driving pipelines because it produces trajectories of other moving objects in the scene and predicts their future motion. Thanks to the recent advances in 3D object detection enabled by deep learning, track-by-detection has become the dominant paradigm in 3D MOT. In this paradigm, a MOT system is essentially made of an object detector and a data association algorithm which establishes track-to-detection correspondence. While 3D object detection has been actively researched, association algorithms for 3D MOT has settled at bipartite matching formulated as a Linear Assignment Problem (LAP) and solved by the Hungarian algorithm. In this paper, we adapt a two-stage data association method which was successfully applied to image-based tracking to the 3D setting, thus providing an alternative for data association for 3D MOT. Our method outperforms the baseline using one-stage bipartite matching for data association by achieving 0.587 Average Multi-Object Tracking Accuracy (AMOTA) in NuScenes validation set and 0.365 AMOTA (at level 2) in Waymo test set.


2009 ◽  
Vol 16 (2) ◽  
pp. 165-177 ◽  
Author(s):  
Jean-Charles Noyer ◽  
Patrick Lanvin ◽  
Mohammed Benjelloun

2018 ◽  
Vol 40 (6) ◽  
pp. 1465-1479 ◽  
Author(s):  
Alberto Crivellaro ◽  
Mahdi Rad ◽  
Yannick Verdie ◽  
Kwang Moo Yi ◽  
Pascal Fua ◽  
...  
Keyword(s):  

2011 ◽  
Vol 30 (11) ◽  
pp. 1311-1327 ◽  
Author(s):  
Michael Krainin ◽  
Peter Henry ◽  
Xiaofeng Ren ◽  
Dieter Fox

Sign in / Sign up

Export Citation Format

Share Document