scholarly journals Road-objects tracking for autonomous driving using lidar and radar fusion

2020 ◽  
Vol 71 (3) ◽  
pp. 138-149
Author(s):  
Wael Farag

AbstractIn this paper, based on the fusion of Lidar and Radar measurement data, a real-time road-Object Detection and Tracking (LR_ODT) method for autonomous driving is proposed. The lidar and radar devices are installed on the ego car, and a customized Unscented Kalman Filter (UKF) is used for their data fusion. Lidars are accurate in determining objects’ positions but significantly less accurate on measuring their velocities. However, Radars are more accurate on measuring objects velocities but less accurate on determining their positions as they have a lower spatial resolution. Therefore, the merits of both sensors are combined using the proposed fusion approach to provide both pose and velocity data for objects moving in roads precisely. The Grid-Based Density-Based Spatial Clustering of Applications with Noise (GB-DBSCAN) clustering algorithm is used to detect objects and estimate their centroids from the lidar and radar raw data. Then, the estimation of the object’s velocity as well as determining its corresponding geometrical shape is performed by the RANdom SAmple Consensus (RANSAC) algorithm. The proposed technique is implemented using the high-performance language C++ and utilizes highly optimized math and optimization libraries for best real-time performance. The performance of the UKF fusion is compared to that of the Extended Kalman Filter fusion (EKF) showing its superiority. Simulation studies have been carried out to evaluate the performance of the LR ODT for tracking bicycles, cars, and pedestrians.

2021 ◽  
pp. 1-14
Author(s):  
Wael Farag

In this paper, based on the fusion of Lidar and Radar measurement data, a real-time road-Object Detection and Tracking (LR_ODT) method for autonomous driving is proposed. The lidar and radar devices are installed on the ego car, and a customized Unscented Kalman Filter (UKF) is used for their data fusion. Lidars are accurate in determining objects’ positions but significantly less accurate on measuring their velocities. However, Radars are more accurate on measuring objects velocities but less accurate on determining their positions as they have a lower spatial resolution. Therefore, the merits of both sensors are combined using the proposed fusion approach to provide both pose and velocity data for objects moving in roads precisely. The Grid-Based Density-Based Spatial Clustering of Applications with Noise (GB-DBSCAN) clustering algorithm is used to detect objects and estimate their centroids from the lidar and radar raw data. Then, the estimation of the object’s velocity as well as determining its corresponding geometrical shape is performed by the RANdom SAmple Consensus (RANSAC) algorithm. The proposed technique is implemented using the high-performance language C+⁣+ and utilizes highly optimized math and optimization libraries for best real-time performance. The performance of the UKF fusion is compared to that of the Extended Kalman Filter fusion (EKF) showing its superiority. Simulation studies have been carried out to evaluate the performance of the LR_ODT for tracking bicycles, cars, and pedestrians.


Author(s):  
Wael Farag ◽  

In this paper, a real-time road-Object Detection and Tracking (LR_ODT) method for autonomous driving is proposed. The method is based on the fusion of lidar and radar measurement data, where they are installed on the ego car, and a customized Unscented Kalman Filter (UKF) is employed for their data fusion. The merits of both devices are combined using the proposed fusion approach to precisely provide both pose and velocity information for objects moving in roads around the ego car. Unlike other detection and tracking approaches, the balanced treatment of both pose estimation accuracy and its real-time performance is the main contribution in this work. The proposed technique is implemented using the high-performance language C++ and utilizes highly optimized math and optimization libraries for best real-time performance. Simulation studies have been carried out to evaluate the performance of the LR_ODT for tracking bicycles, cars, and pedestrians. Moreover, the performance of the UKF fusion is compared to that of the Extended Kalman Filter fusion (EKF) showing its superiority. The UKF has outperformed the EKF on all test cases and all the state variable levels (-24% average RMSE). The employed fusion technique show how outstanding is the improvement in tracking performance compared to the use of a single device (-29% RMES with lidar and -38% RMSE with radar).


Author(s):  
Wael Farag ◽  

In this paper, based on the fusion of Lidar and Radar measurement data, high-definition probabilistic maps, and a tailored particle filter, a Real-Time Monte Carlo Localization (RT_MCL) method for autonomous cars is proposed. The lidar and radar devices are installed on the ego car, and a customized Unscented Kalman Filter (UKF) is used for their data fusion. Lidars are accurate in determining objects' positions and have a much higher spatial resolution. On the other hand, Radars are more accurate in measuring objects velocities and perform well in extreme weather conditions. Therefore, the merits of both sensors are combined using the UKF to provide pole-like static-objects pose estimations that are well suited to serve as landmarks for vehicle localization in urban environments. These pose estimations are then clustered using the Grid-Based Density-Based Spatial Clustering of Applications with Noise (GB-DBSCAN) algorithm to represent each pole landmarks in the form of a source-point model to reduce computational cost and memory requirements. A reference map that includes pole landmarks is generated off-line and extracted from a 3-D lidar to be used by a carefully designed Particle Filter (PF) for accurate ego-car localization. The particle filter is initialized by the combined GPS+IMU reading and used an ego-car motion model to predict the states of the particles. The data association between the estimated landmarks by the UKF and that in the reference map is performed using Iterative Closest Point (ICP) algorithm. The proposed pipeline is implemented using the high-performance language C++ and utilizes highly optimized math and optimization libraries for best real-time performance. Extensive simulation studies have been carried out to evaluate the performance of the RT_MCL in both longitudinal and lateral localization.


2016 ◽  
Vol 16 (06) ◽  
pp. 1550016 ◽  
Author(s):  
Mohsen Askari ◽  
Jianchun Li ◽  
Bijan Samali

System identification refers to the process of building or improving mathematical models of dynamical systems from the observed experimental input–output data. In the area of civil engineering, the estimation of the integrity of a structure under dynamic loadings and during service condition has become a challenge for the engineering community. Therefore, there has been a great deal of attention paid to online and real-time structural identification, especially when input–output measurement data are contaminated by high-level noise. Among real-time identification methods, one of the most successful and widely used algorithms for estimation of system states and parameters is the Kalman filter and its various nonlinear extensions such as extended Kalman filter (EKF), Iterated EKF (IEKF), the recently developed unscented Kalman filter (UKF) and Iterated UKF (IUKF). In this paper, an investigation has been carried out on the aforementioned techniques for their effectiveness and efficiencies through a highly nonlinear single degree of freedom (SDOF) structure as well as a two-storey linear structure. Although IEKF is an improved version of EKF, results show that IUKF generally produces better results in terms of structural parameters and state estimation than UKF and IEKF. Also IUKF is more robust to noise levels compared to the other approaches.


Author(s):  
Wael Farag

In this article, a real-time road-Object Detection and Tracking (LR_ODT) method for autonomous driving is proposed. This method is based on the fusion of lidar and radar measurement data, where they are installed on the ego car, and a customized Unscented Kalman Filter is employed for their data fusion. The merits of both devices are combined using the proposed fusion approach to precisely provide both pose and velocity information for objects moving in roads around the ego car. Unlike other detection and tracking approaches, the balanced treatment of both pose estimation accuracy and its real-time performance is the main contribution in this work. The proposed technique is implemented using the high-performance language C++ and utilizes highly optimized math and optimization libraries for best real-time performance. Simulation studies have been carried out to evaluate the performance of the LR_ODT for tracking bicycles, cars, and pedestrians. Moreover, the performance of the Unscented Kalman Filter fusion is compared to that of the Extended Kalman Filter fusion showing its superiority. The Unscented Kalman Filter has outperformed the Extended Kalman Filter on all test cases and all the state variable levels (−24% average Root Mean Squared Error). The employed fusion technique shows how outstanding is the improvement in tracking performance compared to the use of a single device (−29% Root Mean Squared Error with lidar and −38% Root Mean Squared Error with radar).


Electronics ◽  
2019 ◽  
Vol 8 (9) ◽  
pp. 943 ◽  
Author(s):  
Il Bae ◽  
Jaeyoung Moon ◽  
Jeongseok Seo

The convergence of mechanical, electrical, and advanced ICT technologies, driven by artificial intelligence and 5G vehicle-to-everything (5G-V2X) connectivity, will help to develop high-performance autonomous driving vehicles and services that are usable and convenient for self-driving passengers. Despite widespread research on self-driving, user acceptance remains an essential part of successful market penetration; this forms the motivation behind studies on human factors associated with autonomous shuttle services. We address this by providing a comfortable driving experience while not compromising safety. We focus on the accelerations and jerks of vehicles to reduce the risk of motion sickness and to improve the driving experience for passengers. Furthermore, this study proposes a time-optimal velocity planning method for guaranteeing comfort criteria when an explicit reference path is given. The overall controller and planning method were verified using real-time, software-in-the-loop (SIL) environments for a real-time vehicle dynamics simulation; the performance was then compared with a typical planning approach. The proposed optimized planning shows a relatively better performance and enables a comfortable passenger experience in a self-driving shuttle bus according to the recommended criteria.


Energies ◽  
2021 ◽  
Vol 14 (3) ◽  
pp. 750
Author(s):  
Wenkang Wan ◽  
Jingan Feng ◽  
Bao Song ◽  
Xinxin Li

Accurate and real-time acquisition of vehicle state parameters is key to improving the performance of vehicle control systems. To improve the accuracy of state parameter estimation for distributed drive electric vehicles, an unscented Kalman filter (UKF) algorithm combined with the Huber method is proposed. In this paper, we introduce the nonlinear modified Dugoff tire model, build a nonlinear three-degrees-of-freedom time-varying parametric vehicle dynamics model, and extend the vehicle mass, the height of the center of gravity, and the yaw moment of inertia, which are significantly influenced by the driving state, into the vehicle state vector. The vehicle state parameter observer was designed using an unscented Kalman filter framework. The Huber cost function was introduced to correct the measured noise and state covariance in real-time to improve the robustness of the observer. The simulation verification of a double-lane change and straight-line driving conditions at constant speed was carried out using the Simulink/Carsim platform. The results show that observation using the Huber-based robust unscented Kalman filter (HRUKF) more realistically reflects the vehicle state in real-time, effectively suppresses the influence of abnormal error and noise, and obtains high observation accuracy.


2014 ◽  
Vol 615 ◽  
pp. 244-247
Author(s):  
Dong Wang ◽  
Guo Yu Lin ◽  
Wei Gong Zhang

The wheel force transducer (WFT) is used to measure dynamic wheel loads. Unlike other force sensors, WFT is rotating with the wheel. For this reason, the outputs and the inputs of the transducer are nonlinearly related, and traditional Kalman Filter is not suitable. In this paper, a new real-time filter algorithm utilizing Quadrature Kalman Filter (QKF) is proposed to solve this problem. In Quadrature Kalman Filter, Singer model is introduced to track the wheel force, and the observation function is established for WFT. The simulation results illustrate that the new filter outperforms the traditional Unscented Kalman Filter (UKF) and Extended Kalman Filter (EKF).


2014 ◽  
Vol 2014 ◽  
pp. 1-12 ◽  
Author(s):  
Ho-Nien Shou

This paper represents orbit propagation and determination of low Earth orbit (LEO) satellites. Satellite global positioning system (GPS) configured receiver provides position and velocity measures by navigating filter to get the coordinates of the orbit propagation (OP). The main contradictions in real-time orbit which is determined by the problem are orbit positioning accuracy and the amount of calculating two indicators. This paper is dedicated to solving the problem of tradeoffs. To plan to use a nonlinear filtering method for immediate orbit tasks requires more precise satellite orbit state parameters in a short time. Although the traditional extended Kalman filter (EKF) method is widely used, its linear approximation of the drawbacks in dealing with nonlinear problems was especially evident, without compromising Kalman filter (unscented Kalman Filter, UKF). As a new nonlinear estimation method, it is measured at the estimated measurements on more and more applications. This paper will be the first study on UKF microsatellites in LEO orbit in real time, trying to explore the real-time precision orbit determination techniques. Through the preliminary simulation results, they show that, based on orbit mission requirements and conditions using UKF, they can satisfy the positioning accuracy and compute two indicators.


Sign in / Sign up

Export Citation Format

Share Document