Lidar and radar fusion for real-time road-objects detection and tracking

2021 ◽  
pp. 1-14
Author(s):  
Wael Farag
Keyword(s):  
Kalman Filter ◽  
Real Time ◽  
High Performance ◽  
Clustering Algorithm ◽  
Unscented Kalman Filter ◽  
Spatial Clustering ◽  
Measurement Data ◽  
Autonomous Driving ◽  
Geometrical Shape ◽  
Detection And Tracking

In this paper, based on the fusion of Lidar and Radar measurement data, a real-time road-Object Detection and Tracking (LR_ODT) method for autonomous driving is proposed. The lidar and radar devices are installed on the ego car, and a customized Unscented Kalman Filter (UKF) is used for their data fusion. Lidars are accurate in determining objects’ positions but significantly less accurate on measuring their velocities. However, Radars are more accurate on measuring objects velocities but less accurate on determining their positions as they have a lower spatial resolution. Therefore, the merits of both sensors are combined using the proposed fusion approach to provide both pose and velocity data for objects moving in roads precisely. The Grid-Based Density-Based Spatial Clustering of Applications with Noise (GB-DBSCAN) clustering algorithm is used to detect objects and estimate their centroids from the lidar and radar raw data. Then, the estimation of the object’s velocity as well as determining its corresponding geometrical shape is performed by the RANdom SAmple Consensus (RANSAC) algorithm. The proposed technique is implemented using the high-performance language C+⁣+ and utilizes highly optimized math and optimization libraries for best real-time performance. The performance of the UKF fusion is compared to that of the Extended Kalman Filter fusion (EKF) showing its superiority. Simulation studies have been carried out to evaluate the performance of the LR_ODT for tracking bicycles, cars, and pedestrians.

scholarly journals Road-objects tracking for autonomous driving using lidar and radar fusion

2020 ◽  
Vol 71 (3) ◽  
pp. 138-149
Author(s):  
Wael Farag
Keyword(s):  
Kalman Filter ◽  
Real Time ◽  
High Performance ◽  
Clustering Algorithm ◽  
Unscented Kalman Filter ◽  
Spatial Clustering ◽  
Measurement Data ◽  
Autonomous Driving ◽  
Geometrical Shape ◽  
Dbscan Clustering

AbstractIn this paper, based on the fusion of Lidar and Radar measurement data, a real-time road-Object Detection and Tracking (LR_ODT) method for autonomous driving is proposed. The lidar and radar devices are installed on the ego car, and a customized Unscented Kalman Filter (UKF) is used for their data fusion. Lidars are accurate in determining objects’ positions but significantly less accurate on measuring their velocities. However, Radars are more accurate on measuring objects velocities but less accurate on determining their positions as they have a lower spatial resolution. Therefore, the merits of both sensors are combined using the proposed fusion approach to provide both pose and velocity data for objects moving in roads precisely. The Grid-Based Density-Based Spatial Clustering of Applications with Noise (GB-DBSCAN) clustering algorithm is used to detect objects and estimate their centroids from the lidar and radar raw data. Then, the estimation of the object’s velocity as well as determining its corresponding geometrical shape is performed by the RANdom SAmple Consensus (RANSAC) algorithm. The proposed technique is implemented using the high-performance language C++ and utilizes highly optimized math and optimization libraries for best real-time performance. The performance of the UKF fusion is compared to that of the Extended Kalman Filter fusion (EKF) showing its superiority. Simulation studies have been carried out to evaluate the performance of the LR ODT for tracking bicycles, cars, and pedestrians.

scholarly journals Multiple Road-Objects Detection and Tracking for Autonomous Driving

2021 ◽  
Author(s):  
Wael Farag ◽  
Keyword(s):  
Kalman Filter ◽  
Real Time ◽  
High Performance ◽  
Unscented Kalman Filter ◽  
Measurement Data ◽  
Autonomous Driving ◽  
Estimation Accuracy ◽  
Time Performance ◽  
Detection And Tracking ◽  
Objects Detection

In this paper, a real-time road-Object Detection and Tracking (LR_ODT) method for autonomous driving is proposed. The method is based on the fusion of lidar and radar measurement data, where they are installed on the ego car, and a customized Unscented Kalman Filter (UKF) is employed for their data fusion. The merits of both devices are combined using the proposed fusion approach to precisely provide both pose and velocity information for objects moving in roads around the ego car. Unlike other detection and tracking approaches, the balanced treatment of both pose estimation accuracy and its real-time performance is the main contribution in this work. The proposed technique is implemented using the high-performance language C++ and utilizes highly optimized math and optimization libraries for best real-time performance. Simulation studies have been carried out to evaluate the performance of the LR_ODT for tracking bicycles, cars, and pedestrians. Moreover, the performance of the UKF fusion is compared to that of the Extended Kalman Filter fusion (EKF) showing its superiority. The UKF has outperformed the EKF on all test cases and all the state variable levels (-24% average RMSE). The employed fusion technique show how outstanding is the improvement in tracking performance compared to the use of a single device (-29% RMES with lidar and -38% RMSE with radar).

scholarly journals Bayesian Localization in Real-Time using Probabilistic Maps and Unscented-Kalman-Filters

2021 ◽  
Author(s):  
Wael Farag ◽  
Keyword(s):  
Particle Filter ◽  
Real Time ◽  
High Performance ◽  
Unscented Kalman Filter ◽  
Spatial Clustering ◽  
Computational Cost ◽  
Measurement Data ◽  
High Definition ◽  
Probabilistic Maps ◽  
Reference Map

In this paper, based on the fusion of Lidar and Radar measurement data, high-definition probabilistic maps, and a tailored particle filter, a Real-Time Monte Carlo Localization (RT_MCL) method for autonomous cars is proposed. The lidar and radar devices are installed on the ego car, and a customized Unscented Kalman Filter (UKF) is used for their data fusion. Lidars are accurate in determining objects' positions and have a much higher spatial resolution. On the other hand, Radars are more accurate in measuring objects velocities and perform well in extreme weather conditions. Therefore, the merits of both sensors are combined using the UKF to provide pole-like static-objects pose estimations that are well suited to serve as landmarks for vehicle localization in urban environments. These pose estimations are then clustered using the Grid-Based Density-Based Spatial Clustering of Applications with Noise (GB-DBSCAN) algorithm to represent each pole landmarks in the form of a source-point model to reduce computational cost and memory requirements. A reference map that includes pole landmarks is generated off-line and extracted from a 3-D lidar to be used by a carefully designed Particle Filter (PF) for accurate ego-car localization. The particle filter is initialized by the combined GPS+IMU reading and used an ego-car motion model to predict the states of the particles. The data association between the estimated landmarks by the UKF and that in the reference map is performed using Iterative Closest Point (ICP) algorithm. The proposed pipeline is implemented using the high-performance language C++ and utilizes highly optimized math and optimization libraries for best real-time performance. Extensive simulation studies have been carried out to evaluate the performance of the RT_MCL in both longitudinal and lateral localization.

Kalman-filter-based sensor fusion applied to road-objects detection and tracking for autonomous vehicles

2020 ◽  
pp. 095965182097552
Author(s):  
Wael Farag
Keyword(s):  
Kalman Filter ◽  
Real Time ◽  
Extended Kalman Filter ◽  
Mean Squared Error ◽  
Unscented Kalman Filter ◽  
Measurement Data ◽  
Root Mean Squared Error ◽  
Time Performance ◽  
Detection And Tracking ◽  
Squared Error

In this article, a real-time road-Object Detection and Tracking (LR_ODT) method for autonomous driving is proposed. This method is based on the fusion of lidar and radar measurement data, where they are installed on the ego car, and a customized Unscented Kalman Filter is employed for their data fusion. The merits of both devices are combined using the proposed fusion approach to precisely provide both pose and velocity information for objects moving in roads around the ego car. Unlike other detection and tracking approaches, the balanced treatment of both pose estimation accuracy and its real-time performance is the main contribution in this work. The proposed technique is implemented using the high-performance language C++ and utilizes highly optimized math and optimization libraries for best real-time performance. Simulation studies have been carried out to evaluate the performance of the LR_ODT for tracking bicycles, cars, and pedestrians. Moreover, the performance of the Unscented Kalman Filter fusion is compared to that of the Extended Kalman Filter fusion showing its superiority. The Unscented Kalman Filter has outperformed the Extended Kalman Filter on all test cases and all the state variable levels (−24% average Root Mean Squared Error). The employed fusion technique shows how outstanding is the improvement in tracking performance compared to the use of a single device (−29% Root Mean Squared Error with lidar and −38% Root Mean Squared Error with radar).

scholarly journals Application of Kalman Filtering Methods to Online Real-Time Structural Identification: A Comparison Study

2016 ◽  
Vol 16 (06) ◽  
pp. 1550016 ◽  
Author(s):  
Mohsen Askari ◽  
Jianchun Li ◽  
Bijan Samali
Keyword(s):  
Kalman Filter ◽  
Real Time ◽  
Unscented Kalman Filter ◽  
Structural Parameters ◽  
Measurement Data ◽  
Linear Structure ◽  
Structural Identification ◽  
Input Output ◽  
Output Measurement ◽  
Highly Nonlinear

System identification refers to the process of building or improving mathematical models of dynamical systems from the observed experimental input–output data. In the area of civil engineering, the estimation of the integrity of a structure under dynamic loadings and during service condition has become a challenge for the engineering community. Therefore, there has been a great deal of attention paid to online and real-time structural identification, especially when input–output measurement data are contaminated by high-level noise. Among real-time identification methods, one of the most successful and widely used algorithms for estimation of system states and parameters is the Kalman filter and its various nonlinear extensions such as extended Kalman filter (EKF), Iterated EKF (IEKF), the recently developed unscented Kalman filter (UKF) and Iterated UKF (IUKF). In this paper, an investigation has been carried out on the aforementioned techniques for their effectiveness and efficiencies through a highly nonlinear single degree of freedom (SDOF) structure as well as a two-storey linear structure. Although IEKF is an improved version of EKF, results show that IUKF generally produces better results in terms of structural parameters and state estimation than UKF and IEKF. Also IUKF is more robust to noise levels compared to the other approaches.

scholarly journals Multiple Object Detection and Tracking using Kalman Filter in an Indoor and Outdoor Scene

2020 ◽  
Vol 8 (5) ◽  
pp. 930-933
Keyword(s):  
Kalman Filter ◽  
Object Detection ◽  
Real Time ◽  
High Performance ◽  
Multiple Objects ◽  
Detection And Tracking ◽  
Outdoor Scenes ◽  
Real Time Applications ◽  
Static Background ◽  
Indoor And Outdoor

Tracking target through sequences of images is fundamental problems in vision. In this paper we converse the motion based kalman filter procedure to track the multiple objects for indoor and outdoor scenes. This is of utmost importance for high-performance real -time applications. The mentioned approach is appropriate for indoor & outdoors scenes with static background & overcomes the problem of non-moving objectives fading into the background. The tracking in proposed turned into solely based totally on movement with the belief that each one items move in a immediately line with continuous speed. The motion primarily based Kaman filter monitoring for more than one objects works correctly but requires the camera to be stationary

scholarly journals Toward a Comfortable Driving Experience for a Self-Driving Shuttle Bus

Electronics ◽  
2019 ◽  
Vol 8 (9) ◽  
pp. 943 ◽  
Author(s):  
Il Bae ◽  
Jaeyoung Moon ◽  
Jeongseok Seo
Keyword(s):  
Real Time ◽  
High Performance ◽  
Autonomous Driving ◽  
Planning Method ◽  
Dynamics Simulation ◽  
Driving Experience ◽  
Optimal Velocity ◽  
Planning Approach ◽  
Velocity Planning ◽  
Time Optimal

The convergence of mechanical, electrical, and advanced ICT technologies, driven by artificial intelligence and 5G vehicle-to-everything (5G-V2X) connectivity, will help to develop high-performance autonomous driving vehicles and services that are usable and convenient for self-driving passengers. Despite widespread research on self-driving, user acceptance remains an essential part of successful market penetration; this forms the motivation behind studies on human factors associated with autonomous shuttle services. We address this by providing a comfortable driving experience while not compromising safety. We focus on the accelerations and jerks of vehicles to reduce the risk of motion sickness and to improve the driving experience for passengers. Furthermore, this study proposes a time-optimal velocity planning method for guaranteeing comfort criteria when an explicit reference path is given. The overall controller and planning method were verified using real-time, software-in-the-loop (SIL) environments for a real-time vehicle dynamics simulation; the performance was then compared with a typical planning approach. The proposed optimized planning shows a relatively better performance and enables a comfortable passenger experience in a self-driving shuttle bus according to the recommended criteria.

scholarly journals Huber-Based Robust Unscented Kalman Filter Distributed Drive Electric Vehicle State Observation

Energies ◽  
2021 ◽  
Vol 14 (3) ◽  
pp. 750
Author(s):  
Wenkang Wan ◽  
Jingan Feng ◽  
Bao Song ◽  
Xinxin Li
Keyword(s):  
Kalman Filter ◽  
Real Time ◽  
Degrees Of Freedom ◽  
Unscented Kalman Filter ◽  
State Parameter ◽  
State Observation ◽  
Straight Line ◽  
Distributed Drive Electric Vehicle ◽  
Huber Method ◽  
Yaw Moment

Accurate and real-time acquisition of vehicle state parameters is key to improving the performance of vehicle control systems. To improve the accuracy of state parameter estimation for distributed drive electric vehicles, an unscented Kalman filter (UKF) algorithm combined with the Huber method is proposed. In this paper, we introduce the nonlinear modified Dugoff tire model, build a nonlinear three-degrees-of-freedom time-varying parametric vehicle dynamics model, and extend the vehicle mass, the height of the center of gravity, and the yaw moment of inertia, which are significantly influenced by the driving state, into the vehicle state vector. The vehicle state parameter observer was designed using an unscented Kalman filter framework. The Huber cost function was introduced to correct the measured noise and state covariance in real-time to improve the robustness of the observer. The simulation verification of a double-lane change and straight-line driving conditions at constant speed was carried out using the Simulink/Carsim platform. The results show that observation using the Huber-based robust unscented Kalman filter (HRUKF) more realistically reflects the vehicle state in real-time, effectively suppresses the influence of abnormal error and noise, and obtains high observation accuracy.

Real-Time Signal Denoising Algorithm in Wheel Force Transducer

2014 ◽  
Vol 615 ◽  
pp. 244-247
Author(s):  
Dong Wang ◽  
Guo Yu Lin ◽  
Wei Gong Zhang
Keyword(s):  
Kalman Filter ◽  
Real Time ◽  
Extended Kalman Filter ◽  
Unscented Kalman Filter ◽  
Force Transducer ◽  
Time Signal ◽  
Signal Denoising ◽  
Observation Function ◽  
Simulation Results ◽  
Wheel Force Transducer

The wheel force transducer (WFT) is used to measure dynamic wheel loads. Unlike other force sensors, WFT is rotating with the wheel. For this reason, the outputs and the inputs of the transducer are nonlinearly related, and traditional Kalman Filter is not suitable. In this paper, a new real-time filter algorithm utilizing Quadrature Kalman Filter (QKF) is proposed to solve this problem. In Quadrature Kalman Filter, Singer model is introduced to track the wheel force, and the observation function is established for WFT. The simulation results illustrate that the new filter outperforms the traditional Unscented Kalman Filter (UKF) and Extended Kalman Filter (EKF).

Sign in / Sign up

Export Citation Format

Share Document