FPGA based real-time lane detection and tracking implementation

Author(s):  
I. El Hajjouji ◽  
A. El Mourabit ◽  
Z. Asrih ◽  
S. Mars ◽  
B. Bernoussi
2019 ◽  
Author(s):  
Shun Yang ◽  
Jian Wu ◽  
Yanhu Shan ◽  
Yinan Yu ◽  
Sumin Zhang

Author(s):  
Fuat Cos¸kun ◽  
O¨zgu¨r Tuncer ◽  
Elif Karslıgil ◽  
Levent Gu¨venc¸

Lane keeping assistance systems help the driver in following the lane centerline. While lane keeping assistance systems are available in some mass production vehicles, they have not found widespread use and are not as common as ESP or ACC at the moment. Lane keeping assistance systems still need further development. Previously available systems have to be continuously adapted to newer vehicle models and fully tested after this adaptation. An image processing algorithm for lane detection and tracking, a lane keeping assistance controller design and a real time hardware-in-the-loop (HiL) simulator developed for testing the designed lane keeping assistance system are therefore presented in this paper. The high fidelity, high order, realistic and nonlinear vehicle model in Carmaker HiL runs as software in a real time simulation on a dSpace compact simulator with the DS1005 and DS2210 boards. A PC is used for processing video frames coming from an in-vehicle camera pointed towards the road ahead. Lane detection and tracking computations including fitting of composite Bezier curves to curved lanes are carried out on this PC. In the present setup, the camera used is a virtual camera attached to the virtual vehicle in Carmaker and provides video frames from the Carmaker animation screen. A dSpace microautobox is available for obtaining the lane data from the PC and the Carmaker vehicle data from the dSpace compact simulator and calculating the required steering actions and sending them to the Carmaker vehicle model. The lane keeping controller is designed in the Matlab toolbox COMES using parameter space techniques. The motivation behind this approach is to develop the lane keeping assistance system as much as possible in a laboratory hardware-in-the-loop setting before time consuming, expensive and potentially dangerous road testing. Lane detection, tracking and curved lane fit results, hardware-in-the-loop simulation results of the lane keeping controller with the image processing system are are used to demonstrate the effectiveness of the proposed method.


Author(s):  
Xinyu Jiao ◽  
Diange Yang ◽  
Kun Jiang ◽  
Chunlei Yu ◽  
Tuopu Wen ◽  
...  

This article proposes an improved lane detection and tracking method for autonomous vehicle applications. In real applications, when the pose and position of the camera are changed, parameters and thresholds in the algorithms need fine adjustment. In order to improve adaptability to different perspective conditions, a width-adaptive lane detection method is proposed. As a useful reference to reduce noises, vanishing point is widely applied in lane detection studies. However, vanishing point detection based on original image consumes many calculation resources. In order to improve the calculation efficiency for real-time applications, we proposed a simplified vanishing point detection method. In the feature extraction step, a scan-line method is applied to detect lane ridge features, the width threshold of which is set automatically based on lane tracking. With clustering, validating, and model fitting, lane candidates are obtained from the basic ridge features. A lane-voted vanishing point is obtained by the simplified grid-based method, then applied to filter out noises. Finally, a multi-lane tracking Kalman filter is applied, the confirmed lines of which also provide adaptive width threshold for ridge feature extraction. Real-road experimental results based on our intelligent vehicle testbed proved the validity and robustness of the proposed method.


Sign in / Sign up

Export Citation Format

Share Document