BP neural Network-Kalman filter fusion method for unmanned aerial vehicle target tracking

Author(s):  
Yongqi Liu ◽  
Liangcheng Nie ◽  
Rui Dong ◽  
Gang Chen

The poor real-time performance and target occlusion occurred easily when the UAV was tracking the target. In this paper, a target tracking method based on the Back Propagation neural network fusion Kalman filter algorithm was developed to solve the position prediction problem of the UAV target tracking in real time. Firstly, the target tracking algorithm was used to acquire the center position coordinates of the target on the onboard computer, and then the coordinate difference matrix was constructed to train the BP neural network in real time. Secondly, when the target was occluded by the obstacles judged by the Bhattacharyya coefficient, the BP neural network fusion Kalman filter algorithm was used to accurately predict the center position coordinates of the occluded target. Then the flight speed of UAV was calculated by the deviation between the coordinates of the target and the image center. Finally, the velocity command was sent to the UAV by the onboard computer. The experimental results shown that the target position predicted by BP neural network fusion Kalman filter algorithm was more accurate and robust in predicting the center position coordinates of the target, and the UAV can track the moving target on the ground stably.

2021 ◽  
Vol 336 ◽  
pp. 07004
Author(s):  
Ruoyu Fang ◽  
Cheng Cai

Obstacle detection and target tracking are two major issues for intelligent autonomous vehicles. This paper proposes a new scheme to achieve target tracking and real-time obstacle detection of obstacles based on computer vision. ResNet-18 deep learning neural network is utilized for obstacle detection and Yolo-v3 deep learning neural network is employed for real-time target tracking. These two trained models can be deployed on an autonomous vehicle equipped with an NVIDIA Jetson Nano motherboard. The autonomous vehicle moves to avoid obstacles and follow tracked targets by camera. Adjusting the steering and movement of the autonomous vehicle according to the PID algorithm during the movement, therefore, will help the proposed vehicle achieve stable and precise tracking.


Sign in / Sign up

Export Citation Format

Share Document