This paper proposes a robust tracking algorithm for an autonomous car-like robot, and this algorithm is based on the Tracking-Learning-Detection (TLD). In this paper, the TLD method is extended to track the autonomous car-like robot for the first time. In order to improve accuracy and robustness of the proposed algorithm, a method of symmetry detection of autonomous car-like robot rear is integrated into the TLD. Moreover, the Median-Flow tracker in TLD is improved with a pyramid-based optical flow tracking method to capture fast moving objects. Extensive experiments and comparisons show the robustness of the proposed method.