A novel adaptive image feature reduction approach for object tracking using vectorized texture feature is proposed in this paper. Our contributions are three-fold: 1) a statistical discriminative appearance model using texture feature was proposed. 2) Majority of dimensions of the features are removed by judging their errors of the chosen distribution model. The remaining dimensions are most discriminative ones for classification task. The dimension reduction has advantages of reducing the computational cost in classification stage. 3) An adaptive learning rate was proposed to handle drifts caused by long term occlusion. Preliminary experimental results are satisfactory and compared to state-of-the-art object tracking methods.