Fast steering mirror (FSM) plays a crucial role in stabilization of the line-of-sight (LOS) and phase shift compensation. The control accuracy of the FSM is affected by various disturbances especially the vibration in the aviation environment. Traditional anti-disturbance methods, such as disturbance observer (DOB), have a little effect of suppressing disturbance in FSM. But it also brings some problem, such as increasing mass and amplifying high frequency noise. To solve these problems, an anti-disturbance strategy based on adaptive robust control (ARC) was proposed. And it will not amplify the high-frequency noise which is inevitable in DOB. Experimental results show that, using adaptive robust controller, the steady-state error of the FSM decreased 4.8 times compared to simple PID control and 1.9 times compared to DOB+PID control in the simulated vibration environment.