Through research on initial alignment problem of fiber optic gyro SINS in the sway condition, this paper proposed a rapid compass alignment scheme with variable parameters, which can accomplish rapid initial alignment. Firstly, analysted SINS compass alignment principle, and gave a concrete realization method which has the same calculation procedure with full damping navigation algorithm. This method makes the alignment and navigation to use the same set of algorithms, and can effectively reduce algorithm complexity. Simulation and repeatedly sway test results show that the alignment algorithm is effective. The alignment precision and instrument accuracy is consistent, it can meet the requirements of the initial alignment.