In order to effectively inhibit the influence of constant bias of inertial sensors on strapdown inertial navigation system accuracy, a self-compensation method based on single-axis rotation modulation is proposed. It is shown by theoretical analysis that, the gyro constant drift and zero errors of accelerometer perpendicular to the rotation axis can be modulated to sinusoidal signal, which will be eliminated by integral. The constant bias along the rotation axis cannot be modulated. The effectiveness of the rotation scheme is proved by experiment and the influence of rotation speed is demonstrated.