A natural color fusion method for infrared and low-light-level image is proposed. This method utilizes image fusion and color transfer. The fused image uses sparse representation to merge the source images information to be assigned to the Y channel. And then the I and Q channel is combined using Toets method, which extracts the common component from the source images. Finally, the false-color image is obtained by using color transfer technology to the prior pseudo-color YIQ image. Experiments show that the result of our method is information that is more salient, has a higher color contrast, and a more natural color appearance when compared with those produced by the traditional coloration algorithm.