This chapter demonstrates how unique histories of structural coupling can be understood from the vantage point of evolution. To this end, it provides a critique of the adaptationist view of evolution as a process of progressive fitness, and articulates an alternative view of evolution as natural drift. These unique histories of coupling, which enact incommensurable kinds of “color space,” should not be explained as optimal adaptations to different regularities in the world. Instead, they should be explained as the result of different histories of natural drift. Moreover, since organism and environment cannot be separated but are in fact codetermined in evolution as natural drift, the environmental regularities that one associates with these various color spaces must ultimately be specified in tandem with the perceptually guided activity of the animal.