Lightness Perception in Complex Scenes

Lightness perception is the perception of achromatic surface colors: black, white, and shades of grey. Lightness has long been a central research topic in experimental psychology, as perceiving surface color is an important visual task but also a difficult one due to the deep ambiguity of retinal images. In this article, I review psychophysical work on lightness perception in complex scenes over the past 20 years, with an emphasis on work that supports the development of computational models. I discuss Bayesian models, equivalent illumination models, multidimensional scaling, anchoring theory, spatial filtering models, natural scene statistics, and related work in computer vision. I review open topics in lightness perception that seem ready for progress, including the relationship between lightness and brightness, and developing more sophisticated computational models of lightness in complex scenes. Expected final online publication date for the Annual Review of Vision Science, Volume 7 is September 2021. Please see http://www.annualreviews.org/page/journal/pubdates for revised estimates.

Lightness in a Flash: Effect of Exposure Time on Lightness Perception

A gray target can appear lighter or darker depending on its surrounding spatial context. We examined the effect of exposure time on three such examples (simultaneous lightness contrast, dungeon illusion, and the two-room arrangement), finding very different results with exposure time as brief as 15 ms: the simultaneous lightness contrast was much stronger, the effect of the dungeon illusion was reversed, and the lightness difference between the two isoluminant patches in the two-room arrangement disappeared. These suggest that local luminance ratios dominate lightness perception in a brief flash.

Distinct processes of lighting priors for lightness and 3-D shape perception

The visual system often relies on prior assumptions when interpreting ambiguous visual inputs. A well-known example is the light-from-above prior, which aids the judgment of an object’s three-dimensional (3-D) shape (i.e., convex or concave). Recent studies have revealed that the light-from-above prior also helps solve lightness ambiguity. This study aimed to examine whether 3-D shape perception and lightness perception share the same lighting prior. The study participants performed two tasks: one focusing on lightness perception and another focusing on 3-D shape perception. The dominant directions of the assumed lighting were calculated from participants’ performance in the two tasks. The results showed that the assumed lighting direction for 3-D shape perception considerably shifted toward the left whereas the one for lightness perception was almost from directly above. The clear difference between these two directions supports the hypothesis that the visual system uses distinct lighting priors for 3-D shape perception and lightness perception. Japanese and European observers then replicated these results, indicating that the lighting priors are universal regardless of reading/writing direction.

An Upward-Facing Surface Appears Darker: The Role Played by the Light-From-Above Assumption in Lightness Perception

The human visual system can extract information on surface reflectance (lightness) from light intensity; this, however, confounds information on reflectance and illumination. We hypothesized that the visual system, to solve this lightness problem, utilizes the internally held prior assumption that illumination falls from above. Experiment 1 showed that an upward-facing surface is perceived to be darker than a downward-facing surface, proving our hypothesis. Experiment 2 showed the same results in the absence of explicit illumination cues. The effect of the light-from-left prior assumption was not observed in Experiment 3. The upward- and downward-facing surface stimuli in Experiments 1 and 2 showed no difference in a two-dimensional configuration or three-dimensional structure, and the participants’ perceived lightness appeared to be affected by the observers’ prior assumption that illumination is always from above. Other studies have not accounted for this illusory effect, and this study’s finding provides additional insights into the study of lightness perception.