What can computational models learn from human selective attention? A review from an audiovisual unimodal and crossmodal perspective
Selective attention plays an essential role in information acquisition and utilizationfrom the environment. In the past 50 years, research on selective attention has beena central topic in cognitive science. Compared with unimodal studies, crossmodalstudies are more complex but necessary to solve real-world challenges in both humanexperiments and computational modeling. Although an increasing number of findingson crossmodal selective attention have shed light on humans’ behavioral patterns andneural underpinnings, a much better understanding is still necessary to yield the samebenefit for intelligent computational agents. This article reviews studies of selectiveattention in unimodal visual and auditory and crossmodal audiovisual setups from themultidisciplinary perspectives of psychology and cognitive neuroscience, and evaluatesdifferent ways to simulate analogous mechanisms in computational models and robotics.We discuss the gaps between these fields in this interdisciplinary review and provideinsights about how to use psychological findings and theories in artificial intelligence fromdifferent perspectives.