Detecting Small Size and Minimal Thermal Signature Targets in Infrared Imagery Using Biologically Inspired Vision

Thermal infrared imaging provides an effective sensing modality for detecting small moving objects at long range. Typical challenges that limit the efficiency and robustness of the detection performance include sensor noise, minimal target contrast and cluttered backgrounds. These issues become more challenging when the targets are of small physical size and present minimal thermal signatures. In this paper, we experimentally show that a four-stage biologically inspired vision (BIV) model of the flying insect visual system have an excellent ability to overcome these challenges simultaneously. The early two stages of the model suppress spatio-temporal clutter and enhance spatial target contrast while compressing the signal in a computationally manageable bandwidth. The later two stages provide target motion enhancement and sub-pixel motion detection capabilities. To show the superiority of the BIV target detector over existing traditional detection methods, we perform extensive experiments and performance comparisons using high bit-depth, real-world infrared image sequences of small size and minimal thermal signature targets at long ranges. Our results show that the BIV target detector significantly outperformed 10 conventional spatial-only and spatiotemporal methods for infrared small target detection. The BIV target detector resulted in over 25 dB improvement in the median signal-to-clutter-ratio over the raw input and achieved 43% better detection rate than the best performing existing method.

The Insect Visual System: Correspondence with Vertebrates and with Olfactory Processing

A 1915 monograph by the Nobel Prize–winning neuroanatomist Santiago Ramón y Cajal and Domingo Sánchez y Sánchez, describing neurons and their organization in the optic lobes of insects, is now standard fare for those studying the microcircuitry of the insect visual system. The work contains prescient assumptions about possible functional arrangements, such as lateral interactions, centrifugal pathways, and the convergence of neurons onto wider dendritic trees, to provide central integration of information processed at peripheral levels of the system. This chapter will consider further indications of correspondence between the insect-crustacean and the vertebrate visual systems, with particular reference to the deep organization of the optic lobe’s third optic neuropil, the lobula, and part of the lateral forebrain (protocerebrum) that receives inputs from it. Together, the lobula and lateral protocerebrum suggest valid comparison with the visual cortex and olfactory centers.