The construction of filters arising from linear neural networks with feed-backward excitatory-inhibitory connections is presented. Spatially invariant coupling between neurons and the distribution of neuron-receptor units in the form of a uniform square grid yield the TBT (Toeplitz-Block-Toeplitz) connection matrix. Utilizing the relationship between spectral properties of such matrices and their generating functions, the method for construction of recurrent linear networks is addressed. By appropriately bounding the generating function, the connection matrix eigenvalues are kept in the desired range allowing for large matrix inverse to be approximated by a convergent power series. Instead of matrix inversion, the single pass convolution with the filter obtained from the network connection weights is applied when solving the network. For the case of inter-neuron coupling in the form of a function that is expandable in a Fourier series in polar angle, the network response filter is shown to be steerable.
Spectral properties of flipped Toeplitz matrices and related preconditioning
