Generative Image Inpainting with Dilated Deformable Convolution

The image generation and completion model complement the missing area of the image to be repaired according to the image itself or the information of the image library so that the repaired image looks very natural and difficult to distinguish from the undamaged image. The difficulty of image generation and completion lies in the reasonableness of image semantics and the clear and true texture of the generated image. In this paper, a Wasserstein generative adversarial network with dilated convolution and deformable convolution (DDC-WGAN) is proposed for image completion. A deformable offset is added based on dilated convolution, which enlarges the receptive field and provides a more stable representation of geometric deformation. Experiments show that the DDC-WGAN method proposed in this paper has better performance in image generation and complementation than the traditional generative adversarial complementation network.

Population dynamics of the thalamic head direction system during drift and reorientation

The head direction (HD) system is classically modeled as a ring attractor network1,2 which ensures a stable representation of the animal’s head direction. This unidimensional description popularized the view of the HD system as the brain’s internal compass3,4. However, unlike a globally consistent magnetic compass, the orientation of the HD system is dynamic, depends on local cues and exhibits remapping across familiar environments5. Such a system requires mechanisms to remember and align to familiar landmarks, which may not be well described within the classic 1-dimensional framework. To search for these mechanisms, we performed large population recordings of mouse thalamic HD cells using calcium imaging, during controlled manipulations of a visual landmark in a familiar environment. First, we find that realignment of the system was associated with a continuous rotation of the HD network representation. The speed and angular distance of this rotation was predicted by a 2nd dimension to the ring attractor which we refer to as network gain, i.e. the instantaneous population firing rate. Moreover, the 360-degree azimuthal profile of network gain, during darkness, maintained a ‘memory trace’ of a previously displayed visual landmark. In a 2nd experiment, brief presentations of a rotated landmark revealed an attraction of the network back to its initial orientation, suggesting a time-dependent mechanism underlying the formation of these network gain memory traces. Finally, in a 3rd experiment, continuous rotation of a visual landmark induced a similar rotation of the HD representation which persisted following removal of the landmark, demonstrating that HD network orientation is subject to experience-dependent recalibration. Together, these results provide new mechanistic insights into how the neural compass flexibly adapts to environmental cues to maintain a reliable representation of the head direction.

Stable representation of a naturalistic movie emerges from episodic activity with gain variability

Visual cortical responses are known to be highly variable across trials within an experimental session. However, the long-term stability of visual cortical responses is poorly understood. Here using chronic imaging of V1 in mice we show that neural responses to repeated natural movie clips are unstable across weeks. Individual neuronal responses consist of sparse episodic activity which are stable in time but unstable in gain across weeks. Further, we find that the individual episode, instead of neuron, serves as the basic unit of the week-to-week fluctuation. To investigate how population activity encodes the stimulus, we extract a stable one-dimensional representation of the time in the natural movie, using an unsupervised method. Most week-to-week fluctuation is perpendicular to the stimulus encoding direction, thus leaving the stimulus representation largely unaffected. We propose that precise episodic activity with coordinated gain changes are keys to maintain a stable stimulus representation in V1.

The signing body: extensive sign language practice shapes the size of hands and face

The representation of the metrics of the hands is distorted, but is susceptible to malleability due to expert dexterity (magicians) and long-term tool use (baseball players). However, it remains unclear whether modulation leads to a stable representation of the hand that is adopted in every circumstance, or whether the modulation is closely linked to the spatial context where the expertise occurs. To this aim, a group of 10 experienced Sign Language (SL) interpreters were recruited to study the selective influence of expertise and space localisation in the metric representation of hands. Experiment 1 explored differences in hands’ size representation between the SL interpreters and 10 age-matched controls in near-reaching (Condition 1) and far-reaching space (Condition 2), using the localisation task. SL interpreters presented reduced hand size in near-reaching condition, with characteristic underestimation of finger lengths, and reduced overestimation of hands and wrists widths in comparison with controls. This difference was lost in far-reaching space, confirming the effect of expertise on hand representations is closely linked to the spatial context where an action is performed. As SL interpreters are also experts in the use of their face with communication purposes, the effects of expertise in the metrics of the face were also studied (Experiment 2). SL interpreters were more accurate than controls, with overall reduction of width overestimation. Overall, expertise modifies the representation of relevant body parts in a specific and context-dependent manner. Hence, different representations of the same body part can coexist simultaneously.

Clustering of neuropsychological traits of preschoolers

Neuropsychological tests (targeting cognitive, linguistic, motor, and executive abilities) are grouped in neuropsychological domains that are thought to be stable through adulthood. However, this assumption does not always hold true, particularly during young children’s early developmental phase. Here, we explored how the neuropsychological profile of typical Spanish-speaking preschoolers varied and consolidated with age. We recruited 643 monolingual Latin-American children from Mexico, Colombia, and Guatemala, with ages spanning from 30 to 71 months of age, and applied a novel neuropsychological examination which combined a total of 52 tests covering five classical neuropsychological domains: receptive, expressive, attention/memory, processing, and executive functions. These tests’ scores uncovered a correlational structure across neuropsychological functions that could not be explained by chance. Notably, these correlations’ overall strength, but not their interdependence across domains, dramatically increased with age. Moreover, by applying conventional clustering techniques to classify the experimental data, we found a stable representation of two clusters of children with distinctive traits, with cultural factors contributing to this classification scheme. We also found that the tasks were well organized in a network of abilities, where nodes with highest highest interconnectedness were those that required multimodal processing. These results contribute to our understanding of children’s ‘normal’ development and could help identify how failure in particular functions forecasts the emergence of neurodevelopmental disorders. Our analytic methods might become useful to characterize individual differences and improve educational practices and interventions.

Stable representation of a naturalistic movie emerges from episodic activity with gain variability

Visual cortical responses are known to be highly variable across trials within an experimental session. However, the long-term stability of visual cortical responses is poorly understood. Chronic imaging experiments in V1 showed that neural responses to repeated natural movie clips were unstable across weeks. Single neuronal responses consisted of sparse episodic activity which were stable in time but unstable in spike rates across weeks. Further, we found that the individual episode, instead of neuron, served as the basic unit of the week-to-week fluctuation. To investigate how population activity encodes the stimulus, we extracted a stable one-dimensional representation of the time in the natural movie, using an unsupervised method. Moreover, most week-to-week fluctuation was perpendicular to the stimulus encoding direction, thus leaving the stimulus representation largely unaffected. We propose that precise episodic activity with coordinated gain changes are keys to maintain a stable stimulus representation in V1.

Single neuron activity predicts behavioral performance of individual animals during memory retention

In 1972 Rescorla and Wagner formulated their model of classical Pavlovian conditioning postulating that the associative strength of a stimulus is expressed directly in the behavior it elicits1. Many biologists and psychologists were inspired by this model, and numerous experiments thereafter were interpreted assuming that the magnitude of the conditioned response (CR) reflects an associative effect at the physiological level. However, a correlation between neural activity and the expression of the CR in individual animals has not yet been reported. Here we show that, following differential odor conditioning, the change in activity of single mushroom body output neurons (MBON) of the honeybee predicts the behavioral performance of the individual during memory retention. The encoding of the stimulus-reward association at the mushroom body output occurs about 600 ms before the initiation of the CR. We conclude that the MB provides a stable representation of the stimulus-reward associative strength, and that this representation is required for behavioral decision-making during memory retention.

Climatology of the Combined ASTER MODIS Emissivity over Land (CAMEL) Version 2

The Combined ASTER (Advanced Spaceborne Thermal Emission and Reflection Radiometer) MODIS (Moderate Resolution Imaging Spectroradiometer) Emissivity over Land (CAMEL) Version 2 (V002) has been available since March 2019 from the NASA LP DAAC (Land Processes Distributed Active Archive Center) and provides global, monthly infrared land surface emissivity and uncertainty at 0.05 degrees (~5 km) resolution. A climatology of the CAMEL V002 product is now available at the same spatial, temporal, and spectral resolution, covering the CAMEL record from 2000 to 2016. Characterization of the climatology over case sites and IGBP (International Geosphere-Biosphere Programme) land cover categories shows the climatology is a stable representation of the monthly CAMEL emissivity. Time series of the monthly CAMEL V002 product show realistic seasonal changes but also reveal subtle artifacts known to be from calibration and processing errors in the MODIS MxD11 emissivity. The use of the CAMEL V002 climatology mitigates many of these time dependent errors by providing an emissivity estimate which represents the complete 16-year record. The CAMEL V002 climatology’s integration into RTTOV (Radiative Transfer for TOVS) v12 is demonstrated through the simulation of IASI (Infrared Atmospheric Sounding Interferometer) radiances. Improved stability in CAMEL Version 3 is expected in the future with the incorporation of the new MxD21 and VIIRS VNP21 emissivity products in MODIS Collection 6.1.

Head phantoms for bioelectromagnetic applications: a material study

Background Assessments of source reconstruction procedures in electroencephalography and computations of transcranial electrical stimulation profiles require verification and validation with the help of ground truth configurations as implemented by physical head phantoms. Phantoms provide well-defined volume conduction configurations with realistic geometries.We aim to characterize the electrical conductivity of materials for modeling head compartments to establish reproducible and stable physical head phantoms. We analyzed sodium chloride (NaCl) solution, agarose hydrogel, gypsum and reed sticks as surrogate materials for the intracranial volume, scalp, skull and anisotropic conductivity structures. We measured the impedance of all materials when immersed in NaCl solution using a four-point setup. The electrical conductivity values of each material were calculated from the temperature compensated impedances considering the sample geometries. Results We obtained conductivities of 0.332 S/m (0.17 % NaCl solution), 0.0425 S/m and 0.0017 S/m (gypsum with and without NaCl), 0.314 S/m, 0.30 S/m, 0.311 S/m (2 %, 3 %, 4 % agarose). The reed sticks were tested in longitudinal and transversal direction and showed anisotropic conductivity with a ratio of 1:2.8. Conclusion We conclude that the tested materials NaCl solution, gypsum and agarose can serve as stable representation of the three main conductivity compartments of the head, intracranial volume, skull and scalp. An anisotropic conductivity structure such as a piece of white matter can be modeled using tailored reed sticks inside a volume conductor.