Label2label: Training a neural network to selectively restore cellular structures in fluorescence microscopy

Immunofluorescence (IF) microscopy is routinely used to visualise the spatial distribution of proteins that dictates their cellular function. However, unspecific antibody binding often results in high cytosolic background signals, decreasing the image contrast of a target structure. Recently, convolutional neural networks (CNNs) were successfully employed for image restoration in IF microscopy, but current methods cannot correct for those background signals. We report a new method that trains a CNN to reduce unspecific signals in IF images; we name this method label2label (L2L). In L2L, a CNN is trained with image pairs of two non-identical labels that target the same cellular structure. We show that after L2L training a network predicts images with significantly increased contrast of a target structure, which is further improved after implementing a multi-scale structural similarity loss function. Here, our results suggest that sample differences in the training data decrease hallucination effects that are observed with other methods. We further assess the performance of a cycle generative adversarial network, and show that a CNN can be trained to separate structures in superposed IF images of two targets.

Inverting the structure–property map of truss metamaterials by deep learning

Inspired by crystallography, the periodic assembly of trusses into architected materials has enjoyed popularity for more than a decade and produced countless cellular structures with beneficial mechanical properties. Despite the successful and steady enrichment of the truss design space, the inverse design has remained a challenge: While predicting effective truss properties is now commonplace, efficiently identifying architectures that have homogeneous or spatially varying target properties has remained a roadblock to applications from lightweight structures to biomimetic implants. To overcome this gap, we propose a deep-learning framework, which combines neural networks with enforced physical constraints, to predict truss architectures with fully tailored anisotropic stiffness. Trained on millions of unit cells, it covers an enormous design space of topologically distinct truss lattices and accurately identifies architectures matching previously unseen stiffness responses. We demonstrate the application to patient-specific bone implants matching clinical stiffness data, and we discuss the extension to spatially graded cellular structures with locally optimal properties.