Towards Large-Scale Super Resolution Datasets via Learned Downsampling of Ray-Traced Renderings

Author(s):  
Vaibhav Vavilala ◽  
Mark Meyer
Keyword(s):  
Sensors ◽  
2021 ◽  
Vol 21 (3) ◽  
pp. 1009
Author(s):  
Ilaria De Santis ◽  
Michele Zanoni ◽  
Chiara Arienti ◽  
Alessandro Bevilacqua ◽  
Anna Tesei

Subcellular spatial location is an essential descriptor of molecules biological function. Presently, super-resolution microscopy techniques enable quantification of subcellular objects distribution in fluorescence images, but they rely on instrumentation, tools and expertise not constituting a default for most of laboratories. We propose a method that allows resolving subcellular structures location by reinforcing each single pixel position with the information from surroundings. Although designed for entry-level laboratory equipment with common resolution powers, our method is independent from imaging device resolution, and thus can benefit also super-resolution microscopy. The approach permits to generate density distribution maps (DDMs) informative of both objects’ absolute location and self-relative displacement, thus practically reducing location uncertainty and increasing the accuracy of signal mapping. This work proves the capability of the DDMs to: (a) improve the informativeness of spatial distributions; (b) empower subcellular molecules distributions analysis; (c) extend their applicability beyond mere spatial object mapping. Finally, the possibility of enhancing or even disclosing latent distributions can concretely speed-up routine, large-scale and follow-up experiments, besides representing a benefit for all spatial distribution studies, independently of the image acquisition resolution. DDMaker, a Software endowed with a user-friendly Graphical User Interface (GUI), is also provided to support users in DDMs creation.


2021 ◽  
Author(s):  
Andrew McMahon ◽  
Rebecca Andrews ◽  
Sohail V Ghani ◽  
Thorben Cordes ◽  
Achillefs N Kapanidis ◽  
...  

Many viruses form highly pleomorphic particles; in influenza, these particles range from spheres of ~ 100 nm in diameter to filaments of several microns in length. Virion structure is of interest, not only in the context of virus assembly, but also because pleomorphic variations may correlate with infectivity and pathogenicity. Detailed images of virus morphology often rely on electron microscopy, which is generally low throughput and limited in molecular identification. We have used fluorescence super-resolution microscopy combined with a rapid automated analysis pipeline to image many thousands of individual influenza virions, gaining information on their size, morphology and the distribution of membrane-embedded and internal proteins. This large-scale analysis revealed that influenza particles can be reliably characterised by length, that no spatial frequency patterning of the surface glycoproteins occurs, and that RNPs are preferentially located towards filament ends within Archetti bodies. Our analysis pipeline is versatile and can be adapted for use on multiple other pathogens, as demonstrated by its application for the size analysis of SARS-CoV-2. The ability to gain nanoscale structural information from many thousands of viruses in just a single experiment is valuable for the study of virus assembly mechanisms, host cell interactions and viral immunology, and should be able to contribute to the development of viral vaccines, anti-viral strategies and diagnostics.


Micromachines ◽  
2020 ◽  
Vol 11 (5) ◽  
pp. 473 ◽  
Author(s):  
Pengcheng Zhang ◽  
Xi Chen ◽  
Hui Yang

A large-scale homogenized photonic nanojet array with defined pattern and spacing facilitates practical applications in super-resolution imaging, subwavelength-resolution nanopatterning, nano objects trapping and detection technology. In this paper, we present the fabrication of a large-scale photonic nanojet array via the template-assisted self-assembly (TASA) approach. Templates of two-dimensional (2D) large-scale microwell array with defined pattern and spacing are fabricated. Melamine microspheres with excellent size uniformity are utilized to pattern on the template. It is found that microwells can be filled at a yield up to 95%. These arrayed microspheres on the template serve as microlenses and can be excited to generate large-scale photonic nanojets. The uniformly-sized melamine spheres are beneficial for the generation of a homogenized photonic nanojet array. The intensity of the photonic nanojets in water is as high as ~2 fold the background light signal. Our work shows a simple, robust, and fast means for the fabrication of a large-scale homogenized photonic nanojet array.


2019 ◽  
Vol 28 (03) ◽  
pp. 1 ◽  
Author(s):  
Ye Yang ◽  
Cien Fan ◽  
Sheng Tian ◽  
Yang Guo ◽  
Lingzhi Liu ◽  
...  

2020 ◽  
Vol 12 (11) ◽  
pp. 1702 ◽  
Author(s):  
Thanh Huy Nguyen ◽  
Sylvie Daniel ◽  
Didier Guériot ◽  
Christophe Sintès ◽  
Jean-Marc Le Caillec

Automatic extraction of buildings in urban and residential scenes has become a subject of growing interest in the domain of photogrammetry and remote sensing, particularly since the mid-1990s. Active contour model, colloquially known as snake model, has been studied to extract buildings from aerial and satellite imagery. However, this task is still very challenging due to the complexity of building size, shape, and its surrounding environment. This complexity leads to a major obstacle for carrying out a reliable large-scale building extraction, since the involved prior information and assumptions on building such as shape, size, and color cannot be generalized over large areas. This paper presents an efficient snake model to overcome such a challenge, called Super-Resolution-based Snake Model (SRSM). The SRSM operates on high-resolution Light Detection and Ranging (LiDAR)-based elevation images—called z-images—generated by a super-resolution process applied to LiDAR data. The involved balloon force model is also improved to shrink or inflate adaptively, instead of inflating continuously. This method is applicable for a large scale such as city scale and even larger, while having a high level of automation and not requiring any prior knowledge nor training data from the urban scenes (hence unsupervised). It achieves high overall accuracy when tested on various datasets. For instance, the proposed SRSM yields an average area-based Quality of 86.57% and object-based Quality of 81.60% on the ISPRS Vaihingen benchmark datasets. Compared to other methods using this benchmark dataset, this level of accuracy is highly desirable even for a supervised method. Similarly desirable outcomes are obtained when carrying out the proposed SRSM on the whole City of Quebec (total area of 656 km2), yielding an area-based Quality of 62.37% and an object-based Quality of 63.21%.


2017 ◽  
Vol 7 (1) ◽  
Author(s):  
Minseop Byun ◽  
Dasol Lee ◽  
Minkyung Kim ◽  
Yangdoo Kim ◽  
Kwan Kim ◽  
...  

Abstract Overcoming the resolution limit of conventional optics is regarded as the most important issue in optical imaging science and technology. Although hyperlenses, super-resolution imaging devices based on highly anisotropic dispersion relations that allow the access of high-wavevector components, have recently achieved far-field sub-diffraction imaging in real-time, the previously demonstrated devices have suffered from the extreme difficulties of both the fabrication process and the non-artificial objects placement. This results in restrictions on the practical applications of the hyperlens devices. While implementing large-scale hyperlens arrays in conventional microscopy is desirable to solve such issues, it has not been feasible to fabricate such large-scale hyperlens array with the previously used nanofabrication methods. Here, we suggest a scalable and reliable fabrication process of a large-scale hyperlens device based on direct pattern transfer techniques. We fabricate a 5 cm × 5 cm size hyperlenses array and experimentally demonstrate that it can resolve sub-diffraction features down to 160 nm under 410 nm wavelength visible light. The array-based hyperlens device will provide a simple solution for much more practical far-field and real-time super-resolution imaging which can be widely used in optics, biology, medical science, nanotechnology and other closely related interdisciplinary fields.


2021 ◽  
Author(s):  
Pierre Parutto ◽  
Jennifer Heck ◽  
Meng Lu ◽  
Clemens F Kaminski ◽  
Martin Heine ◽  
...  

Super-resolution imaging can generate thousands of single-particle trajectories. These data can potentially reconstruct subcellular organization and dynamics, as well as measure disease-linked changes. However, computational methods that can derive quantitative information from such massive datasets are currently lacking. Here we present data analysis and algorithms that are broadly applicable to reveal local binding and trafficking interactions and organization of dynamic sub-cellular sites. We applied this analysis to the endoplasmic reticulum and neuronal membrane. The method is based on spatio-temporal time window segmentation that explores data at multiple levels and detects the architecture and boundaries of high density regions in areas that are hundreds of nanometers. By statistical analysis of a large number of datapoints, the present method allows measurements of nano-region stability. By connecting highly dense regions, we reconstructed the network topology of the ER, as well as molecular flow redistribution, and the local space explored by trajectories. Segmenting trajectories at appropriate scales extracts confined trajectories, allowing quantification of dynamic interactions between lysosomes and the ER. A final step of the method reveals the motion of trajectories relative to the ensemble, allowing reconstruction of dynamics in normal ER and the atlastin-null mutant. Our approach allows users to track previously inaccessible large scale dynamics at high resolution from massive datasets. The algorithm is available as an ImageJ plugin that can be applied by users to large datasets of overlapping trajectories.


Author(s):  
Hong Zhu ◽  
Weidong Song ◽  
Hai Tan ◽  
Jingxue Wang ◽  
Di Jia

Super-resolution reconstruction of sequence remote sensing image is a technology which handles multiple low-resolution satellite remote sensing images with complementary information and obtains one or more high resolution images. The cores of the technology are high precision matching between images and high detail information extraction and fusion. In this paper puts forward a new image super resolution model frame which can adaptive multi-scale enhance the details of reconstructed image. First, the sequence images were decomposed into a detail layer containing the detail information and a smooth layer containing the large scale edge information by bilateral filter. Then, a texture detail enhancement function was constructed to promote the magnitude of the medium and small details. Next, the non-redundant information of the super reconstruction was obtained by differential processing of the detail layer, and the initial super resolution construction result was achieved by interpolating fusion of non-redundant information and the smooth layer. At last, the final reconstruction image was acquired by executing a local optimization model on the initial constructed image. Experiments on ZY-3 satellite images of same phase and different phase show that the proposed method can both improve the information entropy and the image details evaluation standard comparing with the interpolation method, traditional TV algorithm and MAP algorithm, which indicate that our method can obviously highlight image details and contains more ground texture information. A large number of experiment results reveal that the proposed method is robust and universal for different kinds of ZY-3 satellite images.


Sign in / Sign up

Export Citation Format

Share Document