Unsupervised Image Translation in the Wild

Author(s):  
Yusuf Ani ◽  
Mehmet Fatih Amasvali
Author(s):  
Ojasvi Yadav ◽  
Koustav Ghosal ◽  
Sebastian Lutz ◽  
Aljosa Smolic

AbstractWe address the problem of exposure correction of dark, blurry and noisy images captured in low-light conditions in the wild. Classical image-denoising filters work well in the frequency space but are constrained by several factors such as the correct choice of thresholds and frequency estimates. On the other hand, traditional deep networks are trained end to end in the RGB space by formulating this task as an image translation problem. However, that is done without any explicit constraints on the inherent noise of the dark images and thus produces noisy and blurry outputs. To this end, we propose a DCT/FFT-based multi-scale loss function, which when combined with traditional losses, trains a network to translate the important features for visually pleasing output. Our loss function is end to end differentiable, scale-agnostic and generic; i.e., it can be applied to both RAW and JPEG images in most existing frameworks without additional overhead. Using this loss function, we report significant improvements over the state of the art using quantitative metrics and subjective tests.


2020 ◽  
Vol 34 (07) ◽  
pp. 11378-11385
Author(s):  
Qi Li ◽  
Yunfan Liu ◽  
Zhenan Sun

Age progression and regression refers to aesthetically rendering a given face image to present effects of face aging and rejuvenation, respectively. Although numerous studies have been conducted in this topic, there are two major problems: 1) multiple models are usually trained to simulate different age mappings, and 2) the photo-realism of generated face images is heavily influenced by the variation of training images in terms of pose, illumination, and background. To address these issues, in this paper, we propose a framework based on conditional Generative Adversarial Networks (cGANs) to achieve age progression and regression simultaneously. Particularly, since face aging and rejuvenation are largely different in terms of image translation patterns, we model these two processes using two separate generators, each dedicated to one age changing process. In addition, we exploit spatial attention mechanisms to limit image modifications to regions closely related to age changes, so that images with high visual fidelity could be synthesized for in-the-wild cases. Experiments on multiple datasets demonstrate the ability of our model in synthesizing lifelike face images at desired ages with personalized features well preserved, and keeping age-irrelevant regions unchanged.


2020 ◽  
Vol 2020 ◽  
pp. 1-8
Author(s):  
Zhiyi Cao ◽  
Shaozhang Niu ◽  
Jiwei Zhang

Generative Adversarial Networks (GANs) have achieved significant success in unsupervised image-to-image translation between given categories (e.g., zebras to horses). Previous GANs models assume that the shared latent space between different categories will be captured from the given categories. Unfortunately, besides the well-designed datasets from given categories, many examples come from different wild categories (e.g., cats to dogs) holding special shapes and sizes (short for adversarial examples), so the shared latent space is troublesome to capture, and it will cause the collapse of these models. For this problem, we assume the shared latent space can be classified as global and local and design a weakly supervised Similar GANs (Sim-GAN) to capture the local shared latent space rather than the global shared latent space. For the well-designed datasets, the local shared latent space is close to the global shared latent space. For the wild datasets, we will get the local shared latent space to stop the model from collapse. Experiments on four public datasets show that our model significantly outperforms state-of-the-art baseline methods.


Author(s):  
Neil Rowlands ◽  
Jeff Price ◽  
Michael Kersker ◽  
Seichi Suzuki ◽  
Steve Young ◽  
...  

Three-dimensional (3D) microstructure visualization on the electron microscope requires that the sample be tilted to different positions to collect a series of projections. This tilting should be performed rapidly for on-line stereo viewing and precisely for off-line tomographic reconstruction. Usually a projection series is collected using mechanical stage tilt alone. The stereo pairs must be viewed off-line and the 60 to 120 tomographic projections must be aligned with fiduciary markers or digital correlation methods. The delay in viewing stereo pairs and the alignment problems in tomographic reconstruction could be eliminated or improved by tilting the beam if such tilt could be accomplished without image translation.A microscope capable of beam tilt with simultaneous image shift to eliminate tilt-induced translation has been investigated for 3D imaging of thick (1 μm) biologic specimens. By tilting the beam above and through the specimen and bringing it back below the specimen, a brightfield image with a projection angle corresponding to the beam tilt angle can be recorded (Fig. 1a).


Author(s):  
Thecan Caesar-Ton That ◽  
Lynn Epstein

Nectria haematococca mating population I (anamorph, Fusarium solani) macroconidia attach to its host (squash) and non-host surfaces prior to germ tube emergence. The macroconidia become adhesive after a brief period of protein synthesis. Recently, Hickman et al. (1989) isolated N. haematococca adhesion-reduced mutants. Using freeze substitution, we compared the development of the macroconidial wall in the wild type in comparison to one of the mutants, LEI.Macroconidia were harvested at 1C, washed by centrifugation, resuspended in a dilute zucchini fruit extract and incubated from 0 - 5 h. During the incubation period, wild type macroconidia attached to uncoated dialysis tubing. Mutant macroconidia did not attach and were collected on poly-L-lysine coated dialysis tubing just prior to freezing. Conidia on the tubing were frozen in liquid propane at 191 - 193C, substituted in acetone with 2% OsO4 and 0.05% uranyl acetate, washed with acetone, and flat-embedded in Epon-Araldite. Using phase contrast microscopy at 1000X, cells without freeze damage were selected, remounted, sectioned and post-stained sequentially with 1% Ba(MnO4)2 2% uranyl acetate and Reynold’s lead citrate. At least 30 cells/treatment were examined.


2020 ◽  
Vol 650 ◽  
pp. 7-18 ◽  
Author(s):  
HW Fennie ◽  
S Sponaugle ◽  
EA Daly ◽  
RD Brodeur

Predation is a major source of mortality in the early life stages of fishes and a driving force in shaping fish populations. Theoretical, modeling, and laboratory studies have generated hypotheses that larval fish size, age, growth rate, and development rate affect their susceptibility to predation. Empirical data on predator selection in the wild are challenging to obtain, and most selective mortality studies must repeatedly sample populations of survivors to indirectly examine survivorship. While valuable on a population scale, these approaches can obscure selection by particular predators. In May 2018, along the coast of Washington, USA, we simultaneously collected juvenile quillback rockfish Sebastes maliger from both the environment and the stomachs of juvenile coho salmon Oncorhynchus kisutch. We used otolith microstructure analysis to examine whether juvenile coho salmon were age-, size-, and/or growth-selective predators of juvenile quillback rockfish. Our results indicate that juvenile rockfish consumed by salmon were significantly smaller, slower growing at capture, and younger than surviving (unconsumed) juvenile rockfish, providing direct evidence that juvenile coho salmon are selective predators on juvenile quillback rockfish. These differences in early life history traits between consumed and surviving rockfish are related to timing of parturition and the environmental conditions larval rockfish experienced, suggesting that maternal effects may substantially influence survival at this stage. Our results demonstrate that variability in timing of parturition and sea surface temperature leads to tradeoffs in early life history traits between growth in the larval stage and survival when encountering predators in the pelagic juvenile stage.


2020 ◽  
Vol 2020 (1) ◽  
pp. 78-81
Author(s):  
Simone Zini ◽  
Simone Bianco ◽  
Raimondo Schettini

Rain removal from pictures taken under bad weather conditions is a challenging task that aims to improve the overall quality and visibility of a scene. The enhanced images usually constitute the input for subsequent Computer Vision tasks such as detection and classification. In this paper, we present a Convolutional Neural Network, based on the Pix2Pix model, for rain streaks removal from images, with specific interest in evaluating the results of the processing operation with respect to the Optical Character Recognition (OCR) task. In particular, we present a way to generate a rainy version of the Street View Text Dataset (R-SVTD) for "text detection and recognition" evaluation in bad weather conditions. Experimental results on this dataset show that our model is able to outperform the state of the art in terms of two commonly used image quality metrics, and that it is capable to improve the performances of an OCR model to detect and recognise text in the wild.


2020 ◽  
Vol 12 (3) ◽  
pp. 189
Author(s):  
Sebastian Gäb

When we were on the subway back from his lecture, I said to Robin: “I’m not sure there actually are any religious fictionalists.” We keep talking about them in papers and lectures, acting as if fictionalism in religion is a real possibility, but to be honest, I haven’t been able to spot one in the wild so far. The only potential candidate who comes to mind is Don Cupitt, who wrote things like: “I still pray and love God, even though I fully acknowledge that no God actually exists.”[1] Perhaps this is as fictionalist as it gets. But then again, Cupitt never explicitly declared himself a fictionalist (at least to my knowledge). Moreover, on other occasions he sounds more like an expressivist than a fictionalist, e.g. when he says: “The Christian doctrine of God just is Christian spirituality in coded form.”[2] So, if there are any actual fictionalists out there, please step forward.[1] Don Cupitt, After God: The Future of Religion (Basic Books, 1997), 85.[2] Don Cupitt, Taking leave of God (SCM Press, 1980), 14.


2020 ◽  
Vol 6 (1) ◽  
Author(s):  
Elly Lestari Rustiati ◽  
Priyambodo Priyambodo ◽  
Yanti Yulianti ◽  
Eko Agus Srihanto ◽  
Dian Neli Pratiwi ◽  
...  

Way Kambas National Park (WKNP) is home of five protected big mammals including sumatran elephants.  It shares its border with 22 of 37 villages surrounding the national park.  Understanding their existence in the wild is a priority, and  wildlife genetics is a crucially needed. Besides poaching and habitat fragmentation, wildlife-human conflict is one big issue.  Elephant Training Center (ETC) in WKNP is built for semi in-situ conservation effort on captive sumatran elephants that mainly have conflict histories with local people.  Participative observation and bio-molecular analysis were conducted to learn the importance of captive Sumatran elephant for conservation effort.  Through captive sumatran elephants, database and applicable methods are expected to be developed supporting the conservation of their population in the wild.  Participative observation and molecular identification was carried on captive sumatran elephants in ETC, WKNP under multiple year Terapan grant of Ministry of Research and Technology Higher Education, Indonesia. Gene sequence and cytological analyses showed that the captive sumatran elephants are closely related and tend to be domesticated.  Translocation among ETC to avoid inbreeding, and maintaining the captive sumatran elephant as natural as possible are highly recommended. Developing genetic database can be a reference for both captive and wild sumatran elephants.


Sign in / Sign up

Export Citation Format

Share Document