A Self Supervised Convolutional Neural Network Outdoor Scene Relighting

2021 ◽  
Author(s):  
Amirsaeed Yazdani

Outdoor scene relighting is a difficult trouble that calls forexact know-how of the scene geometry, illumination and albedo. Currentstrategies are absolutely supervised, requiring excessive exceptional ar?tificial renderings to educate a answer. Such renderings are synthesizedthe usage of priors discovered from restrained facts. In contrast, we ad?vise a self-supervised technique for relighting. Our technique is educatedbest on corpora of pics accrued from the net with none user-supervision.This without a doubt infinite supply of education facts lets in educationa popular relighting answer. Our technique first decomposes an photointo its albedo, geometry and illumination. A novel relighting is thenproduced through enhancing the illumination parameters. Our answerseize shadow the usage of a committed shadow prediction map, and doesnow no longer depend on correct geometry estimation. We compare ourmethod subjectively and objectively the usage of a brand new datasetwith ground-reality relighting. Results display the capacity of our methodto provide photo-sensible and bodily achievable results, that generalizesto unseen scenes

2020 ◽  
Author(s):  
S Kashin ◽  
D Zavyalov ◽  
A Rusakov ◽  
V Khryashchev ◽  
A Lebedev

2020 ◽  
Vol 2020 (10) ◽  
pp. 181-1-181-7
Author(s):  
Takahiro Kudo ◽  
Takanori Fujisawa ◽  
Takuro Yamaguchi ◽  
Masaaki Ikehara

Image deconvolution has been an important issue recently. It has two kinds of approaches: non-blind and blind. Non-blind deconvolution is a classic problem of image deblurring, which assumes that the PSF is known and does not change universally in space. Recently, Convolutional Neural Network (CNN) has been used for non-blind deconvolution. Though CNNs can deal with complex changes for unknown images, some CNN-based conventional methods can only handle small PSFs and does not consider the use of large PSFs in the real world. In this paper we propose a non-blind deconvolution framework based on a CNN that can remove large scale ringing in a deblurred image. Our method has three key points. The first is that our network architecture is able to preserve both large and small features in the image. The second is that the training dataset is created to preserve the details. The third is that we extend the images to minimize the effects of large ringing on the image borders. In our experiments, we used three kinds of large PSFs and were able to observe high-precision results from our method both quantitatively and qualitatively.


Sign in / Sign up

Export Citation Format

Share Document