scholarly journals AOGAN: A generative adversarial network for screen space ambient occlusion

2022 ◽  
Author(s):  
Lei Ren ◽  
Ying Song
Keyword(s):  
Light Intensity ◽  
Real Time ◽  
Generative Model ◽  
Attention Mechanism ◽  
Generative Adversarial Network ◽  
Learning Framework ◽  
Adversarial Network ◽  
Ambient Occlusion ◽  
Complex Scenes ◽  
Screen Space

AbstractAmbient occlusion (AO) is a widely-used real-time rendering technique which estimates light intensity on visible scene surfaces. Recently, a number of learning-based AO approaches have been proposed, which bring a new angle to solving screen space shading via a unified learning framework with competitive quality and speed. However, most such methods have high error for complex scenes or tend to ignore details. We propose an end-to-end generative adversarial network for the production of realistic AO, and explore the importance of perceptual loss in the generative model to AO accuracy. An attention mechanism is also described to improve the accuracy of details, whose effectiveness is demonstrated on a wide variety of scenes.

scholarly journals Stochastic-Depth Ambient Occlusion

2021 ◽  
Vol 4 (1) ◽  
pp. 1-15
Author(s):  
Jop Vermeer ◽  
Leonardo Scandolo ◽  
Elmar Eisemann
Keyword(s):  
Real Time ◽  
High Performance ◽  
Depth Map ◽  
Visual Quality ◽  
Ambient Light ◽  
Missing Information ◽  
Time Performance ◽  
Ambient Occlusion ◽  
Depth Buffer ◽  
Screen Space

Ambient occlusion (AO) is a popular rendering technique that enhances depth perception and realism by darkening locations that are less exposed to ambient light (e.g., corners and creases). In real-time applications, screen-space variants, relying on the depth buffer, are used due to their high performance and good visual quality. However, these only take visible surfaces into account, resulting in inconsistencies, especially during motion. Stochastic-Depth Ambient Occlusion is a novel AO algorithm that accounts for occluded geometry by relying on a stochastic depth map, capturing multiple scene layers per pixel at random. Hereby, we efficiently gather missing information in order to improve upon the accuracy and spatial stability of conventional screen-space approximations, while maintaining real-time performance. Our approach integrates well into existing rendering pipelines and improves the robustness of many different AO techniques, including multi-view solutions.

scholarly journals Posterior-GAN: Towards Informative and Coherent Response Generation with Posterior Generative Adversarial Network

2020 ◽  
Vol 34 (05) ◽  
pp. 7708-7715
Author(s):  
Shaoxiong Feng ◽  
Hongshen Chen ◽  
Kan Li ◽  
Dawei Yin
Keyword(s):  
Likelihood Estimation ◽  
Model Learning ◽  
Generative Adversarial Network ◽  
Adversarial Learning ◽  
Loosely Coupled ◽  
Learning Framework ◽  
Adversarial Network ◽  
The Future ◽  
Quality Response ◽  
The Given

Neural conversational models learn to generate responses by taking into account the dialog history. These models are typically optimized over the query-response pairs with a maximum likelihood estimation objective. However, the query-response tuples are naturally loosely coupled, and there exist multiple responses that can respond to a given query, which leads the conversational model learning burdensome. Besides, the general dull response problem is even worsened when the model is confronted with meaningless response training instances. Intuitively, a high-quality response not only responds to the given query but also links up to the future conversations, in this paper, we leverage the query-response-future turn triples to induce the generated responses that consider both the given context and the future conversations. To facilitate the modeling of these triples, we further propose a novel encoder-decoder based generative adversarial learning framework, Posterior Generative Adversarial Network (Posterior-GAN), which consists of a forward and a backward generative discriminator to cooperatively encourage the generated response to be informative and coherent by two complementary assessment perspectives. Experimental results demonstrate that our method effectively boosts the informativeness and coherence of the generated response on both automatic and human evaluation, which verifies the advantages of considering two assessment perspectives.

Sign in / Sign up

Export Citation Format

Share Document