Data-Driven Particle-Based Liquid Simulation with Deep Learning Utilizing Sub-Pixel Convolution

Author(s):  
Evgenii Tumanov ◽  
Dmitry Korobchenko ◽  
Nuttapong Chentanez

In recent years, the performance of neural network inference has been drastically improved. This rapid change has paved the way for research projects focusing on accelerating physics-based simulations by replacing solver with its approximation. In this paper, we propose several efficient architectures of neural networks, which can be used to exploit this idea. The purpose of our research was to specifically target a liquid simulation problem. The central challenge for us was to create an efficient solution capable of approximating Position Based Fluid [Macklin and Müller 2013] solver. It requires the network to produce an accurate output at particles located in a continuous space and be significantly faster than the GPU based simulation. We achieved this by using modern sub-pixel convolution techniques originally used for image super-resolution. In our experiments, our method runs up to 200 times faster than the reference GPU simulation.

2021 ◽  
Vol ahead-of-print (ahead-of-print) ◽  
Author(s):  
Valli Bhasha A. ◽  
Venkatramana Reddy B.D.

Purpose The problems of Super resolution are broadly discussed in diverse fields. Rather than the progression toward the super resolution models for real-time images, operating hyperspectral images still remains a challenging problem. Design/methodology/approach This paper aims to develop the enhanced image super-resolution model using “optimized Non-negative Structured Sparse Representation (NSSR), Adaptive Discrete Wavelet Transform (ADWT), and Optimized Deep Convolutional Neural Network”. Once after converting the HR images into LR images, the NSSR images are generated by the optimized NSSR. Then the ADWT is used for generating the subbands of both NSSR and HRSB images. The residual image with this information is obtained by the optimized Deep CNN. All the improvements on the algorithms are done by the Opposition-based Barnacles Mating Optimization (O-BMO), with the objective of attaining the multi-objective function concerning the “Peak Signal-to-Noise Ratio (PSNR), and Structural similarity (SSIM) index”. Extensive analysis on benchmark hyperspectral image datasets shows that the proposed model achieves superior performance over typical other existing super-resolution models. Findings From the analysis, the overall analysis of the suggested and the conventional super resolution models relies that the PSNR of the improved O-BMO-(NSSR+DWT+CNN) was 38.8% better than bicubic, 11% better than NSSR, 16.7% better than DWT+CNN, 1.3% better than NSSR+DWT+CNN, and 0.5% better than NSSR+FF-SHO-(DWT+CNN). Hence, it has been confirmed that the developed O-BMO-(NSSR+DWT+CNN) is performing well in converting LR images to HR images. Originality/value This paper adopts a latest optimization algorithm called O-BMO with optimized Non-negative Structured Sparse Representation (NSSR), Adaptive Discrete Wavelet Transform (ADWT) and Optimized Deep Convolutional Neural Network for developing the enhanced image super-resolution model. This is the first work that uses O-BMO-based Deep CNN for image super-resolution model enhancement.


2018 ◽  
Vol 47 (4) ◽  
pp. 410004
Author(s):  
马昊宇 MA Hao-yu ◽  
徐之海 XU Zhi-hai ◽  
冯华君 FENG Hua-jun ◽  
李奇 LI Qi ◽  
陈跃庭 CHEN Yue-ting

Sign in / Sign up

Export Citation Format

Share Document