Real-time Subsurface Control Variates

2021 ◽  
Vol 4 (1) ◽  
pp. 1-18
Author(s):  
Tiantian Xie ◽  
Marc Olano
Keyword(s):  
Real Time ◽  
Adaptive Sampling ◽  
Temporal Dynamics ◽  
Monte Carlo Sampling ◽  
Frame Rate ◽  
Subsurface Scattering ◽  
Control Variates ◽  
Low Pass ◽  
Sample Count ◽  
A New Technique

Real-time adaptive sampling is a new technique recently proposed for efficient importance sampling in realtime Monte Carlo sampling in subsurface scattering. It adaptively places samples based on variance tracking to help escape the uncanny valley of subsurface rendering. However, the occasional performance drop due to temporal lighting dynamics (e.g., guns or lights turning on and off) could hinder adoption in games or other applications where smooth high frame rate is preferred. In this paper we propose a novel usage of Control Variates (CV) in the sample domain instead of shading domain to maintain a consistent low pass time. Our algorithm seamlessly reduces to diffuse with zero scattering samples for sub-pixel scattering. We propose a novel joint-optimization algorithm for sample count and CV coefficient estimation. The main enabler is our novel time-variant covariance updating method that helps remove the effect of recent temporal dynamics from variance tracking. Since bandwidth is critical in real-time rendering, a solution without adding any extra textures is also provided.

Real-time subsurface scattering with single pass variance-guided adaptive importance sampling

2020 ◽  
Vol 3 (1) ◽  
pp. 1-21
Author(s):  
Tiantian Xie ◽  
Marc Olano ◽  
Brian Karis ◽  
Krzysztof Narkowicz
Keyword(s):  
Real Time ◽  
Adaptive Sampling ◽  
Monte Carlo Sampling ◽  
Diffusion Profile ◽  
Correct Result ◽  
Subsurface Scattering ◽  
Stochastic Sampling ◽  
Light Gradient ◽  
Temporal Variance ◽  
Importance Function

In real-time applications, it is difficult to simulate realistic subsurface scattering with differing degrees translucency. Burley's reflectance approximation by empirically fitting the diffusion profile as a whole makes it possible to achieve realistic looking subsurface scattering for different translucent materials in screen space. However, achieving a physically correct result requires real-time Monte Carlo sampling of the analytic importance function per pixel per frame, which seems prohibitive to achieve. In this paper, we propose an approximation of the importance function that can be evaluated in real-time. Since subsurface scattering is more pronounced in certain regions (e.g., with light gradient change), we propose an adaptive sampling method based on temporal variance to lower the required number of samples. We propose a one phase adaptive sampling pass that is unbiased, and able to adapt to scene changes due to motion and lighting. To further improve the quality, we explore temporal reuse with a guiding pass prior to the final temporal anti-aliasing (TAA) phase that further improves the quality. Our local guiding pass does not constrain the TAA implementation, and only requires one additional texture to be passed between frames. Our proposed variance-guided algorithm has the potential to make stochastic sampling algorithm effective for real-time rendering.

scholarly journals Real-time FPGA-based implementation of the AKAZE algorithm with nonlinear scale space generation using image partitioning

2021 ◽  
Author(s):  
Parastoo Soleimani ◽  
David W. Capson ◽  
Kin Fun Li
Keyword(s):  
Real Time ◽  
Memory Management ◽  
Scale Space ◽  
Image Resolution ◽  
Hardware Architecture ◽  
Frame Rate ◽  
Time Sharing ◽  
Scale Invariant ◽  
Nonlinear Scale Space ◽  
Nonlinear Scale

AbstractThe first step in a scale invariant image matching system is scale space generation. Nonlinear scale space generation algorithms such as AKAZE, reduce noise and distortion in different scales while retaining the borders and key-points of the image. An FPGA-based hardware architecture for AKAZE nonlinear scale space generation is proposed to speed up this algorithm for real-time applications. The three contributions of this work are (1) mapping the two passes of the AKAZE algorithm onto a hardware architecture that realizes parallel processing of multiple sections, (2) multi-scale line buffers which can be used for different scales, and (3) a time-sharing mechanism in the memory management unit to process multiple sections of the image in parallel. We propose a time-sharing mechanism for memory management to prevent artifacts as a result of separating the process of image partitioning. We also use approximations in the algorithm to make hardware implementation more efficient while maintaining the repeatability of the detection. A frame rate of 304 frames per second for a $$1280 \times 768$$ 1280 × 768 image resolution is achieved which is favorably faster in comparison with other work.

ViFin

2021 ◽  
Vol 5 (1) ◽  
pp. 1-25
Author(s):  
Wenqiang Chen ◽  
Lin Chen ◽  
Meiyi Ma ◽  
Farshid Salemi Parizi ◽  
Shwetak Patel ◽  
...  
Keyword(s):  
Real Time ◽  
Real World ◽  
Wearable Devices ◽  
User Studies ◽  
Finger Movement ◽  
Writing System ◽  
Time System ◽  
Real Time System ◽  
Input Devices ◽  
A New Technique

Wearable devices, such as smartwatches and head-mounted devices (HMD), demand new input devices for a natural, subtle, and easy-to-use way to input commands and text. In this paper, we propose and investigate ViFin, a new technique for input commands and text entry, which harness finger movement induced vibration to track continuous micro finger-level writing with a commodity smartwatch. Inspired by the recurrent neural aligner and transfer learning, ViFin recognizes continuous finger writing, works across different users, and achieves an accuracy of 90% and 91% for recognizing numbers and letters, respectively. We quantify our approach's accuracy through real-time system experiments in different arm positions, writing speeds, and smartwatch position displacements. Finally, a real-time writing system and two user studies on real-world tasks are implemented and assessed.

scholarly journals Temperature and Relative Humidity Profile Retrieval from Fengyun-3D/HIRAS in the Arctic Region

2021 ◽  
Vol 13 (10) ◽  
pp. 1884
Author(s):  
Jingjing Hu ◽  
Yansong Bao ◽  
Jian Liu ◽  
Hui Liu ◽  
George P. Petropoulos ◽  
...  
Keyword(s):  
Relative Humidity ◽  
Real Time ◽  
Wide Spectrum ◽  
Warm Season ◽  
Arctic Region ◽  
Cold Season ◽  
The Arctic ◽  
Practical Applications ◽  
A New Technique ◽  
The Arctic Region

The acquisition of real-time temperature and relative humidity (RH) profiles in the Arctic is of great significance for the study of the Arctic’s climate and Arctic scientific research. However, the operational algorithm of Fengyun-3D only takes into account areas within 60°N, the innovation of this work is that a new technique based on Neural Network (NN) algorithm was proposed, which can retrieve these parameters in real time from the Fengyun-3D Hyperspectral Infrared Radiation Atmospheric Sounding (HIRAS) observations in the Arctic region. Considering the difficulty of obtaining a large amount of actual observation (such as radiosonde) in the Arctic region, collocated ERA5 data from European Centre for Medium-Range Weather Forecasts (ECMWF) and HIRAS observations were used to train the neural networks (NNs). Brightness temperature and training targets were classified using two variables: season (warm season and cold season) and surface type (ocean and land). NNs-based retrievals were compared with ERA5 data and radiosonde observations (RAOBs) independent of the NN training sets. Results showed that (1) the NNs retrievals accuracy is generally higher on warm season and ocean; (2) the root-mean-square error (RMSE) of retrieved profiles is generally slightly higher in the RAOB comparisons than in the ERA5 comparisons, but the variation trend of errors with height is consistent; (3) the retrieved profiles by the NN method are closer to ERA5, comparing with the AIRS products. All the results demonstrated the potential value in time and space of NN algorithm in retrieving temperature and relative humidity profiles of the Arctic region from HIRAS observations under clear-sky conditions. As such, the proposed NN algorithm provides a valuable pathway for retrieving reliably temperature and RH profiles from HIRAS observations in the Arctic region, providing information of practical value in a wide spectrum of practical applications and research investigations alike.All in all, our work has important implications in broadening Fengyun-3D’s operational implementation range from within 60°N to the Arctic region.

scholarly journals Distributed X-ray photon correlation spectroscopy data reduction using Hadoop MapReduce

2018 ◽  
Vol 25 (4) ◽  
pp. 1135-1143 ◽  
Author(s):  
Faisal Khan ◽  
Suresh Narayanan ◽  
Roger Sersted ◽  
Nicholas Schwarz ◽  
Alec Sandy
Keyword(s):  
Real Time ◽  
Photon Correlation Spectroscopy ◽  
Correlation Spectroscopy ◽  
Frame Rate ◽  
Computational Techniques ◽  
Complex Materials ◽  
Photon Correlation ◽  
X Ray ◽  
Wide Range ◽  
Recent Developments

Multi-speckle X-ray photon correlation spectroscopy (XPCS) is a powerful technique for characterizing the dynamic nature of complex materials over a range of time scales. XPCS has been successfully applied to study a wide range of systems. Recent developments in higher-frame-rate detectors, while aiding in the study of faster dynamical processes, creates large amounts of data that require parallel computational techniques to process in near real-time. Here, an implementation of the multi-tau and two-time autocorrelation algorithms using the Hadoop MapReduce framework for distributed computing is presented. The system scales well with regard to the increase in the data size, and has been serving the users of beamline 8-ID-I at the Advanced Photon Source for near real-time autocorrelations for the past five years.

Sign in / Sign up

Export Citation Format

Share Document