Distributed and parallel processing for real-time and dynamic spatio-temporal graph

2019 ◽  
Vol 23 (2) ◽  
pp. 905-926
Author(s):  
Junhua Fang ◽  
Jiafeng Ding ◽  
Pengpeng Zhao ◽  
Jiajie Xu ◽  
An Liu ◽  
...  
Keyword(s):  
Parallel Processing ◽  
Real Time ◽  
Temporal Graph ◽  
Spatio Temporal

Passthrough+

2020 ◽  
Vol 3 (1) ◽  
pp. 1-17
Author(s):  
Gaurav Chaurasia ◽  
Arthur Nieuwoudt ◽  
Alexandru-Eugen Ichim ◽  
Richard Szeliski ◽  
Alexander Sorkine-Hornung
Keyword(s):  
Real Time ◽  
Video Encoding ◽  
View Synthesis ◽  
Performance Constraints ◽  
Trade Offs ◽  
Stereoscopic View ◽  
Target User ◽  
Spatio Temporal ◽  
And Performance ◽  
3D Scene

We present an end-to-end system for real-time environment capture, 3D reconstruction, and stereoscopic view synthesis on a mobile VR headset. Our solution allows the user to use the cameras on their VR headset as their eyes to see and interact with the real world while still wearing their headset, a feature often referred to as Passthrough. The central challenge when building such a system is the choice and implementation of algorithms under the strict compute, power, and performance constraints imposed by the target user experience and mobile platform. A key contribution of this paper is a complete description of a corresponding system that performs temporally stable passthrough rendering at 72 Hz with only 200 mW power consumption on a mobile Snapdragon 835 platform. Our algorithmic contributions for enabling this performance include the computation of a coarse 3D scene proxy on the embedded video encoding hardware, followed by a depth densification and filtering step, and finally stereoscopic texturing and spatio-temporal up-sampling. We provide a detailed discussion and evaluation of the challenges we encountered, as well as algorithm and performance trade-offs in terms of compute and resulting passthrough quality.;AB@The described system is available to users as the Passthrough+ feature on Oculus Quest. We believe that by publishing the underlying system and methods, we provide valuable insights to the community on how to design and implement real-time environment sensing and rendering on heavily resource constrained hardware.

Real-Time Web GIS Analysis Using WebGL

2012 ◽  
Vol 1 (3) ◽  
pp. 49-61 ◽  
Author(s):  
Michael Auer
Keyword(s):  
Parallel Processing ◽  
Real Time ◽  
Large Data ◽  
Web Gis ◽  
3D Graphics ◽  
Gis Analysis ◽  
User Interactions ◽  
Algorithm Performance ◽  
Gis Applications ◽  
Client Side

Parallel processing methods in Geographic Information Systems (GIS) are traditionally used to accelerate the calculation of large data volumes with sophisticated spatial algorithms. Such kinds of acceleration can also be applied to provide real-time GIS applications to improve the responsiveness of user interactions with the data. This paper presents a method to enable this approach for Web GIS applications. It uses the JavaScript 3D graphics API (WebGL) to perform client-side parallel real-time computations of 2D or 2.5D spatial raster algorithms on the graphics card. The potential of this approach is evaluated using an example implementation of a hillshade algorithm. Performance comparisons of parallel and sequential computations reveal acceleration factors between 25 and 100, mainly depending on mobile or desktop environments.

scholarly journals Evaluation of IMERG Level-3 Products in Depicting the July to October Rainfall over Taiwan: Typhoon Versus Non-Typhoon

2021 ◽  
Vol 13 (4) ◽  
pp. 622
Author(s):  
Wan-Ru Huang ◽  
Pin-Yi Liu ◽  
Ya-Hui Chang ◽  
Cheng-An Lee
Keyword(s):  
Real Time ◽  
Tropical Rainfall Measuring Mission ◽  
Temporal Variations ◽  
Rain Gauge ◽  
Advantages And Disadvantages ◽  
Level 3 ◽  
Spatio Temporal ◽  
Typhoon Season ◽  
Early Late ◽  
Better Than

This study assesses the performance of satellite precipitation products (SPPs) from the latest version, V06B, Integrated Multi-satellitE Retrievals for Global Precipitation Mission (IMERG) Level-3 (including early, late, and final runs), in depicting the characteristics of typhoon season (July to October) rainfall over Taiwan within the period of 2000–2018. The early and late runs are near-real-time SPPs, while final run is post-real-time SPP adjusted by monthly rain gauge data. The latency of early, late, and final runs is approximately 4 h, 14 h, and 3.5 months, respectively, after the observation. Analyses focus on the seasonal mean, daily variation, and interannual variation of typhoon-related (TC) and non-typhoon-related (non-TC) rainfall. Using local rain-gauge observations as a reference for evaluation, our results show that all IMERG products capture the spatio-temporal variations of TC rainfall better than those of non-TC rainfall. Among SPPs, the final run performs better than the late run, which is slightly better than the early run for most of the features assessed for both TC and non-TC rainfall. Despite these differences, all IMERG products outperform the frequently used Tropical Rainfall Measuring Mission 3B42 v7 (TRMM7) for the illustration of the spatio-temporal characteristics of TC rainfall in Taiwan. In contrast, for the non-TC rainfall, the final run performs notably better relative to TRMM7, while the early and late runs showed only slight improvement. These findings highlight the advantages and disadvantages of using IMERG products for studying or monitoring typhoon season rainfall in Taiwan.

Based on spatio-temporal graph convolution networks with residual connection for intelligence behavior recognition

2021 ◽  
pp. 002072092199660
Author(s):  
Yinong Zhang ◽  
Shanshan Guan ◽  
Cheng Xu ◽  
Hongzhe Liu
Keyword(s):  
Human Behavior ◽  
Behavior Recognition ◽  
Convolutional Network ◽  
Skeleton Model ◽  
Basic Technology ◽  
Temporal Model ◽  
Temporal Graph ◽  
Spatio Temporal ◽  
Human Behavior Recognition ◽  
Behavior Characteristics

In the era of intelligent education, human behavior recognition based on computer vision is an important branch of pattern recognition. Human behavior recognition is a basic technology in the fields of intelligent monitoring and human-computer interaction in education. The dynamic changes of human skeleton provide important information for the recognition of educational behavior. Traditional methods usually use manual information to label or traverse rules only, resulting in limited representation capabilities and poor generalization performance of the model. In this paper, a kind of dynamic skeleton model with residual is adopted—a spatio-temporal graph convolutional network based on residual connections, which not only overcomes the limitations of previous methods, but also can learn the spatio-temporal model from the skeleton data. In the big bone NTU-RGB + D dataset, the network model not only improved the representation ability of human behavior characteristics, but also improved the generalization ability, and achieved better recognition effect than the existing model. In addition, this paper also compares the results of behavior recognition on subsets of different joint points, and finds that spatial structure division have better effects.

Sign in / Sign up

Export Citation Format

Share Document