Passthrough+

2020 ◽  
Vol 3 (1) ◽  
pp. 1-17
Author(s):  
Gaurav Chaurasia ◽  
Arthur Nieuwoudt ◽  
Alexandru-Eugen Ichim ◽  
Richard Szeliski ◽  
Alexander Sorkine-Hornung
Keyword(s):  
Real Time ◽  
Video Encoding ◽  
View Synthesis ◽  
Performance Constraints ◽  
Trade Offs ◽  
Stereoscopic View ◽  
Target User ◽  
Spatio Temporal ◽  
And Performance ◽  
3D Scene

We present an end-to-end system for real-time environment capture, 3D reconstruction, and stereoscopic view synthesis on a mobile VR headset. Our solution allows the user to use the cameras on their VR headset as their eyes to see and interact with the real world while still wearing their headset, a feature often referred to as Passthrough. The central challenge when building such a system is the choice and implementation of algorithms under the strict compute, power, and performance constraints imposed by the target user experience and mobile platform. A key contribution of this paper is a complete description of a corresponding system that performs temporally stable passthrough rendering at 72 Hz with only 200 mW power consumption on a mobile Snapdragon 835 platform. Our algorithmic contributions for enabling this performance include the computation of a coarse 3D scene proxy on the embedded video encoding hardware, followed by a depth densification and filtering step, and finally stereoscopic texturing and spatio-temporal up-sampling. We provide a detailed discussion and evaluation of the challenges we encountered, as well as algorithm and performance trade-offs in terms of compute and resulting passthrough quality.;AB@The described system is available to users as the Passthrough+ feature on Oculus Quest. We believe that by publishing the underlying system and methods, we provide valuable insights to the community on how to design and implement real-time environment sensing and rendering on heavily resource constrained hardware.

scholarly journals Resource and performance trade-offs in real-time embedded control systems

2012 ◽  
Vol 49 (3) ◽  
pp. 267-307 ◽  
Author(s):  
Camilo Lozoya ◽  
Pau Martí ◽  
Manel Velasco ◽  
Josep M. Fuertes ◽  
Enrix X. Martin
Keyword(s):  
Control Systems ◽  
Real Time ◽  
Embedded Control ◽  
Embedded Control Systems ◽  
Trade Offs ◽  
And Performance

Specialization and performance trade‐offs across hosts in cactophilic Drosophila species

2021 ◽  
Author(s):  
Santiago Bouzas ◽  
María F. Barbarich ◽  
Eduardo M. Soto ◽  
Julián Padró ◽  
Valeria P. Carreira ◽  
...  
Keyword(s):  
Drosophila Species ◽  
Cactophilic Drosophila ◽  
Trade Offs ◽  
And Performance

scholarly journals Noise and Breakdown Characterization of SPAD Detectors with Time-Gated Photon-Counting Operation

Sensors ◽  
2021 ◽  
Vol 21 (16) ◽  
pp. 5287
Author(s):  
Hiwa Mahmoudi ◽  
Michael Hofbauer ◽  
Bernhard Goll ◽  
Horst Zimmermann
Keyword(s):  
Breakdown Voltage ◽  
Single Photon ◽  
Photon Counting ◽  
Low Noise ◽  
Dark Count ◽  
Fully Integrated ◽  
Trade Offs ◽  
And Performance ◽  
Noise Models

Being ready-to-detect over a certain portion of time makes the time-gated single-photon avalanche diode (SPAD) an attractive candidate for low-noise photon-counting applications. A careful SPAD noise and performance characterization, however, is critical to avoid time-consuming experimental optimization and redesign iterations for such applications. Here, we present an extensive empirical study of the breakdown voltage, as well as the dark-count and afterpulsing noise mechanisms for a fully integrated time-gated SPAD detector in 0.35-μm CMOS based on experimental data acquired in a dark condition. An “effective” SPAD breakdown voltage is introduced to enable efficient characterization and modeling of the dark-count and afterpulsing probabilities with respect to the excess bias voltage and the gating duration time. The presented breakdown and noise models will allow for accurate modeling and optimization of SPAD-based detector designs, where the SPAD noise can impose severe trade-offs with speed and sensitivity as is shown via an example.

Renewable energy selection based on a new entropy and dissimilarity measure on an interval-valued neutrosophic set

2021 ◽  
pp. 1-18
Author(s):  
ShuoYan Chou ◽  
Truong ThiThuy Duong ◽  
Nguyen Xuan Thao
Keyword(s):  
Decision Making ◽  
Renewable Energy ◽  
Membership Function ◽  
Fossil Fuels ◽  
Multiple Criteria Decision Making ◽  
Clean Energy ◽  
Dissimilarity Measure ◽  
Neutrosophic Set ◽  
Trade Offs ◽  
And Performance

Energy plays a central part in economic development, yet alongside fossil fuels bring vast environmental impact. In recent years, renewable energy has gradually become a viable source for clean energy to alleviate and decouple with a negative connotation. Different types of renewable energy are not without trade-offs beyond costs and performance. Multiple-criteria decision-making (MCDM) has become one of the most prominent tools in making decisions with multiple conflicting criteria existing in many complex real-world problems. Information obtained for decision making may be ambiguous or uncertain. Neutrosophic is an extension of fuzzy set types with three membership functions: truth membership function, falsity membership function and indeterminacy membership function. It is a useful tool when dealing with uncertainty issues. Entropy measures the uncertainty of information under neutrosophic circumstances which can be used to identify the weights of criteria in MCDM model. Meanwhile, the dissimilarity measure is useful in dealing with the ranking of alternatives in term of distance. This article proposes to build a new entropy and dissimilarity measure as well as to construct a novel MCDM model based on them to improve the inclusiveness of the perspectives for decision making. In this paper, we also give out a case study of using this model through the process of a renewable energy selection scenario in Taiwan performed and assessed.

High-Performance Image Filters via Sparse Approximations

2020 ◽  
Vol 3 (2) ◽  
pp. 1-19
Author(s):  
Kersten Schuster ◽  
Philip Trettner ◽  
Leif Kobbelt
Keyword(s):  
High Performance ◽  
Hardware Acceleration ◽  
Optimization Method ◽  
Translation Invariant ◽  
Approximation Quality ◽  
Trade Offs ◽  
Sparse Approximations ◽  
Image Filters ◽  
Good Trade ◽  
And Performance

We present a numerical optimization method to find highly efficient (sparse) approximations for convolutional image filters. Using a modified parallel tempering approach, we solve a constrained optimization that maximizes approximation quality while strictly staying within a user-prescribed performance budget. The results are multi-pass filters where each pass computes a weighted sum of bilinearly interpolated sparse image samples, exploiting hardware acceleration on the GPU. We systematically decompose the target filter into a series of sparse convolutions, trying to find good trade-offs between approximation quality and performance. Since our sparse filters are linear and translation-invariant, they do not exhibit the aliasing and temporal coherence issues that often appear in filters working on image pyramids. We show several applications, ranging from simple Gaussian or box blurs to the emulation of sophisticated Bokeh effects with user-provided masks. Our filters achieve high performance as well as high quality, often providing significant speed-up at acceptable quality even for separable filters. The optimized filters can be baked into shaders and used as a drop-in replacement for filtering tasks in image processing or rendering pipelines.

scholarly journals Array databases: concepts, standards, implementations

2021 ◽  
Vol 8 (1) ◽  
Author(s):  
Peter Baumann ◽  
Dimitar Misev ◽  
Vlad Merticariu ◽  
Bang Pham Huu
Keyword(s):  
Service Quality ◽  
Ad Hoc ◽  
Query Language ◽  
Distributed Processing ◽  
Database Systems ◽  
Database Technology ◽  
Comprehensive Survey ◽  
Spatio Temporal ◽  
And Performance ◽  
Array Databases

AbstractMulti-dimensional arrays (also known as raster data or gridded data) play a key role in many, if not all science and engineering domains where they typically represent spatio-temporal sensor, image, simulation output, or statistics “datacubes”. As classic database technology does not support arrays adequately, such data today are maintained mostly in silo solutions, with architectures that tend to erode and not keep up with the increasing requirements on performance and service quality. Array Database systems attempt to close this gap by providing declarative query support for flexible ad-hoc analytics on large n-D arrays, similar to what SQL offers on set-oriented data, XQuery on hierarchical data, and SPARQL and CIPHER on graph data. Today, Petascale Array Database installations exist, employing massive parallelism and distributed processing. Hence, questions arise about technology and standards available, usability, and overall maturity. Several papers have compared models and formalisms, and benchmarks have been undertaken as well, typically comparing two systems against each other. While each of these represent valuable research to the best of our knowledge there is no comprehensive survey combining model, query language, architecture, and practical usability, and performance aspects. The size of this comparison differentiates our study as well with 19 systems compared, four benchmarked to an extent and depth clearly exceeding previous papers in the field; for example, subsetting tests were designed in a way that systems cannot be tuned to specifically these queries. It is hoped that this gives a representative overview to all who want to immerse into the field as well as a clear guidance to those who need to choose the best suited datacube tool for their application. This article presents results of the Research Data Alliance (RDA) Array Database Assessment Working Group (ADA:WG), a subgroup of the Big Data Interest Group. It has elicited the state of the art in Array Databases, technically supported by IEEE GRSS and CODATA Germany, to answer the question: how can data scientists and engineers benefit from Array Database technology? As it turns out, Array Databases can offer significant advantages in terms of flexibility, functionality, extensibility, as well as performance and scalability—in total, the database approach of offering “datacubes” analysis-ready heralds a new level of service quality. Investigation shows that there is a lively ecosystem of technology with increasing uptake, and proven array analytics standards are in place. Consequently, such approaches have to be considered a serious option for datacube services in science, engineering and beyond. Tools, though, vary greatly in functionality and performance as it turns out.

scholarly journals Observer-based robust integral of the sign of the error control of class I of underactuated mechanical systems: Theory and real-time experiments

2021 ◽  
pp. 014233122110313
Author(s):  
Afef Hfaiedh ◽  
Ahmed Chemori ◽  
Afef Abdelkrim
Keyword(s):  
Real Time ◽  
Error Control ◽  
Degrees Of Freedom ◽  
Sliding Mode ◽  
Mechanical Systems ◽  
Class I ◽  
Control Input ◽  
Underactuated Mechanical Systems ◽  
Control Scheme ◽  
And Performance

In this paper, the control problem of a class I of underactuated mechanical systems (UMSs) is addressed. The considered class includes nonlinear UMSs with two degrees of freedom and one control input. Firstly, we propose the design of a robust integral of the sign of the error (RISE) control law, adequate for this special class. Based on a change of coordinates, the dynamics is transformed into a strict-feedback (SF) form. A Lyapunov-based technique is then employed to prove the asymptotic stability of the resulting closed-loop system. Numerical simulation results show the robustness and performance of the original RISE toward parametric uncertainties and disturbance rejection. A comparative study with a conventional sliding mode control reveals a significant robustness improvement with the proposed original RISE controller. However, in real-time experiments, the amplification of the measurement noise is a major problem. It has an impact on the behaviour of the motor and reduces the performance of the system. To deal with this issue, we propose to estimate the velocity using the robust Levant differentiator instead of the numerical derivative. Real-time experiments were performed on the testbed of the inertia wheel inverted pendulum to demonstrate the relevance of the proposed observer-based RISE control scheme. The obtained real-time experimental results and the obtained evaluation indices show clearly a better performance of the proposed observer-based RISE approach compared to the sliding mode and the original RISE controllers.

scholarly journals Gaze awareness and metacognitive suggestions by a pedagogical conversational agent: an experimental investigation on interventions to support collaborative learning process and performance

2020 ◽  
Vol 15 (4) ◽  
pp. 469-498 ◽  
Author(s):  
Yugo Hayashi
Keyword(s):  
Collaborative Learning ◽  
Real Time ◽  
Learning Process ◽  
Common Ground ◽  
Learning Performance ◽  
Conversational Agent ◽  
Learning Gains ◽  
Computer Supported Collaborative Learning ◽  
Collaborative Process ◽  
And Performance

AbstractResearch on collaborative learning has revealed that peer-collaboration explanation activities facilitate reflection and metacognition and that establishing common ground and successful coordination are keys to realizing effective knowledge-sharing in collaborative learning tasks. Studies on computer-supported collaborative learning have investigated how awareness tools can facilitate coordination within a group and how the use of external facilitation scripts can elicit elaborated knowledge during collaboration. However, the separate and joint effects of these tools on the nature of the collaborative process and performance have rarely been investigated. This study investigates how two facilitation methods—coordination support via learner gaze-awareness feedback and metacognitive suggestion provision via a pedagogical conversational agent (PCA)—are able to enhance the learning process and learning gains. Eighty participants, organized into dyads, were enrolled in a 2 × 2 between-subject study. The first and second factors were the presence of real-time gaze feedback (no vs. visible gaze) and that of a suggestion-providing PCA (no vs. visible agent), respectively. Two evaluation methods were used: namely, dialog analysis of the collaborative process and evaluation of learning gains. The real-time gaze feedback and PCA suggestions facilitated the coordination process, while gaze was relatively more effective in improving the learning gains. Learners in the Gaze-feedback condition achieved superior learning gains upon receiving PCA suggestions. A successful coordination/high learning performance correlation was noted solely for learners receiving visible gaze feedback and PCA suggestions simultaneously (visible gaze/visible agent). This finding has the potential to yield improved collaborative processes and learning gains through integration of these two methods as well as contributing towards design principles for collaborative-learning support systems more generally.

Sign in / Sign up

Export Citation Format

Share Document