scholarly journals Aperio: managing 3D scene occlusion using a mechanical tool analogy for visualizing multi-partmesh data.

2021 ◽  
Author(s):  
David Tran
Keyword(s):  
Real Time ◽  
User Study ◽  
Interaction Model ◽  
Supporting Evidence ◽  
Path Constraints ◽  
3D Scene ◽  
Mechanical Tool ◽  
Exploded View ◽  
Metal Tools ◽  
Visualization Application

This thesis presents a novel interaction model for browsing complex 3D scenes containing numerous layers of occluding and intertwining structures that often hide regions of interest. The interaction model is realized through the development of a custom visualization application, Aperio. Aperio provides a set of virtual mechanical "metal" tools, such as rods, rings, "cookie" cutters and a knife, that support real-time, interactive exploration. Cutter tools are designed to create easily-understood cutaway views (or context-preserving ribbon slices) and rings and rods provide simple path constraints that support rigid transformations of models via "sliding", providing interactive exploded-view capabilities. All tools are based on a single underlying superquadric formulation and can ―"iteratively" be picked up and replanted to generate various views. A multi-pass, GPU-based capping algorithm provides real-time "solid cuts" rendering of surface meshes. We also present a user study to provide supporting evidence of Aperio‘s interaction simplicity and effectiveness for occlusion management.

scholarly journals Aperio: managing 3D scene occlusion using a mechanical tool analogy for visualizing multi-partmesh data.

2021 ◽  
Author(s):  
David Tran
Keyword(s):  
Real Time ◽  
User Study ◽  
Interaction Model ◽  
Supporting Evidence ◽  
Path Constraints ◽  
3D Scene ◽  
Mechanical Tool ◽  
Exploded View ◽  
Metal Tools ◽  
Visualization Application

This thesis presents a novel interaction model for browsing complex 3D scenes containing numerous layers of occluding and intertwining structures that often hide regions of interest. The interaction model is realized through the development of a custom visualization application, Aperio. Aperio provides a set of virtual mechanical "metal" tools, such as rods, rings, "cookie" cutters and a knife, that support real-time, interactive exploration. Cutter tools are designed to create easily-understood cutaway views (or context-preserving ribbon slices) and rings and rods provide simple path constraints that support rigid transformations of models via "sliding", providing interactive exploded-view capabilities. All tools are based on a single underlying superquadric formulation and can ―"iteratively" be picked up and replanted to generate various views. A multi-pass, GPU-based capping algorithm provides real-time "solid cuts" rendering of surface meshes. We also present a user study to provide supporting evidence of Aperio‘s interaction simplicity and effectiveness for occlusion management.

scholarly journals Enhancing spatial perception through sound: mapping human movements into MIDI

2021 ◽  
Author(s):  
Bernardo Breve ◽  
Stefano Cirillo ◽  
Mariano Cuofano ◽  
Domenico Desiato
Keyword(s):  
Real Time ◽  
User Study ◽  
Spatial Perception ◽  
Human Movements ◽  
Different Types ◽  
Real Time Tracking ◽  
People’S Perceptions ◽  
Novel Algorithm

AbstractGestural expressiveness plays a fundamental role in the interaction with people, environments, animals, things, and so on. Thus, several emerging application domains would exploit the interpretation of movements to support their critical designing processes. To this end, new forms to express the people’s perceptions could help their interpretation, like in the case of music. In this paper, we investigate the user’s perception associated with the interpretation of sounds by highlighting how sounds can be exploited for helping users in adapting to a specific environment. We present a novel algorithm for mapping human movements into MIDI music. The algorithm has been implemented in a system that integrates a module for real-time tracking of movements through a sample based synthesizer using different types of filters to modulate frequencies. The system has been evaluated through a user study, in which several users have participated in a room experience, yielding significant results about their perceptions with respect to the environment they were immersed.

Passthrough+

2020 ◽  
Vol 3 (1) ◽  
pp. 1-17
Author(s):  
Gaurav Chaurasia ◽  
Arthur Nieuwoudt ◽  
Alexandru-Eugen Ichim ◽  
Richard Szeliski ◽  
Alexander Sorkine-Hornung
Keyword(s):  
Real Time ◽  
Video Encoding ◽  
View Synthesis ◽  
Performance Constraints ◽  
Trade Offs ◽  
Stereoscopic View ◽  
Target User ◽  
Spatio Temporal ◽  
And Performance ◽  
3D Scene

We present an end-to-end system for real-time environment capture, 3D reconstruction, and stereoscopic view synthesis on a mobile VR headset. Our solution allows the user to use the cameras on their VR headset as their eyes to see and interact with the real world while still wearing their headset, a feature often referred to as Passthrough. The central challenge when building such a system is the choice and implementation of algorithms under the strict compute, power, and performance constraints imposed by the target user experience and mobile platform. A key contribution of this paper is a complete description of a corresponding system that performs temporally stable passthrough rendering at 72 Hz with only 200 mW power consumption on a mobile Snapdragon 835 platform. Our algorithmic contributions for enabling this performance include the computation of a coarse 3D scene proxy on the embedded video encoding hardware, followed by a depth densification and filtering step, and finally stereoscopic texturing and spatio-temporal up-sampling. We provide a detailed discussion and evaluation of the challenges we encountered, as well as algorithm and performance trade-offs in terms of compute and resulting passthrough quality.;AB@The described system is available to users as the Passthrough+ feature on Oculus Quest. We believe that by publishing the underlying system and methods, we provide valuable insights to the community on how to design and implement real-time environment sensing and rendering on heavily resource constrained hardware.

scholarly journals Tactowel: A Subtle Sports Performance Display for Giving Real-Time Performance Feedback in Tennis

Sensors ◽  
2021 ◽  
Vol 21 (13) ◽  
pp. 4594
Author(s):  
Hayati Havlucu ◽  
Aykut Coşkun ◽  
Oğuzhan Özcan
Keyword(s):  
Real Time ◽  
Performance Feedback ◽  
User Study ◽  
Tangible Interaction ◽  
Sports Performance ◽  
Design Strategies ◽  
Tennis Players ◽  
Professional Tennis ◽  
Present Design ◽  
Remote User

Sports technology enhances athletes’ performance by providing feedback. However, interaction techniques of current devices may overwhelm athletes with excessive information or distract them from their performance. Despite previous research, design knowledge on how to interact with these devices to prevent such occasions are scarce. To address this gap, we introduce subtle displays as real-time sports performance feedback output devices that unobtrusively present low-resolution information. In this paper, we conceptualize and apply subtle displays to tennis by designing Tactowel, a texture changing sports towel. We evaluate Tactowel through a remote user study with 8 professional tennis players, in which they experience, compare and discuss Tactowel. Our results suggest subtle displays could prevent overwhelming and distracting athletes through three distinct design strategies: (1) Restricting the use excluding duration of performance, (2) using the available routines and interactions, and (3) giving an overall abstraction through tangible interaction. We discuss these results to present design implications and future considerations for designing subtle displays.

scholarly journals Aggressive, Tense or Shy? Identifying Personality Traits from Crowd Videos

2017 ◽  
Author(s):  
Aniket Bera ◽  
Tanmay Randhavane ◽  
Dinesh Manocha
Keyword(s):  
Personality Traits ◽  
Real Time ◽  
Personality Trait ◽  
User Study ◽  
Movement Patterns ◽  
Time Algorithm ◽  
High Density ◽  
Motion Model ◽  
Classification Criterion ◽  
Trait Theory

We present a real-time algorithm to automatically classify the behavior or personality of a pedestrian based on his or her movements in a crowd video. Our classification criterion is based on Personality Trait theory. We present a statistical scheme that dynamically learns the behavior of every pedestrian and computes its motion model. This model is combined with global crowd characteristics to compute the movement patterns and motion dynamics and use them for crowd prediction. Our learning scheme is general and we highlight its performance in identifying the personality of different pedestrians in low and high density crowd videos. We also evaluate the accuracy by comparing the results with a user study.

scholarly journals 3D Road Scene Monitoring Based on Real-Time Panorama

2014 ◽  
Vol 2014 ◽  
pp. 1-8 ◽  
Author(s):  
Yuezhou Wu ◽  
Changjiang Liu ◽  
Shiyong Lan ◽  
Menglong Yang
Keyword(s):  
Real Time ◽  
Traffic Flow ◽  
High Precision ◽  
Motion Detection ◽  
Large Scale ◽  
Traffic Accidents ◽  
Traffic Situation ◽  
Traffic Capacity ◽  
Monitoring Framework ◽  
3D Scene

Road monitoring helps to control the regional traffic situation so as to adjust the traffic flow. Real-time panorama is conducive to timely treat traffic accidents and to greatly improve traffic capacity. This paper designs a 3D road scene monitoring framework based on real-time panorama. The system is the combination of large scale panorama, satellite map textures, and 3D scene model, in which users can ramble freely. This paper has the following contributions. Firstly, land-points were extracted followed by motion detection, then comotion algorithm was applied to land-points from adjacent cameras, and homography matrix was constructed. Secondly, reference camera was chosen and transformed to overhead viewpoint; subsequently multiviews were morphed to the same viewpoint and stitched to panorama. Finally, the registration based on high-precision GPS information between 2D road panorama and 3D scene model was also proposed. The proposed framework has been successfully applied to a large road intersection monitoring. Experimental results are furnished at the end of the paper.

An Assistant Interface to Design and Produce a Pop-Up Card

2010 ◽  
Vol 1 (2) ◽  
pp. 40-50
Author(s):  
Sosuke Okamura ◽  
Takeo Igarashi
Keyword(s):  
Real Time ◽  
Design Process ◽  
Collision Detection ◽  
User Study ◽  
Three Dimensional ◽  
Dimensional Structure ◽  
Design Activity ◽  
Three Dimensional Structure ◽  
Design And Production

This article describes an assistant interface to design and produce pop-up cards. A pop-up card is a piece of folded paper from which a three-dimensional structure pops up when opened. The authors propose an interface to assist the user in the design and production of a pop-up card. During the design process, the system examines whether the parts protrude from the card or whether the parts collide with one another when the card is closed. The user can concentrate on the design activity because the error occurrence and the error resolution are continuously fed to the user in real time. The authors demonstrate the features of their system by creating two pop-up card examples and perform an informal preliminary user study, showing that automatic protrusion and collision detection are effective in the design process.

Large-Scale, Real-Time 3D Scene Reconstruction Using Visual and IMU Sensors

2020 ◽  
Vol 20 (10) ◽  
pp. 5597-5605 ◽  
Author(s):  
Changdi Li ◽  
Lei Yu ◽  
Shumin Fei
Keyword(s):  
Real Time ◽  
Large Scale ◽  
Scene Reconstruction ◽  
3D Scene ◽  
3D Scene Reconstruction

scholarly journals Coordinating Real-Time Serial Cooperative Work by Cuing the Order in the Case of Theatrical Performance Practice

2019 ◽  
Vol 2019 ◽  
pp. 1-10 ◽  
Author(s):  
Kosuke Sasaki ◽  
Tomoo Inoue
Keyword(s):  
Real Time ◽  
Performance Practice ◽  
User Study ◽  
Cooperative Work ◽  
Theatrical Performance

Our goal is to facilitate real-time serial cooperative work. In real-time serial cooperative work, the order of subtasks is important because a failure of the order leads to a failure of the whole task. So, coordinating the order of workers’ subtasks is necessary to smoothly accomplish the tasks. In this paper, we propose a method that uses vibration to present the action order and coordinate the orders. We conducted a user study to verify the effectiveness of the method in theatrical performance practice, which was an example of real-time serial cooperative work. As a result, order coordination reduced mistakes in the order of speech and action and in the contents of lines and action. This result suggests that order coordination can improve real-time serial cooperative work.

Sign in / Sign up

Export Citation Format

Share Document