scholarly journals A VR-based volumetric medical image segmentation and visualization system with natural human interaction

2021 ◽  
Author(s):  
Yi Gao ◽  
Cheng Chang ◽  
Xiaxia Yu ◽  
Pengjin Pang ◽  
Nian Xiong ◽  
...  
Keyword(s):  
Virtual Reality ◽  
Image Segmentation ◽  
User Interface ◽  
Transfer Function ◽  
Volume Rendering ◽  
Human Interaction ◽  
Natural User Interface ◽  
Data Set ◽  
Probability Map ◽  
3D Volume

AbstractVolume rendering produces informative two-dimensional (2D) images from a 3-dimensional (3D) volume. It highlights the region of interest and facilitates a good comprehension of the entire data set. However, volume rendering faces a few challenges. First, a high-dimensional transfer function is usually required to differentiate the target from its neighboring objects with subtle variance. Unfortunately, designing such a transfer function is a strenuously trial-and-error process. Second, manipulating/visualizing a 3D volume with a traditional 2D input/output device suffers dimensional limitations. To address all the challenges, we design NUI-VR$$^2$$ 2 , a natural user interface-enabled volume rendering system in the virtual reality space. NUI-VR$$^2$$ 2 marries volume rendering and interactive image segmentation. It transforms the original volume into a probability map with image segmentation. A simple linear transfer function will highlight the target well in the probability map. More importantly, we set the entire image segmentation and volume rendering pipeline in an immersive virtual reality environment with a natural user interface. NUI-VR$$^2$$ 2 eliminates the dimensional limitations in manipulating and perceiving 3D volumes and dramatically improves the user experience.

Lookable User Interfaces and 3D

2018 ◽  
pp. 119-137
Author(s):  
Alan Radley
Keyword(s):  
Virtual Reality ◽  
User Interface ◽  
User Interfaces ◽  
Interface Design ◽  
Maximum Degree ◽  
Apparent Distance ◽  
User Interface Design ◽  
Perspective View ◽  
Data Set ◽  
The Individual

A new philosophy of user interface design is described. Named the “Lookable User Interface,” or LUI, the approach is based on the concept of a Personal Reality (PR) system. Here the computer adapts to the user's worldview in a personalized way, and according to the specific requirements, behaviors, and perceptive skills of the individual. Typically, a PR system creates and adjusts (in real-time) 3D perspective view(s) of a data-set, including (potentially) the field of view of a scene and the apparent distance and scale of objects, whilst also creating an aesthetic “eye-friendly” context for computing operations. A Lookable User Interface (LUI) affords the maximum degree of visual accessibility to digital content. The authors examine the results of testing a Lookable User Interface. Spectasia is one example of a Personal Virtual Reality (PVR) that can be used to visualize links between universals and particulars within digital worlds.

Lookable User Interfaces and 3D

2015 ◽  
pp. 38-56
Author(s):  
Alan Radley
Keyword(s):  
Virtual Reality ◽  
User Interface ◽  
User Interfaces ◽  
Interface Design ◽  
Maximum Degree ◽  
Apparent Distance ◽  
User Interface Design ◽  
Perspective View ◽  
Data Set ◽  
The Individual

A new philosophy of user interface design is described. Named the “Lookable User Interface,” or LUI, the approach is based on the concept of a Personal Reality (PR) system. Here the computer adapts to the user's worldview in a personalized way, and according to the specific requirements, behaviors, and perceptive skills of the individual. Typically, a PR system creates and adjusts (in real-time) 3D perspective view(s) of a data-set, including (potentially) the field of view of a scene and the apparent distance and scale of objects, whilst also creating an aesthetic “eye-friendly” context for computing operations. A Lookable User Interface (LUI) affords the maximum degree of visual accessibility to digital content. The authors examine the results of testing a Lookable User Interface. Spectasia is one example of a Personal Virtual Reality (PVR) that can be used to visualize links between universals and particulars within digital worlds.

Exploring Body Gestures as Natural User Interface for Flying in a Virtual Reality Game with Kinect

2017 ◽  
Vol 2017 (3) ◽  
pp. 60-63 ◽  
Author(s):  
Xin Tong ◽  
Serkan Pekcetin ◽  
Diane Gromala ◽  
Frederico Machuca
Keyword(s):  
Virtual Reality ◽  
User Interface ◽  
Natural User Interface

scholarly journals Optimization of Breast Tomosynthesis Visualization through 3D Volume Rendering

2020 ◽  
Vol 6 (7) ◽  
pp. 64
Author(s):  
Ana M. Mota ◽  
Matthew J. Clarkson ◽  
Pedro Almeida ◽  
Nuno Matela
Keyword(s):  
Image Quality ◽  
Volume Rendering ◽  
Digital Breast Tomosynthesis ◽  
Data Set ◽  
Breast Tomosynthesis ◽  
Sampling Distance ◽  
Visualization Toolkit ◽  
Time Required ◽  
3D Volume ◽  
3D Volume Rendering

3D volume rendering may represent a complementary option in the visualization of Digital Breast Tomosynthesis (DBT) examinations by providing an understanding of the underlying data at once. Rendering parameters directly influence the quality of rendered images. The purpose of this work is to study the influence of two of these parameters (voxel dimension in z direction and sampling distance) on DBT rendered data. Both parameters were studied with a real phantom and one clinical DBT data set. The voxel size was changed from 0.085 × 0.085 × 1.0 mm3 to 0.085 × 0.085 × 0.085 mm3 using ten interpolation functions available in the Visualization Toolkit library (VTK) and several sampling distance values were evaluated. The results were investigated at 90º using volume rendering visualization with composite technique. For phantom quantitative analysis, degree of smoothness, contrast-to-noise ratio, and full width at half maximum of a Gaussian curve fitted to the profile of one disk were used. Additionally, the time required for each visualization was also recorded. Hamming interpolation function presented the best compromise in image quality. The sampling distance values that showed a better balance between time and image quality were 0.025 mm and 0.05 mm. With the appropriate rendering parameters, a significant improvement in rendered images was achieved.

Virtual Reality Applications: Guidelines to Design Natural User Interface

2018 ◽  
Author(s):  
Daniele Regazzoni ◽  
Caterina Rizzi ◽  
Andrea Vitali
Keyword(s):  
Virtual Reality ◽  
User Interface ◽  
Augmented Reality ◽  
Open Source ◽  
Prosthesis Design ◽  
Software Framework ◽  
Natural User Interface ◽  
Oculus Rift

The Natural User Interface (NUI), which permits a simple and consistent user’s interaction, represents a meaningful challenge for developing virtual/augmented reality applications. This paper presents a set of guidelines to design optimal NUI as well as a software framework, named FrameworkVR, which encapsulates the rules of presented guidelines. FrameworkVR allows developing NUI for VR/AR reality applications based on Oculus Rift, Leap Motions device and on the VTK open source library. An example of VR application for prosthesis design developed using FrameworkVR, is also described. Tests have been carried to validate the approach and the designed NUI and results reached so far are presented and discussed.

Photographic Volume Visualization with LH Histogram and Color Distance Gradient

2013 ◽  
Vol 333-335 ◽  
pp. 1034-1037
Author(s):  
Yong Xia ◽  
Li Bing Zeng ◽  
Kuan Quan Wang
Keyword(s):  
Transfer Function ◽  
Volume Rendering ◽  
Volume Visualization ◽  
Volume Data ◽  
Data Set ◽  
Color Gradient ◽  
Opengl Shading Language

Volume rendering is an important issue in the field of images visualization, which can display the details of the volume data intuitively. In this paper, we provide an new transfer function for volume visualization of photographic data set. LH histogram and color gradient are used for opacity design. And special organ can be enhanced in 3D view for special mission. We use GLSL (OpenGL Shading Language) for the GPUs accelerate. VHP data set is used for test and the result confirms that our method is effective.

scholarly journals Tensor volume exploration using attribute space representatives

2020 ◽  
Author(s):  
Jochen Jankowai ◽  
Robin Skånberg ◽  
Daniel Jönsson ◽  
Anders Ynnerman ◽  
Ingrid Hotz
Keyword(s):  
Transfer Function ◽  
Volume Rendering ◽  
Tensor Field ◽  
Complex Geometry ◽  
Scalar Fields ◽  
Data Sets ◽  
Tensor Fields ◽  
Directional Information ◽  
3D Volume ◽  
Attribute Space

While volume rendering for scalar fields has been advanced into a powerful visualisation method, similar volumetric representations for tensor fields are still rare. The complexity of the data challenges not only the rendering but also the design of the transfer function. In this paper we propose an interface using glyph widgets to design a transfer function for the rendering of tensor data sets. Thereby the transfer function (TF) controls a volume rendering which represents sought after tensor-features and a texture that conveys directional information. The basis of the design interface is a two-dimensional projection of the attribute space. Characteristicrepresentatives in the form of glyphs support an intuitive navigation through the attribute space. We provide three different options to select the representatives: automatic selection based on attribute space clustering, uniform sampling of the attribute space, or manually selected representatives. In contrast to glyphs placed into the 3D volume, we use glyphs with complex geometry as widgets to control the shape and extent of the representatives. In the final rendering the glyphs with their assigned colors play a similar role as a legend in an atlas like representation. The method provides an overview of the tensor field in the 3D volume at the same time as it allows the user to explore the tensor field in an attribute space. We demonstrate the flexibility of our approach on tensor fields for selected data sets with very different characteristics.

A spontán mellkasfali sérvekről két operált eset kapcsán

2010 ◽  
Vol 63 (2) ◽  
pp. 80-83 ◽  
Author(s):  
Károly Vincze ◽  
Péter Zádori ◽  
Zsolt Magyaródi ◽  
Gyula Horváth
Keyword(s):  
Volume Rendering ◽  
Spiral Ct ◽  
Multislice Spiral Ct ◽  
3D Volume ◽  
3D Volume Rendering

Absztrakt A szerzők a világirodalmi ritkaságnak számító atraumaticus (spontán) mellkasfali tüdősérvet ismertetik. Két operált betegük kapcsán bemutatják a sérv kialakulását elősegítő körülményeket és a kórkép klinikai jellemzőit. Mindkét betegük spontán mellkasfali (intercostalis) sérvét chronicus obstructiv syndroma (COPD) okozta makacs köhögés váltotta ki. Az elvégzett multislice spirál CT (MSCT) vizsgálat, valamint a speciális szoftver segítségével készített másodlagos 3D „volume-rendering” (VRT) rekonstrukciós képek egyértelműen utaltak a ritka kórformára. Az MSCT-vizsgálatok a Kaposi Mór Oktató Kórházban készültek, Siemens Somatom Emotion 6 MSCT-berendezéssel. A pontos diagnózis birtokában végzett mellkasfali korrekciók tartós gyógyuláshoz vezettek. A szerzők röviden ismertetik a mellkasfali sérvekkel kapcsolatos hazai és fontosabb külföldi irodalmi vonatkozásokat. A kórkép rendkívüli ritkasága ellenére a kialakulásában szerepet játszó COPD elterjedtsége miatt érdemel figyelmet. A hasonló esetek diagnosztikájában nagy segítséget jelenthet a bemutatott korszerű képalkotó eljárás alkalmazása.

Sign in / Sign up

Export Citation Format

Share Document